nixbot

builds

succeeded vm-test-run-nixbot-gitlab checks.x86_64-linux.nixbot-gitlab · build #241 · raw

1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.GVQJ85sfRv', fmt=raw size=107374182412(finished: start all VMs, in 48.49 seconds)13gitlab # mke2fs 1.47.4 (6-Mar-2025)14gitlab: waiting for unit setup-gitlab.service15gitlab # Discarding device blocks: 0/262144 done16gitlab: waiting for the VM to finish booting17gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes18gitlab # Filesystem UUID: fb2b7da0-47ba-4f63-b0a6-c6c349cac43219gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/b6f9hjw3pz2bqqbpzn7lpsp1q8559v25-nixos-system-gitlab-test/init regInfo=/nix/store/mazp7pg6ac8l94qrmssvsps1msaskdp1-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000000] kvm-clock: using sched offset of 540975713 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000004] tsc: Detected 2400.008 MHz processor67gitlab # [ 0.000851] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000878] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000880] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000923] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002878] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002890] Using GB pages for direct mapping73gitlab # [ 0.002998] RAMDISK: [mem 0xbe31c000-0xbffcffff]74gitlab # [ 0.003007] ACPI: Early table checksum verification disabled75gitlab # [ 0.003014] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.003018] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.003022] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.003028] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.003030] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.003032] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.003034] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.003035] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.003036] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.003038] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.003038] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.003039] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.003039] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.003040] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003279] No NUMA configuration found90gitlab # [ 0.003280] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003283] NODE_DATA(0) allocated [mem 0x1bfffa780-0x1bffffcff]92gitlab # [ 0.005834] Zone ranges:93gitlab # [ 0.005835] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.005836] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.005838] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.005839] Device empty97gitlab # [ 0.005839] Movable zone start for each node98gitlab # [ 0.005840] Early memory node ranges99gitlab # [ 0.005840] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.005841] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.005842] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.005843] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.005867] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.006164] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.126376] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.126812] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.126827] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.126867] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.126870] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.126871] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.126873] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.126874] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.126875] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.126877] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.126879] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.126883] TSC deadline timer available117gitlab # [ 0.126888] CPU topo: Max. logical packages: 1118gitlab # [ 0.126889] CPU topo: Max. logical dies: 1119gitlab # [ 0.126889] CPU topo: Max. dies per package: 1120gitlab # [ 0.126892] CPU topo: Max. threads per core: 1121gitlab # [ 0.126893] CPU topo: Num. cores per package: 4122gitlab # [ 0.126894] CPU topo: Num. threads per package: 4123gitlab # [ 0.126894] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.126921] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.126942] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.126944] kvm-guest: setup PV sched yield127gitlab # [ 0.126963] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.126964] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.126965] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.126967] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.126969] Booting paravirtualized kernel on KVM132gitlab # [ 0.126973] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.131694] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.134586] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.134644] kvm-guest: PV spinlocks enabled136gitlab # [ 0.134646] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.134649] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/b6f9hjw3pz2bqqbpzn7lpsp1q8559v25-nixos-system-gitlab-test/init regInfo=/nix/store/mazp7pg6ac8l94qrmssvsps1msaskdp1-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.134754] Unknown kernel command line parameters "regInfo=/nix/store/mazp7pg6ac8l94qrmssvsps1msaskdp1-closure-info/registration", will be passed to user space.139gitlab # [ 0.134771] random: crng init done140gitlab # [ 0.134772] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.144681] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.149418] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.149502] software IO TLB: area num 4.144gitlab # [ 0.233602] Fallback order for Node 0: 0145gitlab # [ 0.233611] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.233613] Policy zone: Normal147gitlab # [ 0.236859] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.247890] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.263002] allocated 12582912 bytes of page_ext150gitlab # [ 0.273776] ftrace: allocating 48717 entries in 192 pages151gitlab # [ 0.273778] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.274703] Dynamic Preempt: lazy153gitlab # [ 0.274870] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.274870] rcu: RCU event tracing is enabled.155gitlab # [ 0.274871] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.274873] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.274874] Rude variant of Tasks RCU enabled.158gitlab # [ 0.274874] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.274874] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.274875] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.274891] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.274893] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.274894] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.279989] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.280287] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.280296] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns167gitlab # [ 0.280426] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.284153] Console: colour VGA+ 80x25169gitlab # [ 0.284156] printk: legacy console [tty0] enabled170gitlab # [ 0.316207] printk: legacy console [ttyS0] enabled171gitlab # [ 0.416145] ACPI: Core revision 20250807172gitlab # [ 0.417089] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.418638] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.419657] x2apic enabled175gitlab # [ 0.420425] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.421363] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.422573] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.424066] kvm-guest: setup PV IPIs179gitlab # [ 0.425677] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.426755] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns181gitlab # [ 0.428580] Calibrating delay loop (skipped) preset value.. 4800.01 BogoMIPS (lpj=2400008)182gitlab # [ 0.430670] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.431718] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.433577] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.434582] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.435577] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.436578] Transient Scheduler Attacks: Vulnerable: No microcode188gitlab # [ 0.438378] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.439323] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.440385] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.441585] Spectre V2 : Enabling IBPB for BPF192gitlab # [ 0.442578] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier193gitlab # [ 0.443577] active return thunk: srso_alias_return_thunk194gitlab # [ 0.444598] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'195gitlab # [ 0.445577] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'196gitlab # [ 0.447577] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'197gitlab # [ 0.448577] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'198gitlab # [ 0.449577] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'199gitlab # [ 0.450577] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'200gitlab # [ 0.451577] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'201gitlab # [ 0.452577] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256202gitlab # [ 0.454371] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64203gitlab # [ 0.455377] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512204gitlab # [ 0.456369] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024205gitlab # [ 0.457359] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8206gitlab # [ 0.458379] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.207gitlab # [ 0.489910] Freeing SMP alternatives memory: 44K208gitlab # [ 0.490581] pid_max: default: 32768 minimum: 301209gitlab # [ 0.491685] LSM: initializing lsm=capability,landlock,yama,bpf,ima210gitlab # [ 0.492696] landlock: Up and running.211gitlab # [ 0.493578] Yama: becoming mindful.212gitlab # [ 0.494445] LSM support for eBPF active213gitlab # [ 0.495326] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)214gitlab # [ 0.496752] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)215gitlab # [ 0.499700] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)216gitlab # [ 0.501253] Performance Events: Fam17h+ core perfctr, AMD PMU driver.217gitlab # [ 0.501590] ... version: 2218gitlab # [ 0.502350] ... bit width: 48219gitlab # [ 0.502580] ... generic counters: 6220gitlab # [ 0.503339] ... generic bitmap: 000000000000003f221gitlab # [ 0.503579] ... fixed-purpose counters: 0222gitlab # [ 0.504389] ... fixed-purpose bitmap: 0000000000000000223gitlab # [ 0.505319] ... value mask: 0000ffffffffffff224gitlab # [ 0.505579] ... max period: 00007fffffffffff225gitlab # [ 0.506526] ... global_ctrl mask: 000000000000003f226gitlab # [ 0.507465] signal: max sigframe size: 3376227gitlab # [ 0.508246] rcu: Hierarchical SRCU implementation.228gitlab # [ 0.508584] rcu: Max phase no-delay instances is 400.229gitlab # [ 0.509731] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level230gitlab # [ 0.515381] smp: Bringing up secondary CPUs ...231gitlab # [ 0.516641] smpboot: x86: Booting SMP configuration:232gitlab # [ 0.517533] .... node #0, CPUs: #1 #2 #3233gitlab # [ 0.520738] smp: Brought up 1 node, 4 CPUs234gitlab # [ 0.522582] smpboot: Total of 4 processors activated (19200.06 BogoMIPS)235gitlab # [ 0.524153] Memory: 6011384K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260100K reserved, 0K cma-reserved)236gitlab # [ 0.526580] devtmpfs: initialized237gitlab # [ 0.527750] x86/mm: Memory block size: 128MB238gitlab # [ 0.530768] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)239gitlab # [ 0.532639] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).240gitlab # [ 0.533700] pinctrl core: initialized pinctrl subsystem241gitlab # [ 0.534871] PM: RTC time: 05:46:00, date: 2026-08-20242gitlab # [ 0.538878] NET: Registered PF_NETLINK/PF_ROUTE protocol family243gitlab # [ 0.541112] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations244gitlab # [ 0.541651] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations245gitlab # [ 0.543818] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations246gitlab # [ 0.544594] audit: initializing netlink subsys (disabled)247gitlab # [ 0.545793] audit: type=2000 audit(1787204760.068:1): state=initialized audit_enabled=0 res=1248gitlab # [ 0.545883] thermal_sys: Registered thermal governor 'fair_share'249gitlab # [ 0.547580] thermal_sys: Registered thermal governor 'bang_bang'250gitlab # [ 0.548580] thermal_sys: Registered thermal governor 'step_wise'251gitlab # [ 0.549580] thermal_sys: Registered thermal governor 'user_space'252gitlab # [ 0.550579] thermal_sys: Registered thermal governor 'power_allocator'253gitlab # [ 0.551616] cpuidle: using governor menu254gitlab # [ 0.554258] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5255gitlab # [ 0.555717] PCI: Using configuration type 1 for base access256gitlab # [ 0.556580] PCI: Using configuration type 1 for extended access257gitlab # [ 0.557762] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.258gitlab # [ 0.560582] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages259gitlab # [ 0.561580] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page260gitlab # [ 0.562580] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages261gitlab # [ 0.563580] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page262gitlab # [ 0.568702] ACPI: Added _OSI(Module Device)263gitlab # [ 0.570590] ACPI: Added _OSI(Processor Device)264gitlab # [ 0.572586] ACPI: Added _OSI(Processor Aggregator Device)265gitlab # [ 0.579526] ACPI: 1 ACPI AML tables successfully acquired and loaded266gitlab # [ 0.588699] ACPI: Interpreter enabled267gitlab # [ 0.589410] ACPI: PM: (supports S0 S3 S4 S5)268gitlab # [ 0.590588] ACPI: Using IOAPIC for interrupt routing269gitlab # [ 0.592682] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug270gitlab # [ 0.596590] PCI: Using E820 reservations for host bridge windows271gitlab # [ 0.599178] ACPI: Enabled 2 GPEs in block 00 to 0F272gitlab # [ 0.613186] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])273gitlab # [ 0.614595] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]274gitlab # [ 0.618286] acpiphp: Slot [3] registered275gitlab # [ 0.619597] acpiphp: Slot [4] registered276gitlab # [ 0.620670] acpiphp: Slot [5] registered277gitlab # [ 0.622663] acpiphp: Slot [6] registered278gitlab # [ 0.623683] acpiphp: Slot [7] registered279gitlab # [ 0.624666] acpiphp: Slot [8] registered280gitlab # [ 0.626654] acpiphp: Slot [9] registered281gitlab # [ 0.627655] acpiphp: Slot [10] registered282gitlab # [ 0.628720] acpiphp: Slot [11] registered283gitlab # [ 0.630678] acpiphp: Slot [12] registered284gitlab # [ 0.631653] acpiphp: Slot [13] registered285gitlab # [ 0.633624] acpiphp: Slot [14] registered286gitlab # [ 0.634641] acpiphp: Slot [15] registered287gitlab # [ 0.635625] acpiphp: Slot [16] registered288gitlab # [ 0.636419] acpiphp: Slot [17] registered289gitlab # [ 0.637128] acpiphp: Slot [18] registered290gitlab # [ 0.638600] acpiphp: Slot [19] registered291gitlab # [ 0.639347] acpiphp: Slot [20] registered292gitlab # [ 0.639600] acpiphp: Slot [21] registered293gitlab # [ 0.640337] acpiphp: Slot [22] registered294gitlab # [ 0.640601] acpiphp: Slot [23] registered295gitlab # [ 0.641351] acpiphp: Slot [24] registered296gitlab # [ 0.642600] acpiphp: Slot [25] registered297gitlab # [ 0.643349] acpiphp: Slot [26] registered298gitlab # [ 0.643601] acpiphp: Slot [27] registered299gitlab # [ 0.644348] acpiphp: Slot [28] registered300gitlab # [ 0.645602] acpiphp: Slot [29] registered301gitlab # [ 0.646339] acpiphp: Slot [30] registered302gitlab # [ 0.646601] acpiphp: Slot [31] registered303gitlab # [ 0.647298] PCI host bridge to bus 0000:00304gitlab # [ 0.648588] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]305gitlab # [ 0.649580] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]306gitlab # [ 0.650580] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]307gitlab # [ 0.651590] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]308gitlab # [ 0.653581] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]309gitlab # [ 0.654581] pci_bus 0000:00: root bus resource [bus 00-ff]310gitlab # [ 0.656822] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint311gitlab # [ 0.661121] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint312gitlab # [ 0.665691] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint313gitlab # [ 0.672672] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]314gitlab # [ 0.675654] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk315gitlab # [ 0.677586] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk316gitlab # [ 0.679585] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk317gitlab # [ 0.682585] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk318gitlab # [ 0.685039] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint319gitlab # [ 0.691753] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]320gitlab # [ 0.696253] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint321gitlab # [ 0.700267] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI322gitlab # [ 0.703601] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB323gitlab # [ 0.706063] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint324gitlab # [ 0.725648] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]325gitlab # [ 0.726594] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]326gitlab # [ 0.727601] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]327gitlab # [ 0.729767] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]328gitlab # [ 0.731750] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint329gitlab # [ 0.737615] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]330gitlab # [ 0.738502] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]331gitlab # [ 0.739342] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]332gitlab # [ 0.751557] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]333gitlab # [ 0.754116] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint334gitlab # [ 0.758612] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]335gitlab # [ 0.759484] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]336gitlab # [ 0.760372] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]337gitlab # [ 0.762768] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint338gitlab # [ 0.768309] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]339gitlab # [ 0.769586] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]340gitlab # [ 0.770601] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]341gitlab # [ 0.772811] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint342gitlab # [ 0.775611] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]343gitlab # [ 0.776447] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]344gitlab # [ 0.777349] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]345gitlab # [ 0.780826] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint346gitlab # [ 0.784615] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]347gitlab # [ 0.785501] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]348gitlab # [ 0.786384] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]349gitlab # [ 0.788778] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint350gitlab # [ 0.793630] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]351gitlab # [ 0.794593] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]352gitlab # [ 0.795591] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]353gitlab # [ 0.798299] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint354gitlab # [ 0.803627] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]355gitlab # [ 0.804545] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]356gitlab # [ 0.806362] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]357gitlab # [ 0.807541] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]358gitlab # [ 0.809642] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint359gitlab # [ 0.813618] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]360gitlab # [ 0.815650] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]361gitlab # [ 0.820147] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint362gitlab # [ 0.827627] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]363gitlab # [ 0.829586] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]364gitlab # [ 0.830570] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]365gitlab # [ 0.833513] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint366gitlab # [ 0.836612] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]367gitlab # [ 0.837507] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]368gitlab # [ 0.838366] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]369gitlab # [ 0.844975] ACPI: PCI: Interrupt link LNKA configured for IRQ 10370gitlab # [ 0.845758] ACPI: PCI: Interrupt link LNKB configured for IRQ 10371gitlab # [ 0.846713] ACPI: PCI: Interrupt link LNKC configured for IRQ 11372gitlab # [ 0.847709] ACPI: PCI: Interrupt link LNKD configured for IRQ 11373gitlab # [ 0.848655] ACPI: PCI: Interrupt link LNKS configured for IRQ 9374gitlab # [ 0.851997] iommu: Default domain type: Translated375gitlab # [ 0.852583] iommu: DMA domain TLB invalidation policy: lazy mode376gitlab # [ 0.854941] ACPI: bus type USB registered377gitlab # [ 0.855662] usbcore: registered new interface driver usbfs378gitlab # [ 0.856631] usbcore: registered new interface driver hub379gitlab # [ 0.857582] usbcore: registered new device driver usb380gitlab # [ 0.859842] NetLabel: Initializing381gitlab # [ 0.860499] NetLabel: domain hash size = 128382gitlab # [ 0.861155] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383gitlab # [ 0.862661] NetLabel: unlabeled traffic allowed by default384gitlab # [ 0.863591] PCI: Using ACPI for IRQ routing385gitlab # [ 0.864853] pci 0000:00:02.0: vgaarb: setting as boot VGA device386gitlab # [ 0.865576] pci 0000:00:02.0: vgaarb: bridge control possible387gitlab # [ 0.865576] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388gitlab # [ 0.867583] vgaarb: loaded389gitlab # [ 0.868406] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390gitlab # [ 0.869235] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391gitlab # [ 0.874694] clocksource: Switched to clocksource kvm-clock392gitlab # [ 0.876488] VFS: Disk quotas dquot_6.6.0393gitlab # [ 0.877233] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394gitlab # [ 0.878776] pnp: PnP ACPI init395gitlab # [ 0.879926] pnp: PnP ACPI: found 6 devices396gitlab # [ 0.889532] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns397gitlab # [ 0.892388] clocksource: Switched to clocksource acpi_pm398gitlab # [ 0.894733] NET: Registered PF_INET protocol family399gitlab # [ 0.898894] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)400gitlab # [ 0.931235] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)401gitlab # [ 0.932755] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)402gitlab # [ 0.934178] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)403gitlab # [ 0.938053] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)404gitlab # [ 0.939439] TCP: Hash tables configured (established 65536 bind 65536)405gitlab # [ 0.940667] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)406gitlab # [ 0.942324] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 0.943757] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)408gitlab # [ 0.945144] NET: Registered PF_UNIX/PF_LOCAL protocol family409gitlab # [ 0.946171] NET: Registered PF_XDP protocol family410gitlab # [ 0.947055] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]411gitlab # [ 0.948096] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]412gitlab # [ 0.949147] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]413gitlab # [ 0.950271] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]414gitlab # [ 0.951426] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]415gitlab # [ 0.952791] pci 0000:00:01.0: PIIX3: Enabling Passive Release416gitlab # [ 0.953771] pci 0000:00:00.0: Limiting direct PCI/PCI transfers417gitlab # [ 0.956171] ACPI: \_SB_.LNKD: Enabled at IRQ 11418gitlab # [ 0.958799] PCI: CLS 0 bytes, default 64419gitlab # [ 0.959583] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)420gitlab # [ 0.960053] Trying to unpack rootfs image as initramfs...421gitlab # [ 0.960667] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)422gitlab # [ 0.960798] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns423gitlab # [ 0.984678] Initialise system trusted keyrings424gitlab # [ 0.985873] workingset: timestamp_bits=40 max_order=21 bucket_order=0425gitlab # [ 0.997367] Key type asymmetric registered426gitlab # [ 0.998096] Asymmetric key parser 'x509' registered427gitlab # [ 0.999015] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)428gitlab # [ 1.000618] io scheduler mq-deadline registered429gitlab # [ 1.001445] io scheduler kyber registered430gitlab # [ 1.005164] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled431gitlab # [ 1.006539] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A432gitlab # [ 1.010994] Linux agpgart interface v0.103433gitlab # [ 1.013044] ACPI: bus type drm_connector registered434gitlab # [ 1.018631] usbcore: registered new interface driver usbserial_generic435gitlab # [ 1.021235] usbserial: USB Serial support registered for generic436gitlab # [ 1.023689] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.437gitlab # [ 1.023689] Please enable it if your BIOS has the CPPC option.438gitlab # [ 1.029005] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled439gitlab # [ 1.032472] drop_monitor: Initializing network drop monitor service440gitlab # [ 1.035329] NET: Registered PF_INET6 protocol family441gitlab # [ 1.039265] Segment Routing with IPv6442gitlab # [ 1.041056] In-situ OAM (IOAM) with IPv6443gitlab # [ 1.045427] IPI shorthand broadcast: enabled444gitlab # [ 1.058748] sched_clock: Marking stable (918038477, 140280585)->(1078095436, -19776374)445gitlab # [ 1.063553] registered taskstats version 1446gitlab # [ 1.065925] Loading compiled-in X.509 certificates447gitlab # [ 1.088482] Demotion targets for Node 0: null448gitlab # [ 1.090597] Key type .fscrypt registered449gitlab # [ 1.091955] Key type fscrypt-provisioning registered450gitlab # [ 1.093853] ima: No TPM chip found, activating TPM-bypass!451gitlab # [ 1.095595] ima: Allocated hash algorithm: sha1452gitlab # [ 1.097130] ima: No architecture policies found453gitlab # [ 1.099167] PM: Magic number: 6:280:770454gitlab # [ 1.100559] misc userfaultfd: hash matches455gitlab # [ 1.104355] RAS: Correctable Errors collector initialized.456gitlab # [ 1.113194] clk: Disabling unused clocks457gitlab # [ 1.114546] PM: genpd: Disabling unused power domains458gitlab # [ 1.290890] Freeing initrd memory: 29392K459gitlab # [ 1.298179] Freeing unused decrypted memory: 2028K460gitlab # [ 1.303393] Freeing unused kernel image (initmem) memory: 3640K461gitlab # [ 1.305482] Write protecting the kernel read-only data: 32768k462gitlab # [ 1.309461] Freeing unused kernel image (text/rodata gap) memory: 1220K463gitlab # [ 1.312435] Freeing unused kernel image (rodata/data gap) memory: 760K464gitlab # [ 1.375952] x86/mm: Checked W+X mappings: passed, no W+X pages found.465gitlab # [ 1.377048] Run /init as init process466gitlab # [ 1.389265] systemd[1]: Inserted module 'autofs4'467gitlab # [ 1.411712] fuse: init (API version 7.45)468gitlab # [ 1.420003] ACPI: \_SB_.LNKC: Enabled at IRQ 10469gitlab # [ 1.426543] ACPI: \_SB_.LNKA: Enabled at IRQ 10470gitlab # [ 1.429979] ACPI: \_SB_.LNKB: Enabled at IRQ 11471gitlab # [ 1.468042] systemd[1]: Successfully made /usr/ read-only.472gitlab # [ 1.804067] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)473gitlab # [ 1.843946] systemd[1]: Detected virtualization kvm.474gitlab # [ 1.846050] systemd[1]: Detected architecture x86-64.475gitlab # [ 1.848158] systemd[1]: Running in initrd.476gitlab # [ 1.850648] systemd[1]: Initializing machine ID from random generator.477gitlab # [ 1.853530] systemd[1]: Hostname set to <gitlab>.478gitlab # [ 1.963600] systemd[1]: bpf-restrict-fs: LSM BPF program attached479gitlab # [ 2.008727] systemd[1]: Queued start job for default target Initrd Default Target.480gitlab # [ 2.018967] systemd[1]: Created slice Slice /system/modprobe.481gitlab # [ 2.020163] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.482gitlab # [ 2.021626] systemd[1]: Expecting device /dev/disk/by-label/nix-store...483gitlab # [ 2.022801] systemd[1]: Expecting device /dev/disk/by-label/nixos...484gitlab # [ 2.023907] systemd[1]: Reached target Path Units.485gitlab # [ 2.024765] systemd[1]: Reached target Slice Units.486gitlab # [ 2.025617] systemd[1]: Reached target Swaps.487gitlab # [ 2.026468] systemd[1]: Reached target Timer Units.488gitlab # [ 2.027464] systemd[1]: Listening on D-Bus System Message Bus Socket.489gitlab # [ 2.028703] systemd[1]: Listening on Journal Socket (/dev/log).490gitlab # [ 2.029814] systemd[1]: Listening on Journal Sockets.491gitlab # [ 2.030814] systemd[1]: Listening on udev Control Socket.492gitlab # [ 2.031844] systemd[1]: Listening on udev Kernel Socket.493gitlab # [ 2.032800] systemd[1]: Reached target Socket Units.494gitlab # [ 2.034719] systemd[1]: Starting Create List of Static Device Nodes...495gitlab # [ 2.036855] systemd[1]: Starting Load Kernel Module 9pnet_virtio...496gitlab # [ 2.038975] systemd[1]: Starting Load Kernel Module configfs...497gitlab # [ 2.041790] systemd[1]: Starting Journal Service...498gitlab # [ 2.045370] systemd[1]: Starting Load Kernel Modules...499gitlab # [ 2.048255] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os500gitlab # [ 2.059150] systemd[1]: Starting Coldplug All udev Devices...501gitlab # [ 2.063460] systemd[1]: Finished Create List of Static Device Nodes.502gitlab # [ 2.066626] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...503gitlab # [ 2.089361] systemd-journald[91]: Collecting audit messages is disabled.504gitlab # [ 2.095821] systemd[1]: modprobe@configfs.service: Deactivated successfully.505gitlab # [ 2.097685] systemd[1]: Finished Load Kernel Module configfs.506gitlab # [ 2.099213] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config507gitlab # [ 2.104745] netfs: FS-Cache loaded508gitlab # [ 2.107394] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.509gitlab # [ 2.111444] systemd[1]: Starting Create Static Device Nodes in /dev...510gitlab # [ 2.115623] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.511gitlab # [ 2.118043] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev512gitlab # [ 2.124750] systemd[1]: Finished Load Kernel Modules.513gitlab # [ 2.127112] systemd[1]: Starting Apply Kernel Variables...514gitlab # [ 2.128898] systemd[1]: Finished Create Static Device Nodes in /dev.515gitlab # [ 2.130035] 9pnet: Installing 9P2000 support516gitlab # [ 2.130332] systemd[1]: Reached target Preparation for Local File Systems.517gitlab # [ 2.132060] systemd[1]: Reached target Local File Systems.518gitlab # [ 2.138417] systemd[1]: Starting Rule-based Manager for Device Events and Files...519gitlab # [ 2.141423] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.520gitlab # [ 2.149731] systemd[1]: Finished Load Kernel Module 9pnet_virtio.521gitlab # [ 2.009547] systemd-modules-load[92]: Using 4 probe threads522gitlab # [ 2.151115] systemd[1]: Started Journal Service.523gitlab # [ 2.011754] systemd-modules-load[92]: Inserted module 'virtio_balloon'524gitlab # [ 2.013254] systemd-modules-load[92]: Inserted module 'dm_mod'525gitlab # [ 2.014252] systemd-modules-load[92]: Inserted module 'virtio_gpu'526gitlab # [ 2.015215] systemd[1]: Finished Apply Kernel Variables.527gitlab # [ 2.016222] systemd[1]: Starting Create System Files and Directories...528gitlab # [ 2.028646] systemd-udevd[105]: Using default interface naming scheme 'v261'.529gitlab # [ 2.032220] systemd[1]: Finished Create System Files and Directories.530gitlab # [ 2.042956] systemd[1]: Started Rule-based Manager for Device Events and Files.531gitlab # [ 2.057113] systemd[1]: Finished Coldplug All udev Devices.532gitlab # [ 2.057960] systemd[1]: Reached target System Initialization.533gitlab # [ 2.058757] systemd[1]: Reached target Basic System.534gitlab # [ 2.289792] uhci_hcd 0000:00:01.2: UHCI Host Controller535gitlab # [ 2.291649] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1536gitlab # [ 2.292868] uhci_hcd 0000:00:01.2: detected 2 ports537gitlab # [ 2.305968] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140538gitlab # [ 2.306972] SCSI subsystem initialized539gitlab # [ 2.307305] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18540gitlab # [ 2.308657] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1541gitlab # [ 2.309642] usb usb1: Product: UHCI Host Controller542gitlab # [ 2.310325] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd543gitlab # [ 2.311035] usb usb1: SerialNumber: 0000:00:01.2544gitlab # [ 2.316229] hub 1-0:1.0: USB hub found545gitlab # [ 2.316812] hub 1-0:1.0: 2 ports detected546gitlab # [ 2.318484] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12547gitlab # [ 2.318762] virtio_blk virtio4: 4/0/0 default/read/poll queues548gitlab # [ 2.321496] serio: i8042 KBD port at 0x60,0x64 irq 1549gitlab # [ 2.322196] serio: i8042 AUX port at 0x60,0x64 irq 12550gitlab # [ 2.340896] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)551gitlab # [ 2.343546] scsi host0: ata_piix552gitlab # [ 2.347624] scsi host1: ata_piix553gitlab # [ 2.352308] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0554gitlab # [ 2.353584] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0555gitlab # [ 2.355400] virtio_blk virtio5: 4/0/0 default/read/poll queues556gitlab # [ 2.380824] virtio_blk virtio5: [vdb] 11789152 512-byte logical blocks (6.04 GB/5.62 GiB)557gitlab # [ 2.242636] systemd[1]: Starting Virtual Console Setup...558gitlab # [ 2.243849] (udev-worker)[121]: Network interface NamePolicy= disabled on kernel command line.559gitlab # [ 2.245912] (udev-worker)[132]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.560gitlab # [ 2.247856] (udev-worker)[132]: Network interface NamePolicy= disabled on kernel command line.561gitlab # [ 2.263300] systemd-vconsole-setup[152]: Configuration of first virtual console was skipped, ignoring remaining ones.562gitlab # [ 2.264869] systemd[1]: Finished Virtual Console Setup.563gitlab # [ 2.516766] ata2: found unknown device (class 0)564gitlab # [ 2.519916] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100565gitlab # [ 2.524506] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5566gitlab # [ 2.549923] usb 1-1: new full-speed USB device number 2 using uhci_hcd567gitlab # [ 2.562562] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0568gitlab # [ 2.446541] systemd[1]: Found device /dev/disk/by-label/nixos.569gitlab # [ 2.451987] systemd[1]: Found device /dev/disk/by-label/nix-store.570gitlab # [ 2.453802] systemd[1]: Reached target Initrd Root Device.571gitlab # [ 2.455454] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...572gitlab # [ 2.597697] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray573gitlab # [ 2.641177] cdrom: Uniform CD-ROM driver Revision: 3.20574gitlab # [ 2.501985] systemd-fsck[160]: nixos: clean, 12/65536 files, 13019/262144 blocks575gitlab # [ 2.509093] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.576gitlab # [ 2.723725] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00577gitlab # [ 2.727154] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10578gitlab # [ 2.729651] usb 1-1: Product: QEMU USB Tablet579gitlab # [ 2.731169] usb 1-1: Manufacturer: QEMU580gitlab # [ 2.732603] usb 1-1: SerialNumber: 28754-0000:00:01.2-1581gitlab # [ 2.761722] hid: raw HID events driver (C) Jiri Kosina582gitlab # [ 2.775032] usbcore: registered new interface driver usbhid583gitlab # [ 2.777055] usbhid: USB HID core driver584gitlab # [ 2.786117] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2585gitlab # [ 2.789353] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0586gitlab # [ 2.925253] systemd[1]: Mounting /sysroot...587gitlab # [ 3.212477] EXT4-fs (vda): mounted filesystem fb2b7da0-47ba-4f63-b0a6-c6c349cac432 r/w with ordered data mode. Quota mode: none.588gitlab # [ 3.078885] systemd[1]: Mounted /sysroot.589gitlab # [ 3.080581] systemd[1]: Reached target Initrd Root File System.590gitlab # [ 3.084428] systemd[1]: Mounting /sysroot/nix/.ro-store...591gitlab # [ 3.086226] systemd[1]: Mounting /sysroot/nix/.rw-store...592gitlab # [ 3.090069] systemd[1]: Mounting /sysroot/run...593gitlab # [ 3.100674] systemd[1]: Mounting /sysroot/tmp/shared...594gitlab # [ 3.103298] systemd[1]: Mounting /sysroot/tmp/xchg...595gitlab # [ 3.106206] systemd[1]: Starting Mountpoints Configured in the Real Root...596gitlab # [ 3.115936] systemd-sysroot-fstab-check[179]: /sysroot should be mounted in the initrd, will request daemon-reload.597gitlab # [ 3.118182] systemd[1]: Mounted /sysroot/nix/.rw-store.598gitlab # [ 3.120357] systemd[1]: Reload requested from client PID 179 ('systemd-sysroot') (unit initrd-parse-etc.service)...599gitlab # [ 3.121752] systemd[1]: Reloading...600gitlab # [ 3.268926] 9p: Installing v9fs 9p2000 file system support601gitlab # [ 3.282388] erofs (device vdb): mounted with root inode @ nid 128.602gitlab # [ 3.187824] systemd[1]: Reloading finished in 66 ms.603gitlab # [ 3.214631] systemd-sysroot-fstab-check[179]: Requesting initrd-fs.target/start/replace...604gitlab # [ 3.216849] systemd[1]: Mounted /sysroot/nix/.ro-store.605gitlab # [ 3.218386] systemd[1]: Mounted /sysroot/run.606gitlab # [ 3.219675] systemd[1]: Mounted /sysroot/tmp/shared.607gitlab # [ 3.221061] systemd[1]: Mounted /sysroot/tmp/xchg.608gitlab # [ 3.222422] systemd-sysroot-fstab-check[179]: Requesting swap.target/start/replace...609gitlab # [ 3.224485] systemd[1]: Starting rw-sysroot-nix-store.service...610gitlab # [ 3.226129] systemd[1]: initrd-parse-etc.service: Deactivated successfully.611gitlab # [ 3.227946] systemd[1]: Finished Mountpoints Configured in the Real Root.612gitlab # [ 3.229606] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.613gitlab # [ 3.248960] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.614gitlab # [ 3.250943] systemd[1]: Finished rw-sysroot-nix-store.service.615gitlab # [ 3.925645] systemd[1]: Mounting /sysroot/nix/store...616gitlab # [ 3.977071] systemd[1]: Mounted /sysroot/nix/store.617gitlab # [ 3.979524] systemd[1]: Reached target Initrd File Systems.618gitlab # [ 3.982081] systemd[1]: Starting Find NixOS closure...619gitlab # [ 3.983997] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...620gitlab # [ 4.022234] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.621gitlab # [ 4.025128] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.622gitlab # [ 4.043588] systemd[1]: Finished Find NixOS closure.623gitlab # [ 4.045644] systemd[1]: Reached target Initrd Default Target.624gitlab # [ 4.047710] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...625gitlab # [ 4.081560] systemd[1]: Stopped target Initrd Default Target.626gitlab # [ 4.083544] systemd[1]: Stopped target Basic System.627gitlab # [ 4.085327] systemd[1]: Stopped target Initrd Root Device.628gitlab # [ 4.087218] systemd[1]: Stopped target Path Units.629gitlab # [ 4.088860] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.630gitlab # [ 4.091426] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.631gitlab # [ 4.094251] systemd[1]: Stopped target Slice Units.632gitlab # [ 4.098219] systemd[1]: Stopped target Socket Units.633gitlab # [ 4.100250] systemd[1]: Stopped target System Initialization.634gitlab # [ 4.103400] systemd[1]: Stopped target Swaps.635gitlab # [ 4.106180] systemd[1]: Stopped target Timer Units.636gitlab # [ 4.108389] systemd[1]: dbus.socket: Deactivated successfully.637gitlab # [ 4.111330] systemd[1]: Closed D-Bus System Message Bus Socket.638gitlab # [ 4.113589] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.639gitlab # [ 4.116239] systemd[1]: Stopped Find NixOS closure.640gitlab # [ 4.118140] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio641gitlab # [ 4.121895] systemd[1]: Starting rw-sysroot-nix-store.service...642gitlab # [ 4.123566] systemd[1]: systemd-sysctl.service: Deactivated successfully.643gitlab # [ 4.125438] systemd[1]: Stopped Apply Kernel Variables.644gitlab # [ 4.127189] systemd[1]: systemd-modules-load.service: Deactivated successfully.645gitlab # [ 4.129237] systemd[1]: Stopped Load Kernel Modules.646gitlab # [ 4.130795] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.647gitlab # [ 4.132819] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.648gitlab # [ 4.135179] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.649gitlab # [ 4.137194] systemd[1]: Stopped Create System Files and Directories.650gitlab # [ 4.138881] systemd[1]: Stopped target Local File Systems.651gitlab # [ 4.139818] systemd[1]: Stopped target Preparation for Local File Systems.652gitlab # [ 4.140948] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.653gitlab # [ 4.142096] systemd[1]: Stopped Coldplug All udev Devices.654gitlab # [ 4.143087] systemd[1]: Stopping Rule-based Manager for Device Events and Files...655gitlab # [ 4.144272] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.656gitlab # [ 4.145414] systemd[1]: Stopped Virtual Console Setup.657gitlab # [ 4.146584] systemd[1]: initrd-cleanup.service: Deactivated successfully.658gitlab # [ 4.147632] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.659gitlab # [ 4.148613] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.660gitlab # [ 4.149712] systemd[1]: Finished rw-sysroot-nix-store.service.661gitlab # [ 4.150604] systemd[1]: systemd-udevd.service: Deactivated successfully.662gitlab # [ 4.151579] systemd[1]: Stopped Rule-based Manager for Device Events and Files.663gitlab # [ 4.152581] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.664gitlab # [ 4.153592] systemd[1]: Closed udev Control Socket.665gitlab # [ 4.154388] systemd[1]: Starting Cleanup udev Database...666gitlab # [ 4.155209] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.667gitlab # [ 4.156305] systemd[1]: Stopped Create Static Device Nodes in /dev.668gitlab # [ 4.157301] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.669gitlab # [ 4.158460] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.670gitlab # [ 4.159499] systemd[1]: kmod-static-nodes.service: Deactivated successfully.671gitlab # [ 4.160514] systemd[1]: Stopped Create List of Static Device Nodes.672gitlab # [ 4.161407] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.673gitlab # [ 4.162497] systemd[1]: Finished Cleanup udev Database.674gitlab # [ 4.163193] systemd[1]: Reached target Switch Root.675gitlab # [ 4.163880] systemd[1]: Starting NixOS Activation...676gitlab # [ 4.278825] initrd-nixos-activation-start[230]: booting system configuration /nix/store/b6f9hjw3pz2bqqbpzn7lpsp1q8559v25-nixos-system-gitlab-test677gitlab # [ 4.324428] initrd-nixos-activation-start[230]: running activation script...678gitlab # [ 4.562370] initrd-nixos-activation-start[253]: setting up /etc...679gitlab # [ 4.644274] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.680gitlab # [ 4.646730] systemd[1]: Finished NixOS Activation.681gitlab # [ 4.648322] systemd[1]: Starting Switch Root...682gitlab # [ 4.679203] systemd[1]: Switching root.683gitlab # [ 4.876145] systemd-journald[91]: Received SIGTERM from PID 1 (systemd).684gitlab # [ 5.009502] NET: Registered PF_VSOCK protocol family685gitlab # [ 5.374841] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)686gitlab # [ 5.384660] systemd[1]: Detected virtualization kvm.687gitlab # [ 5.386446] systemd[1]: Detected architecture x86-64.688gitlab # [ 5.388394] systemd[1]: Detected first boot.689gitlab # [ 5.390964] systemd[1]: Initializing machine ID from random generator.690gitlab # [ 5.537108] systemd[1]: bpf-restrict-fs: LSM BPF program attached691gitlab # [ 5.635928] systemd[1]: Applying preset policy.692gitlab # [ 5.808296] systemd[1]: Populated /etc with preset unit settings.693gitlab # [ 5.930387] systemd[1]: initrd-switch-root.service: Deactivated successfully.694gitlab # [ 5.931707] systemd[1]: Stopped initrd-switch-root.service.695gitlab # [ 5.934186] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.696gitlab # [ 5.936334] systemd[1]: Created slice Slice /system/getty.697gitlab # [ 5.938052] systemd[1]: Created slice GitLab DevOps Platform Slice.698gitlab # [ 5.939504] systemd[1]: Created slice User and Session Slice.699gitlab # [ 5.940426] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.700gitlab # [ 5.941728] systemd[1]: Started Forward Password Requests to Wall Directory Watch.701gitlab # [ 5.942788] systemd[1]: Expecting device /dev/hvc0...702gitlab # [ 5.943495] systemd[1]: Expecting device /dev/ttyS0...703gitlab # [ 5.944215] systemd[1]: Reached target Local Encrypted Volumes.704gitlab # [ 5.945033] systemd[1]: Stopped target initrd-fs.target.705gitlab # [ 5.945780] systemd[1]: Stopped target initrd-root-fs.target.706gitlab # [ 5.946556] systemd[1]: Stopped target initrd-switch-root.target.707gitlab # [ 5.947429] systemd[1]: Reached target Virtual Machines and Containers.708gitlab # [ 5.948331] systemd[1]: Reached target Path Units.709gitlab # [ 5.949017] systemd[1]: Reached target Remote File Systems.710gitlab # [ 5.949851] systemd[1]: Reached target Slice Units.711gitlab # [ 5.950576] systemd[1]: Reached target Swaps.712gitlab # [ 5.952015] systemd[1]: Listening on Query the User Interactively for a Password.713gitlab # [ 5.954083] systemd[1]: Listening on Process Core Dump Socket.714gitlab # [ 5.955466] systemd[1]: Listening on Credential Encryption/Decryption.715gitlab # [ 5.957020] systemd[1]: Listening on Factory Reset Management.716gitlab # [ 5.957966] systemd[1]: Listening on Hostname Service Socket.717gitlab # [ 5.960465] systemd[1]: Starting Journal Log Access Socket...718gitlab # [ 5.961929] systemd[1]: Listening on Journal Audit Socket.719gitlab # [ 5.963886] systemd[1]: Listening on Console Output Muting Service Socket.720gitlab # [ 5.965035] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.721gitlab # [ 5.966224] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os722gitlab # [ 5.967533] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki723gitlab # [ 5.970343] systemd[1]: Listening on Disk Repartitioning Service Socket.724gitlab # [ 5.971375] systemd[1]: Listening on udev Control Socket.725gitlab # [ 5.972234] systemd[1]: Listening on udev Varlink Socket.726gitlab # [ 5.975356] systemd[1]: Mounting Huge Pages File System...727gitlab # [ 5.977565] systemd[1]: Mounting POSIX Message Queue File System...728gitlab # [ 5.979653] systemd[1]: Mounting Kernel Debug File System...729gitlab # [ 5.982591] systemd[1]: Mounting Kernel Trace File System...730gitlab # [ 5.986526] systemd[1]: Starting Create List of Static Device Nodes...731gitlab # [ 5.987575] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio732gitlab # [ 5.991984] systemd[1]: Starting Load Kernel Module configfs...733gitlab # [ 6.025315] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm734gitlab # [ 6.028843] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore735gitlab # [ 6.032635] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse736gitlab # [ 6.038027] systemd[1]: Mounting FUSE Control File System...737gitlab # [ 6.039799] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67738gitlab # [ 6.047125] systemd[1]: Starting Journal Service...739gitlab # [ 6.050579] systemd[1]: Starting Load Kernel Modules...740gitlab # [ 6.054902] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...741gitlab # [ 6.056893] systemd[1]: Starting Remount Root and Kernel File Systems...742gitlab # [ 6.057968] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os743gitlab # [ 6.061926] systemd[1]: Starting Coldplug All udev Devices...744gitlab # [ 6.073377] loop: module loaded745gitlab # [ 6.073740] systemd[1]: Listening on Journal Log Access Socket.746gitlab # [ 6.075130] systemd[1]: Mounted Huge Pages File System.747gitlab # [ 6.076072] systemd[1]: Mounted POSIX Message Queue File System.748gitlab # [ 6.077103] systemd[1]: Mounted Kernel Debug File System.749gitlab # [ 6.078097] systemd[1]: Mounted Kernel Trace File System.750gitlab # [ 6.079402] systemd[1]: Finished Create List of Static Device Nodes.751gitlab # [ 6.080130] systemd-journald[324]: Collecting audit messages is enabled.752gitlab # [ 6.080638] systemd[1]: modprobe@configfs.service: Deactivated successfully.753gitlab # [ 6.082582] systemd[1]: Finished Load Kernel Module configfs.754gitlab # [ 6.083610] systemd[1]: Mounted FUSE Control File System.755gitlab # [ 6.084843] systemd[1]: Finished Load Kernel Modules.756gitlab # [ 6.087063] systemd[1]: Mounting Kernel Configuration File System...757gitlab # [ 6.089409] EXT4-fs (vda): re-mounted fb2b7da0-47ba-4f63-b0a6-c6c349cac432.758gitlab # [ 6.091418] systemd[1]: Starting Firewall...759gitlab # [ 6.097434] systemd[1]: Starting Apply Kernel Variables...760gitlab # [ 5.960211] systemd[1]: Queued start job for default target Multi-User System.761gitlab # [ 5.961497] systemd[1]: Unnecessary job was removed for /dev/vdb.762gitlab # [ 5.962589] systemd[1]: systemd-journald.service: Deactivated successfully.763gitlab # [ 5.963719] systemd-modules-load[325]: Using 3 probe threads764gitlab # [ 5.964742] systemd-modules-load[325]: Inserted module 'tls'765gitlab # [ 6.105369] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...766gitlab # [ 5.965781] systemd-modules-load[325]: Inserted module 'loop'767gitlab # [ 6.108680] systemd[1]: Started Journal Service.768gitlab # [ 5.976168] systemd[1]: Finished Remount Root and Kernel File Systems.769gitlab # [ 5.978174] systemd[1]: Mounted Kernel Configuration File System.770gitlab # [ 5.980315] systemd-oomd[327]: No swap; memory pressure usage will be degraded771gitlab # [ 5.982565] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.772gitlab # [ 5.986782] systemd[1]: Listening on Disk Image Download Service Socket.773gitlab # [ 5.989077] systemd[1]: Starting Flush Journal to Persistent Storage...774gitlab # [ 5.989964] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore775gitlab # [ 5.994062] systemd[1]: Starting Load/Save OS Random Seed...776gitlab # [ 5.994902] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os777gitlab # [ 6.005938] systemd[1]: Finished Apply Kernel Variables.778gitlab # [ 6.008591] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.779gitlab # [ 6.012871] systemd[1]: Starting Create Static Device Nodes in /dev...780gitlab # [ 6.154376] systemd-journald[324]: Received client request to flush runtime journal.781gitlab # [ 6.049914] systemd[1]: Finished Load/Save OS Random Seed.782gitlab # [ 6.050841] systemd[1]: Reached target First Boot Complete.783gitlab # [ 6.052040] systemd[1]: Finished Create Static Device Nodes in /dev.784gitlab # [ 6.052838] systemd[1]: Reached target Preparation for Local File Systems.785gitlab # [ 6.054597] systemd[1]: Starting Rule-based Manager for Device Events and Files...786gitlab # [ 6.055761] systemd[1]: Finished Flush Journal to Persistent Storage.787gitlab # [ 6.062083] systemd-udevd[373]: Using default interface naming scheme 'v261'.788gitlab # [ 6.078807] systemd[1]: Finished Coldplug All udev Devices.789gitlab # [ 6.089726] systemd[1]: Started Rule-based Manager for Device Events and Files.790gitlab # [ 6.160295] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse791gitlab # [ 6.185454] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.792gitlab # [ 6.196691] (udev-worker)[438]: Network interface NamePolicy= disabled on kernel command line.793gitlab # [ 6.207218] (udev-worker)[439]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.794gitlab # [ 6.209250] (udev-worker)[439]: Network interface NamePolicy= disabled on kernel command line.795gitlab # [ 6.211336] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.796gitlab # [ 6.216570] systemd[1]: Finished Firewall.797gitlab # [ 6.231065] systemd[1]: Condition check resulted in Virtio network device being skipped.798gitlab # [ 6.232191] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore799gitlab # [ 6.233785] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67800gitlab # [ 6.235904] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore801gitlab # [ 6.238133] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os802gitlab # [ 6.239327] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os803gitlab # [ 6.383915] mousedev: PS/2 mouse device common for all mice804gitlab # [ 6.413435] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3805gitlab # [ 6.420490] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console806gitlab # [ 6.428041] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0807gitlab # [ 6.428105] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD808gitlab # [ 6.433170] Console: switching to colour dummy device 80x25809gitlab # [ 6.435458] [drm] Found bochs VGA, ID 0xb0c5.810gitlab # [ 6.435460] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.811gitlab # [ 6.453411] rtc_cmos 00:05: RTC can wake from S4812gitlab # [ 6.454859] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic813gitlab # [ 6.456080] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0814gitlab # [ 6.460386] ACPI: button: Power Button [PWRF]815gitlab # [ 6.460528] rtc_cmos 00:05: registered as rtc0816gitlab # [ 6.461422] rtc_cmos 00:05: setting system clock to 2026-08-20T05:46:06 UTC (1787204766)817gitlab # [ 6.465493] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs818gitlab # [ 6.468028] Console: switching to colour frame buffer device 160x50819gitlab # [ 6.471664] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device820gitlab # [ 6.471900] Floppy drive(s): fd0 is 2.88M AMI BIOS821gitlab # [ 6.475000] parport_pc 00:03: reported by Plug and Play ACPI822gitlab # [ 6.477128] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]823gitlab # [ 6.484920] FDC 0 is a S82078B824gitlab # [ 6.496994] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input4825gitlab # [ 6.502231] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6826gitlab # [ 6.525177] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5827gitlab # [ 6.416454] systemd[1]: Starting Virtual Console Setup...828gitlab # [ 6.431029] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.829gitlab # [ 6.433126] systemd[1]: Stopped Virtual Console Setup.830gitlab # [ 6.448476] systemd[1]: Starting Virtual Console Setup...831gitlab # [ 6.471118] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.832gitlab # [ 6.472531] systemd[1]: Stopped Virtual Console Setup.833gitlab # [ 6.613826] ppdev: user-space parallel port driver834gitlab # [ 6.475226] systemd[1]: Starting Virtual Console Setup...835gitlab # [ 6.635599] kvm_amd: TSC scaling supported836gitlab # [ 6.636130] kvm_amd: Nested Virtualization enabled837gitlab # [ 6.636686] kvm_amd: Nested Paging enabled838gitlab # [ 6.637136] kvm_amd: LBR virtualization supported839gitlab # [ 6.637687] kvm_amd: Virtual VMLOAD VMSAVE supported840gitlab # [ 6.638367] kvm_amd: Virtual GIF supported841gitlab # [ 6.638804] kvm_amd: Virtual NMI enabled842gitlab # [ 6.674870] EDAC MC: Ver: 3.0.0843gitlab # [ 6.536559] systemd-vconsole-setup[497]: Configuration of first virtual console was skipped, ignoring remaining ones.844gitlab # [ 6.539221] systemd[1]: Finished Virtual Console Setup.845gitlab # [ 6.795046] systemd[1]: Mounting /run/wrappers...846gitlab # [ 6.822298] systemd[1]: Mounted /run/wrappers.847gitlab # [ 6.823617] systemd[1]: Reached target Local File Systems.848gitlab # [ 6.825237] systemd[1]: Listening on Boot Loader Control Service Socket.849gitlab # [ 6.827877] systemd[1]: Starting register-nix-paths.service...850gitlab # [ 6.830235] systemd[1]: Starting Create SUID/SGID Wrappers...851gitlab # [ 6.831122] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.852gitlab # [ 6.832701] systemd[1]: Starting Save Transient machine-id to Disk...853gitlab # [ 6.835563] systemd[1]: Starting Create System Files and Directories...854gitlab # [ 6.870638] systemd[1]: Finished Create System Files and Directories.855gitlab # [ 6.876204] systemd[1]: Starting Rebuild Journal Catalog...856gitlab # [ 6.880517] systemd[1]: Starting Record System Boot/Shutdown in UTMP...857gitlab # [ 6.883795] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.858gitlab # [ 6.886541] systemd[1]: Finished Save Transient machine-id to Disk.859gitlab # [ 6.900116] systemd[1]: Finished Record System Boot/Shutdown in UTMP.860gitlab # [ 6.914151] systemd[1]: Finished Rebuild Journal Catalog.861gitlab # [ 6.916795] systemd[1]: Starting Update is Completed...862gitlab # [ 6.931629] systemd[1]: Finished Update is Completed.863gitlab # [ 6.974776] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.864gitlab # [ 6.975781] systemd[1]: Finished Create SUID/SGID Wrappers.865gitlab # [ 7.224163] systemd[1]: Finished register-nix-paths.service.866gitlab # [ 7.225368] systemd[1]: Reached target System Initialization.867gitlab # [ 7.226367] systemd[1]: Started Discard unused filesystem blocks once a week.868gitlab # [ 7.227471] systemd[1]: Started logrotate.timer.869gitlab # [ 7.228352] systemd[1]: Started Daily Cleanup of Temporary Directories.870gitlab # [ 7.229387] systemd[1]: Reached target Timer Units.871gitlab # [ 7.230316] systemd[1]: Listening on D-Bus System Message Bus Socket.872gitlab # [ 7.231342] systemd[1]: Listening on Nix Daemon Socket.873gitlab # [ 7.239671] systemd[1]: Starting nixbot CI service socket...874gitlab # [ 7.240668] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.875gitlab # [ 7.246254] systemd[1]: Starting D-Bus System Message Bus...876gitlab # [ 7.247292] systemd[1]: Listening on nixbot CI service socket.877gitlab # [ 7.248312] systemd[1]: Reached target Socket Units.878gitlab # [ 7.299153] dbus-broker-launch[579]: Looking up NSS user entry for 'systemd-timesync'...879gitlab # [ 7.301771] dbus-broker-launch[579]: NSS returned no entry for 'systemd-timesync'880gitlab # [ 7.304440] dbus-broker-launch[579]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"881gitlab # [ 7.309420] systemd[1]: Started D-Bus System Message Bus.882gitlab # [ 7.327898] dbus-broker-launch[579]: Ready883gitlab # [ 7.330690] systemd[1]: Reached target Basic System.884gitlab # [ 7.333908] systemd[1]: Started backdoor.service.885gitlab # [ 7.336716] systemd[1]: Starting gitlab-config.service...886gitlab # [ 7.340648] systemd[1]: Starting Import lastlog data into lastlog2 database...887gitlab # [ 7.347223] systemd[1]: Starting Logrotate configuration check...888gitlab # [ 7.353161] systemd[1]: Starting Name Service Cache Daemon (nsncd)...889gitlab # [ 7.361333] systemd[1]: Starting Post-Boot Actions...890gitlab # [ 7.365731] logrotate[584]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.891gitlab # [ 7.369541] logrotate[584]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf892gitlab # [ 7.372547] systemd[1]: Started Reset console on configuration changes.893gitlab # [ 7.375281] logrotate[584]: note: 'monthly' overrides previously specified 'weekly'894gitlab # [ 7.379508] logrotate[584]: Reading state from file: /var/lib/logrotate.status895gitlab # connecting to host...896gitlab # [ 7.383097] logrotate[584]: state file /var/lib/logrotate.status does not exist897gitlab # [ 7.383463] logrotate[584]: Allocating hash table for state file, size 64 entries898gitlab # [ 7.383795] logrotate[584]: Handling 4 logs899gitlab # [ 7.384348] logrotate[584]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed900gitlab # [ 7.384954] logrotate[584]: considering log /var/log/btmp901gitlab # [ 7.385883] logrotate[584]: Creating new state902gitlab # [ 7.386627] logrotate[584]: Now: 2026-08-20 05:46903gitlab # [ 7.387832] logrotate[584]: Last rotated at 2026-08-20 05:00904gitlab # [ 7.388820] logrotate[584]: log does not need rotating (log has already been rotated)905gitlab # [ 7.389652] logrotate[584]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed906gitlab # [ 7.392773] logrotate[584]: considering log /var/log/wtmp907gitlab # [ 7.393422] logrotate[584]: Creating new state908gitlab # [ 7.393854] logrotate[584]: Now: 2026-08-20 05:46909gitlab # [ 7.394425] logrotate[584]: Last rotated at 2026-08-20 05:00910gitlab # [ 7.394857] logrotate[584]: log does not need rotating (log has already been rotated)911gitlab # [ 7.397087] logrotate[584]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed912gitlab # [ 7.397682] logrotate[584]: switching euid from 0 to 165 and egid from 0 to 165 (pid 584)913gitlab # [ 7.398134] logrotate[584]: considering log /var/gitlab/state/log/*.log914gitlab # [ 7.398585] logrotate[584]: log /var/gitlab/state/log/*.log does not exist -- skipping915gitlab # [ 7.399708] logrotate[584]: Creating new state916gitlab # [ 7.402137] logrotate[584]: switching euid from 165 to 0 and egid from 165 to 0 (pid 584)917gitlab # [ 7.402527] logrotate[584]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed918gitlab # [ 7.402982] logrotate[584]: switching euid from 0 to 60 and egid from 0 to 60 (pid 584)919gitlab # [ 7.403546] logrotate[584]: considering log /var/log/nginx/*.log920gitlab # [ 7.403999] logrotate[584]: log /var/log/nginx/*.log does not exist -- skipping921gitlab # [ 7.406125] logrotate[584]: Creating new state922gitlab # [ 7.406520] logrotate[584]: not running postrotate script, since no logs were rotated923gitlab # [ 7.406990] logrotate[584]: switching euid from 60 to 0 and egid from 60 to 0 (pid 584)924gitlab # [ 7.407763] systemd[1]: Starting resolvconf update...925gitlab # [ 7.409676] systemd[1]: Finished Logrotate configuration check.926gitlab # [ 7.410189] systemd[1]: Finished Post-Boot Actions.927gitlab # [ 7.411046] systemd[1]: Finished Import lastlog data into lastlog2 database.928gitlab: Guest shell says: b'Spawning backdoor root shell...\n'929gitlab: connected to guest root shell930gitlab # [ 7.424349] nsncd[585]: Aug 20 05:46:07.602 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"931gitlab: (connecting took 8.11 seconds)932gitlab # [ 7.426258] systemd[1]: Started Name Service Cache Daemon (nsncd).933gitlab: (finished: waiting for the VM to finish booting, in 8.11 seconds)934gitlab # [ 7.427079] systemd[1]: Reached target Host and Network Name Lookups.935gitlab # [ 7.427908] systemd[1]: Reached target User and Group Name Lookups.936gitlab # [ 7.429622] systemd[1]: Starting User Login Management...937gitlab # [ 7.461748] systemd[1]: Stopped target Host and Network Name Lookups.938gitlab # [ 7.462768] systemd[1]: Stopping Host and Network Name Lookups...939gitlab # [ 7.463219] systemd[1]: Stopped target User and Group Name Lookups.940gitlab # [ 7.463626] systemd[1]: Stopping User and Group Name Lookups...941gitlab # [ 7.464150] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...942gitlab # [ 7.468097] systemd[1]: nscd.service: Deactivated successfully.943gitlab # [ 7.468585] systemd[1]: Stopped Name Service Cache Daemon (nsncd).944gitlab # [ 7.468995] systemd[1]: nscd.service: Consumed 20ms CPU time over 114ms wall clock time, 7.3M memory peak, 5.5M read from disk.945gitlab # [ 7.474194] systemd[1]: Starting Name Service Cache Daemon (nsncd)...946gitlab # [ 7.481724] systemd-logind[633]: New seat seat0.947gitlab # [ 7.484817] systemd-logind[633]: Watching system buttons on /dev/input/event2 (Power Button)948gitlab # [ 7.485219] systemd-logind[633]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)949gitlab # [ 7.485748] systemd-logind[633]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)950gitlab # [ 7.486210] systemd[1]: Started User Login Management.951gitlab # [ 7.488738] systemd[1]: Starting linger-users.service...952gitlab # [ 7.491516] systemd[1]: Finished resolvconf update.953gitlab # [ 7.494191] systemd[1]: Reached target Preparation for Network.954gitlab # [ 7.497148] systemd[1]: Starting DHCP Client...955gitlab # [ 7.499450] nsncd[678]: Aug 20 05:46:07.677 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"956gitlab # [ 7.499800] systemd[1]: Starting Address configuration of eth1...957gitlab # [ 7.501758] systemd[1]: Starting Extra networking commands....958gitlab # [ 7.503664] systemd[1]: Started Name Service Cache Daemon (nsncd).959gitlab # [ 7.504083] systemd[1]: Reached target Host and Network Name Lookups.960gitlab # [ 7.504464] systemd[1]: Reached target User and Group Name Lookups.961gitlab # [ 7.506610] systemd[1]: linger-users.service: Deactivated successfully.962gitlab # [ 7.510659] systemd[1]: Finished linger-users.service.963gitlab # [ 7.529574] network-addresses-eth1-start[691]: adding address 192.168.1.1/24... done964gitlab # [ 7.533620] network-addresses-eth1-start[691]: adding address 2001:db8:1::1/64... done965gitlab # [ 7.540158] systemd[1]: Finished Address configuration of eth1.966gitlab # [ 7.572806] systemd[1]: Finished Extra networking commands..967gitlab # [ 7.573854] systemd[1]: Reached target Network.968gitlab # [ 7.576746] systemd[1]: Starting gitlab-workhorse.service...969gitlab # [ 7.579668] systemd[1]: Starting Nginx Web Server...970gitlab # [ 7.584100] systemd[1]: Starting PostgreSQL Server...971gitlab # [ 7.586861] systemd[1]: Starting Redis Server - redis-gitlab...972gitlab # [ 7.591120] dhcpcd[730]: dhcpcd-10.3.2 starting973gitlab # [ 7.592044] systemd[1]: Starting Permit User Sessions...974gitlab # [ 7.594789] dhcpcd[772]: dev: loaded udev975gitlab # [ 7.740922] 8021q: 802.1Q VLAN Support v1.8976gitlab # [ 7.741549] 8021q: adding VLAN 0 to HW filter on device eth1977gitlab # [ 7.606641] systemd[1]: Finished Permit User Sessions.978gitlab # [ 7.620652] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.979gitlab # [ 7.625071] systemd[1]: Started Getty on tty1.980gitlab # [ 7.626912] systemd[1]: Reached target Login Prompts.981gitlab # [ 7.841441] cfg80211: Loading compiled-in X.509 certificates for regulatory database982gitlab # [ 7.846193] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'983gitlab # [ 7.847116] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'984gitlab # [ 7.848336] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2985gitlab # [ 7.849551] cfg80211: failed to load regulatory.db986gitlab # [ 7.723236] nginx-pre-start[791]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok987gitlab # [ 7.723860] nginx-pre-start[791]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful988gitlab # [ 7.731121] systemd[1]: Started Nginx Web Server.989gitlab # [ 7.741482] redis-server[792]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutSto[ 7.882800] 8021q: adding VLAN 0 to HW filter on device eth0990gitlab # pSec in your service unit.991gitlab # [ 7.744786] dhcpcd[772]: eth0: waiting for carrier992gitlab # [ 7.745604] dhcpcd[772]: eth0: carrier acquired993gitlab # [ 7.747191] redis-server[792]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo994gitlab # [ 7.748325] redis-server[792]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=792, just started995gitlab # [ 7.749784] redis-server[792]: Configuration loaded996gitlab # [ 7.750598] redis[792]: monotonic clock: POSIX clock_gettime997gitlab # [ 7.751790] dhcpcd[772]: DUID 00:01:00:01:32:19:51:1f:52:54:00:12:34:56998gitlab # [ 7.754133] postgresql-pre-start[794]: The files belonging to this database system will be owned by user "postgres".999gitlab # [ 7.755541] postgresql-pre-start[794]: This user must also own the server process.1000gitlab # [ 7.756712] systemd[1]: Started Redis Server - redis-gitlab.1001gitlab # [ 7.757443] dhcpcd[772]: eth0: IAID 00:12:34:561002gitlab # [ 7.758160] postgresql-pre-start[794]: The database cluster will be initialized with locale "en_US.UTF-8".1003gitlab # [ 7.761259] postgresql-pre-start[794]: The default database encoding has accordingly been set to "UTF8".1004gitlab # [ 7.761535] postgresql-pre-start[794]: The default text search configuration will be set to "english".1005gitlab # [ 7.762207] postgresql-pre-start[794]: Data page checksums are enabled.1006gitlab # [ 7.762711] postgresql-pre-start[794]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1007gitlab # [ 7.763189] postgresql-pre-start[794]: creating subdirectories ... ok1008gitlab # [ 7.763732] postgresql-pre-start[794]: selecting dynamic shared memory implementation ... posix1009gitlab # [ 7.764414] dhcpcd[772]: eth0: adding address fe80::5054:ff:fe12:34561010gitlab # [ 7.764907] redis[792]: Running mode=standalone, port=0.1011gitlab # [ 7.765479] redis[792]: Server initialized1012gitlab # [ 7.765878] redis[792]: Ready to accept connections unix1013gitlab # [ 7.766447] redis[792]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1014gitlab # [ 7.800732] postgresql-pre-start[794]: selecting default "max_connections" ... 1001015gitlab # [ 7.838559] postgresql-pre-start[794]: selecting default "shared_buffers" ... 128MB1016gitlab # [ 8.064710] systemd[1]: Started gitlab-workhorse.service.1017gitlab # [ 8.193881] postgresql-pre-start[794]: selecting default time zone ... UTC1018gitlab # [ 8.195353] postgresql-pre-start[794]: creating configuration files ... ok1019gitlab # [ 8.301268] gitlab-workhorse[827]: time="2026-08-20T05:46:08Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41020gitlab # [ 8.302887] gitlab-workhorse[827]: time="2026-08-20T05:46:08Z" level=info msg="Using redis/go-redis"1021gitlab # [ 8.304067] gitlab-workhorse[827]: time="2026-08-20T05:46:08Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1022gitlab # [ 8.367390] postgresql-pre-start[794]: running bootstrap script ... ok1023gitlab # [ 8.766794] postgresql-pre-start[794]: performing post-bootstrap initialization ... ok1024gitlab # [ 8.778983] dhcpcd[772]: eth0: soliciting a DHCP lease1025gitlab # [ 8.924224] NET: Registered PF_PACKET protocol family1026gitlab # [ 8.789149] dhcpcd[772]: eth0: offered 10.0.2.15 from 10.0.2.21027gitlab # [ 8.793213] dhcpcd[772]: eth0: probing address 10.0.2.15/241028gitlab # [ 9.003498] postgresql-pre-start[794]: syncing data to disk ... ok1029gitlab # [ 9.004159] postgresql-pre-start[794]: initdb: warning: enabling "trust" authentication for local connections1030gitlab # [ 9.004722] postgresql-pre-start[794]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1031gitlab # [ 9.005550] postgresql-pre-start[794]: Success. You can now start the database server using:1032gitlab # [ 9.006195] postgresql-pre-start[794]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1033gitlab # [ 9.128470] postgres[853]: [853] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1034gitlab # [ 9.130528] postgres[853]: [853] LOG: listening on IPv6 address "::1", port 54321035gitlab # [ 9.132070] postgres[853]: [853] LOG: listening on IPv4 address "127.0.0.1", port 54321036gitlab # [ 9.139817] postgres[853]: [853] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1037gitlab # [ 9.155642] postgres[862]: [862] LOG: database system was shut down at 2026-08-20 05:46:08 GMT1038gitlab # [ 9.165482] postgres[853]: [853] LOG: database system is ready to accept connections1039gitlab # [ 9.172433] systemd[1]: Started PostgreSQL Server.1040gitlab # [ 9.177703] systemd[1]: Starting PostgreSQL Setup Scripts...1041gitlab # [ 9.411132] postgresql-setup-start[873]: CREATE DATABASE1042gitlab # [ 9.439355] postgresql-setup-start[883]: CREATE ROLE1043gitlab # [ 9.452099] postgresql-setup-start[885]: ALTER DATABASE1044gitlab # [ 9.468114] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[878]: mkdir -p /var/gitlab/state/home/.ssh: OK1045gitlab # [ 9.469362] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[878]: chmod 700 /var/gitlab/state/home/.ssh: OK1046gitlab # [ 9.477075] postgresql-setup-start[890]: CREATE ROLE1047gitlab # [ 9.480549] systemd[1]: Finished PostgreSQL Setup Scripts.1048gitlab # [ 9.481605] systemd[1]: Reached target PostgreSQL.1049gitlab # [ 9.484479] systemd[1]: Starting gitlab-postgresql.service...1050gitlab # [ 9.510741] systemd[1]: Finished gitlab-config.service.1051gitlab # [ 9.512733] systemd[1]: Started gitaly.service.1052gitlab # [ 9.514293] systemd[1]: Starting gitlab-db-config.service...1053gitlab # [ 9.580313] gitlab-postgresql-start[910]: CREATE DATABASE1054gitlab # [ 9.611390] gitlab-postgresql-start[928]: CREATE EXTENSION1055gitlab # [ 9.682145] gitlab-postgresql-start[930]: CREATE EXTENSION1056gitlab # [ 9.686842] systemd[1]: Finished gitlab-postgresql.service.1057gitlab # [ 10.014491] gitaly[911]: time="2026-08-20T05:46:10.192Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=9111058gitlab # [ 10.014875] gitaly[911]: time="2026-08-20T05:46:10.193Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=9111059gitlab # [ 10.015513] gitaly[911]: time="2026-08-20T05:46:10.193Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=9111060gitlab # [ 10.015901] gitaly[911]: time="2026-08-20T05:46:10.193Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=9111061gitlab # [ 10.016459] gitaly[911]: time="2026-08-20T05:46:10.193Z" level=info msg="Starting Gitaly" pid=911 version=1062gitlab # [ 10.196384] gitaly[911]: time="2026-08-20T05:46:10.375Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=173 pid=9111063gitlab # [ 10.196826] gitaly[911]: time="2026-08-20T05:46:10.375Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=9111064gitlab # [ 10.197503] gitaly[911]: time="2026-08-20T05:46:10.375Z" level=info msg="finished initializing command factory" duration_ms=0 pid=9111065gitlab # [ 10.197896] gitaly[911]: time="2026-08-20T05:46:10.375Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-911/git-exec-2759751732.d/git pid=9111066gitlab # [ 10.200529] gitaly[911]: time="2026-08-20T05:46:10.379Z" level=info msg="finished detecting git version" duration_ms=3 pid=9111067gitlab # [ 10.201349] gitaly[911]: time="2026-08-20T05:46:10.379Z" level=info msg="using Git version" pid=911 version=2.53.g1068gitlab # [ 10.201897] gitaly[911]: time="2026-08-20T05:46:10.379Z" level=info msg="clearing disk cache object folder" pid=911 storage=default1069gitlab # [ 10.202426] gitaly[911]: time="2026-08-20T05:46:10.379Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3252243967 pid=911 storage=default1070gitlab # [ 10.202904] gitaly[911]: time="2026-08-20T05:46:10.379Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3252243967 pid=911 storage=default1071gitlab # [ 10.203501] gitaly[911]: time="2026-08-20T05:46:10.380Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3252243967 clear_duration_ms=0 pid=911 storage=default1072gitlab # [ 10.211198] gitaly[911]: time="2026-08-20T05:46:10.390Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=9111073gitlab # [ 10.211561] gitaly[911]: time="2026-08-20T05:46:10.390Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=9111074gitlab # [ 10.245886] gitaly[911]: time="2026-08-20T05:46:10.424Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9111075gitlab # [ 10.246490] gitaly[911]: time="2026-08-20T05:46:10.424Z" level=info msg="counting repositories" pid=9111076gitlab # [ 10.247107] gitaly[911]: time="2026-08-20T05:46:10.424Z" level=info msg="starting to count repositories" pid=911 storage_path=/var/gitlab/state/repositories1077gitlab # [ 10.247527] gitaly[911]: time="2026-08-20T05:46:10.424Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=911 schema=unix1078gitlab # [ 10.248053] gitaly[911]: time="2026-08-20T05:46:10.425Z" level=info msg="listening at address" address=/run/gitaly/gitaly-911/sock.d/intern pid=911 schema=unix1079gitlab # [ 10.254234] gitaly[911]: time="2026-08-20T05:46:10.433Z" level=info msg="completed counting repositories" counting_duration_ms=8 pid=911 storage_path=/var/gitlab/state/repositories1080gitlab # [ 10.254754] gitaly[911]: time="2026-08-20T05:46:10.433Z" level=info msg="completed counting all repositories" counting_duration=8 pid=9111081gitlab # [ 10.255720] gitaly[911]: time="2026-08-20T05:46:10.433Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9111082gitlab # [ 10.256457] gitaly[911]: time="2026-08-20T05:46:10.433Z" level=info msg="Started Gitaly" duration_ms=240 pid=9111083gitlab # [ 10.256808] gitaly[911]: time="2026-08-20T05:46:10.424Z" level=info msg="finished tempdir cleaner walk" pid=911 storage=default time_ms=01084gitlab # [ 10.257447] gitaly[911]: time="2026-08-20T05:46:10.433Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9111085gitlab # [ 10.257804] gitaly[911]: time="2026-08-20T05:46:10.433Z" level=info msg="maintenance: daily scheduled" pid=911 scheduled="2026-08-20 12:00:00 +0000 UTC"1086gitlab # [ 10.395034] dhcpcd[772]: eth0: soliciting an IPv6 router1087gitlab # [ 10.397129] dhcpcd[772]: eth0: Router Advertisement from fe80::21088gitlab # [ 10.397656] dhcpcd[772]: eth0: adding address fec0::5054:ff:fe12:3456/641089gitlab # [ 10.398074] dhcpcd[772]: eth0: adding route to fec0::/641090gitlab # [ 10.398904] dhcpcd[772]: eth0: adding default route via fe80::21091gitlab # [ 10.850223] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[921]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1092gitlab # [ 10.850667] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[921]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1093gitlab # [ 10.871278] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[921]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1094gitlab # [ 12.243081] gitaly[911]: time="2026-08-20T05:46:12.421Z" level=info msg="License database preloaded" duration_ms=2227 pid=9111095gitlab # [ 13.678206] dhcpcd[772]: eth0: leased 10.0.2.15 for 86400 seconds1096gitlab # [ 13.678442] dhcpcd[772]: eth0: adding route to 10.0.2.0/241097gitlab # [ 13.679171] dhcpcd[772]: eth0: adding default route via 10.0.2.21098gitlab # [ 13.761195] systemd[1]: Started DHCP Client.1099gitlab # [ 13.762417] systemd[1]: Reached target Network is Online.1100gitlab # [ 40.617128] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[921]: W, [2026-08-20T05:46:40.795094 #921] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1101gitlab # [ 42.556656] postgres[1309]: [1309] ERROR: relation "feature_gates" does not exist at character 5231102gitlab # [ 42.559481] postgres[1309]: [1309] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1103gitlab # [ 42.562275] postgres[1309]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1104gitlab # [ 42.565300] postgres[1309]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1105gitlab # [ 42.567986] postgres[1309]: attidentity AS identity,1106gitlab # [ 42.569924] postgres[1309]: attgenerated as attgenerated1107gitlab # [ 42.572081] postgres[1309]: FROM pg_attribute a1108gitlab # [ 42.573794] postgres[1309]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1109gitlab # [ 42.576580] postgres[1309]: LEFT JOIN pg_type t ON a.atttypid = t.oid1110gitlab # [ 42.578714] postgres[1309]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1111gitlab # [ 42.581847] postgres[1309]: WHERE a.attrelid = '"feature_gates"'::regclass1112gitlab # [ 42.584129] postgres[1309]: AND a.attnum > 0 AND NOT a.attisdropped1113gitlab # [ 42.586316] postgres[1309]: ORDER BY a.attnum1114gitlab # [ 42.587907] postgres[1309]:1115gitlab # [ 45.898391] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1342]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1116gitlab # [ 45.899259] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1342]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1117gitlab # [ 48.357206] gitlab-workhorse[827]: time="2026-08-20T05:46:48Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1118gitlab # [ 58.367736] gitlab-workhorse[827]: time="2026-08-20T05:46:58Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1119gitlab # [ 60.887438] postgres[1408]: [1408] ERROR: relation "table_without_models" does not exist1120gitlab # [ 60.888256] postgres[1408]: [1408] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1121gitlab # [ 68.375966] gitlab-workhorse[827]: time="2026-08-20T05:47:08Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1122gitlab # [ 73.614537] systemd[1]: Finished gitlab-db-config.service.1123gitlab # [ 73.619777] systemd[1]: Started gitlab-sidekiq.service.1124gitlab # [ 73.623064] systemd[1]: Starting gitlab.service...1125gitlab # [ 73.989524] bundle[1593]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1126gitlab # [ 73.989865] bundle[1593]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1127gitlab # [ 73.991112] bundle[1593]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1128gitlab # [ 76.739837] sidekiq-cluster[1592]: {"severity":"INFO","time":"2026-08-20T05:47:16.901Z","message":"Starting cluster with 1 processes"}1129gitlab # [ 77.002882] bundle[1593]: {"timestamp":"2026-08-20T05:47:17.161Z","pid":1593,"message":"* Enabling systemd notification integration"}1130gitlab # [ 77.006415] bundle[1593]: {"timestamp":"2026-08-20T05:47:17.180Z","pid":1593,"message":"Puma starting in cluster mode..."}1131gitlab # [ 77.007395] bundle[1593]: {"timestamp":"2026-08-20T05:47:17.180Z","pid":1593,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1132gitlab # [ 77.008151] bundle[1593]: {"timestamp":"2026-08-20T05:47:17.180Z","pid":1593,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1133gitlab # [ 77.009150] bundle[1593]: {"timestamp":"2026-08-20T05:47:17.180Z","pid":1593,"message":"* Min threads: 0"}1134gitlab # [ 77.010218] bundle[1593]: {"timestamp":"2026-08-20T05:47:17.180Z","pid":1593,"message":"* Max threads: 4"}1135gitlab # [ 77.011287] bundle[1593]: {"timestamp":"2026-08-20T05:47:17.180Z","pid":1593,"message":"* Environment: production"}1136gitlab # [ 77.012349] bundle[1593]: {"timestamp":"2026-08-20T05:47:17.180Z","pid":1593,"message":"* Master PID: 1593"}1137gitlab # [ 77.013398] bundle[1593]: {"timestamp":"2026-08-20T05:47:17.180Z","pid":1593,"message":"* Workers: 2"}1138gitlab # [ 77.014460] bundle[1593]: {"timestamp":"2026-08-20T05:47:17.181Z","pid":1593,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1139gitlab # [ 77.015914] bundle[1593]: {"timestamp":"2026-08-20T05:47:17.181Z","pid":1593,"message":"* Preloading application"}1140gitlab # [ 78.386431] gitlab-workhorse[827]: time="2026-08-20T05:47:18Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1141gitlab # [ 88.396169] gitlab-workhorse[827]: time="2026-08-20T05:47:28Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1142gitlab # [ 98.406225] gitlab-workhorse[827]: time="2026-08-20T05:47:38Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1143gitlab # [ 100.369210] bundle[1593]: W, [2026-08-20T05:47:40.547174 #1593] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1144gitlab # [ 103.028256] sidekiq-cluster[1623]: 2026-08-20T05:47:43.205Z pid=1623 tid=wlb INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1623, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>432914432}1145gitlab # [ 103.205571] sidekiq-cluster[1623]: W, [2026-08-20T05:47:43.384074 #1623] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1146gitlab # [ 103.244847] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:43.423Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1147gitlab # [ 105.198360] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.376Z","message":"GitLab reliable fetch activated!"}1148gitlab # [ 105.198901] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.376Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1149gitlab # [ 105.231185] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.409Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1150gitlab # [ 105.238100] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.416Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1151gitlab # [ 105.248376] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.427Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1152gitlab # [ 105.257337] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.436Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1153gitlab # [ 105.261604] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.440Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1154gitlab # [ 105.266849] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.445Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1155gitlab # [ 105.275266] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.453Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1156gitlab # [ 105.282843] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.461Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1157gitlab # [ 105.290635] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.469Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1158gitlab # [ 105.298649] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.477Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1159gitlab # [ 105.302491] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.481Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1160gitlab # [ 105.308240] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.486Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1161gitlab # [ 105.311803] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.490Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1162gitlab # [ 105.316063] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.494Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1163gitlab # [ 105.320324] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.498Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1164gitlab # [ 105.324193] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.502Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1165gitlab # [ 105.327493] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.506Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1166gitlab # [ 105.330882] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.509Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1167gitlab # [ 105.334101] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.512Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1168gitlab # [ 105.338080] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.516Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1169gitlab # [ 105.341254] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.520Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1170gitlab # [ 105.344241] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.522Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1171gitlab # [ 105.347061] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.525Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1172gitlab # [ 105.349784] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.528Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1173gitlab # [ 105.352721] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.531Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1174gitlab # [ 105.355820] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.534Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1175gitlab # [ 105.358912] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.537Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1176gitlab # [ 105.361859] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.540Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1177gitlab # [ 105.364859] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.543Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1178gitlab # [ 105.367869] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.546Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1179gitlab # [ 105.370355] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.549Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1180gitlab # [ 105.373085] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.551Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1181gitlab # [ 105.375669] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.554Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1182gitlab # [ 105.378537] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.557Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1183gitlab # [ 105.381286] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.560Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1184gitlab # [ 105.383687] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.562Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1185gitlab # [ 105.386249] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.565Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1186gitlab # [ 105.389306] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.568Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1187gitlab # [ 105.391695] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.570Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1188gitlab # [ 105.393943] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.572Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1189gitlab # [ 105.396452] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.575Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1190gitlab # [ 105.398775] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.577Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1191gitlab # [ 105.401279] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.580Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1192gitlab # [ 105.403821] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.582Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1193gitlab # [ 105.406090] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.584Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1194gitlab # [ 105.408261] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.587Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1195gitlab # [ 105.409977] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.588Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1196gitlab # [ 105.412182] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.590Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1197gitlab # [ 105.414405] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.593Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1198gitlab # [ 105.416327] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.595Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1199gitlab # [ 105.418542] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.597Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1200gitlab # [ 105.421190] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.599Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1201gitlab # [ 105.430155] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.608Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1202gitlab # [ 105.432446] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.611Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1203gitlab # [ 105.434550] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.613Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1204gitlab # [ 105.436739] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.615Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1205gitlab # [ 105.438731] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.617Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1206gitlab # [ 105.440921] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.619Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1207gitlab # [ 105.442547] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.621Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1208gitlab # [ 105.444892] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.623Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1209gitlab # [ 105.447090] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.625Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1210gitlab # [ 105.448773] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.627Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1211gitlab # [ 105.451426] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.630Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1212gitlab # [ 105.453953] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.632Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1213gitlab # [ 105.455941] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.634Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1214gitlab # [ 105.458163] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.636Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1215gitlab # [ 105.460029] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.638Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1216gitlab # [ 105.462064] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.640Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1217gitlab # [ 105.497128] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.675Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1218gitlab # [ 105.499440] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.678Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1219gitlab # [ 105.501427] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.680Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1220gitlab # [ 105.503317] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.682Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1221gitlab # [ 105.505578] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.684Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1222gitlab # [ 105.508204] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.687Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1223gitlab # [ 105.510310] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.689Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1224gitlab # [ 105.513081] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.691Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1225gitlab # [ 105.515312] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.694Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1226gitlab # [ 105.517978] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.696Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1227gitlab # [ 105.520042] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.698Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1228gitlab # [ 105.522032] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.700Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1229gitlab # [ 105.523553] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.702Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1230gitlab # [ 105.525552] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.704Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1231gitlab # [ 105.528334] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.707Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1232gitlab # [ 105.530222] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.709Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1233gitlab # [ 105.532334] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.711Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1234gitlab # [ 105.533996] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.712Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1235gitlab # [ 105.536581] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.715Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1236gitlab # [ 105.541409] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.720Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1237gitlab # [ 105.545786] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.724Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1238gitlab # [ 105.549270] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.728Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1239gitlab # [ 105.553094] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.731Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1240gitlab # [ 105.556319] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.735Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1241gitlab # [ 105.559570] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.738Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1242gitlab # [ 105.563386] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.742Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1243gitlab # [ 105.567229] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.746Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1244gitlab # [ 105.570975] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.749Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1245gitlab # [ 105.574739] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.753Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1246gitlab # [ 105.577963] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.756Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1247gitlab # [ 105.589519] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.768Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1248gitlab # [ 105.592262] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.771Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1249gitlab # [ 105.594111] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.772Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1250gitlab # [ 105.596703] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.775Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1251gitlab # [ 105.599475] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.778Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1252gitlab # [ 105.601605] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.780Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1253gitlab # [ 105.604023] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.782Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1254gitlab # [ 105.605566] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.784Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1255gitlab # [ 105.607557] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.786Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1256gitlab # [ 105.610280] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.789Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1257gitlab # [ 105.611815] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:47:45.790Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1258gitlab # [ 108.415866] gitlab-workhorse[827]: time="2026-08-20T05:47:48Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1259gitlab # [ 118.425872] gitlab-workhorse[827]: time="2026-08-20T05:47:58Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1260gitlab # [ 128.427502] gitlab-workhorse[827]: time="2026-08-20T05:48:08Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1261gitlab # [ 129.843360] postgres[2079]: [2079] ERROR: relation "table_without_models" does not exist1262gitlab # [ 129.843772] postgres[2079]: [2079] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1263gitlab # [ 130.417746] postgres[2099]: [2099] ERROR: relation "table_without_models" does not exist1264gitlab # [ 130.420493] postgres[2099]: [2099] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1265gitlab # [ 132.352282] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:12.527Z","message":"Booted Rails 7.2.3.1 application in production environment"}1266gitlab # [ 132.353308] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:12.532Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1267gitlab # [ 132.353986] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:12.532Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1268gitlab # [ 132.355339] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:12.533Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1269gitlab # [ 132.359056] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:12.535Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1270gitlab # [ 133.254297] bundle[1593]: {"timestamp":"2026-08-20T05:48:13.432Z","pid":1593,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1271gitlab # [ 133.254613] bundle[1593]: {"timestamp":"2026-08-20T05:48:13.432Z","pid":1593,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1272gitlab # [ 133.256667] bundle[1593]: {"timestamp":"2026-08-20T05:48:13.432Z","pid":1593,"message":"! #\u003cThread:0x00007b1b28a8b8f8 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1273gitlab # [ 133.258483] bundle[1593]: {"timestamp":"2026-08-20T05:48:13.432Z","pid":1593,"message":"! #\u003cThread:0x00007b1b28dccee0 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1274gitlab # [ 133.259921] bundle[1593]: {"timestamp":"2026-08-20T05:48:13.432Z","pid":1593,"message":"Use Ctrl-C to stop"}1275gitlab # [ 133.261507] bundle[1593]: {"timestamp":"2026-08-20T05:48:13.432Z","pid":1593,"message":"Sending status to systemd every 1.0 sec"}1276gitlab # [ 133.717110] bundle[1593]: {"timestamp":"2026-08-20T05:48:13.895Z","pid":1593,"message":"- Worker 1 (PID: 2169) booted in 0.38s, phase: 0"}1277gitlab # [ 133.733442] bundle[1593]: {"timestamp":"2026-08-20T05:48:13.912Z","pid":1593,"message":"- Worker 0 (PID: 2165) booted in 0.42s, phase: 0"}1278gitlab # [ 133.742570] systemd[1]: Started gitlab.service.1279gitlab # [ 133.744426] systemd[1]: Reached target Common target for all GitLab services..1280gitlab # [ 133.749185] systemd[1]: Starting setup-gitlab.service...1281gitlab # [ 133.768200] setup-gitlab-start[2202]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1282gitlab # [ 133.862790] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:14.040Z","message":"Cleaning working queues"}1283gitlab # [ 133.870091] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:14.047Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"f09c9f26576f27f75a8bf1de","created_at":"2026-08-20T05:47:13.427Z","trace_propagation_headers":{"sentry-trace":"2b9e91665f8a4be18f49c741a6a65aa9-965923f6cc234d13","baggage":"sentry-trace_id=2b9e91665f8a4be18f49c741a6a65aa9,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"433f2320de2ae4f5d1dfb93875307318","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T05:47:13.436Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-f09c9f26576f27f75a8bf1de: start","job_status":"start","queue_duration_s":60.609878,"scheduling_latency_s":60.610021}1284gitlab # [ 134.039709] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:14.217Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"f09c9f26576f27f75a8bf1de","created_at":"2026-08-20T05:47:13.427Z","trace_propagation_headers":{"sentry-trace":"2b9e91665f8a4be18f49c741a6a65aa9-965923f6cc234d13","baggage":"sentry-trace_id=2b9e91665f8a4be18f49c741a6a65aa9,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"433f2320de2ae4f5d1dfb93875307318","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T05:47:13.436Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-f09c9f26576f27f75a8bf1de: done: 0.171388 sec","job_status":"done","queue_duration_s":60.609878,"scheduling_latency_s":60.610021,"redis_calls":24,"redis_duration_s":0.005246,"redis_read_bytes":912,"redis_write_bytes":2622,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.002237,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001613,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001396,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057821,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.080595718,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.171388,"completed_at":"2026-08-20T05:48:14.217Z","load_balancing_strategy":"primary","db_duration_s":0.048594,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1285gitlab # [ 136.163456] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:48:16 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 23711286gitlab # [ 136.170698] setup-gitlab-start[2202]: + TOKEN=nixbot-test-token-of-20-chars1287gitlab # [ 136.171534] setup-gitlab-start[2202]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1288gitlab # [ 136.196659] runuser[2229]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1289gitlab # [ 136.596221] setup-gitlab-start[2230]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1290gitlab # [ 136.600783] setup-gitlab-start[2230]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1291gitlab # [ 136.605251] setup-gitlab-start[2230]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1292gitlab # [ 137.212208] setup-gitlab-start[2230]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1293gitlab # [ 137.216776] setup-gitlab-start[2230]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1294gitlab # [ 137.221308] setup-gitlab-start[2230]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1295gitlab # [ 144.743751] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:24.921Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"24802e5090a6d5f1a7c37272","created_at":"2026-08-20T05:48:24.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b4025bcfeb6465a61e456b2ae97d9342","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:24.919Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-24802e5090a6d5f1a7c37272: start","job_status":"start","queue_duration_s":0.001819,"scheduling_latency_s":0.001856}1296gitlab # [ 144.787342] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:24.965Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1297gitlab # [ 144.804314] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:24.982Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"24802e5090a6d5f1a7c37272","created_at":"2026-08-20T05:48:24.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b4025bcfeb6465a61e456b2ae97d9342","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:24.919Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-24802e5090a6d5f1a7c37272: done: 0.061002 sec","job_status":"done","queue_duration_s":0.001819,"scheduling_latency_s":0.001856,"redis_calls":10,"redis_duration_s":0.018999,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.009855,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007366,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001778,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015858,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001644902,"duration_s":0.061002,"completed_at":"2026-08-20T05:48:24.982Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001977,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1298gitlab # [ 144.869142] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:25.047Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"124cfed5051a9616bdcae744","created_at":"2026-08-20T05:48:24.932Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0ca0d4c8ba495368ed5ae998c4c39762","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:24.947Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-124cfed5051a9616bdcae744: start","job_status":"start","queue_duration_s":0.099943,"scheduling_latency_s":0.099968}1299gitlab # [ 145.352965] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:25.530Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"124cfed5051a9616bdcae744","created_at":"2026-08-20T05:48:24.932Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0ca0d4c8ba495368ed5ae998c4c39762","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:24.947Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-124cfed5051a9616bdcae744: done: 0.483204 sec","job_status":"done","queue_duration_s":0.099943,"scheduling_latency_s":0.099968,"redis_calls":14,"redis_duration_s":0.012211,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.003294,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005322,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003595,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.147,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.147,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.214696,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00094174,"exclusive_lock_hold_duration_s":0.426982479,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.483204,"completed_at":"2026-08-20T05:48:25.530Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.234831,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 145.407438] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:25.534Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"e8a78025d253cb74bfa48b77","created_at":"2026-08-20T05:48:24.960Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5d2921fdb8f3fe4b59c9725165095325","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:24.975Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-e8a78025d253cb74bfa48b77: start","job_status":"start","queue_duration_s":0.559002,"scheduling_latency_s":0.559034}1301gitlab # [ 145.450248] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:25.628Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"e8a78025d253cb74bfa48b77","created_at":"2026-08-20T05:48:24.960Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5d2921fdb8f3fe4b59c9725165095325","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:24.975Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-e8a78025d253cb74bfa48b77: done: 0.094291 sec","job_status":"done","queue_duration_s":0.559002,"scheduling_latency_s":0.559034,"redis_calls":13,"redis_duration_s":0.00609,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001351,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002429,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00231,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.032,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028809,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.03606855,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.094291,"completed_at":"2026-08-20T05:48:25.628Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.032387,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1302gitlab # [ 145.486487] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:25.632Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleDeleteObjectsCronWorker","jid":"d2bd545d78a170af1f4b66b3","created_at":"2026-08-20T05:48:25.044Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8251d4193fad694e50c4958d17fdca56b6fb205fa6961a4b1ccb7cd497bc09c1","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.063Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleDeleteObjectsCronWorker JID-d2bd545d78a170af1f4b66b3: start","job_status":"start","queue_duration_s":0.569321,"scheduling_latency_s":0.56935}1303gitlab # [ 145.571631] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:25.750Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleDeleteObjectsCronWorker","jid":"d2bd545d78a170af1f4b66b3","created_at":"2026-08-20T05:48:25.044Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8251d4193fad694e50c4958d17fdca56b6fb205fa6961a4b1ccb7cd497bc09c1","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.063Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleDeleteObjectsCronWorker JID-d2bd545d78a170af1f4b66b3: done: 0.117545 sec","job_status":"done","queue_duration_s":0.569321,"scheduling_latency_s":0.56935,"redis_calls":65,"redis_duration_s":0.015377,"redis_read_bytes":114,"redis_write_bytes":41282,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001895,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":656,"redis_queues_calls":2,"redis_queues_duration_s":0.000892,"redis_queues_read_bytes":3,"redis_queues_write_bytes":36985,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.01208,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3374,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00051,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":267,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063967,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000286629,"duration_s":0.117545,"completed_at":"2026-08-20T05:48:25.749Z","load_balancing_strategy":"primary","db_duration_s":0.002447,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1304gitlab # [ 145.639972] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:25.818Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"e8712b661fa789fe93fa5bdd","created_at":"2026-08-20T05:48:25.074Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"cb05bf1bdb77579766a58fc2bb6532f0","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.085Z","job_size_bytes":3,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-e8712b661fa789fe93fa5bdd: start","job_status":"start","queue_duration_s":0.733035,"scheduling_latency_s":0.733066}1305gitlab # [ 145.677760] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:25.855Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"e8712b661fa789fe93fa5bdd","created_at":"2026-08-20T05:48:25.074Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"cb05bf1bdb77579766a58fc2bb6532f0","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.085Z","job_size_bytes":3,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-e8712b661fa789fe93fa5bdd: done: 0.037444 sec","job_status":"done","queue_duration_s":0.733035,"scheduling_latency_s":0.733066,"redis_calls":10,"redis_duration_s":0.0028150000000000002,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000821,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001515,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000479,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016651,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000605664,"duration_s":0.037444,"completed_at":"2026-08-20T05:48:25.855Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000781,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1306gitlab # [ 145.700391] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:25.858Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"b36afe1ebe5cae523588bf31","created_at":"2026-08-20T05:48:25.112Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e17b4dbec2b18a766f7341fb2e985462","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.121Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-b36afe1ebe5cae523588bf31: start","job_status":"start","queue_duration_s":0.736421,"scheduling_latency_s":0.736454}1307gitlab # [ 145.712128] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:25.890Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"b36afe1ebe5cae523588bf31","created_at":"2026-08-20T05:48:25.112Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e17b4dbec2b18a766f7341fb2e985462","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.121Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-b36afe1ebe5cae523588bf31: done: 0.031992 sec","job_status":"done","queue_duration_s":0.736421,"scheduling_latency_s":0.736454,"redis_calls":12,"redis_duration_s":0.005631,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000699,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003616,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001316,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017292,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000558451,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.031992,"completed_at":"2026-08-20T05:48:25.890Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000808,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1308gitlab # [ 145.780831] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:25.957Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"a61ee315d7f1541d7aa9d260","created_at":"2026-08-20T05:48:25.132Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e98886377567b7afbd91bdc020903752","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.142Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-a61ee315d7f1541d7aa9d260: start","job_status":"start","queue_duration_s":0.815678,"scheduling_latency_s":0.815712}1309gitlab # [ 145.815053] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:25.993Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"a61ee315d7f1541d7aa9d260","created_at":"2026-08-20T05:48:25.132Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e98886377567b7afbd91bdc020903752","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.142Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-a61ee315d7f1541d7aa9d260: done: 0.035716 sec","job_status":"done","queue_duration_s":0.815678,"scheduling_latency_s":0.815712,"redis_calls":12,"redis_duration_s":0.0016129999999999999,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000246,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000779,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000588,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011053,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000394184,"exclusive_lock_hold_duration_s":0.0044634159999999996,"duration_s":0.035716,"completed_at":"2026-08-20T05:48:25.993Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003089,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1310gitlab # [ 145.856827] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:26.035Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"4cf84ff266c49aaede8a58b7","created_at":"2026-08-20T05:48:25.158Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c3ec116a2973e35666a95535d5199bf6","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.172Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-4cf84ff266c49aaede8a58b7: start","job_status":"start","queue_duration_s":0.862864,"scheduling_latency_s":0.862918}1311gitlab # [ 145.902108] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:26.079Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"4cf84ff266c49aaede8a58b7","created_at":"2026-08-20T05:48:25.158Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c3ec116a2973e35666a95535d5199bf6","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.172Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-4cf84ff266c49aaede8a58b7: done: 0.044933 sec","job_status":"done","queue_duration_s":0.862864,"scheduling_latency_s":0.862918,"redis_calls":12,"redis_duration_s":0.003265,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000497,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001539,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001229,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000749816,"exclusive_lock_hold_duration_s":0.003724217,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.044933,"completed_at":"2026-08-20T05:48:26.079Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001516,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1312gitlab # [ 145.924457] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:26.082Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"79a6550705e3d1521083dfd0","created_at":"2026-08-20T05:48:25.207Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"de2539d7c9d2ab32fb2e17fdf429ae86","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:48:25.218Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-79a6550705e3d1521083dfd0: start","job_status":"start","queue_duration_s":0.864039,"scheduling_latency_s":0.86407}1313gitlab # [ 145.943872] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:26.122Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"79a6550705e3d1521083dfd0","created_at":"2026-08-20T05:48:25.207Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"de2539d7c9d2ab32fb2e17fdf429ae86","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:48:25.218Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-79a6550705e3d1521083dfd0: done: 0.039834 sec","job_status":"done","queue_duration_s":0.864039,"scheduling_latency_s":0.86407,"redis_calls":10,"redis_duration_s":0.00349,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00065,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002149,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000691,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023893,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000439721,"duration_s":0.039834,"completed_at":"2026-08-20T05:48:26.122Z","load_balancing_strategy":"primary","db_duration_s":0.005226,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1314gitlab # [ 145.988666] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:26.127Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"f23e79df95c8c1d563d65819","created_at":"2026-08-20T05:48:25.250Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"51f16e97e6affc5d296445a70d22a620","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:48:25.259Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-f23e79df95c8c1d563d65819: start","job_status":"start","queue_duration_s":0.867921,"scheduling_latency_s":0.867937}1315gitlab # [ 145.990287] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:26.135Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1316gitlab # [ 145.991062] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:26.140Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"f23e79df95c8c1d563d65819","created_at":"2026-08-20T05:48:25.250Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"51f16e97e6affc5d296445a70d22a620","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:48:25.259Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-f23e79df95c8c1d563d65819: done: 0.01274 sec","job_status":"done","queue_duration_s":0.867921,"scheduling_latency_s":0.867937,"redis_calls":10,"redis_duration_s":0.002017,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000415,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001208,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000394,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006776,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000253384,"duration_s":0.01274,"completed_at":"2026-08-20T05:48:26.140Z","load_balancing_strategy":"primary","db_duration_s":0.00051,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1317gitlab # [ 146.007171] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:26.141Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"23533fd04bc2069d5fae5931","created_at":"2026-08-20T05:48:25.268Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ca5e5c6c6ec764f7c8183897ac1191af","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.280Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-23533fd04bc2069d5fae5931: start","job_status":"start","queue_duration_s":0.861057,"scheduling_latency_s":0.86107}1318gitlab # [ 146.044855] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:26.155Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"23533fd04bc2069d5fae5931","created_at":"2026-08-20T05:48:25.268Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ca5e5c6c6ec764f7c8183897ac1191af","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.280Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-23533fd04bc2069d5fae5931: done: 0.014057 sec","job_status":"done","queue_duration_s":0.861057,"scheduling_latency_s":0.86107,"redis_calls":12,"redis_duration_s":0.002533,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000854,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001219,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00046,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007755,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000292495,"duration_s":0.014057,"completed_at":"2026-08-20T05:48:26.155Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000795,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1319gitlab # [ 146.055566] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:26.156Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"0c97a8b2451b514d98e3b942","created_at":"2026-08-20T05:48:25.289Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d7cd8a46b2d441b89352a91063497e0","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.302Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-0c97a8b2451b514d98e3b942: start","job_status":"start","queue_duration_s":0.85456,"scheduling_latency_s":0.854573}1320gitlab # [ 146.068143] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:26.193Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"0c97a8b2451b514d98e3b942","created_at":"2026-08-20T05:48:25.289Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d7cd8a46b2d441b89352a91063497e0","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.302Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-0c97a8b2451b514d98e3b942: done: 0.037228 sec","job_status":"done","queue_duration_s":0.85456,"scheduling_latency_s":0.854573,"redis_calls":16,"redis_duration_s":0.007135,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.005495,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00121,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00043,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013289,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000279644,"duration_s":0.037228,"completed_at":"2026-08-20T05:48:26.193Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014148,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1321gitlab # [ 146.115824] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:26.195Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"a551f6cd0ca2fea602565615","created_at":"2026-08-20T05:48:25.318Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2924e74fa12c4fd1a850c49fa389e42c","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.327Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-a551f6cd0ca2fea602565615: start","job_status":"start","queue_duration_s":0.867552,"scheduling_latency_s":0.867566}1322gitlab # [ 146.116624] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:26.221Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"a551f6cd0ca2fea602565615","created_at":"2026-08-20T05:48:25.318Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2924e74fa12c4fd1a850c49fa389e42c","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.327Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-a551f6cd0ca2fea602565615: done: 0.026508 sec","job_status":"done","queue_duration_s":0.867552,"scheduling_latency_s":0.867566,"redis_calls":10,"redis_duration_s":0.002191,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000408,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001357,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000426,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009124,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000270146,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.026508,"completed_at":"2026-08-20T05:48:26.221Z","load_balancing_strategy":"primary","db_duration_s":0.012066,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1323gitlab # [ 146.155851] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:26.222Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"5d63febb4188d40552b4aed9","created_at":"2026-08-20T05:48:25.351Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab653571b613149a60a51a75174c354c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.359Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-5d63febb4188d40552b4aed9: start","job_status":"start","queue_duration_s":0.862982,"scheduling_latency_s":0.862996}1324gitlab # [ 146.237815] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:26.415Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"5d63febb4188d40552b4aed9","created_at":"2026-08-20T05:48:25.351Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab653571b613149a60a51a75174c354c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.359Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-5d63febb4188d40552b4aed9: done: 0.192877 sec","job_status":"done","queue_duration_s":0.862982,"scheduling_latency_s":0.862996,"redis_calls":14,"redis_duration_s":0.007693,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00233,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003118,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002245,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024617,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000669918,"exclusive_lock_hold_duration_s":0.163378306,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.192877,"completed_at":"2026-08-20T05:48:26.415Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.152911,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1325gitlab # [ 146.276789] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:26.455Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"adc27757be95a25fa8361331","created_at":"2026-08-20T05:48:25.375Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a30810e5e27e10585a11526a2aea27ce","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.382Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-adc27757be95a25fa8361331: start","job_status":"start","queue_duration_s":1.072153,"scheduling_latency_s":1.072196}1326gitlab # [ 146.330554] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:26.508Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"adc27757be95a25fa8361331","created_at":"2026-08-20T05:48:25.375Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a30810e5e27e10585a11526a2aea27ce","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.382Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-adc27757be95a25fa8361331: done: 0.053418 sec","job_status":"done","queue_duration_s":1.072153,"scheduling_latency_s":1.072196,"redis_calls":12,"redis_duration_s":0.0036959999999999996,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000678,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001715,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001303,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028488,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00083139,"exclusive_lock_hold_duration_s":0.016662732,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.053418,"completed_at":"2026-08-20T05:48:26.508Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013205,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1327gitlab # [ 146.368363] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:26.546Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"a2b0bb1c35e77562c4461b5b","created_at":"2026-08-20T05:48:25.391Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"91208f5cc8d720b12bfc9bcfae5ebe78","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.400Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-a2b0bb1c35e77562c4461b5b: start","job_status":"start","queue_duration_s":1.145865,"scheduling_latency_s":1.14591}1328gitlab # [ 146.649388] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:26.827Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"a2b0bb1c35e77562c4461b5b","created_at":"2026-08-20T05:48:25.391Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"91208f5cc8d720b12bfc9bcfae5ebe78","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.400Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-a2b0bb1c35e77562c4461b5b: done: 0.281036 sec","job_status":"done","queue_duration_s":1.145865,"scheduling_latency_s":1.14591,"redis_calls":565,"redis_duration_s":0.094662,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000767,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001369,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.092526,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.210379,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000233549,"duration_s":0.281036,"completed_at":"2026-08-20T05:48:26.827Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000787,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1329gitlab # [ 146.683633] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:26.862Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"ea62b26d5092fd35efb337b8","created_at":"2026-08-20T05:48:25.418Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.425Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-ea62b26d5092fd35efb337b8: start","job_status":"start","queue_duration_s":1.436885,"scheduling_latency_s":1.436909}1330gitlab # [ 146.801846] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:26.979Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"ea62b26d5092fd35efb337b8","created_at":"2026-08-20T05:48:25.418Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.425Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-ea62b26d5092fd35efb337b8: done: 0.117773 sec","job_status":"done","queue_duration_s":1.436885,"scheduling_latency_s":1.436909,"redis_calls":71,"redis_duration_s":0.015373000000000001,"redis_read_bytes":121,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.001245,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001122,"redis_queues_read_bytes":4,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.012462,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000544,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.091207,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000607899,"duration_s":0.117773,"completed_at":"2026-08-20T05:48:26.979Z","load_balancing_strategy":"primary","db_duration_s":0.002075,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1331gitlab # [ 146.804327] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:26.981Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"35101ce4cba848d44899dfe2","created_at":"2026-08-20T05:48:25.432Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7083d4d5a2614dbe2fc61c8c3960f747","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.441Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-35101ce4cba848d44899dfe2: start","job_status":"start","queue_duration_s":1.540649,"scheduling_latency_s":1.540665}1332gitlab # [ 146.870687] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:26.999Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"35101ce4cba848d44899dfe2","created_at":"2026-08-20T05:48:25.432Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7083d4d5a2614dbe2fc61c8c3960f747","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.441Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-35101ce4cba848d44899dfe2: done: 0.017249 sec","job_status":"done","queue_duration_s":1.540649,"scheduling_latency_s":1.540665,"redis_calls":10,"redis_duration_s":0.002155,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000428,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001245,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000482,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000226845,"duration_s":0.017249,"completed_at":"2026-08-20T05:48:26.999Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001846,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1333gitlab # [ 146.878362] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.000Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"d370117875105c8920dfdd38","created_at":"2026-08-20T05:48:25.453Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2db26e3eafd0dc73e67dd32ff62de785","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.458Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-d370117875105c8920dfdd38: start","job_status":"start","queue_duration_s":1.542097,"scheduling_latency_s":1.542111}1334gitlab # [ 146.889793] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.015Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"d370117875105c8920dfdd38","created_at":"2026-08-20T05:48:25.453Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2db26e3eafd0dc73e67dd32ff62de785","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.458Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-d370117875105c8920dfdd38: done: 0.015829 sec","job_status":"done","queue_duration_s":1.542097,"scheduling_latency_s":1.542111,"redis_calls":12,"redis_duration_s":0.00196,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000308,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000945,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000707,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009185,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000335797,"exclusive_lock_hold_duration_s":0.003838756,"duration_s":0.015829,"completed_at":"2026-08-20T05:48:27.015Z","load_balancing_strategy":"primary","db_duration_s":0.001602,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1335gitlab # [ 146.943096] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.017Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"a76739f99f48d15110cff80b","created_at":"2026-08-20T05:48:25.466Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"341d41975772cac6f1b02cb81856b431","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.479Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-a76739f99f48d15110cff80b: start","job_status":"start","queue_duration_s":1.537381,"scheduling_latency_s":1.537394}1336gitlab # [ 146.943765] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.108Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"a76739f99f48d15110cff80b","created_at":"2026-08-20T05:48:25.466Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"341d41975772cac6f1b02cb81856b431","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.479Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-a76739f99f48d15110cff80b: done: 0.091021 sec","job_status":"done","queue_duration_s":1.537381,"scheduling_latency_s":1.537394,"redis_calls":19,"redis_duration_s":0.002582,"redis_read_bytes":23,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000612,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000215,"redis_queues_read_bytes":4,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.001286,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000469,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.082142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000209245,"duration_s":0.091021,"completed_at":"2026-08-20T05:48:27.108Z","load_balancing_strategy":"primary","db_duration_s":0.001543,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1337gitlab # [ 146.968126] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.109Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"bbe3310a65b37b2ed0deffdc","created_at":"2026-08-20T05:48:25.488Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a906330c5cf612a886fbd00db1ca7927","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.501Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-bbe3310a65b37b2ed0deffdc: start","job_status":"start","queue_duration_s":1.607137,"scheduling_latency_s":1.607153}1338gitlab # [ 146.979977] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.116Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1339gitlab # [ 147.015584] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.121Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"bbe3310a65b37b2ed0deffdc","created_at":"2026-08-20T05:48:25.488Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a906330c5cf612a886fbd00db1ca7927","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.501Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-bbe3310a65b37b2ed0deffdc: done: 0.012679 sec","job_status":"done","queue_duration_s":1.607137,"scheduling_latency_s":1.607153,"redis_calls":10,"redis_duration_s":0.001165,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00023,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000701,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000234,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007052,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000186616,"duration_s":0.012679,"completed_at":"2026-08-20T05:48:27.121Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000258,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340gitlab # [ 147.016655] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.127Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"446935130a923d8052f077d9","created_at":"2026-08-20T05:48:25.513Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e70910366a039fb678d8ff5ba099951c","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.523Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-446935130a923d8052f077d9: start","job_status":"start","queue_duration_s":1.604048,"scheduling_latency_s":1.604062}1341gitlab # [ 147.060811] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.156Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"446935130a923d8052f077d9","created_at":"2026-08-20T05:48:25.513Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e70910366a039fb678d8ff5ba099951c","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.523Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-446935130a923d8052f077d9: done: 0.029107 sec","job_status":"done","queue_duration_s":1.604048,"scheduling_latency_s":1.604062,"redis_calls":10,"redis_duration_s":0.007652,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001235,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004647,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00177,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010403,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0009856,"duration_s":0.029107,"completed_at":"2026-08-20T05:48:27.156Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006724,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1342gitlab # [ 147.062161] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.158Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"a33e577a4fa96c7fa2f01417","created_at":"2026-08-20T05:48:25.547Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"650e8061ca3f31c6851094e9e434b2a4","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.569Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-a33e577a4fa96c7fa2f01417: start","job_status":"start","queue_duration_s":1.589527,"scheduling_latency_s":1.589542}1343gitlab # [ 147.108831] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.172Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"a33e577a4fa96c7fa2f01417","created_at":"2026-08-20T05:48:25.547Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"650e8061ca3f31c6851094e9e434b2a4","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.569Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-a33e577a4fa96c7fa2f01417: done: 0.013638 sec","job_status":"done","queue_duration_s":1.589527,"scheduling_latency_s":1.589542,"redis_calls":12,"redis_duration_s":0.001652,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000322,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000227,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000847,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000256,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007717,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000188571,"duration_s":0.013638,"completed_at":"2026-08-20T05:48:27.172Z","load_balancing_strategy":"primary","db_duration_s":0.000264,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 147.109951] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.173Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"fd8c362c27ab134a71aa44f4","created_at":"2026-08-20T05:48:25.586Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"43b349f4d3968360cbbde453441b28a4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.593Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-fd8c362c27ab134a71aa44f4: start","job_status":"start","queue_duration_s":1.579659,"scheduling_latency_s":1.579672}1345gitlab # [ 147.149507] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.180Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1346gitlab # [ 147.150200] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.185Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"fd8c362c27ab134a71aa44f4","created_at":"2026-08-20T05:48:25.586Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"43b349f4d3968360cbbde453441b28a4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.593Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-fd8c362c27ab134a71aa44f4: done: 0.012283 sec","job_status":"done","queue_duration_s":1.579659,"scheduling_latency_s":1.579672,"redis_calls":10,"redis_duration_s":0.001158,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000225,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000679,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000254,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007023,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000186615,"duration_s":0.012283,"completed_at":"2026-08-20T05:48:27.185Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00025,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347gitlab # [ 147.196698] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.186Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"71eb73c6d156462d54858557","created_at":"2026-08-20T05:48:25.597Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"30e491277530f02c7effee92dcb927c2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.615Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-71eb73c6d156462d54858557: start","job_status":"start","queue_duration_s":1.570867,"scheduling_latency_s":1.570881}1348gitlab # [ 147.197680] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.200Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"71eb73c6d156462d54858557","created_at":"2026-08-20T05:48:25.597Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"30e491277530f02c7effee92dcb927c2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.615Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-71eb73c6d156462d54858557: done: 0.01371 sec","job_status":"done","queue_duration_s":1.570867,"scheduling_latency_s":1.570881,"redis_calls":10,"redis_duration_s":0.0026420000000000003,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000223,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002194,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000225,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007202,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000616839,"duration_s":0.01371,"completed_at":"2026-08-20T05:48:27.200Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000219,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 147.237363] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.203Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"7c9a7d8a9609399c2293c6c5","created_at":"2026-08-20T05:48:25.633Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"07220268d1ddb91b306113509dc60244","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:48:25.651Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-7c9a7d8a9609399c2293c6c5: start","job_status":"start","queue_duration_s":1.551752,"scheduling_latency_s":1.551766}1350gitlab # [ 147.239057] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.210Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1351gitlab # [ 147.239813] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.215Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"7c9a7d8a9609399c2293c6c5","created_at":"2026-08-20T05:48:25.633Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"07220268d1ddb91b306113509dc60244","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:48:25.651Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-7c9a7d8a9609399c2293c6c5: done: 0.012249 sec","job_status":"done","queue_duration_s":1.551752,"scheduling_latency_s":1.551766,"redis_calls":10,"redis_duration_s":0.001137,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00025,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000661,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000226,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006936,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000188292,"duration_s":0.012249,"completed_at":"2026-08-20T05:48:27.215Z","load_balancing_strategy":"primary","db_duration_s":0.000291,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 147.291253] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.216Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"2c696d9d00865731c97c4fd4","created_at":"2026-08-20T05:48:25.669Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"08b6fcbfa598ab93a300109a2d6d9bce","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.682Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-2c696d9d00865731c97c4fd4: start","job_status":"start","queue_duration_s":1.533631,"scheduling_latency_s":1.533645}1353gitlab # [ 147.291839] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.223Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1354gitlab # [ 147.292463] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.227Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"2c696d9d00865731c97c4fd4","created_at":"2026-08-20T05:48:25.669Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"08b6fcbfa598ab93a300109a2d6d9bce","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.682Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-2c696d9d00865731c97c4fd4: done: 0.011398 sec","job_status":"done","queue_duration_s":1.533631,"scheduling_latency_s":1.533645,"redis_calls":10,"redis_duration_s":0.0012829999999999999,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000226,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000837,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00022,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006622,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000190247,"duration_s":0.011398,"completed_at":"2026-08-20T05:48:27.227Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000246,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1355gitlab # [ 147.316395] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.228Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"24bba79b46b211ff35bd0d27","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-24bba79b46b211ff35bd0d27: start","job_status":"start","queue_duration_s":1.485796,"scheduling_latency_s":1.48581}1356gitlab # [ 147.357083] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.256Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"24bba79b46b211ff35bd0d27","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-24bba79b46b211ff35bd0d27: done: 0.028012 sec","job_status":"done","queue_duration_s":1.485796,"scheduling_latency_s":1.48581,"redis_calls":13,"redis_duration_s":0.006194,"redis_read_bytes":12,"redis_write_bytes":1300,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000385,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":289,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000613,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":395,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.005196,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":616,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.008,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.008,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012699,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00020226,"duration_s":0.028012,"completed_at":"2026-08-20T05:48:27.256Z","load_balancing_strategy":"primary","db_duration_s":0.006221,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357gitlab # [ 147.361706] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.257Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f1238a909459ae37b009af27","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f1238a909459ae37b009af27: start","job_status":"start","queue_duration_s":1.514672,"scheduling_latency_s":1.514686}1358gitlab # [ 147.409933] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.269Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f1238a909459ae37b009af27","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f1238a909459ae37b009af27: done: 0.012099 sec","job_status":"done","queue_duration_s":1.514672,"scheduling_latency_s":1.514686,"redis_calls":10,"redis_duration_s":0.0014919999999999998,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00047,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001022,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007942,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012099,"completed_at":"2026-08-20T05:48:27.269Z","load_balancing_strategy":"primary","db_duration_s":0.000982,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1359gitlab # [ 147.410864] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.270Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ef9f85ef80df2e2094914cf3","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ef9f85ef80df2e2094914cf3: start","job_status":"start","queue_duration_s":1.527566,"scheduling_latency_s":1.527579}1360gitlab # [ 147.417298] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.281Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ef9f85ef80df2e2094914cf3","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ef9f85ef80df2e2094914cf3: done: 0.011446 sec","job_status":"done","queue_duration_s":1.527566,"scheduling_latency_s":1.527579,"redis_calls":10,"redis_duration_s":0.001217,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000492,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000725,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00784,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011446,"completed_at":"2026-08-20T05:48:27.281Z","load_balancing_strategy":"primary","db_duration_s":0.000921,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1361gitlab # [ 147.459612] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.282Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"4073c83c1ee4139409fa8a1b","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-4073c83c1ee4139409fa8a1b: start","job_status":"start","queue_duration_s":1.53998,"scheduling_latency_s":1.540006}1362gitlab # [ 147.461202] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.297Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"4073c83c1ee4139409fa8a1b","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-4073c83c1ee4139409fa8a1b: done: 0.014666 sec","job_status":"done","queue_duration_s":1.53998,"scheduling_latency_s":1.540006,"redis_calls":10,"redis_duration_s":0.004334,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000481,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003853,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007907,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014666,"completed_at":"2026-08-20T05:48:27.297Z","load_balancing_strategy":"primary","db_duration_s":0.000993,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363gitlab # [ 147.494836] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.298Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b82a77d20d5ee5145ce864f4","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b82a77d20d5ee5145ce864f4: start","job_status":"start","queue_duration_s":1.55565,"scheduling_latency_s":1.555663}1364gitlab # [ 147.537715] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.309Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b82a77d20d5ee5145ce864f4","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b82a77d20d5ee5145ce864f4: done: 0.011027 sec","job_status":"done","queue_duration_s":1.55565,"scheduling_latency_s":1.555663,"redis_calls":10,"redis_duration_s":0.001157,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000462,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000695,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007557,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011027,"completed_at":"2026-08-20T05:48:27.309Z","load_balancing_strategy":"primary","db_duration_s":0.000912,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 147.538612] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.310Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1443dc3b39447880cae79035","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1443dc3b39447880cae79035: start","job_status":"start","queue_duration_s":1.567647,"scheduling_latency_s":1.56766}1366gitlab # [ 147.544691] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.321Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1443dc3b39447880cae79035","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1443dc3b39447880cae79035: done: 0.011111 sec","job_status":"done","queue_duration_s":1.567647,"scheduling_latency_s":1.56766,"redis_calls":10,"redis_duration_s":0.001178,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000471,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000707,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007723,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011111,"completed_at":"2026-08-20T05:48:27.321Z","load_balancing_strategy":"primary","db_duration_s":0.000931,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367gitlab # [ 147.607690] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.322Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9691368607055cc6efc74772","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9691368607055cc6efc74772: start","job_status":"start","queue_duration_s":1.579755,"scheduling_latency_s":1.579768}1368gitlab # [ 147.608482] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.338Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9691368607055cc6efc74772","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9691368607055cc6efc74772: done: 0.015878 sec","job_status":"done","queue_duration_s":1.579755,"scheduling_latency_s":1.579768,"redis_calls":10,"redis_duration_s":0.0045320000000000004,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0011,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003432,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015878,"completed_at":"2026-08-20T05:48:27.338Z","load_balancing_strategy":"primary","db_duration_s":0.001812,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369gitlab # [ 147.615741] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.339Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8a03baec5e9e72ac6c31546b","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8a03baec5e9e72ac6c31546b: start","job_status":"start","queue_duration_s":1.596462,"scheduling_latency_s":1.596476}1370gitlab # [ 147.625496] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.350Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8a03baec5e9e72ac6c31546b","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8a03baec5e9e72ac6c31546b: done: 0.011489 sec","job_status":"done","queue_duration_s":1.596462,"scheduling_latency_s":1.596476,"redis_calls":10,"redis_duration_s":0.001171,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000455,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000716,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007822,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011489,"completed_at":"2026-08-20T05:48:27.350Z","load_balancing_strategy":"primary","db_duration_s":0.000919,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 147.668052] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.406Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"742bcf8720c65a0d6e38f774","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-742bcf8720c65a0d6e38f774: start","job_status":"start","queue_duration_s":1.663141,"scheduling_latency_s":1.663167}1372gitlab # [ 147.668657] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.425Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"742bcf8720c65a0d6e38f774","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-742bcf8720c65a0d6e38f774: done: 0.019829 sec","job_status":"done","queue_duration_s":1.663141,"scheduling_latency_s":1.663167,"redis_calls":10,"redis_duration_s":0.006734,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002682,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009268,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019829,"completed_at":"2026-08-20T05:48:27.425Z","load_balancing_strategy":"primary","db_duration_s":0.001431,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373gitlab # [ 147.706590] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.429Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"147dc12e4d2ed3e52f4d7e06","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-147dc12e4d2ed3e52f4d7e06: start","job_status":"start","queue_duration_s":1.686314,"scheduling_latency_s":1.68633}1374gitlab # [ 147.707169] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"147dc12e4d2ed3e52f4d7e06","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-147dc12e4d2ed3e52f4d7e06: done: 0.012419 sec","job_status":"done","queue_duration_s":1.686314,"scheduling_latency_s":1.68633,"redis_calls":10,"redis_duration_s":0.001162,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000487,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000675,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008027,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012419,"completed_at":"2026-08-20T05:48:27.441Z","load_balancing_strategy":"primary","db_duration_s":0.000986,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375gitlab # [ 147.735933] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.442Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0bed7e5148748d462e3c2b3e","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0bed7e5148748d462e3c2b3e: start","job_status":"start","queue_duration_s":1.699547,"scheduling_latency_s":1.69956}1376gitlab # [ 147.778602] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.453Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0bed7e5148748d462e3c2b3e","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0bed7e5148748d462e3c2b3e: done: 0.01083 sec","job_status":"done","queue_duration_s":1.699547,"scheduling_latency_s":1.69956,"redis_calls":10,"redis_duration_s":0.0011459999999999999,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000479,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000667,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007503,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01083,"completed_at":"2026-08-20T05:48:27.453Z","load_balancing_strategy":"primary","db_duration_s":0.000912,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 147.779608] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.454Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d5f05aa1e950ee1bd682e95f","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d5f05aa1e950ee1bd682e95f: start","job_status":"start","queue_duration_s":1.711619,"scheduling_latency_s":1.711633}1378gitlab # [ 147.785654] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.465Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d5f05aa1e950ee1bd682e95f","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d5f05aa1e950ee1bd682e95f: done: 0.010765 sec","job_status":"done","queue_duration_s":1.711619,"scheduling_latency_s":1.711633,"redis_calls":10,"redis_duration_s":0.001144,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000484,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00066,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007445,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010765,"completed_at":"2026-08-20T05:48:27.465Z","load_balancing_strategy":"primary","db_duration_s":0.000949,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 147.823960] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.466Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"cb39eeb846d6da213f528151","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-cb39eeb846d6da213f528151: start","job_status":"start","queue_duration_s":1.723319,"scheduling_latency_s":1.723333}1380gitlab # [ 147.825356] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.479Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"cb39eeb846d6da213f528151","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-cb39eeb846d6da213f528151: done: 0.013247 sec","job_status":"done","queue_duration_s":1.723319,"scheduling_latency_s":1.723333,"redis_calls":10,"redis_duration_s":0.0035199999999999997,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00139,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00213,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007594,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013247,"completed_at":"2026-08-20T05:48:27.479Z","load_balancing_strategy":"primary","db_duration_s":0.000905,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381gitlab # [ 147.875728] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.482Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b307cb9a6948e77ed957e059","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b307cb9a6948e77ed957e059: start","job_status":"start","queue_duration_s":1.739268,"scheduling_latency_s":1.739283}1382gitlab # [ 147.876483] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.499Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b307cb9a6948e77ed957e059","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b307cb9a6948e77ed957e059: done: 0.017777 sec","job_status":"done","queue_duration_s":1.739268,"scheduling_latency_s":1.739283,"redis_calls":10,"redis_duration_s":0.006533000000000001,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001825,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.004708,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017777,"completed_at":"2026-08-20T05:48:27.499Z","load_balancing_strategy":"primary","db_duration_s":0.000994,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383gitlab # [ 147.922421] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.500Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b202e02a7920f2c9770dd7e7","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b202e02a7920f2c9770dd7e7: start","job_status":"start","queue_duration_s":1.757858,"scheduling_latency_s":1.757871}1384gitlab # [ 147.923173] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.512Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b202e02a7920f2c9770dd7e7","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b202e02a7920f2c9770dd7e7: done: 0.011373 sec","job_status":"done","queue_duration_s":1.757858,"scheduling_latency_s":1.757871,"redis_calls":10,"redis_duration_s":0.001152,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000448,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000704,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007477,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011373,"completed_at":"2026-08-20T05:48:27.512Z","load_balancing_strategy":"primary","db_duration_s":0.000924,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 147.962717] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.512Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5d5c1cef62a1672fb8ad195b","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5d5c1cef62a1672fb8ad195b: start","job_status":"start","queue_duration_s":1.770007,"scheduling_latency_s":1.770021}1386gitlab # [ 147.963502] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.524Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5d5c1cef62a1672fb8ad195b","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5d5c1cef62a1672fb8ad195b: done: 0.011282 sec","job_status":"done","queue_duration_s":1.770007,"scheduling_latency_s":1.770021,"redis_calls":10,"redis_duration_s":0.001155,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000464,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000691,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007942,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011282,"completed_at":"2026-08-20T05:48:27.524Z","load_balancing_strategy":"primary","db_duration_s":0.0009,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387gitlab # [ 147.975823] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.524Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"758a1dfbd224d8ae90f66d4d","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-758a1dfbd224d8ae90f66d4d: start","job_status":"start","queue_duration_s":1.782055,"scheduling_latency_s":1.782095}1388gitlab # [ 147.985611] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.535Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"758a1dfbd224d8ae90f66d4d","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-758a1dfbd224d8ae90f66d4d: done: 0.010373 sec","job_status":"done","queue_duration_s":1.782055,"scheduling_latency_s":1.782095,"redis_calls":10,"redis_duration_s":0.001136,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000474,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000662,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0071,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010373,"completed_at":"2026-08-20T05:48:27.535Z","load_balancing_strategy":"primary","db_duration_s":0.000892,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389gitlab # [ 148.030075] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.540Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"63f8ddc185323d790b24a723","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-63f8ddc185323d790b24a723: start","job_status":"start","queue_duration_s":1.797788,"scheduling_latency_s":1.797803}1390gitlab # [ 148.030784] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.555Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"63f8ddc185323d790b24a723","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-63f8ddc185323d790b24a723: done: 0.015104 sec","job_status":"done","queue_duration_s":1.797788,"scheduling_latency_s":1.797803,"redis_calls":10,"redis_duration_s":0.003724,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00218,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007783,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015104,"completed_at":"2026-08-20T05:48:27.555Z","load_balancing_strategy":"primary","db_duration_s":0.000998,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1391gitlab # [ 148.066826] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.556Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"de0fb89571ffb552235b4bc5","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-de0fb89571ffb552235b4bc5: start","job_status":"start","queue_duration_s":1.8137,"scheduling_latency_s":1.813714}1392gitlab # [ 148.067518] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.567Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"de0fb89571ffb552235b4bc5","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-de0fb89571ffb552235b4bc5: done: 0.011162 sec","job_status":"done","queue_duration_s":1.8137,"scheduling_latency_s":1.813714,"redis_calls":10,"redis_duration_s":0.001343,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000624,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000719,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007626,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011162,"completed_at":"2026-08-20T05:48:27.567Z","load_balancing_strategy":"primary","db_duration_s":0.000949,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1393gitlab # [ 148.096710] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.568Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"137d3168319409cb0322f08f","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-137d3168319409cb0322f08f: start","job_status":"start","queue_duration_s":1.825759,"scheduling_latency_s":1.825772}1394gitlab # [ 148.139328] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.579Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"137d3168319409cb0322f08f","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-137d3168319409cb0322f08f: done: 0.010959 sec","job_status":"done","queue_duration_s":1.825759,"scheduling_latency_s":1.825772,"redis_calls":10,"redis_duration_s":0.001133,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000463,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00067,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007573,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010959,"completed_at":"2026-08-20T05:48:27.579Z","load_balancing_strategy":"primary","db_duration_s":0.000912,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1395gitlab # [ 148.140210] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.580Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9372b04639a1471d39239c0c","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9372b04639a1471d39239c0c: start","job_status":"start","queue_duration_s":1.837866,"scheduling_latency_s":1.83788}1396gitlab # [ 148.146478] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.595Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9372b04639a1471d39239c0c","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9372b04639a1471d39239c0c: done: 0.014628 sec","job_status":"done","queue_duration_s":1.837866,"scheduling_latency_s":1.83788,"redis_calls":10,"redis_duration_s":0.004896,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003916,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00098,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007543,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014628,"completed_at":"2026-08-20T05:48:27.595Z","load_balancing_strategy":"primary","db_duration_s":0.000927,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397gitlab # [ 148.188110] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.597Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"40be6580d948b87a5418544f","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-40be6580d948b87a5418544f: start","job_status":"start","queue_duration_s":1.854267,"scheduling_latency_s":1.854281}1398gitlab # [ 148.188775] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.608Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"40be6580d948b87a5418544f","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-40be6580d948b87a5418544f: done: 0.011878 sec","job_status":"done","queue_duration_s":1.854267,"scheduling_latency_s":1.854281,"redis_calls":10,"redis_duration_s":0.001222,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000496,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000726,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007589,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011878,"completed_at":"2026-08-20T05:48:27.608Z","load_balancing_strategy":"primary","db_duration_s":0.001025,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1399gitlab # [ 148.226073] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.609Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"418253f3dd38d3f601433faa","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-418253f3dd38d3f601433faa: start","job_status":"start","queue_duration_s":1.866907,"scheduling_latency_s":1.86692}1400gitlab # [ 148.226821] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.620Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"418253f3dd38d3f601433faa","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-418253f3dd38d3f601433faa: done: 0.010757 sec","job_status":"done","queue_duration_s":1.866907,"scheduling_latency_s":1.86692,"redis_calls":10,"redis_duration_s":0.001106,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000456,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00065,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007446,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010757,"completed_at":"2026-08-20T05:48:27.620Z","load_balancing_strategy":"primary","db_duration_s":0.000926,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401gitlab # [ 148.283982] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.621Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"971031164fdf3cc008d663ed","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-971031164fdf3cc008d663ed: start","job_status":"start","queue_duration_s":1.878795,"scheduling_latency_s":1.878808}1402gitlab # [ 148.284677] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.632Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"971031164fdf3cc008d663ed","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-971031164fdf3cc008d663ed: done: 0.010871 sec","job_status":"done","queue_duration_s":1.878795,"scheduling_latency_s":1.878808,"redis_calls":10,"redis_duration_s":0.001131,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000449,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000682,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007564,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010871,"completed_at":"2026-08-20T05:48:27.632Z","load_balancing_strategy":"primary","db_duration_s":0.00093,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403gitlab # [ 148.320744] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.633Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a62d25eac52ed86fce222384","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a62d25eac52ed86fce222384: start","job_status":"start","queue_duration_s":1.890477,"scheduling_latency_s":1.89049}1404gitlab # [ 148.321539] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.649Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a62d25eac52ed86fce222384","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a62d25eac52ed86fce222384: done: 0.015989 sec","job_status":"done","queue_duration_s":1.890477,"scheduling_latency_s":1.89049,"redis_calls":10,"redis_duration_s":0.006128,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0013,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.004828,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007748,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015989,"completed_at":"2026-08-20T05:48:27.649Z","load_balancing_strategy":"primary","db_duration_s":0.000928,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1405gitlab # [ 148.355990] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.652Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"369981c4896c9e44da4e2cad","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-369981c4896c9e44da4e2cad: start","job_status":"start","queue_duration_s":1.909282,"scheduling_latency_s":1.909296}1406gitlab # [ 148.356635] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.669Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"369981c4896c9e44da4e2cad","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-369981c4896c9e44da4e2cad: done: 0.017284 sec","job_status":"done","queue_duration_s":1.909282,"scheduling_latency_s":1.909296,"redis_calls":10,"redis_duration_s":0.006487,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002179,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.004308,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007407,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017284,"completed_at":"2026-08-20T05:48:27.669Z","load_balancing_strategy":"primary","db_duration_s":0.000983,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407gitlab # [ 148.391923] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.673Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ca76d38947cf101c36824f86","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ca76d38947cf101c36824f86: start","job_status":"start","queue_duration_s":1.930371,"scheduling_latency_s":1.930386}1408gitlab # [ 148.392573] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.687Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ca76d38947cf101c36824f86","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ca76d38947cf101c36824f86: done: 0.014532 sec","job_status":"done","queue_duration_s":1.930371,"scheduling_latency_s":1.930386,"redis_calls":10,"redis_duration_s":0.003665,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001578,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002087,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007855,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014532,"completed_at":"2026-08-20T05:48:27.687Z","load_balancing_strategy":"primary","db_duration_s":0.000976,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409gitlab # [ 148.427173] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.688Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d5662f92657cc73400032c9c","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d5662f92657cc73400032c9c: start","job_status":"start","queue_duration_s":1.945781,"scheduling_latency_s":1.945794}1410gitlab # [ 148.427726] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.699Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d5662f92657cc73400032c9c","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d5662f92657cc73400032c9c: done: 0.010921 sec","job_status":"done","queue_duration_s":1.945781,"scheduling_latency_s":1.945794,"redis_calls":10,"redis_duration_s":0.001156,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00045,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000706,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0075,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010921,"completed_at":"2026-08-20T05:48:27.699Z","load_balancing_strategy":"primary","db_duration_s":0.000922,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 148.475269] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.700Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"cd31f4d18bdf831639d9c85a","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-cd31f4d18bdf831639d9c85a: start","job_status":"start","queue_duration_s":1.957617,"scheduling_latency_s":1.95763}1412gitlab # [ 148.475881] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.711Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"cd31f4d18bdf831639d9c85a","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-cd31f4d18bdf831639d9c85a: done: 0.010745 sec","job_status":"done","queue_duration_s":1.957617,"scheduling_latency_s":1.95763,"redis_calls":10,"redis_duration_s":0.001161,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000475,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000686,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010745,"completed_at":"2026-08-20T05:48:27.711Z","load_balancing_strategy":"primary","db_duration_s":0.000908,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 148.525869] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"735c4ec4715b14e1048350a2","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-735c4ec4715b14e1048350a2: start","job_status":"start","queue_duration_s":1.969665,"scheduling_latency_s":1.969678}1414gitlab # [ 148.526526] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.729Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"735c4ec4715b14e1048350a2","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-735c4ec4715b14e1048350a2: done: 0.016927 sec","job_status":"done","queue_duration_s":1.969665,"scheduling_latency_s":1.969678,"redis_calls":10,"redis_duration_s":0.007079,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001312,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.005767,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007687,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016927,"completed_at":"2026-08-20T05:48:27.729Z","load_balancing_strategy":"primary","db_duration_s":0.001,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 148.563634] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.732Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"467cd71539f85a66a716017e","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-467cd71539f85a66a716017e: start","job_status":"start","queue_duration_s":1.989255,"scheduling_latency_s":1.98927}1416gitlab # [ 148.564302] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.750Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"467cd71539f85a66a716017e","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-467cd71539f85a66a716017e: done: 0.018274 sec","job_status":"done","queue_duration_s":1.989255,"scheduling_latency_s":1.98927,"redis_calls":10,"redis_duration_s":0.007304,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002873,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.004431,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007932,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018274,"completed_at":"2026-08-20T05:48:27.750Z","load_balancing_strategy":"primary","db_duration_s":0.00098,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417gitlab # [ 148.577282] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.752Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3eafa8bb721b2625cc7ee525","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3eafa8bb721b2625cc7ee525: start","job_status":"start","queue_duration_s":2.009856,"scheduling_latency_s":2.009869}1418gitlab # [ 148.587273] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.764Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3eafa8bb721b2625cc7ee525","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3eafa8bb721b2625cc7ee525: done: 0.011442 sec","job_status":"done","queue_duration_s":2.009856,"scheduling_latency_s":2.009869,"redis_calls":10,"redis_duration_s":0.00112,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000451,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000669,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007739,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011442,"completed_at":"2026-08-20T05:48:27.764Z","load_balancing_strategy":"primary","db_duration_s":0.000941,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 148.622729] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.764Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"08a29039e2be3b27a191607d","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-08a29039e2be3b27a191607d: start","job_status":"start","queue_duration_s":2.0221,"scheduling_latency_s":2.022113}1420gitlab # [ 148.658649] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.775Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"08a29039e2be3b27a191607d","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-08a29039e2be3b27a191607d: done: 0.011041 sec","job_status":"done","queue_duration_s":2.0221,"scheduling_latency_s":2.022113,"redis_calls":10,"redis_duration_s":0.001319,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000474,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000845,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007521,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011041,"completed_at":"2026-08-20T05:48:27.775Z","load_balancing_strategy":"primary","db_duration_s":0.001346,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421gitlab # [ 148.660051] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"31ebf6d84d74531b42ed96a0","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-31ebf6d84d74531b42ed96a0: start","job_status":"start","queue_duration_s":2.033887,"scheduling_latency_s":2.033901}1422gitlab # [ 148.695644] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.792Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"31ebf6d84d74531b42ed96a0","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-31ebf6d84d74531b42ed96a0: done: 0.015651 sec","job_status":"done","queue_duration_s":2.033887,"scheduling_latency_s":2.033901,"redis_calls":10,"redis_duration_s":0.005717000000000001,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003911,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001806,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007821,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015651,"completed_at":"2026-08-20T05:48:27.792Z","load_balancing_strategy":"primary","db_duration_s":0.000897,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423gitlab # [ 148.696721] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.794Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9bd94da0d182283d67a7f51d","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9bd94da0d182283d67a7f51d: start","job_status":"start","queue_duration_s":2.051879,"scheduling_latency_s":2.051893}1424gitlab # [ 148.707223] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.810Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9bd94da0d182283d67a7f51d","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9bd94da0d182283d67a7f51d: done: 0.015698 sec","job_status":"done","queue_duration_s":2.051879,"scheduling_latency_s":2.051893,"redis_calls":10,"redis_duration_s":0.005025,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002283,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002742,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008155,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015698,"completed_at":"2026-08-20T05:48:27.810Z","load_balancing_strategy":"primary","db_duration_s":0.000974,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 148.759705] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.812Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"eade5a6407984329fee56b7f","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-eade5a6407984329fee56b7f: start","job_status":"start","queue_duration_s":2.069832,"scheduling_latency_s":2.069847}1426gitlab # [ 148.760507] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.824Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"eade5a6407984329fee56b7f","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-eade5a6407984329fee56b7f: done: 0.012352 sec","job_status":"done","queue_duration_s":2.069832,"scheduling_latency_s":2.069847,"redis_calls":10,"redis_duration_s":0.002268,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000484,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001784,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012352,"completed_at":"2026-08-20T05:48:27.824Z","load_balancing_strategy":"primary","db_duration_s":0.00097,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427gitlab # [ 148.778946] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.825Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"28dca265958dc8b072414c0f","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-28dca265958dc8b072414c0f: start","job_status":"start","queue_duration_s":2.082964,"scheduling_latency_s":2.082977}1428gitlab # [ 148.816179] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.837Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"28dca265958dc8b072414c0f","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-28dca265958dc8b072414c0f: done: 0.011509 sec","job_status":"done","queue_duration_s":2.082964,"scheduling_latency_s":2.082977,"redis_calls":10,"redis_duration_s":0.001143,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000451,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000692,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007166,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011509,"completed_at":"2026-08-20T05:48:27.837Z","load_balancing_strategy":"primary","db_duration_s":0.000938,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1429gitlab # [ 148.818113] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.838Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"2baacb06a4dd3ec6e6e10872","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-2baacb06a4dd3ec6e6e10872: start","job_status":"start","queue_duration_s":2.09529,"scheduling_latency_s":2.095304}1430gitlab # [ 148.861038] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.852Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"2baacb06a4dd3ec6e6e10872","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-2baacb06a4dd3ec6e6e10872: done: 0.014588 sec","job_status":"done","queue_duration_s":2.09529,"scheduling_latency_s":2.095304,"redis_calls":10,"redis_duration_s":0.004692,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003496,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001196,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007748,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014588,"completed_at":"2026-08-20T05:48:27.852Z","load_balancing_strategy":"primary","db_duration_s":0.001021,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1431gitlab # [ 148.861855] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.853Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"2863030e2cce6c4af4330fe9","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-2863030e2cce6c4af4330fe9: start","job_status":"start","queue_duration_s":2.1107,"scheduling_latency_s":2.110714}1432gitlab # [ 148.867523] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.864Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"2863030e2cce6c4af4330fe9","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-2863030e2cce6c4af4330fe9: done: 0.011008 sec","job_status":"done","queue_duration_s":2.1107,"scheduling_latency_s":2.110714,"redis_calls":10,"redis_duration_s":0.001124,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00045,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000674,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007635,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011008,"completed_at":"2026-08-20T05:48:27.864Z","load_balancing_strategy":"primary","db_duration_s":0.000964,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433gitlab # [ 148.913563] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.865Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"38eac201a97498764f956c66","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-38eac201a97498764f956c66: start","job_status":"start","queue_duration_s":2.122843,"scheduling_latency_s":2.122857}1434gitlab # [ 148.914405] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.876Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"38eac201a97498764f956c66","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-38eac201a97498764f956c66: done: 0.010923 sec","job_status":"done","queue_duration_s":2.122843,"scheduling_latency_s":2.122857,"redis_calls":10,"redis_duration_s":0.001149,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000451,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000698,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007621,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010923,"completed_at":"2026-08-20T05:48:27.876Z","load_balancing_strategy":"primary","db_duration_s":0.000922,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435gitlab # [ 148.948531] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.877Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f65d6d212fa54dfdebea0de2","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f65d6d212fa54dfdebea0de2: start","job_status":"start","queue_duration_s":2.134568,"scheduling_latency_s":2.134581}1436gitlab # [ 148.949235] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.891Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f65d6d212fa54dfdebea0de2","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f65d6d212fa54dfdebea0de2: done: 0.013873 sec","job_status":"done","queue_duration_s":2.134568,"scheduling_latency_s":2.134581,"redis_calls":10,"redis_duration_s":0.004471,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002956,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001515,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007469,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013873,"completed_at":"2026-08-20T05:48:27.891Z","load_balancing_strategy":"primary","db_duration_s":0.000928,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437gitlab # [ 149.003175] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.894Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"933dfa3d895781432d685ee7","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-933dfa3d895781432d685ee7: start","job_status":"start","queue_duration_s":2.15129,"scheduling_latency_s":2.151305}1438gitlab # [ 149.003829] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.911Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"933dfa3d895781432d685ee7","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-933dfa3d895781432d685ee7: done: 0.017231 sec","job_status":"done","queue_duration_s":2.15129,"scheduling_latency_s":2.151305,"redis_calls":10,"redis_duration_s":0.006537,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002463,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.004074,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007428,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017231,"completed_at":"2026-08-20T05:48:27.911Z","load_balancing_strategy":"primary","db_duration_s":0.000996,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439gitlab # [ 149.040250] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.914Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"57eefad3257d1c94cfe84e99","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-57eefad3257d1c94cfe84e99: start","job_status":"start","queue_duration_s":2.171985,"scheduling_latency_s":2.172006}1440gitlab # [ 149.040943] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.928Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"57eefad3257d1c94cfe84e99","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-57eefad3257d1c94cfe84e99: done: 0.013758 sec","job_status":"done","queue_duration_s":2.171985,"scheduling_latency_s":2.172006,"redis_calls":10,"redis_duration_s":0.0037270000000000003,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002171,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007725,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013758,"completed_at":"2026-08-20T05:48:27.928Z","load_balancing_strategy":"primary","db_duration_s":0.000977,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441gitlab # [ 149.082108] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.929Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"20cfd318a0cf451bd3f87dde","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-20cfd318a0cf451bd3f87dde: start","job_status":"start","queue_duration_s":2.186643,"scheduling_latency_s":2.186656}1442gitlab # [ 149.082843] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.940Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"20cfd318a0cf451bd3f87dde","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-20cfd318a0cf451bd3f87dde: done: 0.010897 sec","job_status":"done","queue_duration_s":2.186643,"scheduling_latency_s":2.186656,"redis_calls":10,"redis_duration_s":0.001129,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000453,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000676,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007545,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010897,"completed_at":"2026-08-20T05:48:27.940Z","load_balancing_strategy":"primary","db_duration_s":0.000898,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1443gitlab # [ 149.095561] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.941Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7f16024a802c58d9f82661f9","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7f16024a802c58d9f82661f9: start","job_status":"start","queue_duration_s":2.198399,"scheduling_latency_s":2.198413}1444gitlab # [ 149.131505] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.952Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7f16024a802c58d9f82661f9","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7f16024a802c58d9f82661f9: done: 0.010969 sec","job_status":"done","queue_duration_s":2.198399,"scheduling_latency_s":2.198413,"redis_calls":10,"redis_duration_s":0.001206,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000481,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000725,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007131,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010969,"completed_at":"2026-08-20T05:48:27.952Z","load_balancing_strategy":"primary","db_duration_s":0.000993,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445gitlab # [ 149.134967] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.952Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5015ee21a4300d60546909d9","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5015ee21a4300d60546909d9: start","job_status":"start","queue_duration_s":2.210155,"scheduling_latency_s":2.210168}1446gitlab # [ 149.171511] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.970Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5015ee21a4300d60546909d9","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5015ee21a4300d60546909d9: done: 0.017068 sec","job_status":"done","queue_duration_s":2.210155,"scheduling_latency_s":2.210168,"redis_calls":10,"redis_duration_s":0.00734,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001404,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.005936,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007563,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017068,"completed_at":"2026-08-20T05:48:27.970Z","load_balancing_strategy":"primary","db_duration_s":0.000959,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1447gitlab # [ 149.174551] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.970Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5da293a0ec476afc2b82a26a","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5da293a0ec476afc2b82a26a: start","job_status":"start","queue_duration_s":2.228053,"scheduling_latency_s":2.228089}1448gitlab # [ 149.217133] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.981Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5da293a0ec476afc2b82a26a","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5da293a0ec476afc2b82a26a: done: 0.010708 sec","job_status":"done","queue_duration_s":2.228053,"scheduling_latency_s":2.228089,"redis_calls":10,"redis_duration_s":0.00117,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000471,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000699,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007376,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010708,"completed_at":"2026-08-20T05:48:27.981Z","load_balancing_strategy":"primary","db_duration_s":0.000942,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449gitlab # [ 149.218540] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.982Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1b1fb98a90da014eadd85e7e","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1b1fb98a90da014eadd85e7e: start","job_status":"start","queue_duration_s":2.23956,"scheduling_latency_s":2.239573}1450gitlab # [ 149.224539] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.993Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1b1fb98a90da014eadd85e7e","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1b1fb98a90da014eadd85e7e: done: 0.01078 sec","job_status":"done","queue_duration_s":2.23956,"scheduling_latency_s":2.239573,"redis_calls":10,"redis_duration_s":0.001186,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000669,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007375,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01078,"completed_at":"2026-08-20T05:48:27.993Z","load_balancing_strategy":"primary","db_duration_s":0.000926,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 149.265774] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:27.993Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"189e8363531fd7f2f24a9e38","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-189e8363531fd7f2f24a9e38: start","job_status":"start","queue_duration_s":2.251142,"scheduling_latency_s":2.251155}1452gitlab # [ 149.266569] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.007Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"189e8363531fd7f2f24a9e38","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-189e8363531fd7f2f24a9e38: done: 0.013422 sec","job_status":"done","queue_duration_s":2.251142,"scheduling_latency_s":2.251155,"redis_calls":10,"redis_duration_s":0.0039109999999999995,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002714,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001197,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007382,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013422,"completed_at":"2026-08-20T05:48:28.007Z","load_balancing_strategy":"primary","db_duration_s":0.000993,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453gitlab # [ 149.296505] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.010Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"62f5baaf13016c9da6ae3107","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-62f5baaf13016c9da6ae3107: start","job_status":"start","queue_duration_s":2.267349,"scheduling_latency_s":2.267364}1454gitlab # [ 149.337573] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.024Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"62f5baaf13016c9da6ae3107","created_at":"2026-08-20T05:48:25.649Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a1f30dc0ae454ef8","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b415c54b8aa59476624907e3d8a23a73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:25.742Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-62f5baaf13016c9da6ae3107: done: 0.014439 sec","job_status":"done","queue_duration_s":2.267349,"scheduling_latency_s":2.267364,"redis_calls":10,"redis_duration_s":0.003587,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001587,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007784,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014439,"completed_at":"2026-08-20T05:48:28.024Z","load_balancing_strategy":"primary","db_duration_s":0.000976,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455gitlab # [ 149.338580] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.025Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f06ab56fbc3a49793d769b7","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f06ab56fbc3a49793d769b7: start","job_status":"start","queue_duration_s":1.054888,"scheduling_latency_s":1.054902}1456gitlab # [ 149.345869] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.039Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f06ab56fbc3a49793d769b7","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f06ab56fbc3a49793d769b7: done: 0.01419 sec","job_status":"done","queue_duration_s":1.054888,"scheduling_latency_s":1.054902,"redis_calls":16,"redis_duration_s":0.001828,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00027,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001019,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008065,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000220419,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01419,"completed_at":"2026-08-20T05:48:28.039Z","load_balancing_strategy":"primary","db_duration_s":0.000343,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457gitlab # [ 149.381163] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.040Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ec10a1791886f4b2e3d91a88","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ec10a1791886f4b2e3d91a88: start","job_status":"start","queue_duration_s":1.06995,"scheduling_latency_s":1.069962}1458gitlab # [ 149.417582] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.050Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ec10a1791886f4b2e3d91a88","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ec10a1791886f4b2e3d91a88: done: 0.009662 sec","job_status":"done","queue_duration_s":1.06995,"scheduling_latency_s":1.069962,"redis_calls":13,"redis_duration_s":0.001356,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000434,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000922,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005998,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009662,"completed_at":"2026-08-20T05:48:28.050Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459gitlab # [ 149.418790] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.050Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb4a299cf863e56994c6af5e","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb4a299cf863e56994c6af5e: start","job_status":"start","queue_duration_s":1.080404,"scheduling_latency_s":1.080417}1460gitlab # [ 149.428641] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.069Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb4a299cf863e56994c6af5e","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb4a299cf863e56994c6af5e: done: 0.018437 sec","job_status":"done","queue_duration_s":1.080404,"scheduling_latency_s":1.080417,"redis_calls":13,"redis_duration_s":0.010199,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003983,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006216,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006698,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018437,"completed_at":"2026-08-20T05:48:28.069Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1461gitlab # [ 149.463660] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.070Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6473bdc1bd960898de7dc428","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6473bdc1bd960898de7dc428: start","job_status":"start","queue_duration_s":1.099684,"scheduling_latency_s":1.099698}1462gitlab # [ 149.469136] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.079Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6473bdc1bd960898de7dc428","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6473bdc1bd960898de7dc428: done: 0.009022 sec","job_status":"done","queue_duration_s":1.099684,"scheduling_latency_s":1.099698,"redis_calls":13,"redis_duration_s":0.001382,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000456,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000926,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006044,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009022,"completed_at":"2026-08-20T05:48:28.079Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463gitlab # [ 149.505992] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.080Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8b5ece1f230871cf566c70e","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8b5ece1f230871cf566c70e: start","job_status":"start","queue_duration_s":1.109502,"scheduling_latency_s":1.109516}1464gitlab # [ 149.509933] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.089Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8b5ece1f230871cf566c70e","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8b5ece1f230871cf566c70e: done: 0.009013 sec","job_status":"done","queue_duration_s":1.109502,"scheduling_latency_s":1.109516,"redis_calls":13,"redis_duration_s":0.001381,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000456,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000925,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006083,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009013,"completed_at":"2026-08-20T05:48:28.089Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1465gitlab # [ 149.544514] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.089Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ec5966ae30306c9ebe32dd5e","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ec5966ae30306c9ebe32dd5e: start","job_status":"start","queue_duration_s":1.11933,"scheduling_latency_s":1.119368}1466gitlab # [ 149.583697] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.098Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ec5966ae30306c9ebe32dd5e","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ec5966ae30306c9ebe32dd5e: done: 0.009093 sec","job_status":"done","queue_duration_s":1.11933,"scheduling_latency_s":1.119368,"redis_calls":13,"redis_duration_s":0.001338,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000436,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000902,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005949,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009093,"completed_at":"2026-08-20T05:48:28.098Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1467gitlab # [ 149.584586] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.099Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b590e2732ec45c2d048c5a06","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b590e2732ec45c2d048c5a06: start","job_status":"start","queue_duration_s":1.1292,"scheduling_latency_s":1.129212}1468gitlab # [ 149.622726] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.113Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b590e2732ec45c2d048c5a06","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b590e2732ec45c2d048c5a06: done: 0.013559 sec","job_status":"done","queue_duration_s":1.1292,"scheduling_latency_s":1.129212,"redis_calls":13,"redis_duration_s":0.002506,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001216,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00129,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006193,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013559,"completed_at":"2026-08-20T05:48:28.113Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1469gitlab # [ 149.623597] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.114Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"393ed9368e60663c779da7c8","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-393ed9368e60663c779da7c8: start","job_status":"start","queue_duration_s":1.143568,"scheduling_latency_s":1.143582}1470gitlab # [ 149.632394] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.123Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"393ed9368e60663c779da7c8","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-393ed9368e60663c779da7c8: done: 0.008928 sec","job_status":"done","queue_duration_s":1.143568,"scheduling_latency_s":1.143582,"redis_calls":13,"redis_duration_s":0.001401,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000472,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000929,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00598,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008928,"completed_at":"2026-08-20T05:48:28.122Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1471gitlab # [ 149.664430] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.123Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28165d098a67b6cf6bb5615a","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28165d098a67b6cf6bb5615a: start","job_status":"start","queue_duration_s":1.153269,"scheduling_latency_s":1.15329}1472gitlab # [ 149.700968] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.132Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28165d098a67b6cf6bb5615a","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28165d098a67b6cf6bb5615a: done: 0.008864 sec","job_status":"done","queue_duration_s":1.153269,"scheduling_latency_s":1.15329,"redis_calls":13,"redis_duration_s":0.0013059999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000432,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000874,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008864,"completed_at":"2026-08-20T05:48:28.132Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1473gitlab # [ 149.705436] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.133Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"885590287b91eafba7b5b41d","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-885590287b91eafba7b5b41d: start","job_status":"start","queue_duration_s":1.16293,"scheduling_latency_s":1.162942}1474gitlab # [ 149.742625] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"885590287b91eafba7b5b41d","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-885590287b91eafba7b5b41d: done: 0.013175 sec","job_status":"done","queue_duration_s":1.16293,"scheduling_latency_s":1.162942,"redis_calls":13,"redis_duration_s":0.00526,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004372,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000888,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013175,"completed_at":"2026-08-20T05:48:28.146Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1475gitlab # [ 149.745905] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.150Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e66d145132f3554005ee882d","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e66d145132f3554005ee882d: start","job_status":"start","queue_duration_s":1.179632,"scheduling_latency_s":1.179647}1476gitlab # [ 149.788648] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.168Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e66d145132f3554005ee882d","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e66d145132f3554005ee882d: done: 0.018219 sec","job_status":"done","queue_duration_s":1.179632,"scheduling_latency_s":1.179647,"redis_calls":13,"redis_duration_s":0.009434999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002157,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007278,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00658,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018219,"completed_at":"2026-08-20T05:48:28.168Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1477gitlab # [ 149.789591] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.171Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29fd81eb52aec42a3baa42f0","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29fd81eb52aec42a3baa42f0: start","job_status":"start","queue_duration_s":1.200541,"scheduling_latency_s":1.200556}1478gitlab # [ 149.798609] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.181Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29fd81eb52aec42a3baa42f0","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29fd81eb52aec42a3baa42f0: done: 0.010126 sec","job_status":"done","queue_duration_s":1.200541,"scheduling_latency_s":1.200556,"redis_calls":13,"redis_duration_s":0.00159,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000648,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000942,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006152,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010126,"completed_at":"2026-08-20T05:48:28.181Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1479gitlab # [ 149.852809] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.182Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ddeabe476059073e91530662","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ddeabe476059073e91530662: start","job_status":"start","queue_duration_s":1.211497,"scheduling_latency_s":1.21151}1480gitlab # [ 149.853618] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.191Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ddeabe476059073e91530662","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ddeabe476059073e91530662: done: 0.00901 sec","job_status":"done","queue_duration_s":1.211497,"scheduling_latency_s":1.21151,"redis_calls":13,"redis_duration_s":0.001363,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000453,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006092,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00901,"completed_at":"2026-08-20T05:48:28.191Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1481gitlab # [ 149.906862] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.191Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"339ad44417f70a14410e33bd","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-339ad44417f70a14410e33bd: start","job_status":"start","queue_duration_s":1.221423,"scheduling_latency_s":1.221436}1482gitlab # [ 149.907661] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.200Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"339ad44417f70a14410e33bd","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-339ad44417f70a14410e33bd: done: 0.008925 sec","job_status":"done","queue_duration_s":1.221423,"scheduling_latency_s":1.221436,"redis_calls":13,"redis_duration_s":0.001382,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00044,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000942,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006022,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008925,"completed_at":"2026-08-20T05:48:28.200Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1483gitlab # [ 149.947572] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.201Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a1c19fea38e24b3f2aa130cc","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a1c19fea38e24b3f2aa130cc: start","job_status":"start","queue_duration_s":1.23114,"scheduling_latency_s":1.231154}1484gitlab # [ 149.948147] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.213Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a1c19fea38e24b3f2aa130cc","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a1c19fea38e24b3f2aa130cc: done: 0.012007 sec","job_status":"done","queue_duration_s":1.23114,"scheduling_latency_s":1.231154,"redis_calls":13,"redis_duration_s":0.004327,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003371,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000956,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006114,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012007,"completed_at":"2026-08-20T05:48:28.213Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1485gitlab # [ 149.984075] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.214Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a302d236f19711893cc156a","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a302d236f19711893cc156a: start","job_status":"start","queue_duration_s":1.243979,"scheduling_latency_s":1.243992}1486gitlab # [ 149.984741] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.223Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a302d236f19711893cc156a","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a302d236f19711893cc156a: done: 0.008992 sec","job_status":"done","queue_duration_s":1.243979,"scheduling_latency_s":1.243992,"redis_calls":13,"redis_duration_s":0.0013319999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000433,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000899,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006016,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008992,"completed_at":"2026-08-20T05:48:28.223Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1487gitlab # [ 150.021982] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.224Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b17eb2856e838af8405de84d","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b17eb2856e838af8405de84d: start","job_status":"start","queue_duration_s":1.253768,"scheduling_latency_s":1.253782}1488gitlab # [ 150.022575] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.233Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b17eb2856e838af8405de84d","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b17eb2856e838af8405de84d: done: 0.008978 sec","job_status":"done","queue_duration_s":1.253768,"scheduling_latency_s":1.253782,"redis_calls":13,"redis_duration_s":0.001379,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000463,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005916,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008978,"completed_at":"2026-08-20T05:48:28.233Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1489gitlab # [ 150.042990] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.234Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c82296fd721718f6b4f9f6e","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c82296fd721718f6b4f9f6e: start","job_status":"start","queue_duration_s":1.263549,"scheduling_latency_s":1.263562}1490gitlab # [ 150.079860] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.243Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c82296fd721718f6b4f9f6e","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c82296fd721718f6b4f9f6e: done: 0.009056 sec","job_status":"done","queue_duration_s":1.263549,"scheduling_latency_s":1.263562,"redis_calls":13,"redis_duration_s":0.001361,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000467,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000894,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005798,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009056,"completed_at":"2026-08-20T05:48:28.243Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1491gitlab # [ 150.085278] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.243Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c642a3cf21b5127ebb95a25","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c642a3cf21b5127ebb95a25: start","job_status":"start","queue_duration_s":1.273407,"scheduling_latency_s":1.27342}1492gitlab # [ 150.121708] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.265Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c642a3cf21b5127ebb95a25","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c642a3cf21b5127ebb95a25: done: 0.02154 sec","job_status":"done","queue_duration_s":1.273407,"scheduling_latency_s":1.27342,"redis_calls":13,"redis_duration_s":0.00905,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001885,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007165,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00689,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02154,"completed_at":"2026-08-20T05:48:28.265Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1493gitlab # [ 150.127079] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.268Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d7bced14fe2d198e8a47ee8","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d7bced14fe2d198e8a47ee8: start","job_status":"start","queue_duration_s":1.297589,"scheduling_latency_s":1.297604}1494gitlab # [ 150.164212] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.284Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d7bced14fe2d198e8a47ee8","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d7bced14fe2d198e8a47ee8: done: 0.016334 sec","job_status":"done","queue_duration_s":1.297589,"scheduling_latency_s":1.297604,"redis_calls":13,"redis_duration_s":0.007578,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002267,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005311,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006277,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016334,"completed_at":"2026-08-20T05:48:28.284Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1495gitlab # [ 150.169633] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.285Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dbc230932111b61587a49b72","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dbc230932111b61587a49b72: start","job_status":"start","queue_duration_s":1.314773,"scheduling_latency_s":1.314788}1496gitlab # [ 150.179829] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.294Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dbc230932111b61587a49b72","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dbc230932111b61587a49b72: done: 0.009269 sec","job_status":"done","queue_duration_s":1.314773,"scheduling_latency_s":1.314788,"redis_calls":13,"redis_duration_s":0.001441,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00044,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006008,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009269,"completed_at":"2026-08-20T05:48:28.294Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1497gitlab # [ 150.226618] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.295Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f21aaa1a6911c57a18d93702","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f21aaa1a6911c57a18d93702: start","job_status":"start","queue_duration_s":1.325021,"scheduling_latency_s":1.325035}1498gitlab # [ 150.227529] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.304Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f21aaa1a6911c57a18d93702","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f21aaa1a6911c57a18d93702: done: 0.009154 sec","job_status":"done","queue_duration_s":1.325021,"scheduling_latency_s":1.325035,"redis_calls":13,"redis_duration_s":0.001418,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000446,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000972,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006045,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009154,"completed_at":"2026-08-20T05:48:28.304Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1499gitlab # [ 150.269706] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.305Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d82b892dd3ad8478c9fc098","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d82b892dd3ad8478c9fc098: start","job_status":"start","queue_duration_s":1.334982,"scheduling_latency_s":1.334996}1500gitlab # [ 150.270461] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.314Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d82b892dd3ad8478c9fc098","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d82b892dd3ad8478c9fc098: done: 0.009001 sec","job_status":"done","queue_duration_s":1.334982,"scheduling_latency_s":1.334996,"redis_calls":13,"redis_duration_s":0.001373,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000454,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000919,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006046,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009001,"completed_at":"2026-08-20T05:48:28.314Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1501gitlab # [ 150.323683] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.315Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5066674957fc0036912c092","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5066674957fc0036912c092: start","job_status":"start","queue_duration_s":1.344785,"scheduling_latency_s":1.344799}1502gitlab # [ 150.324483] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.333Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5066674957fc0036912c092","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5066674957fc0036912c092: done: 0.018624 sec","job_status":"done","queue_duration_s":1.344785,"scheduling_latency_s":1.344799,"redis_calls":13,"redis_duration_s":0.010827999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001833,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.008995,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006479,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018624,"completed_at":"2026-08-20T05:48:28.333Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1503gitlab # [ 150.343884] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.334Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"111d9d0b6698dd4a18f1543e","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-111d9d0b6698dd4a18f1543e: start","job_status":"start","queue_duration_s":1.364217,"scheduling_latency_s":1.364231}1504gitlab # [ 150.355299] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.343Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"111d9d0b6698dd4a18f1543e","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-111d9d0b6698dd4a18f1543e: done: 0.009039 sec","job_status":"done","queue_duration_s":1.364217,"scheduling_latency_s":1.364231,"redis_calls":13,"redis_duration_s":0.001347,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000435,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005889,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009039,"completed_at":"2026-08-20T05:48:28.343Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1505gitlab # [ 150.404297] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.344Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0be635658ab356b1239d69d2","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0be635658ab356b1239d69d2: start","job_status":"start","queue_duration_s":1.374254,"scheduling_latency_s":1.374267}1506gitlab # [ 150.404869] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.353Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0be635658ab356b1239d69d2","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artif[ 150.506593] sched: DL replenish lagged too much1507gitlab # acts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0be635658ab356b1239d69d2: done: 0.008989 sec","job_status":"done","queue_duration_s":1.374254,"scheduling_latency_s":1.374267,"redis_calls":13,"redis_duration_s":0.0014169999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000441,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000976,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006039,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008989,"completed_at":"2026-08-20T05:48:28.353Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1508gitlab # [ 150.434731] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.354Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b71398779d667d39a0b7a260","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b71398779d667d39a0b7a260: start","job_status":"start","queue_duration_s":1.384143,"scheduling_latency_s":1.384157}1509gitlab # [ 150.445646] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.363Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b71398779d667d39a0b7a260","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b71398779d667d39a0b7a260: done: 0.009102 sec","job_status":"done","queue_duration_s":1.384143,"scheduling_latency_s":1.384157,"redis_calls":13,"redis_duration_s":0.001392,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000443,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000949,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006121,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009102,"completed_at":"2026-08-20T05:48:28.363Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1510gitlab # [ 150.484194] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.364Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9656c2358c6e2790451963e8","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9656c2358c6e2790451963e8: start","job_status":"start","queue_duration_s":1.394053,"scheduling_latency_s":1.394067}1511gitlab # [ 150.525172] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.376Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9656c2358c6e2790451963e8","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9656c2358c6e2790451963e8: done: 0.012238 sec","job_status":"done","queue_duration_s":1.394053,"scheduling_latency_s":1.394067,"redis_calls":13,"redis_duration_s":0.004431,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000741,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00369,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006207,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012238,"completed_at":"2026-08-20T05:48:28.376Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1512gitlab # [ 150.526095] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.377Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3384b3c1f13b1dda635b92e9","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3384b3c1f13b1dda635b92e9: start","job_status":"start","queue_duration_s":1.407178,"scheduling_latency_s":1.407192}1513gitlab # [ 150.534242] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.386Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3384b3c1f13b1dda635b92e9","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3384b3c1f13b1dda635b92e9: done: 0.009084 sec","job_status":"done","queue_duration_s":1.407178,"scheduling_latency_s":1.407192,"redis_calls":13,"redis_duration_s":0.001363,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000433,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005906,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009084,"completed_at":"2026-08-20T05:48:28.386Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1514gitlab # [ 150.584297] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.387Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f7499d1be4d0a725097463c","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f7499d1be4d0a725097463c: start","job_status":"start","queue_duration_s":1.417181,"scheduling_latency_s":1.417194}1515gitlab # [ 150.584981] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.396Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f7499d1be4d0a725097463c","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f7499d1be4d0a725097463c: done: 0.008968 sec","job_status":"done","queue_duration_s":1.417181,"scheduling_latency_s":1.417194,"redis_calls":13,"redis_duration_s":0.00135,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000445,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000905,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006028,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008968,"completed_at":"2026-08-20T05:48:28.396Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1516gitlab # [ 150.637648] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.397Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"834880399b68c0e9bf8e5d7d","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-834880399b68c0e9bf8e5d7d: start","job_status":"start","queue_duration_s":1.427291,"scheduling_latency_s":1.427305}1517gitlab # [ 150.638481] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.411Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"834880399b68c0e9bf8e5d7d","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-834880399b68c0e9bf8e5d7d: done: 0.013591 sec","job_status":"done","queue_duration_s":1.427291,"scheduling_latency_s":1.427305,"redis_calls":13,"redis_duration_s":0.005834,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004318,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001516,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006172,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013591,"completed_at":"2026-08-20T05:48:28.411Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1518gitlab # [ 150.688217] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.414Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7701958fef2ef23f9d4cb50","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7701958fef2ef23f9d4cb50: start","job_status":"start","queue_duration_s":1.443645,"scheduling_latency_s":1.443659}1519gitlab # [ 150.688867] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.431Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7701958fef2ef23f9d4cb50","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7701958fef2ef23f9d4cb50: done: 0.01696 sec","job_status":"done","queue_duration_s":1.443645,"scheduling_latency_s":1.443659,"redis_calls":13,"redis_duration_s":0.008124000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001619,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006505,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00646,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01696,"completed_at":"2026-08-20T05:48:28.431Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1520gitlab # [ 150.698240] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.432Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21727228b1257ebb32e6b14f","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21727228b1257ebb32e6b14f: start","job_status":"start","queue_duration_s":1.461925,"scheduling_latency_s":1.46194}1521gitlab # [ 150.708819] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.442Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21727228b1257ebb32e6b14f","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21727228b1257ebb32e6b14f: done: 0.010439 sec","job_status":"done","queue_duration_s":1.461925,"scheduling_latency_s":1.46194,"redis_calls":13,"redis_duration_s":0.001363,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000444,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000919,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010439,"completed_at":"2026-08-20T05:48:28.442Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1522gitlab # [ 150.749063] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.443Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b3ca812abc9db29cf3011e01","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b3ca812abc9db29cf3011e01: start","job_status":"start","queue_duration_s":1.472839,"scheduling_latency_s":1.472852}1523gitlab # [ 150.750175] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.453Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b3ca812abc9db29cf3011e01","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b3ca812abc9db29cf3011e01: done: 0.010146 sec","job_status":"done","queue_duration_s":1.472839,"scheduling_latency_s":1.472852,"redis_calls":13,"redis_duration_s":0.001715,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000468,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001247,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006892,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010146,"completed_at":"2026-08-20T05:48:28.453Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1524gitlab # [ 150.785445] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.454Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"88c48f43d3d438a2d23bc2c4","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-88c48f43d3d438a2d23bc2c4: start","job_status":"start","queue_duration_s":1.483868,"scheduling_latency_s":1.483881}1525gitlab # [ 150.823767] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.467Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"88c48f43d3d438a2d23bc2c4","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-88c48f43d3d438a2d23bc2c4: done: 0.013265 sec","job_status":"done","queue_duration_s":1.483868,"scheduling_latency_s":1.483881,"redis_calls":13,"redis_duration_s":0.00453,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000485,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004045,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006536,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013265,"completed_at":"2026-08-20T05:48:28.467Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1526gitlab # [ 150.825142] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.468Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d23b22512994a613d3a580ed","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d23b22512994a613d3a580ed: start","job_status":"start","queue_duration_s":1.497956,"scheduling_latency_s":1.497969}1527gitlab # [ 150.831813] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.478Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d23b22512994a613d3a580ed","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d23b22512994a613d3a580ed: done: 0.010484 sec","job_status":"done","queue_duration_s":1.497956,"scheduling_latency_s":1.497969,"redis_calls":13,"redis_duration_s":0.0018419999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000632,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00121,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006657,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010484,"completed_at":"2026-08-20T05:48:28.478Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1528gitlab # [ 150.864796] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.479Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe3ceec8307a4cb96ff948d2","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe3ceec8307a4cb96ff948d2: start","job_status":"start","queue_duration_s":1.509322,"scheduling_latency_s":1.509335}1529gitlab # [ 150.874756] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.490Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe3ceec8307a4cb96ff948d2","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe3ceec8307a4cb96ff948d2: done: 0.01036 sec","job_status":"done","queue_duration_s":1.509322,"scheduling_latency_s":1.509335,"redis_calls":13,"redis_duration_s":0.00144,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000459,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000981,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00663,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01036,"completed_at":"2026-08-20T05:48:28.490Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1530gitlab # [ 150.928312] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.491Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a55aa4a2715c2217781bc3fd","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a55aa4a2715c2217781bc3fd: start","job_status":"start","queue_duration_s":1.520592,"scheduling_latency_s":1.520605}1531gitlab # [ 150.928932] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.502Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a55aa4a2715c2217781bc3fd","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a55aa4a2715c2217781bc3fd: done: 0.011245 sec","job_status":"done","queue_duration_s":1.520592,"scheduling_latency_s":1.520605,"redis_calls":13,"redis_duration_s":0.0027489999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000473,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002276,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006572,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011245,"completed_at":"2026-08-20T05:48:28.502Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1532gitlab # [ 150.972913] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.503Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d74a41f7eb668591ed554f0","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d74a41f7eb668591ed554f0: start","job_status":"start","queue_duration_s":1.532912,"scheduling_latency_s":1.532925}1533gitlab # [ 150.973581] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.513Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d74a41f7eb668591ed554f0","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d74a41f7eb668591ed554f0: done: 0.009895 sec","job_status":"done","queue_duration_s":1.532912,"scheduling_latency_s":1.532925,"redis_calls":13,"redis_duration_s":0.001352,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000438,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000914,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006629,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009895,"completed_at":"2026-08-20T05:48:28.513Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1534gitlab # [ 151.010920] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.514Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"246a2a9b97fe9f61eb510bee","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-246a2a9b97fe9f61eb510bee: start","job_status":"start","queue_duration_s":1.543882,"scheduling_latency_s":1.543895}1535gitlab # [ 151.011593] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.524Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"246a2a9b97fe9f61eb510bee","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-246a2a9b97fe9f61eb510bee: done: 0.009849 sec","job_status":"done","queue_duration_s":1.543882,"scheduling_latency_s":1.543895,"redis_calls":13,"redis_duration_s":0.001358,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00046,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000898,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006886,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009849,"completed_at":"2026-08-20T05:48:28.524Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1536gitlab # [ 151.047586] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.525Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23dc9dc3ea56ba12f4ab9fde","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23dc9dc3ea56ba12f4ab9fde: start","job_status":"start","queue_duration_s":1.554777,"scheduling_latency_s":1.554791}1537gitlab # [ 151.048160] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.535Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23dc9dc3ea56ba12f4ab9fde","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23dc9dc3ea56ba12f4ab9fde: done: 0.009843 sec","job_status":"done","queue_duration_s":1.554777,"scheduling_latency_s":1.554791,"redis_calls":13,"redis_duration_s":0.001333,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000442,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000891,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006861,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009843,"completed_at":"2026-08-20T05:48:28.535Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1538gitlab # [ 151.084846] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.536Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"768fe24aec0f8cdbbf41f673","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-768fe24aec0f8cdbbf41f673: start","job_status":"start","queue_duration_s":1.566444,"scheduling_latency_s":1.566458}1539gitlab # [ 151.085682] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.546Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"768fe24aec0f8cdbbf41f673","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-768fe24aec0f8cdbbf41f673: done: 0.010028 sec","job_status":"done","queue_duration_s":1.566444,"scheduling_latency_s":1.566458,"redis_calls":13,"redis_duration_s":0.001467,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000471,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010028,"completed_at":"2026-08-20T05:48:28.546Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1540gitlab # [ 151.106594] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.548Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e2a0b5282f2f48b8b27d67a5","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e2a0b5282f2f48b8b27d67a5: start","job_status":"start","queue_duration_s":1.577803,"scheduling_latency_s":1.577818}1541gitlab # [ 151.145727] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.558Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e2a0b5282f2f48b8b27d67a5","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e2a0b5282f2f48b8b27d67a5: done: 0.009993 sec","job_status":"done","queue_duration_s":1.577803,"scheduling_latency_s":1.577818,"redis_calls":13,"redis_duration_s":0.001398,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000462,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009993,"completed_at":"2026-08-20T05:48:28.558Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1542gitlab # [ 151.146919] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.559Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e2ddc936b856392fac47eacb","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e2ddc936b856392fac47eacb: start","job_status":"start","queue_duration_s":1.58859,"scheduling_latency_s":1.588604}1543gitlab # [ 151.156718] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.569Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e2ddc936b856392fac47eacb","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e2ddc936b856392fac47eacb: done: 0.010149 sec","job_status":"done","queue_duration_s":1.58859,"scheduling_latency_s":1.588604,"redis_calls":13,"redis_duration_s":0.001366,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000463,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006858,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010149,"completed_at":"2026-08-20T05:48:28.569Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1544gitlab # [ 151.192026] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.572Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41f21de3c4184ccf228f2f48","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41f21de3c4184ccf228f2f48: start","job_status":"start","queue_duration_s":1.601795,"scheduling_latency_s":1.60181}1545gitlab # [ 151.197596] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.581Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41f21de3c4184ccf228f2f48","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41f21de3c4184ccf228f2f48: done: 0.009143 sec","job_status":"done","queue_duration_s":1.601795,"scheduling_latency_s":1.60181,"redis_calls":13,"redis_duration_s":0.00136,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000444,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005949,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009143,"completed_at":"2026-08-20T05:48:28.581Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1546gitlab # [ 151.241594] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.582Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"891174fce959237ceeccbef5","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-891174fce959237ceeccbef5: start","job_status":"start","queue_duration_s":1.611785,"scheduling_latency_s":1.611799}1547gitlab # [ 151.242287] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.591Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"891174fce959237ceeccbef5","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-891174fce959237ceeccbef5: done: 0.008758 sec","job_status":"done","queue_duration_s":1.611785,"scheduling_latency_s":1.611799,"redis_calls":13,"redis_duration_s":0.001362,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000445,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005839,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008758,"completed_at":"2026-08-20T05:48:28.591Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1548gitlab # [ 151.286631] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.591Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6fd074eeceaa35b08685323","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6fd074eeceaa35b08685323: start","job_status":"start","queue_duration_s":1.621308,"scheduling_latency_s":1.621321}1549gitlab # [ 151.287203] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.600Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6fd074eeceaa35b08685323","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6fd074eeceaa35b08685323: done: 0.008775 sec","job_status":"done","queue_duration_s":1.621308,"scheduling_latency_s":1.621321,"redis_calls":13,"redis_duration_s":0.001382,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000433,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000949,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005877,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008775,"completed_at":"2026-08-20T05:48:28.600Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1550gitlab # [ 151.324473] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.601Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4bcb5fe796ee64f80c23a62b","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4bcb5fe796ee64f80c23a62b: start","job_status":"start","queue_duration_s":1.630912,"scheduling_latency_s":1.630924}1551gitlab # [ 151.325149] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.619Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4bcb5fe796ee64f80c23a62b","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4bcb5fe796ee64f80c23a62b: done: 0.017989 sec","job_status":"done","queue_duration_s":1.630912,"scheduling_latency_s":1.630924,"redis_calls":13,"redis_duration_s":0.010216,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001191,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.009025,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006214,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017989,"completed_at":"2026-08-20T05:48:28.619Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1552gitlab # [ 151.359398] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.620Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2a24b0d32080617f5e148962","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2a24b0d32080617f5e148962: start","job_status":"start","queue_duration_s":1.649748,"scheduling_latency_s":1.649763}1553gitlab # [ 151.359951] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.629Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2a24b0d32080617f5e148962","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2a24b0d32080617f5e148962: done: 0.008863 sec","job_status":"done","queue_duration_s":1.649748,"scheduling_latency_s":1.649763,"redis_calls":13,"redis_duration_s":0.001388,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000448,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005864,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008863,"completed_at":"2026-08-20T05:48:28.629Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1554gitlab # [ 151.389558] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.630Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11c7b5772eeee47758bd0286","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11c7b5772eeee47758bd0286: start","job_status":"start","queue_duration_s":1.659454,"scheduling_latency_s":1.659469}1555gitlab # [ 151.430679] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.638Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11c7b5772eeee47758bd0286","created_at":"2026-08-20T05:48:26.886Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-5e8da4224e894e1d","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a91b5e98779cb2eff577f8d698579d54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:26.970Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11c7b5772eeee47758bd0286: done: 0.008758 sec","job_status":"done","queue_duration_s":1.659454,"scheduling_latency_s":1.659469,"redis_calls":13,"redis_duration_s":0.0013419999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000432,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005892,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008758,"completed_at":"2026-08-20T05:48:28.638Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1556gitlab # [ 151.431557] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.639Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"aaeb1f6a40ee612eb6fd0d22","created_at":"2026-08-20T05:48:27.094Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-23fd989e40984613","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"341d41975772cac6f1b02cb81856b431","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:27.102Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-aaeb1f6a40ee612eb6fd0d22: start","job_status":"start","queue_duration_s":1.537052,"scheduling_latency_s":1.537066}1557gitlab # [ 151.439395] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.649Z","message":"No existing merge request to be cleaned up."}1558gitlab # [ 151.440515] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.662Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"aaeb1f6a40ee612eb6fd0d22","created_at":"2026-08-20T05:48:27.094Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-23fd989e40984613","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"341d41975772cac6f1b02cb81856b431","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:27.102Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-aaeb1f6a40ee612eb6fd0d22: done: 0.022925 sec","job_status":"done","queue_duration_s":1.537052,"scheduling_latency_s":1.537066,"redis_calls":13,"redis_duration_s":0.006971,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000286,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005393,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001292,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011301,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000983086,"duration_s":0.022925,"completed_at":"2026-08-20T05:48:28.662Z","load_balancing_strategy":"primary","db_duration_s":0.002434,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1559gitlab # [ 151.474576] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.665Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0f481e3d731a992340a8a368","created_at":"2026-08-20T05:48:27.094Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-23fd989e40984613","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"341d41975772cac6f1b02cb81856b431","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:27.102Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0f481e3d731a992340a8a368: start","job_status":"start","queue_duration_s":1.562632,"scheduling_latency_s":1.562646}1560gitlab # [ 151.510210] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.673Z","message":"No existing merge request to be cleaned up."}1561gitlab # [ 151.510921] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.678Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0f481e3d731a992340a8a368","created_at":"2026-08-20T05:48:27.094Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-23fd989e40984613","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"341d41975772cac6f1b02cb81856b431","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:27.102Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0f481e3d731a992340a8a368: done: 0.013022 sec","job_status":"done","queue_duration_s":1.562632,"scheduling_latency_s":1.562646,"redis_calls":10,"redis_duration_s":0.002424,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001176,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001248,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007404,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013022,"completed_at":"2026-08-20T05:48:28.678Z","load_balancing_strategy":"primary","db_duration_s":0.001046,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1562gitlab # [ 151.512516] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.679Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"647b2418ab0e82ba8e22702f","created_at":"2026-08-20T05:48:27.094Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-23fd989e40984613","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"341d41975772cac6f1b02cb81856b431","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:27.102Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-647b2418ab0e82ba8e22702f: start","job_status":"start","queue_duration_s":1.576531,"scheduling_latency_s":1.576545}1563gitlab # [ 151.548159] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.685Z","message":"No existing merge request to be cleaned up."}1564gitlab # [ 151.548794] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.689Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"647b2418ab0e82ba8e22702f","created_at":"2026-08-20T05:48:27.094Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-23fd989e40984613","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"341d41975772cac6f1b02cb81856b431","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:27.102Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-647b2418ab0e82ba8e22702f: done: 0.010398 sec","job_status":"done","queue_duration_s":1.576531,"scheduling_latency_s":1.576545,"redis_calls":10,"redis_duration_s":0.0011580000000000002,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000497,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000661,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007041,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010398,"completed_at":"2026-08-20T05:48:28.689Z","load_balancing_strategy":"primary","db_duration_s":0.00087,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1565gitlab # [ 151.553582] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.690Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7b77b3d37dbd37d6dfb5762a","created_at":"2026-08-20T05:48:27.094Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-23fd989e40984613","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"341d41975772cac6f1b02cb81856b431","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:27.102Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7b77b3d37dbd37d6dfb5762a: start","job_status":"start","queue_duration_s":1.587751,"scheduling_latency_s":1.587763}1566gitlab # [ 151.563487] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.696Z","message":"No existing merge request to be cleaned up."}1567gitlab # [ 151.564636] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:48:28.700Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7b77b3d37dbd37d6dfb5762a","created_at":"2026-08-20T05:48:27.094Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-23fd989e40984613","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"341d41975772cac6f1b02cb81856b431","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:48:27.102Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7b77b3d37dbd37d6dfb5762a: done: 0.010427 sec","job_status":"done","queue_duration_s":1.587751,"scheduling_latency_s":1.587763,"redis_calls":10,"redis_duration_s":0.001154,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000464,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00069,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010427,"completed_at":"2026-08-20T05:48:28.700Z","load_balancing_strategy":"primary","db_duration_s":0.000922,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1568gitlab # [ 151.770114] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 3334183081 wd_nsec: 33341832551569gitlab # [ 163.241817] setup-gitlab-start[2230]: W, [2026-08-20T05:48:43.419830 #2230] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1570gitlab # [ 185.874427] postgres[2422]: [2422] ERROR: relation "table_without_models" does not exist1571gitlab # [ 185.875372] postgres[2422]: [2422] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1572gitlab # [ 187.308729] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:07.486Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"b9cdac672e10ddbccf242117","created_at":"2026-08-20T05:49:07.439Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1bfdfc64966918a2b40aa8a97234b81a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.484Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-b9cdac672e10ddbccf242117: start","job_status":"start","queue_duration_s":0.001797,"scheduling_latency_s":0.001834}1573gitlab # [ 187.375431] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:07.553Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1574gitlab # [ 187.408651] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:07.586Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"b9cdac672e10ddbccf242117","created_at":"2026-08-20T05:49:07.439Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1bfdfc64966918a2b40aa8a97234b81a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.484Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-b9cdac672e10ddbccf242117: done: 0.100032 sec","job_status":"done","queue_duration_s":0.001797,"scheduling_latency_s":0.001834,"redis_calls":8,"redis_duration_s":0.009543,"redis_read_bytes":9,"redis_write_bytes":825,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006615,"redis_queues_metadata_read_bytes":8,"redis_queues_metadata_write_bytes":561,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002928,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013367,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.100032,"completed_at":"2026-08-20T05:49:07.586Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1575gitlab # [ 187.451428] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:07.626Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"77d24e54f5d97ec129f36575","created_at":"2026-08-20T05:49:07.538Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"44e84b448c61913840217e2fc041c0a6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.543Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-77d24e54f5d97ec129f36575: start","job_status":"start","queue_duration_s":0.082666,"scheduling_latency_s":0.082717}1576gitlab # [ 187.900871] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.079Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"77d24e54f5d97ec129f36575","created_at":"2026-08-20T05:49:07.538Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"44e84b448c61913840217e2fc041c0a6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.543Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-77d24e54f5d97ec129f36575: done: 0.453114 sec","job_status":"done","queue_duration_s":0.082666,"scheduling_latency_s":0.082717,"redis_calls":9,"redis_duration_s":0.005407,"redis_read_bytes":7,"redis_write_bytes":987,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002406,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003001,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.098,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.098,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.193644,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.002172622,"exclusive_lock_hold_duration_s":0.3675347,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.453114,"completed_at":"2026-08-20T05:49:08.079Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.231355,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1577gitlab # [ 187.977172] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.155Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"b50f73731db5e74516d5cc3b","created_at":"2026-08-20T05:49:07.569Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"605d6d96272cd654e080da571a482c08","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.577Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-b50f73731db5e74516d5cc3b: start","job_status":"start","queue_duration_s":0.578092,"scheduling_latency_s":0.578123}1578gitlab # [ 188.034485] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.212Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"b50f73731db5e74516d5cc3b","created_at":"2026-08-20T05:49:07.569Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"605d6d96272cd654e080da571a482c08","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.577Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-b50f73731db5e74516d5cc3b: done: 0.057004 sec","job_status":"done","queue_duration_s":0.578092,"scheduling_latency_s":0.578123,"redis_calls":11,"redis_duration_s":0.003926,"redis_read_bytes":136,"redis_write_bytes":1288,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000338,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":49,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002188,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.0014,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022276,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.023204346,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.057004,"completed_at":"2026-08-20T05:49:08.212Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023091,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1579gitlab # [ 188.036668] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.215Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"8bdd3bcfa9de581efe6e79b0","created_at":"2026-08-20T05:49:07.602Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f2080030bcc095696056f9469f3dc45a","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.607Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-8bdd3bcfa9de581efe6e79b0: start","job_status":"start","queue_duration_s":0.607684,"scheduling_latency_s":0.607719}1580gitlab # [ 188.106429] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.284Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"8bdd3bcfa9de581efe6e79b0","created_at":"2026-08-20T05:49:07.602Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f2080030bcc095696056f9469f3dc45a","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.607Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-8bdd3bcfa9de581efe6e79b0: done: 0.069488 sec","job_status":"done","queue_duration_s":0.607684,"scheduling_latency_s":0.607719,"redis_calls":9,"redis_duration_s":0.003309,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001731,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001578,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.044,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.044,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016302,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000882515,"exclusive_lock_hold_duration_s":0.046685263,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.069488,"completed_at":"2026-08-20T05:49:08.284Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.044291,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1581gitlab # [ 188.108792] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.287Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"45cbe9703f1e27ad71b06ebd","created_at":"2026-08-20T05:49:07.627Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ce513e9f6bbb51d193c2f43885948f40","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:49:07.629Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-45cbe9703f1e27ad71b06ebd: start","job_status":"start","queue_duration_s":0.657333,"scheduling_latency_s":0.657368}1582gitlab # [ 188.143641] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.321Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"45cbe9703f1e27ad71b06ebd","created_at":"2026-08-20T05:49:07.627Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ce513e9f6bbb51d193c2f43885948f40","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:49:07.629Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-45cbe9703f1e27ad71b06ebd: done: 0.0346 sec","job_status":"done","queue_duration_s":0.657333,"scheduling_latency_s":0.657368,"redis_calls":8,"redis_duration_s":0.00261,"redis_read_bytes":133,"redis_write_bytes":811,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000284,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":70,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001711,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000615,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021794,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0346,"completed_at":"2026-08-20T05:49:08.321Z","load_balancing_strategy":"primary","db_duration_s":0.004394,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1583gitlab # [ 188.148953] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.327Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"e5259306e4458852137c7c3e","created_at":"2026-08-20T05:49:07.702Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bc32e6ae1665a619049b3b53db8d3e96","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:49:07.708Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-e5259306e4458852137c7c3e: start","job_status":"start","queue_duration_s":0.618495,"scheduling_latency_s":0.618531}1584gitlab # [ 188.162097] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.340Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1585gitlab # [ 188.168444] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.346Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"e5259306e4458852137c7c3e","created_at":"2026-08-20T05:49:07.702Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bc32e6ae1665a619049b3b53db8d3e96","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:49:07.708Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-e5259306e4458852137c7c3e: done: 0.019406 sec","job_status":"done","queue_duration_s":0.618495,"scheduling_latency_s":0.618531,"redis_calls":7,"redis_duration_s":0.002726,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001926,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0008,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009921,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019406,"completed_at":"2026-08-20T05:49:08.346Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1586gitlab # [ 188.214943] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.353Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"85c7703da2ff8dec229dbf16","created_at":"2026-08-20T05:49:07.715Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df5ef83d2d52c3c36a47d941b9db4584","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.719Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-85c7703da2ff8dec229dbf16: start","job_status":"start","queue_duration_s":0.633581,"scheduling_latency_s":0.633608}1587gitlab # [ 188.215753] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.368Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"85c7703da2ff8dec229dbf16","created_at":"2026-08-20T05:49:07.715Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df5ef83d2d52c3c36a47d941b9db4584","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.719Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-85c7703da2ff8dec229dbf16: done: 0.015378 sec","job_status":"done","queue_duration_s":0.633581,"scheduling_latency_s":0.633608,"redis_calls":7,"redis_duration_s":0.002027,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001365,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000662,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008956,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015378,"completed_at":"2026-08-20T05:49:08.368Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1588gitlab # [ 188.238181] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.370Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"1eb1bd3f6f97cac71de37c5a","created_at":"2026-08-20T05:49:07.725Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d40c5c69cc83e4ed71135e0d88920333","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.729Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-1eb1bd3f6f97cac71de37c5a: start","job_status":"start","queue_duration_s":0.641055,"scheduling_latency_s":0.641069}1589gitlab # [ 188.277186] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.398Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"1eb1bd3f6f97cac71de37c5a","created_at":"2026-08-20T05:49:07.725Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d40c5c69cc83e4ed71135e0d88920333","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.729Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-1eb1bd3f6f97cac71de37c5a: done: 0.028754 sec","job_status":"done","queue_duration_s":0.641055,"scheduling_latency_s":0.641069,"redis_calls":7,"redis_duration_s":0.005303,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004904,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000399,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008097,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028754,"completed_at":"2026-08-20T05:49:08.398Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013388,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1590gitlab # [ 188.281423] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.402Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"0f6dce27af52ebecc67775c4","created_at":"2026-08-20T05:49:07.736Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ea7fea06c1394461004f489c10d42a28","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.739Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-0f6dce27af52ebecc67775c4: start","job_status":"start","queue_duration_s":0.662649,"scheduling_latency_s":0.662667}1591gitlab # [ 188.291571] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.425Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"0f6dce27af52ebecc67775c4","created_at":"2026-08-20T05:49:07.736Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ea7fea06c1394461004f489c10d42a28","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.739Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-0f6dce27af52ebecc67775c4: done: 0.02323 sec","job_status":"done","queue_duration_s":0.662649,"scheduling_latency_s":0.662667,"redis_calls":7,"redis_duration_s":0.002808,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002354,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000454,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006547,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.02323,"completed_at":"2026-08-20T05:49:08.425Z","load_balancing_strategy":"primary","db_duration_s":0.011167,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1592gitlab # [ 188.336924] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.426Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"1107a34abaef47a457aa500a","created_at":"2026-08-20T05:49:07.751Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ad49acb5692197aa72e6ec87b704ac2f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.755Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-1107a34abaef47a457aa500a: start","job_status":"start","queue_duration_s":0.670971,"scheduling_latency_s":0.670985}1593gitlab # [ 188.337546] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.445Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"1107a34abaef47a457aa500a","created_at":"2026-08-20T05:49:07.751Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ad49acb5692197aa72e6ec87b704ac2f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.755Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-1107a34abaef47a457aa500a: done: 0.019403 sec","job_status":"done","queue_duration_s":0.670971,"scheduling_latency_s":0.670985,"redis_calls":9,"redis_duration_s":0.001177,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000597,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00058,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011577,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000341384,"exclusive_lock_hold_duration_s":0.01038009,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.019403,"completed_at":"2026-08-20T05:49:08.445Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005052,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1594gitlab # [ 188.382362] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.446Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"1c993acff8d9e3987b0d9f15","created_at":"2026-08-20T05:49:07.767Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b289a3b14b3d21084ba03680fcfb6ab5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.768Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-1c993acff8d9e3987b0d9f15: start","job_status":"start","queue_duration_s":0.677974,"scheduling_latency_s":0.677986}1595gitlab # [ 188.383296] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.479Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"1c993acff8d9e3987b0d9f15","created_at":"2026-08-20T05:49:07.767Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b289a3b14b3d21084ba03680fcfb6ab5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.768Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-1c993acff8d9e3987b0d9f15: done: 0.032993 sec","job_status":"done","queue_duration_s":0.677974,"scheduling_latency_s":0.677986,"redis_calls":9,"redis_duration_s":0.0034479999999999997,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001741,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001707,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010577,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00067774,"exclusive_lock_hold_duration_s":0.015328485,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.032993,"completed_at":"2026-08-20T05:49:08.479Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017376,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1596gitlab # [ 188.416638] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.482Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"cc374704f69c071acb4fa039","created_at":"2026-08-20T05:49:07.777Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a2714030c3236b9c161c2ed082412b6d","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.778Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-cc374704f69c071acb4fa039: start","job_status":"start","queue_duration_s":0.703565,"scheduling_latency_s":0.703579}1597gitlab # [ 188.538790] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.717Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"cc374704f69c071acb4fa039","created_at":"2026-08-20T05:49:07.777Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a2714030c3236b9c161c2ed082412b6d","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.778Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-cc374704f69c071acb4fa039: done: 0.234659 sec","job_status":"done","queue_duration_s":0.703565,"scheduling_latency_s":0.703579,"redis_calls":562,"redis_duration_s":0.07956099999999999,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.078633,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.171083,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.234659,"completed_at":"2026-08-20T05:49:08.717Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1598gitlab # [ 188.539923] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.718Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"80cf8445c79fd85443de8422","created_at":"2026-08-20T05:49:07.784Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.789Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-80cf8445c79fd85443de8422: start","job_status":"start","queue_duration_s":0.929137,"scheduling_latency_s":0.929157}1599gitlab # [ 188.594145] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.772Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"80cf8445c79fd85443de8422","created_at":"2026-08-20T05:49:07.784Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.789Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-80cf8445c79fd85443de8422: done: 0.053502 sec","job_status":"done","queue_duration_s":0.929137,"scheduling_latency_s":0.929157,"redis_calls":60,"redis_duration_s":0.008186,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.000526,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.007249,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000411,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044408,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.053502,"completed_at":"2026-08-20T05:49:08.772Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1600gitlab # [ 188.595300] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.773Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"cf9c8ad05ebb81ac4834f058","created_at":"2026-08-20T05:49:07.791Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1f4c264822737664bd9f6acdd9f3d5fc","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.792Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-cf9c8ad05ebb81ac4834f058: start","job_status":"start","queue_duration_s":0.980362,"scheduling_latency_s":0.980379}1601gitlab # [ 188.634710] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.784Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"cf9c8ad05ebb81ac4834f058","created_at":"2026-08-20T05:49:07.791Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1f4c264822737664bd9f6acdd9f3d5fc","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.792Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-cf9c8ad05ebb81ac4834f058: done: 0.011071 sec","job_status":"done","queue_duration_s":0.980362,"scheduling_latency_s":0.980379,"redis_calls":7,"redis_duration_s":0.000983,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000702,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000281,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006188,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011071,"completed_at":"2026-08-20T05:49:08.784Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000972,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1602gitlab # [ 188.636119] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.785Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"6b687ad29bfb9a992e279751","created_at":"2026-08-20T05:49:07.796Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"83c28b8235235b7ecf14ec8160c3c770","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.799Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-6b687ad29bfb9a992e279751: start","job_status":"start","queue_duration_s":0.985581,"scheduling_latency_s":0.985595}1603gitlab # [ 188.645742] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.795Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"6b687ad29bfb9a992e279751","created_at":"2026-08-20T05:49:07.796Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"83c28b8235235b7ecf14ec8160c3c770","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.799Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-6b687ad29bfb9a992e279751: done: 0.010372 sec","job_status":"done","queue_duration_s":0.985581,"scheduling_latency_s":0.985595,"redis_calls":9,"redis_duration_s":0.001315,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000688,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000627,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006553,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000340267,"exclusive_lock_hold_duration_s":0.002134908,"duration_s":0.010372,"completed_at":"2026-08-20T05:49:08.795Z","load_balancing_strategy":"primary","db_duration_s":0.000622,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1604gitlab # [ 188.682283] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.796Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"8d7be257a0559353015635e7","created_at":"2026-08-20T05:49:07.813Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8c464a2fab20598e7813f4ffca2cd0b8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.817Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-8d7be257a0559353015635e7: start","job_status":"start","queue_duration_s":0.979002,"scheduling_latency_s":0.979016}1605gitlab # [ 188.688438] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.811Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"8d7be257a0559353015635e7","created_at":"2026-08-20T05:49:07.813Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8c464a2fab20598e7813f4ffca2cd0b8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.817Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-8d7be257a0559353015635e7: done: 0.01541 sec","job_status":"done","queue_duration_s":0.979002,"scheduling_latency_s":0.979016,"redis_calls":14,"redis_duration_s":0.001777,"redis_read_bytes":16,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.00018,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001214,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000383,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011104,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01541,"completed_at":"2026-08-20T05:49:08.811Z","load_balancing_strategy":"primary","db_duration_s":0.000768,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1606gitlab # [ 188.747434] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.812Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"a00e3456b42727e78f73935c","created_at":"2026-08-20T05:49:07.826Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3ddb7cab2617b25101263754083e2714","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.828Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-a00e3456b42727e78f73935c: start","job_status":"start","queue_duration_s":0.984111,"scheduling_latency_s":0.984126}1607gitlab # [ 188.748129] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.817Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1608gitlab # [ 188.748760] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.820Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"a00e3456b42727e78f73935c","created_at":"2026-08-20T05:49:07.826Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3ddb7cab2617b25101263754083e2714","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.828Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-a00e3456b42727e78f73935c: done: 0.007848 sec","job_status":"done","queue_duration_s":0.984111,"scheduling_latency_s":0.984126,"redis_calls":7,"redis_duration_s":0.000915,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000629,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000286,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004776,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.007848,"completed_at":"2026-08-20T05:49:08.820Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1609gitlab # [ 188.769736] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.821Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"0e0526c865ea0a3db426101b","created_at":"2026-08-20T05:49:07.850Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1c2046548e82c788bc309f2a9c82e782","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.858Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-0e0526c865ea0a3db426101b: start","job_status":"start","queue_duration_s":0.962799,"scheduling_latency_s":0.962812}1610gitlab # [ 188.812073] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.825Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1611gitlab # [ 188.812751] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.829Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"0e0526c865ea0a3db426101b","created_at":"2026-08-20T05:49:07.850Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1c2046548e82c788bc309f2a9c82e782","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.858Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-0e0526c865ea0a3db426101b: done: 0.007747 sec","job_status":"done","queue_duration_s":0.962799,"scheduling_latency_s":0.962812,"redis_calls":7,"redis_duration_s":0.000873,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000632,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000241,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004706,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.007747,"completed_at":"2026-08-20T05:49:08.829Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1612gitlab # [ 188.847252] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.829Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"b4291bd13a0acb0a192a5f1d","created_at":"2026-08-20T05:49:07.871Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"de7fdbd2ed3486cea23783cbb8747402","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.874Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-b4291bd13a0acb0a192a5f1d: start","job_status":"start","queue_duration_s":0.955286,"scheduling_latency_s":0.955326}1613gitlab # [ 188.848254] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.837Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"b4291bd13a0acb0a192a5f1d","created_at":"2026-08-20T05:49:07.871Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"de7fdbd2ed3486cea23783cbb8747402","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.874Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-b4291bd13a0acb0a192a5f1d: done: 0.0079 sec","job_status":"done","queue_duration_s":0.955286,"scheduling_latency_s":0.955326,"redis_calls":7,"redis_duration_s":0.000938,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000662,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000276,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004905,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0079,"completed_at":"2026-08-20T05:49:08.837Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1614gitlab # [ 188.884435] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.838Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"838c78934f04052beb3c2f3a","created_at":"2026-08-20T05:49:07.889Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"49f55970d3bf8ee872ff05eb4c760005","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:49:07.891Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-838c78934f04052beb3c2f3a: start","job_status":"start","queue_duration_s":0.946795,"scheduling_latency_s":0.946808}1615gitlab # [ 188.885473] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.843Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1616gitlab # [ 188.886313] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.846Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"838c78934f04052beb3c2f3a","created_at":"2026-08-20T05:49:07.889Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"49f55970d3bf8ee872ff05eb4c760005","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:49:07.891Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-838c78934f04052beb3c2f3a: done: 0.007801 sec","job_status":"done","queue_duration_s":0.946795,"scheduling_latency_s":0.946808,"redis_calls":7,"redis_duration_s":0.000896,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000655,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000241,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004719,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.007801,"completed_at":"2026-08-20T05:49:08.846Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1617gitlab # [ 188.903798] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.847Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"aff9fc6175c51274cf467d8a","created_at":"2026-08-20T05:49:07.921Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"124dda8d48a162b084575c49083fb742","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.926Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-aff9fc6175c51274cf467d8a: start","job_status":"start","queue_duration_s":0.921274,"scheduling_latency_s":0.921287}1618gitlab # [ 188.916633] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.851Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1619gitlab # [ 188.919300] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.855Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"aff9fc6175c51274cf467d8a","created_at":"2026-08-20T05:49:07.921Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"124dda8d48a162b084575c49083fb742","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.926Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-aff9fc6175c51274cf467d8a: done: 0.00768 sec","job_status":"done","queue_duration_s":0.921274,"scheduling_latency_s":0.921287,"redis_calls":7,"redis_duration_s":0.000895,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000652,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000243,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004678,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.00768,"completed_at":"2026-08-20T05:49:08.854Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1620gitlab # [ 188.959856] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.855Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"443c071a4daae898aff8fe05","created_at":"2026-08-20T05:49:07.949Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"63b7ea5d044a03d5558e1ad28f0189a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.962Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-443c071a4daae898aff8fe05: start","job_status":"start","queue_duration_s":0.893159,"scheduling_latency_s":0.893172}1621gitlab # [ 188.962784] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.955Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"443c071a4daae898aff8fe05","created_at":"2026-08-20T05:49:07.949Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-1dcc0b251d9e458f","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"63b7ea5d044a03d5558e1ad28f0189a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:07.962Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-443c071a4daae898aff8fe05: done: 0.099444 sec","job_status":"done","queue_duration_s":0.893159,"scheduling_latency_s":0.893172,"redis_calls":12,"redis_duration_s":0.001878,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000287,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000857,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000734,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.084919,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000300317,"exclusive_lock_hold_duration_s":0.085403312,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.099444,"completed_at":"2026-08-20T05:49:08.955Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011227,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null}1622gitlab # [ 189.007800] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.956Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d88187f68043f144aeab3f8c","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d88187f68043f144aeab3f8c: start","job_status":"start","queue_duration_s":0.189412,"scheduling_latency_s":0.189428}1623gitlab # [ 189.008777] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.966Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d88187f68043f144aeab3f8c","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d88187f68043f144aeab3f8c: done: 0.010247 sec","job_status":"done","queue_duration_s":0.189412,"scheduling_latency_s":0.189428,"redis_calls":13,"redis_duration_s":0.001586,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001083,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006336,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010247,"completed_at":"2026-08-20T05:49:08.966Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1624gitlab # [ 189.067231] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.967Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ffb5f0ed5cc58eb0fbeb1b6","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ffb5f0ed5cc58eb0fbeb1b6: start","job_status":"start","queue_duration_s":0.20056,"scheduling_latency_s":0.200574}1625gitlab # [ 189.068115] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.977Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ffb5f0ed5cc58eb0fbeb1b6","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ffb5f0ed5cc58eb0fbeb1b6: done: 0.009569 sec","job_status":"done","queue_duration_s":0.20056,"scheduling_latency_s":0.200574,"redis_calls":13,"redis_duration_s":0.001706,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001188,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005933,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009569,"completed_at":"2026-08-20T05:49:08.977Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1626gitlab # [ 189.081694] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.977Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb9f638381af8c043d155f7c","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb9f638381af8c043d155f7c: start","job_status":"start","queue_duration_s":0.210974,"scheduling_latency_s":0.210988}1627gitlab # [ 189.091984] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.987Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb9f638381af8c043d155f7c","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb9f638381af8c043d155f7c: done: 0.009264 sec","job_status":"done","queue_duration_s":0.210974,"scheduling_latency_s":0.210988,"redis_calls":13,"redis_duration_s":0.0015539999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001029,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009264,"completed_at":"2026-08-20T05:49:08.987Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1628gitlab # [ 189.143208] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.988Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01f711510ff4aabf848e211f","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01f711510ff4aabf848e211f: start","job_status":"start","queue_duration_s":0.22108,"scheduling_latency_s":0.221093}1629gitlab # [ 189.143846] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.997Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01f711510ff4aabf848e211f","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01f711510ff4aabf848e211f: done: 0.009372 sec","job_status":"done","queue_duration_s":0.22108,"scheduling_latency_s":0.221093,"redis_calls":13,"redis_duration_s":0.001653,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000603,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005949,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009372,"completed_at":"2026-08-20T05:49:08.997Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1630gitlab # [ 189.185299] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:08.998Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9952f4e13b2cf5342946373e","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9952f4e13b2cf5342946373e: start","job_status":"start","queue_duration_s":0.231316,"scheduling_latency_s":0.231329}1631gitlab # [ 189.185906] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.007Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9952f4e13b2cf5342946373e","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9952f4e13b2cf5342946373e: done: 0.009404 sec","job_status":"done","queue_duration_s":0.231316,"scheduling_latency_s":0.231329,"redis_calls":13,"redis_duration_s":0.001627,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006014,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009404,"completed_at":"2026-08-20T05:49:09.007Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1632gitlab # [ 189.225723] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.008Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c46cf0278d663d64daeefe4","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c46cf0278d663d64daeefe4: start","job_status":"start","queue_duration_s":0.241615,"scheduling_latency_s":0.241628}1633gitlab # [ 189.226449] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.017Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c46cf0278d663d64daeefe4","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c46cf0278d663d64daeefe4: done: 0.00931 sec","job_status":"done","queue_duration_s":0.241615,"scheduling_latency_s":0.241628,"redis_calls":13,"redis_duration_s":0.001603,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001064,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00595,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00931,"completed_at":"2026-08-20T05:49:09.017Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1634gitlab # [ 189.272441] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.018Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"210b50c1e9dc2216e22000c3","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-210b50c1e9dc2216e22000c3: start","job_status":"start","queue_duration_s":0.251767,"scheduling_latency_s":0.25178}1635gitlab # [ 189.273074] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.028Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"210b50c1e9dc2216e22000c3","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-210b50c1e9dc2216e22000c3: done: 0.009844 sec","job_status":"done","queue_duration_s":0.251767,"scheduling_latency_s":0.25178,"redis_calls":13,"redis_duration_s":0.0015869999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001042,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006368,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009844,"completed_at":"2026-08-20T05:49:09.028Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1636gitlab # [ 189.311327] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.029Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9482a95d5db2cf7e1daffcd","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9482a95d5db2cf7e1daffcd: start","job_status":"start","queue_duration_s":0.262495,"scheduling_latency_s":0.262507}1637gitlab # [ 189.311950] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.039Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9482a95d5db2cf7e1daffcd","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9482a95d5db2cf7e1daffcd: done: 0.010081 sec","job_status":"done","queue_duration_s":0.262495,"scheduling_latency_s":0.262507,"redis_calls":13,"redis_duration_s":0.001588,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001086,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006331,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010081,"completed_at":"2026-08-20T05:49:09.039Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1638gitlab # [ 189.357833] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.040Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f11bef006d5fbee593f0be5","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f11bef006d5fbee593f0be5: start","job_status":"start","queue_duration_s":0.273542,"scheduling_latency_s":0.273555}1639gitlab # [ 189.358604] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.050Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f11bef006d5fbee593f0be5","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f11bef006d5fbee593f0be5: done: 0.010258 sec","job_status":"done","queue_duration_s":0.273542,"scheduling_latency_s":0.273555,"redis_calls":13,"redis_duration_s":0.0017629999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001241,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006374,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010258,"completed_at":"2026-08-20T05:49:09.050Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1640gitlab # [ 189.393639] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.051Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db61cde373bd43cdedbb2b14","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db61cde373bd43cdedbb2b14: start","job_status":"start","queue_duration_s":0.284706,"scheduling_latency_s":0.284721}1641gitlab # [ 189.394468] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.061Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db61cde373bd43cdedbb2b14","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db61cde373bd43cdedbb2b14: done: 0.009885 sec","job_status":"done","queue_duration_s":0.284706,"scheduling_latency_s":0.284721,"redis_calls":13,"redis_duration_s":0.001519,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001015,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006201,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009885,"completed_at":"2026-08-20T05:49:09.061Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1642gitlab # [ 189.438261] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.062Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a5e244619b5f38caf0c8e97","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a5e244619b5f38caf0c8e97: start","job_status":"start","queue_duration_s":0.295421,"scheduling_latency_s":0.295434}1643gitlab # [ 189.438900] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.072Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a5e244619b5f38caf0c8e97","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a5e244619b5f38caf0c8e97: done: 0.00976 sec","job_status":"done","queue_duration_s":0.295421,"scheduling_latency_s":0.295434,"redis_calls":13,"redis_duration_s":0.00162,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000599,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001021,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006242,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00976,"completed_at":"2026-08-20T05:49:09.072Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1644gitlab # [ 189.452167] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.073Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47bc53386479a54fd71d4256","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47bc53386479a54fd71d4256: start","job_status":"start","queue_duration_s":0.306361,"scheduling_latency_s":0.306375}1645gitlab # [ 189.462536] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.107Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47bc53386479a54fd71d4256","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47bc53386479a54fd71d4256: done: 0.033984 sec","job_status":"done","queue_duration_s":0.306361,"scheduling_latency_s":0.306375,"redis_calls":13,"redis_duration_s":0.0017009999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000661,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029204,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033984,"completed_at":"2026-08-20T05:49:09.107Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1646gitlab # [ 189.514688] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.108Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d07c366a85dac561562ada8","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d07c366a85dac561562ada8: start","job_status":"start","queue_duration_s":0.341494,"scheduling_latency_s":0.341512}1647gitlab # [ 189.515449] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.119Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d07c366a85dac561562ada8","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d07c366a85dac561562ada8: done: 0.011037 sec","job_status":"done","queue_duration_s":0.341494,"scheduling_latency_s":0.341512,"redis_calls":13,"redis_duration_s":0.00203,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000563,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001467,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011037,"completed_at":"2026-08-20T05:49:09.119Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1648gitlab # [ 189.535107] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.120Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c550a6579454fd7b9df601b","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c550a6579454fd7b9df601b: start","job_status":"start","queue_duration_s":0.353445,"scheduling_latency_s":0.35346}1649gitlab # [ 189.545055] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.131Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c550a6579454fd7b9df601b","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c550a6579454fd7b9df601b: done: 0.010644 sec","job_status":"done","queue_duration_s":0.353445,"scheduling_latency_s":0.35346,"redis_calls":13,"redis_duration_s":0.001532,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000495,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001037,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006922,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010644,"completed_at":"2026-08-20T05:49:09.130Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1650gitlab # [ 189.594795] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.131Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f5da3e2dee71739c345dc941","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f5da3e2dee71739c345dc941: start","job_status":"start","queue_duration_s":0.364961,"scheduling_latency_s":0.364975}1651gitlab # [ 189.595551] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.142Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f5da3e2dee71739c345dc941","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f5da3e2dee71739c345dc941: done: 0.010352 sec","job_status":"done","queue_duration_s":0.364961,"scheduling_latency_s":0.364975,"redis_calls":13,"redis_duration_s":0.001496,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000488,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001008,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006139,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010352,"completed_at":"2026-08-20T05:49:09.142Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1652gitlab # [ 189.629911] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.143Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f448033d90327b4c7bde6365","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f448033d90327b4c7bde6365: start","job_status":"start","queue_duration_s":0.376661,"scheduling_latency_s":0.376674}1653gitlab # [ 189.630611] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.153Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f448033d90327b4c7bde6365","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f448033d90327b4c7bde6365: done: 0.010395 sec","job_status":"done","queue_duration_s":0.376661,"scheduling_latency_s":0.376674,"redis_calls":13,"redis_duration_s":0.00159,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001085,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006774,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010395,"completed_at":"2026-08-20T05:49:09.153Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1654gitlab # [ 189.665977] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.154Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d4f432952d61fb7ab30fa2cf","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d4f432952d61fb7ab30fa2cf: start","job_status":"start","queue_duration_s":0.387881,"scheduling_latency_s":0.387894}1655gitlab # [ 189.666961] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.164Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d4f432952d61fb7ab30fa2cf","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d4f432952d61fb7ab30fa2cf: done: 0.009816 sec","job_status":"done","queue_duration_s":0.387881,"scheduling_latency_s":0.387894,"redis_calls":13,"redis_duration_s":0.0015170000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000484,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001033,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006392,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009816,"completed_at":"2026-08-20T05:49:09.164Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1656gitlab # [ 189.698740] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.165Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7f1092540581c152686b49a","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7f1092540581c152686b49a: start","job_status":"start","queue_duration_s":0.398738,"scheduling_latency_s":0.398752}1657gitlab # [ 189.738309] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.175Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7f1092540581c152686b49a","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7f1092540581c152686b49a: done: 0.009919 sec","job_status":"done","queue_duration_s":0.398738,"scheduling_latency_s":0.398752,"redis_calls":13,"redis_duration_s":0.0017330000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000664,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001069,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006348,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009919,"completed_at":"2026-08-20T05:49:09.175Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1658gitlab # [ 189.739610] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.176Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e241e0b7800f27e9905a7f34","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e241e0b7800f27e9905a7f34: start","job_status":"start","queue_duration_s":0.409523,"scheduling_latency_s":0.409536}1659gitlab # [ 189.781950] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.185Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e241e0b7800f27e9905a7f34","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e241e0b7800f27e9905a7f34: done: 0.009396 sec","job_status":"done","queue_duration_s":0.409523,"scheduling_latency_s":0.409536,"redis_calls":13,"redis_duration_s":0.001516,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000992,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005753,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009396,"completed_at":"2026-08-20T05:49:09.185Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1660gitlab # [ 189.783299] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.187Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be95a93a97d324bcff08f325","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be95a93a97d324bcff08f325: start","job_status":"start","queue_duration_s":0.420157,"scheduling_latency_s":0.420171}1661gitlab # [ 189.791538] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.196Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be95a93a97d324bcff08f325","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be95a93a97d324bcff08f325: done: 0.009253 sec","job_status":"done","queue_duration_s":0.420157,"scheduling_latency_s":0.420171,"redis_calls":13,"redis_duration_s":0.0015140000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000984,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005988,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009253,"completed_at":"2026-08-20T05:49:09.196Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1662gitlab # [ 189.830141] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.197Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fc3553d6e00fc5e98fd56dc","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fc3553d6e00fc5e98fd56dc: start","job_status":"start","queue_duration_s":0.430241,"scheduling_latency_s":0.430254}1663gitlab # [ 189.832363] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.206Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fc3553d6e00fc5e98fd56dc","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fc3553d6e00fc5e98fd56dc: done: 0.009365 sec","job_status":"done","queue_duration_s":0.430241,"scheduling_latency_s":0.430254,"redis_calls":13,"redis_duration_s":0.00154,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006065,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009365,"completed_at":"2026-08-20T05:49:09.206Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1664gitlab # [ 189.880771] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.207Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4dfa9fdeb4abdb344f6beef","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4dfa9fdeb4abdb344f6beef: start","job_status":"start","queue_duration_s":0.440459,"scheduling_latency_s":0.440471}1665gitlab # [ 189.881753] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.216Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4dfa9fdeb4abdb344f6beef","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4dfa9fdeb4abdb344f6beef: done: 0.009449 sec","job_status":"done","queue_duration_s":0.440459,"scheduling_latency_s":0.440471,"redis_calls":13,"redis_duration_s":0.001545,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000485,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00106,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006095,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009449,"completed_at":"2026-08-20T05:49:09.216Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1666gitlab # [ 189.919704] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.218Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"78c5b0c282a7c0b13d2214f7","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-78c5b0c282a7c0b13d2214f7: start","job_status":"start","queue_duration_s":0.45122,"scheduling_latency_s":0.451232}1667gitlab # [ 189.920558] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.227Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"78c5b0c282a7c0b13d2214f7","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-78c5b0c282a7c0b13d2214f7: done: 0.009401 sec","job_status":"done","queue_duration_s":0.45122,"scheduling_latency_s":0.451232,"redis_calls":13,"redis_duration_s":0.002014,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001021,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006139,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009401,"completed_at":"2026-08-20T05:49:09.227Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1668gitlab # [ 189.955563] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.228Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b354b1f8900bd9fa88b22787","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b354b1f8900bd9fa88b22787: start","job_status":"start","queue_duration_s":0.461445,"scheduling_latency_s":0.461458}1669gitlab # [ 189.956328] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.238Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b354b1f8900bd9fa88b22787","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b354b1f8900bd9fa88b22787: done: 0.010575 sec","job_status":"done","queue_duration_s":0.461445,"scheduling_latency_s":0.461458,"redis_calls":13,"redis_duration_s":0.0015799999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00106,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007215,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010575,"completed_at":"2026-08-20T05:49:09.238Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1670gitlab # [ 190.018140] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.239Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"816171a5b71feae1e2331cdd","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-816171a5b71feae1e2331cdd: start","job_status":"start","queue_duration_s":0.472841,"scheduling_latency_s":0.472865}1671gitlab # [ 190.018837] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.249Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"816171a5b71feae1e2331cdd","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-816171a5b71feae1e2331cdd: done: 0.009434 sec","job_status":"done","queue_duration_s":0.472841,"scheduling_latency_s":0.472865,"redis_calls":13,"redis_duration_s":0.0015249999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001005,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006174,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009434,"completed_at":"2026-08-20T05:49:09.249Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1672gitlab # [ 190.057763] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.250Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3f7fa742b69c14dc9f195d7","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3f7fa742b69c14dc9f195d7: start","job_status":"start","queue_duration_s":0.483128,"scheduling_latency_s":0.483141}1673gitlab # [ 190.058753] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.259Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3f7fa742b69c14dc9f195d7","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3f7fa742b69c14dc9f195d7: done: 0.00991 sec","job_status":"done","queue_duration_s":0.483128,"scheduling_latency_s":0.483141,"redis_calls":13,"redis_duration_s":0.001576,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001073,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005805,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00991,"completed_at":"2026-08-20T05:49:09.259Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1674gitlab # [ 190.104283] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.260Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d428cc56d9335aa6d9a6b6b7","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d428cc56d9335aa6d9a6b6b7: start","job_status":"start","queue_duration_s":0.493872,"scheduling_latency_s":0.493885}1675gitlab # [ 190.105280] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.270Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d428cc56d9335aa6d9a6b6b7","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d428cc56d9335aa6d9a6b6b7: done: 0.009741 sec","job_status":"done","queue_duration_s":0.493872,"scheduling_latency_s":0.493885,"redis_calls":13,"redis_duration_s":0.001509,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000998,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006412,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009741,"completed_at":"2026-08-20T05:49:09.270Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1676gitlab # [ 190.112224] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a379143aa065776088e00e82","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a379143aa065776088e00e82: start","job_status":"start","queue_duration_s":0.504435,"scheduling_latency_s":0.504448}1677gitlab # [ 190.122984] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.281Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a379143aa065776088e00e82","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a379143aa065776088e00e82: done: 0.010494 sec","job_status":"done","queue_duration_s":0.504435,"scheduling_latency_s":0.504448,"redis_calls":13,"redis_duration_s":0.0016090000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001082,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00685,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010494,"completed_at":"2026-08-20T05:49:09.281Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1678gitlab # [ 190.161064] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.282Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"632bb8ecabedbd94bb65594d","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-632bb8ecabedbd94bb65594d: start","job_status":"start","queue_duration_s":0.515777,"scheduling_latency_s":0.515789}1679gitlab # [ 190.163896] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.292Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"632bb8ecabedbd94bb65594d","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-632bb8ecabedbd94bb65594d: done: 0.009874 sec","job_status":"done","queue_duration_s":0.515777,"scheduling_latency_s":0.515789,"redis_calls":13,"redis_duration_s":0.001628,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001078,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005935,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009874,"completed_at":"2026-08-20T05:49:09.292Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1680gitlab # [ 190.201654] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.294Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c828c07a752008575f4a04d4","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c828c07a752008575f4a04d4: start","job_status":"start","queue_duration_s":0.527117,"scheduling_latency_s":0.52713}1681gitlab # [ 190.205325] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.303Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c828c07a752008575f4a04d4","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c828c07a752008575f4a04d4: done: 0.009683 sec","job_status":"done","queue_duration_s":0.527117,"scheduling_latency_s":0.52713,"redis_calls":13,"redis_duration_s":0.002008,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000566,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001442,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006314,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009683,"completed_at":"2026-08-20T05:49:09.303Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1682gitlab # [ 190.250196] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.304Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79b7c10043e452fb00e05d87","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79b7c10043e452fb00e05d87: start","job_status":"start","queue_duration_s":0.537683,"scheduling_latency_s":0.537698}1683gitlab # [ 190.250826] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.314Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79b7c10043e452fb00e05d87","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79b7c10043e452fb00e05d87: done: 0.009862 sec","job_status":"done","queue_duration_s":0.537683,"scheduling_latency_s":0.537698,"redis_calls":13,"redis_duration_s":0.00147,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006562,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009862,"completed_at":"2026-08-20T05:49:09.314Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1684gitlab # [ 190.287993] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.315Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86319cfe87326420224032d7","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86319cfe87326420224032d7: start","job_status":"start","queue_duration_s":0.548375,"scheduling_latency_s":0.548388}1685gitlab # [ 190.288683] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.325Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86319cfe87326420224032d7","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86319cfe87326420224032d7: done: 0.009714 sec","job_status":"done","queue_duration_s":0.548375,"scheduling_latency_s":0.548388,"redis_calls":13,"redis_duration_s":0.0015789999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001058,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006366,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009714,"completed_at":"2026-08-20T05:49:09.325Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1686gitlab # [ 190.324650] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.325Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ccabefc83feb80c227702d2a","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ccabefc83feb80c227702d2a: start","job_status":"start","queue_duration_s":0.558896,"scheduling_latency_s":0.558909}1687gitlab # [ 190.329066] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.336Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ccabefc83feb80c227702d2a","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ccabefc83feb80c227702d2a: done: 0.010818 sec","job_status":"done","queue_duration_s":0.558896,"scheduling_latency_s":0.558909,"redis_calls":13,"redis_duration_s":0.001559,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001048,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005876,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010818,"completed_at":"2026-08-20T05:49:09.336Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1688gitlab # [ 190.380331] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.337Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9cb6988003291a6ecf7ea2a","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9cb6988003291a6ecf7ea2a: start","job_status":"start","queue_duration_s":0.570618,"scheduling_latency_s":0.570632}1689gitlab # [ 190.380891] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.347Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9cb6988003291a6ecf7ea2a","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9cb6988003291a6ecf7ea2a: done: 0.009947 sec","job_status":"done","queue_duration_s":0.570618,"scheduling_latency_s":0.570632,"redis_calls":13,"redis_duration_s":0.0015,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000484,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001016,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006535,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009947,"completed_at":"2026-08-20T05:49:09.347Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1690gitlab # [ 190.432686] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.348Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"adf48d1d9f739d21f6506679","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-adf48d1d9f739d21f6506679: start","job_status":"start","queue_duration_s":0.58149,"scheduling_latency_s":0.581504}1691gitlab # [ 190.432948] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.358Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"adf48d1d9f739d21f6506679","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-adf48d1d9f739d21f6506679: done: 0.009952 sec","job_status":"done","queue_duration_s":0.58149,"scheduling_latency_s":0.581504,"redis_calls":13,"redis_duration_s":0.0016120000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000576,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001036,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006529,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009952,"completed_at":"2026-08-20T05:49:09.358Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1692gitlab # [ 190.442541] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.359Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4fdeff644cdd04cd8cb25240","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4fdeff644cdd04cd8cb25240: start","job_status":"start","queue_duration_s":0.592334,"scheduling_latency_s":0.592348}1693gitlab # [ 190.452561] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.369Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4fdeff644cdd04cd8cb25240","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4fdeff644cdd04cd8cb25240: done: 0.010089 sec","job_status":"done","queue_duration_s":0.592334,"scheduling_latency_s":0.592348,"redis_calls":13,"redis_duration_s":0.0015960000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000594,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001002,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006049,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010089,"completed_at":"2026-08-20T05:49:09.369Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1694gitlab # [ 190.484620] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.371Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab5d6de181f5e41511fdadba","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab5d6de181f5e41511fdadba: start","job_status":"start","queue_duration_s":0.604076,"scheduling_latency_s":0.60409}1695gitlab # [ 190.494532] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.381Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab5d6de181f5e41511fdadba","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab5d6de181f5e41511fdadba: done: 0.010754 sec","job_status":"done","queue_duration_s":0.604076,"scheduling_latency_s":0.60409,"redis_calls":13,"redis_duration_s":0.001802,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000582,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00122,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010754,"completed_at":"2026-08-20T05:49:09.381Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1696gitlab # [ 190.539339] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.382Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7eb4a9d6002921db35ad6cef","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7eb4a9d6002921db35ad6cef: start","job_status":"start","queue_duration_s":0.615762,"scheduling_latency_s":0.615777}1697gitlab # [ 190.539992] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.395Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7eb4a9d6002921db35ad6cef","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7eb4a9d6002921db35ad6cef: done: 0.012348 sec","job_status":"done","queue_duration_s":0.615762,"scheduling_latency_s":0.615777,"redis_calls":13,"redis_duration_s":0.002145,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008318,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012348,"completed_at":"2026-08-20T05:49:09.395Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1698gitlab # [ 190.585191] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.396Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8bcba4cc1e862ad559c364b","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8bcba4cc1e862ad559c364b: start","job_status":"start","queue_duration_s":0.629564,"scheduling_latency_s":0.629579}1699gitlab # [ 190.585830] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.413Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8bcba4cc1e862ad559c364b","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8bcba4cc1e862ad559c364b: done: 0.016885 sec","job_status":"done","queue_duration_s":0.629564,"scheduling_latency_s":0.629579,"redis_calls":13,"redis_duration_s":0.0069889999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00646,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00802,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016885,"completed_at":"2026-08-20T05:49:09.413Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1700gitlab # [ 190.622705] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.415Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4928f8463bad696c6c0fa74f","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4928f8463bad696c6c0fa74f: start","job_status":"start","queue_duration_s":0.648542,"scheduling_latency_s":0.648561}1701gitlab # [ 190.623708] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.428Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4928f8463bad696c6c0fa74f","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4928f8463bad696c6c0fa74f: done: 0.013236 sec","job_status":"done","queue_duration_s":0.648542,"scheduling_latency_s":0.648561,"redis_calls":13,"redis_duration_s":0.0031009999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000596,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002505,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007185,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013236,"completed_at":"2026-08-20T05:49:09.428Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1702gitlab # [ 190.677576] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.429Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e17c53a0b5be0657c3387e7b","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e17c53a0b5be0657c3387e7b: start","job_status":"start","queue_duration_s":0.662055,"scheduling_latency_s":0.662069}1703gitlab # [ 190.678358] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.440Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e17c53a0b5be0657c3387e7b","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e17c53a0b5be0657c3387e7b: done: 0.01165 sec","job_status":"done","queue_duration_s":0.662055,"scheduling_latency_s":0.662069,"redis_calls":13,"redis_duration_s":0.001503,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000479,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001024,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007599,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01165,"completed_at":"2026-08-20T05:49:09.440Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1704gitlab # [ 190.713255] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1d7bbd3326707c36b45efb3","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1d7bbd3326707c36b45efb3: start","job_status":"start","queue_duration_s":0.674594,"scheduling_latency_s":0.674612}1705gitlab # [ 190.714188] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:09.451Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1d7bbd3326707c36b45efb3","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1d7bbd3326707c36b45efb3: done: 0.010412 sec","job_status":"done","queue_duration_s":0.674594,"scheduling_latency_s":0.674612,"redis_calls":13,"redis_duration_s":0.0015010000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000478,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007059,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010412,"completed_at":"2026-08-20T05:49:09.451Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1706gitlab # [ 190.776833] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:10.955Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20a27d51b69536e518881b1d","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20a27d51b69536e518881b1d: start","job_status":"start","queue_duration_s":2.188143,"scheduling_latency_s":2.188191}1707gitlab # [ 190.806650] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:10.984Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20a27d51b69536e518881b1d","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20a27d51b69536e518881b1d: done: 0.029727 sec","job_status":"done","queue_duration_s":2.188143,"scheduling_latency_s":2.188191,"redis_calls":13,"redis_duration_s":0.002932,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001136,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001796,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029727,"completed_at":"2026-08-20T05:49:10.984Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1708gitlab # [ 190.808806] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:10.987Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0a8adf165b0c4fa659ae0b4","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0a8adf165b0c4fa659ae0b4: start","job_status":"start","queue_duration_s":2.220205,"scheduling_latency_s":2.22024}1709gitlab # [ 190.833982] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:11.012Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0a8adf165b0c4fa659ae0b4","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0a8adf165b0c4fa659ae0b4: done: 0.025164 sec","job_status":"done","queue_duration_s":2.220205,"scheduling_latency_s":2.22024,"redis_calls":13,"redis_duration_s":0.003625,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001314,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002311,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016681,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025164,"completed_at":"2026-08-20T05:49:11.012Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1710gitlab # [ 190.844706] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:11.014Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1673f9cf99717884ae002b84","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1673f9cf99717884ae002b84: start","job_status":"start","queue_duration_s":2.247211,"scheduling_latency_s":2.247237}1711gitlab # [ 190.855695] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:11.025Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1673f9cf99717884ae002b84","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1673f9cf99717884ae002b84: done: 0.011791 sec","job_status":"done","queue_duration_s":2.247211,"scheduling_latency_s":2.247237,"redis_calls":13,"redis_duration_s":0.002484,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000792,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001692,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011791,"completed_at":"2026-08-20T05:49:11.025Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1712gitlab # [ 190.893259] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:11.027Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e2c0cbdd089673e179b301bc","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e2c0cbdd089673e179b301bc: start","job_status":"start","queue_duration_s":2.260048,"scheduling_latency_s":2.260061}1713gitlab # [ 190.896534] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:11.048Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e2c0cbdd089673e179b301bc","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e2c0cbdd089673e179b301bc: done: 0.021344 sec","job_status":"done","queue_duration_s":2.260048,"scheduling_latency_s":2.260061,"redis_calls":13,"redis_duration_s":0.007221999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000833,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006389,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010487,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021344,"completed_at":"2026-08-20T05:49:11.048Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1714gitlab # [ 190.930977] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:11.050Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19ced705c987a23aa15abebf","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19ced705c987a23aa15abebf: start","job_status":"start","queue_duration_s":2.283165,"scheduling_latency_s":2.283195}1715gitlab # [ 190.941443] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:11.069Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19ced705c987a23aa15abebf","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19ced705c987a23aa15abebf: done: 0.019021 sec","job_status":"done","queue_duration_s":2.283165,"scheduling_latency_s":2.283195,"redis_calls":13,"redis_duration_s":0.0027470000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000884,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001863,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012411,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019021,"completed_at":"2026-08-20T05:49:11.069Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1716gitlab # [ 190.990614] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:11.070Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c788bd007be439caa9b308b","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c788bd007be439caa9b308b: start","job_status":"start","queue_duration_s":2.303739,"scheduling_latency_s":2.303766}1717gitlab # [ 190.991495] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:11.083Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c788bd007be439caa9b308b","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c788bd007be439caa9b308b: done: 0.013003 sec","job_status":"done","queue_duration_s":2.303739,"scheduling_latency_s":2.303766,"redis_calls":13,"redis_duration_s":0.002595,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000892,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001703,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007147,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013003,"completed_at":"2026-08-20T05:49:11.083Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1718gitlab # [ 191.015146] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:11.084Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"974b7209581ff22d758f7a14","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-974b7209581ff22d758f7a14: start","job_status":"start","queue_duration_s":2.317795,"scheduling_latency_s":2.317809}1719gitlab # [ 191.025081] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:11.095Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"974b7209581ff22d758f7a14","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-974b7209581ff22d758f7a14: done: 0.01087 sec","job_status":"done","queue_duration_s":2.317795,"scheduling_latency_s":2.317809,"redis_calls":13,"redis_duration_s":0.002492,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000803,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001689,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005978,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01087,"completed_at":"2026-08-20T05:49:11.095Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1720gitlab # [ 191.062749] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:11.097Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b1e3def29fab5d02aa4b577","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b1e3def29fab5d02aa4b577: start","job_status":"start","queue_duration_s":2.330606,"scheduling_latency_s":2.33062}1721gitlab # [ 191.065553] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:11.110Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b1e3def29fab5d02aa4b577","created_at":"2026-08-20T05:49:08.724Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-2b248e2bea604068","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0c900224af063eb25e3bcd5cf3946dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.766Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b1e3def29fab5d02aa4b577: done: 0.012477 sec","job_status":"done","queue_duration_s":2.330606,"scheduling_latency_s":2.33062,"redis_calls":13,"redis_duration_s":0.0027099999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000856,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001854,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007817,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012477,"completed_at":"2026-08-20T05:49:11.109Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1722gitlab # [ 191.117741] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:11.111Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"14beb6a103596e25ae5e0161","created_at":"2026-08-20T05:49:08.802Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a0a3958107674751","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8c464a2fab20598e7813f4ffca2cd0b8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.808Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-14beb6a103596e25ae5e0161: start","job_status":"start","queue_duration_s":2.302881,"scheduling_latency_s":2.302897}1723gitlab # [ 191.118477] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:11.124Z","message":"No existing merge request to be cleaned up."}1724gitlab # [ 191.119305] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:11.134Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"14beb6a103596e25ae5e0161","created_at":"2026-08-20T05:49:08.802Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a0a3958107674751","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8c464a2fab20598e7813f4ffca2cd0b8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.808Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-14beb6a103596e25ae5e0161: done: 0.02325 sec","job_status":"done","queue_duration_s":2.302881,"scheduling_latency_s":2.302897,"redis_calls":10,"redis_duration_s":0.00294,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001069,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001871,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0168,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02325,"completed_at":"2026-08-20T05:49:11.134Z","load_balancing_strategy":"primary","db_duration_s":0.002682,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1725gitlab # [ 191.140326] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:11.136Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"81a3ddb4bba5337d2d2e8ba7","created_at":"2026-08-20T05:49:08.802Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a0a3958107674751","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8c464a2fab20598e7813f4ffca2cd0b8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.808Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-81a3ddb4bba5337d2d2e8ba7: start","job_status":"start","queue_duration_s":2.327667,"scheduling_latency_s":2.327693}1726gitlab # [ 191.175576] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:11.146Z","message":"No existing merge request to be cleaned up."}1727gitlab # [ 191.176319] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:11.152Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"81a3ddb4bba5337d2d2e8ba7","created_at":"2026-08-20T05:49:08.802Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a0a3958107674751","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8c464a2fab20598e7813f4ffca2cd0b8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.808Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-81a3ddb4bba5337d2d2e8ba7: done: 0.015971 sec","job_status":"done","queue_duration_s":2.327667,"scheduling_latency_s":2.327693,"redis_calls":10,"redis_duration_s":0.00166,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000841,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000819,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010009,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015971,"completed_at":"2026-08-20T05:49:11.152Z","load_balancing_strategy":"primary","db_duration_s":0.00124,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1728gitlab # [ 191.210911] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:11.152Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"549945363879e5cec9c0d6e1","created_at":"2026-08-20T05:49:08.802Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a0a3958107674751","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8c464a2fab20598e7813f4ffca2cd0b8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.808Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-549945363879e5cec9c0d6e1: start","job_status":"start","queue_duration_s":2.34445,"scheduling_latency_s":2.344465}1729gitlab # [ 191.211678] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:11.159Z","message":"No existing merge request to be cleaned up."}1730gitlab # [ 191.212483] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:11.163Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"549945363879e5cec9c0d6e1","created_at":"2026-08-20T05:49:08.802Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a0a3958107674751","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8c464a2fab20598e7813f4ffca2cd0b8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.808Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-549945363879e5cec9c0d6e1: done: 0.010881 sec","job_status":"done","queue_duration_s":2.34445,"scheduling_latency_s":2.344465,"redis_calls":10,"redis_duration_s":0.001179,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000482,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000697,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007433,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010881,"completed_at":"2026-08-20T05:49:11.163Z","load_balancing_strategy":"primary","db_duration_s":0.001018,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1731gitlab # [ 191.256674] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:11.164Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"20027d3d8f5739370f730473","created_at":"2026-08-20T05:49:08.802Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a0a3958107674751","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8c464a2fab20598e7813f4ffca2cd0b8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.808Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-20027d3d8f5739370f730473: start","job_status":"start","queue_duration_s":2.356131,"scheduling_latency_s":2.356143}1732gitlab # [ 191.257551] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:11.171Z","message":"No existing merge request to be cleaned up."}1733gitlab # [ 191.258230] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:11.176Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"20027d3d8f5739370f730473","created_at":"2026-08-20T05:49:08.802Z","trace_propagation_headers":{"sentry-trace":"5bdd750f579e42de84bb3be8465dd60b-a0a3958107674751","baggage":"sentry-trace_id=5bdd750f579e42de84bb3be8465dd60b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8c464a2fab20598e7813f4ffca2cd0b8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:08.808Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-20027d3d8f5739370f730473: done: 0.012221 sec","job_status":"done","queue_duration_s":2.356131,"scheduling_latency_s":2.356143,"redis_calls":10,"redis_duration_s":0.002005,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001077,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007636,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012221,"completed_at":"2026-08-20T05:49:11.176Z","load_balancing_strategy":"primary","db_duration_s":0.001432,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1734gitlab # [ 191.505153] runuser[2229]: pam_unix(runuser:session): session closed for user gitlab1735gitlab # [ 191.506266] setup-gitlab-start[2202]: + systemctl restart gitlab-sidekiq.service1736gitlab # [ 191.533406] systemd[1]: Stopping gitlab-sidekiq.service...1737gitlab # [ 191.534812] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:11.711Z","message":"Shutting down"}1738gitlab # [ 191.535525] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:11.712Z","message":"Scheduler exiting..."}1739gitlab # [ 191.540989] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:11.719Z","message":"Terminating quiet threads for default capsule"}1740gitlab # [ 191.541678] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:11.719Z","message":"Scheduler exiting..."}1741gitlab # [ 192.048341] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:12.226Z","message":"Pausing to allow jobs to finish..."}1742gitlab # [ 196.052881] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:16.230Z","message":"Bye!"}1743gitlab # [ 196.084140] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-20T05:49:16.262Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1623,"worker_id":"sidekiq_0","memwd_rss_bytes":939520000,"retry":0}1744gitlab # [ 196.775219] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1745gitlab # [ 196.778172] systemd[1]: Stopped gitlab-sidekiq.service.1746gitlab # [ 196.780252] systemd[1]: gitlab-sidekiq.service: Consumed 1min 1.542s CPU time over 2min 3.154s wall clock time, 962M memory peak, 5.2M read from disk.1747gitlab # [ 196.791641] systemd[1]: Started gitlab-sidekiq.service.1748gitlab # [ 196.794651] setup-gitlab-start[2202]: + mkdir -p /var/lib/secrets1749gitlab # [ 196.797363] setup-gitlab-start[2202]: + echo nixbot-test-token-of-20-chars1750gitlab # [ 196.799904] setup-gitlab-start[2202]: + chmod 644 /var/lib/secrets/gitlab-token1751gitlab # [ 196.802574] setup-gitlab-start[2202]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1752gitlab # [ 197.758283] gitaly[911]: time="2026-08-20T05:49:17.936Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVEWT3GAB3V8CCNDG941PA error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:49:27.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:49:17.935" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1753gitlab # [ 197.779125] gitaly[911]: time="2026-08-20T05:49:17.936Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVEWT3GAB3V8CCNDG941PA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:49:27.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:49:17.935" grpc.time_ms=0.581 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1754gitlab # [ 197.968749] gitaly[911]: time="2026-08-20T05:49:18.147Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVEWT3GAB3V8CCNDG941PA error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:49:28.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:49:18.147" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1755gitlab # [ 197.989243] gitaly[911]: time="2026-08-20T05:49:18.147Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVEWT3GAB3V8CCNDG941PA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:49:28.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:49:18.147" grpc.time_ms=0.367 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1756gitlab # [ 198.046446] gitaly[911]: time="2026-08-20T05:49:18.225Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVEWT3GAB3V8CCNDG941PA diskcache=2992b3b3-3594-4be0-a8b7-99ae8509327a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T05:49:28.017" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:49:18.158" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1757gitlab # [ 198.068666] gitaly[911]: time="2026-08-20T05:49:18.225Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1582 command.oublock=32 command.real_time_ms=35 command.spawn_token_fork_ms=0 command.system_time_ms=13 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVEWT3GAB3V8CCNDG941PA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T05:49:28.017" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:49:18.158" grpc.time_ms=66.55 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1758gitlab # [ 198.069298] gitaly[911]: time="2026-08-20T05:49:18.247Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVEWT3GAB3V8CCNDG941PA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:49:28.106" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:49:18.246" pid=911 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1759gitlab # [ 198.071077] gitaly[911]: time="2026-08-20T05:49:18.248Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVEWT3GAB3V8CCNDG941PA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:49:28.106" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:49:18.246" grpc.time_ms=1.426 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1760gitlab # [ 198.118279] gitaly[911]: time="2026-08-20T05:49:18.296Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVEWT3GAB3V8CCNDG941PA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:49:28.145" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:49:18.286" grpc.time_ms=10.407 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1761gitlab # [ 198.203777] gitaly[911]: time="2026-08-20T05:49:18.382Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVEWT3GAB3V8CCNDG941PA error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:49:28.241" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:49:18.382" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1762gitlab # [ 198.204515] gitaly[911]: time="2026-08-20T05:49:18.382Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVEWT3GAB3V8CCNDG941PA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:49:28.241" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:49:18.382" grpc.time_ms=0.471 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1763gitlab # [ 198.298789] gitaly[911]: time="2026-08-20T05:49:18.477Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVEWT3GAB3V8CCNDG941PA diskcache=40a70034-11c0-41ad-ab1c-a1c2b78a19fe grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T05:49:28.287" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:49:18.428" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1764gitlab # [ 198.299616] gitaly[911]: time="2026-08-20T05:49:18.477Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1574 command.oublock=32 command.real_time_ms=23 command.spawn_token_fork_ms=0 command.system_time_ms=17 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVEWT3GAB3V8CCNDG941PA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T05:49:28.287" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:49:18.428" grpc.time_ms=49.342 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1765gitlab # [ 198.338414] gitaly[911]: time="2026-08-20T05:49:18.517Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVEWT3GAB3V8CCNDG941PA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:49:28.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:49:18.516" pid=911 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1766gitlab # [ 198.339166] gitaly[911]: time="2026-08-20T05:49:18.517Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVEWT3GAB3V8CCNDG941PA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:49:28.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:49:18.516" grpc.time_ms=0.462 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1767gitlab # [ 198.354857] gitaly[911]: time="2026-08-20T05:49:18.533Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVEWT3GAB3V8CCNDG941PA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:49:28.011" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:49:18.522" grpc.time_ms=10.903 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1768gitlab # [ 198.393473] gitaly[911]: time="2026-08-20T05:49:18.572Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVEWT3GAB3V8CCNDG941PA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:49:28.061" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:49:18.571" grpc.time_ms=0.279 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1769gitlab # [ 198.405807] gitaly[911]: time="2026-08-20T05:49:18.584Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVEWT3GAB3V8CCNDG941PA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T05:49:28.073" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:49:18.583" grpc.time_ms=0.327 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1770gitlab # [ 198.875577] gitaly[911]: time="2026-08-20T05:49:19.053Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVEWT3GAB3V8CCNDG941PA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:49:29.002" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:49:19.042" grpc.time_ms=10.622 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1771gitlab # [ 199.331486] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:49:19 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 25131772gitlab # [ 199.337868] setup-gitlab-start[2202]: + mkdir -p /tmp/test-flake1773gitlab # [ 199.342473] setup-gitlab-start[2202]: + cd /tmp/test-flake1774gitlab # [ 199.342592] setup-gitlab-start[2202]: + git init -b master1775gitlab # [ 199.373851] setup-gitlab-start[2527]: Initialized empty Git repository in /tmp/test-flake/.git/1776gitlab # [ 199.374233] setup-gitlab-start[2202]: + git config user.name test1777gitlab # [ 199.377842] setup-gitlab-start[2202]: + git config user.email test@example.com1778gitlab # [ 199.383321] setup-gitlab-start[2202]: + cat1779gitlab # [ 199.388102] setup-gitlab-start[2202]: + git add flake.nix1780gitlab # [ 199.392414] setup-gitlab-start[2202]: + git commit -m 'initial commit'1781gitlab # [ 199.407737] setup-gitlab-start[2532]: [master (root-commit) cdfad25] initial commit1782gitlab # [ 199.408356] setup-gitlab-start[2532]: 1 file changed, 10 insertions(+)1783gitlab # [ 199.410211] setup-gitlab-start[2532]: create mode 100644 flake.nix1784gitlab # [ 199.411182] setup-gitlab-start[2202]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1785gitlab # [ 199.414117] setup-gitlab-start[2202]: + git push -u origin master1786gitlab # [ 199.483877] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:49:19 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 361787gitlab # [ 199.592634] gitaly[911]: time="2026-08-20T05:49:19.771Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVEZDKH7TDJMCB3A1VH374 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:49:19.759" grpc.time_ms=11.528 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1788gitlab # [ 199.594663] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:49:19 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 1051789gitlab # [ 199.868216] gitaly[911]: time="2026-08-20T05:49:20.046Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:49:30.005" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:49:20.035" grpc.time_ms=10.926 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1790gitlab # [ 199.924276] sidekiq-cluster[2479]: {"severity":"INFO","time":"2026-08-20T05:49:20.084Z","message":"Starting cluster with 1 processes"}1791gitlab # [ 199.945393] gitaly[911]: time="2026-08-20T05:49:20.123Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=330 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-20T05:49:50.014" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-20T05:49:20.114" grpc.time_ms=8.943 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1792gitlab # [ 199.983796] gitaly[911]: time="2026-08-20T05:49:20.162Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 duration_ms=183ns method=POST pid=911 status=200 url="http://unix/api/v4/internal/allowed"1793gitlab # [ 200.017450] gitaly[911]: time="2026-08-20T05:49:20.196Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 duration_ms=27ns method=POST pid=911 status=200 url="http://unix/api/v4/internal/pre_receive"1794gitlab # [ 200.023781] gitaly[911]: time="2026-08-20T05:49:20.202Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:49:19.977" grpc.time_ms=224.503 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1795gitlab # [ 200.078531] gitaly[911]: time="2026-08-20T05:49:20.257Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:49:20.256" grpc.time_ms=0.904 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1796gitlab # [ 200.135285] gitaly[911]: time="2026-08-20T05:49:20.313Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:49:20.312" grpc.time_ms=1.122 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1797gitlab # [ 200.171729] gitaly[911]: time="2026-08-20T05:49:20.350Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:49:20.350" grpc.time_ms=0.397 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1798gitlab # [ 200.250319] gitaly[911]: time="2026-08-20T05:49:20.428Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:49:30.279" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:49:20.420" grpc.time_ms=8.306 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1799gitlab # [ 200.271755] gitaly[911]: time="2026-08-20T05:49:20.450Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1568 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-20T05:49:30.293" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:49:20.433" grpc.time_ms=16.488 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1800gitlab # [ 200.279238] gitaly[911]: time="2026-08-20T05:49:20.457Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 duration_ms=77ns method=POST pid=911 status=200 url="http://unix/api/v4/internal/post_receive"1801gitlab # [ 200.280516] gitaly[911]: time="2026-08-20T05:49:20.458Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:49:20.379" grpc.time_ms=79.398 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1802gitlab # [ 200.303165] gitaly[911]: time="2026-08-20T05:49:20.481Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 diskcache=c52e5c79-0b75-4570-bc71-8c87a234ae58 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:49:19.901" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1803gitlab # [ 200.303962] gitaly[911]: time="2026-08-20T05:49:20.482Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=205 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=892928 command.minflt=13676 command.oublock=32 command.real_time_ms=571 command.spawn_token_fork_ms=0 command.system_time_ms=122 command.user_time_ms=83 component=gitaly.StreamServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:49:19.901" grpc.time_ms=580.569 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1804gitlab # [ 200.304876] gitlab-workhorse[827]: time="2026-08-20T05:49:20Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521805gitlab # [ 200.305667] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:49:20 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 6681806gitlab # [ 200.326499] setup-gitlab-start[2536]: To http://gitlab/root/test-flake.git1807gitlab # [ 200.327104] setup-gitlab-start[2536]: * [new branch] master -> master1808gitlab # [ 200.330913] setup-gitlab-start[2536]: branch 'master' set up to track 'origin/master'.1809gitlab # [ 200.333962] systemd[1]: Finished setup-gitlab.service.1810gitlab # [ 200.336452] systemd[1]: Starting nixbot CI service...1811gitlab: (finished: waiting for unit setup-gitlab.service, in 201.36 seconds)1812gitlab: waiting for unit nixbot.service1813gitlab # [ 201.443312] nixbot[2620]: {"ts": "2026-08-20T05:49:21.621Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1814gitlab # [ 201.473320] nixbot[2620]: {"ts": "2026-08-20T05:49:21.651Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1815gitlab # [ 201.500703] nixbot[2620]: {"ts": "2026-08-20T05:49:21.679Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1816gitlab # [ 201.508228] nixbot[2620]: {"ts": "2026-08-20T05:49:21.686Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1817gitlab # [ 201.514056] nixbot[2620]: {"ts": "2026-08-20T05:49:21.692Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1818gitlab # [ 201.520835] nixbot[2620]: {"ts": "2026-08-20T05:49:21.699Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1819gitlab # [ 201.524863] nixbot[2620]: {"ts": "2026-08-20T05:49:21.703Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1820gitlab # [ 201.528976] nixbot[2620]: {"ts": "2026-08-20T05:49:21.707Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1821gitlab # [ 201.537096] nixbot[2620]: {"ts": "2026-08-20T05:49:21.715Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1822gitlab # [ 201.540896] nixbot[2620]: {"ts": "2026-08-20T05:49:21.719Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1823gitlab # [ 201.547715] nixbot[2620]: {"ts": "2026-08-20T05:49:21.726Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1824gitlab # [ 201.555983] nixbot[2620]: {"ts": "2026-08-20T05:49:21.734Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1825gitlab # [ 201.561953] nixbot[2620]: {"ts": "2026-08-20T05:49:21.740Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1826gitlab # [ 201.566654] nixbot[2620]: {"ts": "2026-08-20T05:49:21.745Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1827gitlab # [ 201.572265] nixbot[2620]: {"ts": "2026-08-20T05:49:21.750Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1828gitlab # [ 201.576416] nixbot[2620]: {"ts": "2026-08-20T05:49:21.755Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1829gitlab # [ 201.580848] nixbot[2620]: {"ts": "2026-08-20T05:49:21.759Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1830gitlab # [ 201.585797] nixbot[2620]: {"ts": "2026-08-20T05:49:21.764Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1831gitlab # [ 201.595101] nixbot[2620]: {"ts": "2026-08-20T05:49:21.773Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1832gitlab # [ 201.599114] nixbot[2620]: {"ts": "2026-08-20T05:49:21.777Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1833gitlab # [ 201.604700] nixbot[2620]: {"ts": "2026-08-20T05:49:21.783Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1834gitlab # [ 201.613704] nixbot[2620]: {"ts": "2026-08-20T05:49:21.792Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1835gitlab # [ 201.617491] nixbot[2620]: {"ts": "2026-08-20T05:49:21.796Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1836gitlab # [ 201.622620] nixbot[2620]: {"ts": "2026-08-20T05:49:21.801Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1837gitlab # [ 201.625218] nixbot[2620]: {"ts": "2026-08-20T05:49:21.803Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1838gitlab # [ 201.945740] nixbot[2620]: INFO: Started server process [2620]1839gitlab # [ 201.946766] nixbot[2620]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1840gitlab # [ 201.964538] nixbot[2620]: INFO: ::ffff:127.0.0.1:38416 - "GET /health HTTP/1.1" 200 OK1841gitlab # [ 201.971282] systemd[1]: Started nixbot CI service.1842gitlab # [ 201.972834] systemd[1]: Reached target Multi-User System.1843gitlab # [ 201.976983] systemd[1]: Startup finished in 1.240s (kernel) + 3.585s (initrd) + 3min 17.150s (userspace) = 3min 21.976s.1844gitlab # [ 202.198468] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:49:22 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 2341845gitlab # [ 202.205049] nixbot[2620]: {"ts": "2026-08-20T05:49:22.383Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1846gitlab # [ 202.229353] nixbot[2620]: {"ts": "2026-08-20T05:49:22.407Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1847gitlab # [ 202.293305] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:49:22 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 511848gitlab # [ 202.294263] nixbot[2620]: {"ts": "2026-08-20T05:49:22.472Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1849gitlab # [ 202.295456] nixbot[2620]: {"ts": "2026-08-20T05:49:22.474Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1850gitlab # [ 202.396308] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:49:22 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 981851gitlab # [ 202.402051] nixbot[2620]: {"ts": "2026-08-20T05:49:22.580Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1852gitlab # [ 202.529507] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:49:22 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1131853gitlab # [ 202.531174] nixbot[2620]: {"ts": "2026-08-20T05:49:22.709Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1854gitlab # [ 202.589499] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:49:22 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 421855gitlab # [ 202.595112] nixbot[2620]: {"ts": "2026-08-20T05:49:22.773Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1856gitlab: (finished: waiting for unit nixbot.service, in 2.09 seconds)1857gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1858gitlab # [ 202.803253] nixbot[2620]: INFO: ::ffff:127.0.0.1:38432 - "GET /health HTTP/1.1" 200 OK1859gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.04 seconds)1860subtest: project discovered and webhook registered1861gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1862gitlab # [ 202.868065] nixbot[2620]: {"ts": "2026-08-20T05:49:23.046Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1863gitlab # [ 202.868767] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:49:23 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 2621864gitlab # [ 202.909588] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:49:23 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 671865gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.10 seconds)1866(finished: subtest: project discovered and webhook registered, in 0.10 seconds)1867subtest: push delivers the webhook1868gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1869gitlab # [ 202.965324] gitaly[911]: time="2026-08-20T05:49:23.143Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF2QEPGQCEHM9MCRYC0YQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-20T05:49:53.032" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:49:23.132" grpc.time_ms=10.394 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1870gitlab # [ 202.994722] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:49:23 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 341871gitlab # [ 203.015366] gitaly[911]: time="2026-08-20T05:49:23.193Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF2QEPGQCEHM9MCRYC0YQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:49:53.092" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:49:23.193" grpc.time_ms=0.511 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1872gitlab # [ 203.036871] gitaly[911]: time="2026-08-20T05:49:23.215Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF2QEPGQCEHM9MCRYC0YQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-20T05:49:33.007" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:49:23.207" grpc.time_ms=8.008 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1873gitlab # [ 203.106543] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:49:23 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 2301874gitlab # [ 203.112653] nixbot[2620]: {"ts": "2026-08-20T05:49:23.291Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1875gitlab # [ 203.201839] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:49:23 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 771876gitlab # [ 203.207723] nixbot[2620]: {"ts": "2026-08-20T05:49:23.386Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1877gitlab # [ 203.218266] nixbot[2620]: {"ts": "2026-08-20T05:49:23.396Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1878gitlab # [ 203.232367] gitaly[911]: time="2026-08-20T05:49:23.411Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVF2V7FHVWM2SDBXS0MYPA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:49:23.402" grpc.time_ms=8.848 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1879gitlab # [ 203.233802] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:49:23 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 203 "" "git/2.55.0" 2361880gitlab # Enumerating objects: 5, done.1881gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1882gitlab # Delta compression using up to 4 threads1883gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1884gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 274.00 KiB/s, done.1885gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1886gitlab # [ 203.342711] gitaly[911]: time="2026-08-20T05:49:23.521Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVF34CDWGS99THZYXE6B39 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:49:23.514" grpc.time_ms=6.732 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1887gitlab # [ 203.343938] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:49:23 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 541888gitlab # [ 203.423780] gitaly[911]: time="2026-08-20T05:49:23.602Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF364938Z4G4M6Y2HBG7K grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:49:23.595" pid=911 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1889gitlab # [ 203.424186] gitaly[911]: time="2026-08-20T05:49:23.602Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF364938Z4G4M6Y2HBG7K grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:49:23.595" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1890gitlab # [ 203.425150] gitaly[911]: time="2026-08-20T05:49:23.603Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF364938Z4G4M6Y2HBG7K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:49:23.595" grpc.time_ms=7.984 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1891gitlab # [ 203.426558] gitlab-workhorse[827]: time="2026-08-20T05:49:23Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131892gitlab # [ 203.427133] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:49:23 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 811893gitlab # [ 203.514096] gitaly[911]: time="2026-08-20T05:49:23.692Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=331 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVF33XYQTWS112XM44RJZW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-20T05:49:53.584" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-20T05:49:23.684" grpc.time_ms=7.898 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1894gitlab # [ 203.544105] gitaly[911]: time="2026-08-20T05:49:23.722Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0EVF33XYQTWS112XM44RJZW duration_ms=80ns method=POST pid=911 status=200 url="http://unix/api/v4/internal/allowed"1895gitlab # [ 203.564021] gitaly[911]: time="2026-08-20T05:49:23.742Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF39QV8S1PPHFZ97V5DF5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:49:23.730" pid=911 remote_ip="2001:db8:1::1" request_sha=7dd0ef57ff1b010f29ab945b8b3809dd5a422e8b response_bytes=223 span.kind=server system=grpc1896gitlab # [ 203.564433] gitaly[911]: time="2026-08-20T05:49:23.742Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1199 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF39QV8S1PPHFZ97V5DF5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:49:23.730" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1897gitlab # [ 203.566119] gitaly[911]: time="2026-08-20T05:49:23.744Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0EVF33XYQTWS112XM44RJZW duration_ms=21ns method=POST pid=911 status=200 url="http://unix/api/v4/internal/pre_receive"1898gitlab # [ 203.566849] gitaly[911]: time="2026-08-20T05:49:23.744Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVF33XYQTWS112XM44RJZW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:49:23.641" grpc.time_ms=103.418 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1899gitlab # [ 203.568222] gitaly[911]: time="2026-08-20T05:49:23.747Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1199 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF39QV8S1PPHFZ97V5DF5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:49:23.730" grpc.time_ms=16.524 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1900gitlab # [ 203.608394] gitlab-workhorse[827]: time="2026-08-20T05:49:23Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231901gitlab # [ 203.608552] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:49:23 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 1461902gitlab # [ 203.626123] gitaly[911]: time="2026-08-20T05:49:23.804Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVF33XYQTWS112XM44RJZW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:49:23.804" grpc.time_ms=0.545 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1903gitlab # [ 203.659075] gitaly[911]: time="2026-08-20T05:49:23.837Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVF33XYQTWS112XM44RJZW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:49:23.837" grpc.time_ms=0.327 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1904gitlab # [ 203.687047] gitaly[911]: time="2026-08-20T05:49:23.865Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVF33XYQTWS112XM44RJZW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:49:23.865" grpc.time_ms=0.422 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1905gitlab # [ 203.695559] gitaly[911]: time="2026-08-20T05:49:23.870Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVF3F9TYS96Q9QQDM12DCR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:49:23.861" grpc.time_ms=9.216 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1906gitlab # [ 203.706564] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:49:23 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 531907gitlab # [ 203.744423] gitaly[911]: time="2026-08-20T05:49:23.923Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF3H0WQFNKB410NSTJBJ8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:49:23.915" pid=911 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1908gitlab # [ 203.753257] gitaly[911]: time="2026-08-20T05:49:23.924Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF3H0WQFNKB410NSTJBJ8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:49:23.915" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1909gitlab # [ 203.764400] gitlab-workhorse[827]: time="2026-08-20T05:49:23Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671910gitlab # [ 203.766058] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:49:23 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 531911gitlab # [ 203.767690] gitaly[911]: time="2026-08-20T05:49:23.924Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF3H0WQFNKB410NSTJBJ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:49:23.915" grpc.time_ms=8.558 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1912gitlab # [ 203.823501] gitaly[911]: time="2026-08-20T05:49:24.002Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0EVF33XYQTWS112XM44RJZW duration_ms=100ns method=POST pid=911 status=200 url="http://unix/api/v4/internal/post_receive"1913gitlab # [ 203.827672] gitaly[911]: time="2026-08-20T05:49:24.002Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVF33XYQTWS112XM44RJZW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:49:23.901" grpc.time_ms=100.861 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1914gitlab # [ 203.841279] gitaly[911]: time="2026-08-20T05:49:24.020Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0EVF33XYQTWS112XM44RJZW diskcache=8542ee47-9499-4368-846b-5bd1eca1e7e4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:49:23.554" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1915gitlab # To http://gitlab/root/test-flake.git1916gitlab # cdfad25..848de65 master -> master1917gitlab # [ 203.854618] gitaly[911]: time="2026-08-20T05:49:24.020Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=132 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=876544 command.minflt=13343 command.oublock=32 command.real_time_ms=458 command.spawn_token_fork_ms=0 command.system_time_ms=87 command.user_time_ms=45 component=gitaly.StreamServerInterceptor correlation_id=01M0EVF33XYQTWS112XM44RJZW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:49:23.554" grpc.time_ms=465.437 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1918gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.96 seconds)1919gitlab # [ 203.865559] gitlab-workhorse[827]: time="2026-08-20T05:49:24Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521920gitlab: must succeed: git -C /tmp/test-flake rev-parse master1921gitlab # [ 203.867164] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:49:24 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 5671922gitlab # [ 203.875048] gitaly[911]: time="2026-08-20T05:49:24.052Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF3JSRDDJKYZRETDYK0Q4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:49:24.039" pid=911 remote_ip="2001:db8:1::1" request_sha=1c0ba62e24444a827013e7af201178c304bf6f26 response_bytes=338 span.kind=server system=grpc1923gitlab # [ 203.883158] gitlab-workhorse[827]: time="2026-08-20T05:49:24Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3381924gitlab # [ 203.884807] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:49:24 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 338 "" "git/2.55.0" 1241925gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.02 seconds)1926gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'1927gitlab # [ 203.886631] gitaly[911]: time="2026-08-20T05:49:24.052Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1188 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF3JSRDDJKYZRETDYK0Q4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:49:24.039" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1928gitlab # [ 203.897813] gitaly[911]: time="2026-08-20T05:49:24.053Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1188 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF3JSRDDJKYZRETDYK0Q4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:49:24.039" grpc.time_ms=13.332 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1929gitlab # [ 203.947529] nixbot[2620]: INFO: ::ffff:127.0.0.1:35274 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK1930gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.06 seconds)1931gitlab # [ 204.011385] gitaly[911]: time="2026-08-20T05:49:24.189Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVF3SC53HPEMR1P77MXSN4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:49:24.176" grpc.time_ms=12.567 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1932gitlab # [ 204.030153] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:49:24 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 491933gitlab # [ 204.111178] gitaly[911]: time="2026-08-20T05:49:24.289Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF3V0XBDBER8ZFY5SGAEF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:49:24.275" pid=911 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1934gitlab # [ 204.111485] gitaly[911]: time="2026-08-20T05:49:24.290Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1158 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF3V0XBDBER8ZFY5SGAEF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:49:24.275" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1935gitlab # [ 204.158453] gitaly[911]: time="2026-08-20T05:49:24.337Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1158 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF3V0XBDBER8ZFY5SGAEF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:49:24.275" grpc.time_ms=61.223 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1936gitlab # [ 204.159221] gitlab-workhorse[827]: time="2026-08-20T05:49:24Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091937gitlab # [ 204.160410] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:49:24 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 1451938gitlab # [ 204.277279] gitaly[911]: time="2026-08-20T05:49:24.455Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF41ARCXRYZGTKQDC09F5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:49:54.354" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:49:24.454" grpc.time_ms=0.755 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1939gitlab # [ 204.341117] gitaly[911]: time="2026-08-20T05:49:24.519Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVF41ARCXRYZGTKQDC09F5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-20T05:49:54.408" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:49:24.509" grpc.time_ms=10.399 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1940gitlab # [ 204.399834] gitaly[911]: time="2026-08-20T05:49:24.578Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVF41ARCXRYZGTKQDC09F5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:49:34.057" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:49:24.568" grpc.time_ms=9.938 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1941gitlab # [ 204.435331] gitaly[911]: time="2026-08-20T05:49:24.613Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVF41ARCXRYZGTKQDC09F5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:49:34.094" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:49:24.605" grpc.time_ms=8.477 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1942gitlab # [ 204.506572] gitaly[911]: time="2026-08-20T05:49:24.685Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF41ARCXRYZGTKQDC09F5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T05:49:34.174" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:49:24.684" grpc.time_ms=0.238 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1943gitlab # [ 204.553893] gitaly[911]: time="2026-08-20T05:49:24.732Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF41ARCXRYZGTKQDC09F5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T05:49:34.209" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:49:24.720" grpc.time_ms=11.934 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1944gitlab # [ 204.639500] gitaly[911]: time="2026-08-20T05:49:24.818Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVF41ARCXRYZGTKQDC09F5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:49:24.817" grpc.time_ms=0.703 pid=911 span.kind=server system=grpc1945gitlab # [ 204.696837] gitaly[911]: time="2026-08-20T05:49:24.875Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVF41ARCXRYZGTKQDC09F5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:49:24.874" grpc.time_ms=0.673 pid=911 span.kind=server system=grpc1946gitlab # [ 204.724149] gitaly[911]: time="2026-08-20T05:49:24.902Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF41ARCXRYZGTKQDC09F5 diskcache=5dae1449-3943-442d-b63d-9c59bc66ce98 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:49:34.250" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:49:24.761" pid=911 ref=refs/keep-around/cdfad2516041998554ac4f31826da9c7a308d68b remote_ip="2001:db8:1::1" revision=cdfad2516041998554ac4f31826da9c7a308d68b span.kind=server system=grpc username=root1947gitlab # [ 204.734533] gitaly[911]: time="2026-08-20T05:49:24.903Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=120 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5394 command.oublock=8 command.real_time_ms=132 command.spawn_token_fork_ms=0 command.system_time_ms=81 command.user_time_ms=39 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF41ARCXRYZGTKQDC09F5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:49:34.250" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:49:24.761" grpc.time_ms=141.768 pid=911 ref=refs/keep-around/cdfad2516041998554ac4f31826da9c7a308d68b remote_ip="2001:db8:1::1" revision=cdfad2516041998554ac4f31826da9c7a308d68b span.kind=server system=grpc username=root1948gitlab # [ 204.735239] gitaly[911]: time="2026-08-20T05:49:24.908Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF41ARCXRYZGTKQDC09F5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:49:54.807" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:49:24.908" grpc.time_ms=0.439 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1949gitlab # [ 204.914164] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:49:25 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/cdfad2516041998554ac4f31826da9c7a308d68b HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 6971950gitlab # [ 204.920583] nixbot[2620]: {"ts": "2026-08-20T05:49:25.099Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/cdfad2516041998554ac4f31826da9c7a308d68b \"HTTP/1.1 201 Created\""}1951gitlab # [ 204.935226] nixbot[2620]: {"ts": "2026-08-20T05:49:25.113Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-cdfad2516041-0"}1952gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'1953gitlab # [ 204.976693] nixbot[2620]: INFO: ::ffff:127.0.0.1:35284 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK1954gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.03 seconds)1955gitlab # [ 204.989320] systemd[1]: Started Nix Daemon.1956gitlab # [ 205.035955] nix-daemon[2839]: accepted connection from pid 2830, user nixbot1957gitlab # [ 205.111250] nix-daemon[2839]: accepted connection from pid 2846, user nixbot1958gitlab # [ 205.127372] nixbot[2620]: {"ts": "2026-08-20T05:49:25.305Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-cdfad2516041-0", "argv0": "bwrap"}1959gitlab # [ 205.279424] nix-daemon[2839]: accepted connection from pid 2856, user nixbot1960gitlab # [ 205.330364] nix-daemon[2839]: accepted connection from pid 2866, user nixbot1961gitlab # [ 205.350214] nix-daemon[2839]: accepted connection from pid 2856, user nixbot1962gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'1963gitlab # [ 206.021413] nixbot[2620]: INFO: ::ffff:127.0.0.1:35286 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK1964gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)1965gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'1966gitlab # [ 207.062147] nixbot[2620]: INFO: ::ffff:127.0.0.1:35298 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK1967gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)1968gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'1969gitlab # [ 208.099768] nixbot[2620]: INFO: ::ffff:127.0.0.1:35312 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK1970gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)1971gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'1972gitlab # [ 209.136944] nixbot[2620]: INFO: ::ffff:127.0.0.1:35328 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK1973gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)1974gitlab # [ 210.032761] nix-daemon[2839]: accepted connection from pid 2895, user nixbot1975gitlab # [ 210.087810] gitaly[911]: time="2026-08-20T05:49:30.266Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF9PTR02R4FHQJM2E1FFS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:50:00.165" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:49:30.265" grpc.time_ms=0.556 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1976gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'1977gitlab # [ 210.166366] nixbot[2620]: INFO: ::ffff:127.0.0.1:35340 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK1978gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.03 seconds)1979gitlab # [ 210.363448] gitaly[911]: time="2026-08-20T05:49:30.542Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0EVF9PTR02R4FHQJM2E1FFS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:49:40.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:49:30.530" grpc.time_ms=11.652 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1980gitlab # [ 210.506804] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:49:30 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/cdfad2516041998554ac4f31826da9c7a308d68b HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 4821981gitlab # [ 210.508668] nixbot[2620]: {"ts": "2026-08-20T05:49:30.687Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/cdfad2516041998554ac4f31826da9c7a308d68b \"HTTP/1.1 201 Created\""}1982gitlab # [ 210.558621] gitaly[911]: time="2026-08-20T05:49:30.737Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVFA648GM915FEDME3K5TF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:50:00.635" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:49:30.736" grpc.time_ms=0.913 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1983gitlab # [ 210.628871] gitaly[911]: time="2026-08-20T05:49:30.807Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVFA648GM915FEDME3K5TF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:49:40.272" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:49:30.793" grpc.time_ms=14.248 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1984gitlab # [ 210.677760] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:49:30 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/cdfad2516041998554ac4f31826da9c7a308d68b HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1621985gitlab # [ 210.683459] nixbot[2620]: {"ts": "2026-08-20T05:49:30.858Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/cdfad2516041998554ac4f31826da9c7a308d68b \"HTTP/1.1 201 Created\""}1986gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'1987gitlab # [ 211.199348] nixbot[2620]: INFO: ::ffff:127.0.0.1:35348 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK1988gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.03 seconds)1989gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'1990gitlab # [ 212.238524] nixbot[2620]: INFO: ::ffff:127.0.0.1:35352 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK1991gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)1992gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'1993gitlab # [ 213.278585] nixbot[2620]: INFO: ::ffff:127.0.0.1:36264 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK1994gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)1995gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'1996gitlab # [ 214.313917] nixbot[2620]: INFO: ::ffff:127.0.0.1:36266 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK1997gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.03 seconds)1998gitlab # [ 214.813364] nix-daemon[2839]: accepted connection from pid 2940, user nixbot1999gitlab # [ 214.913853] gitaly[911]: time="2026-08-20T05:49:35.091Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVFEDFX60CHBDWTEH2X825 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:50:05.089" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:49:35.090" grpc.time_ms=1.061 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2000gitlab # [ 214.964758] gitaly[911]: time="2026-08-20T05:49:35.143Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVFEDFX60CHBDWTEH2X825 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:49:45.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:49:35.132" grpc.time_ms=11.075 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2001gitlab # [ 215.014800] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:49:35 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/cdfad2516041998554ac4f31826da9c7a308d68b HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1682002gitlab # [ 215.020628] nixbot[2620]: {"ts": "2026-08-20T05:49:35.193Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/cdfad2516041998554ac4f31826da9c7a308d68b \"HTTP/1.1 201 Created\""}2003gitlab # [ 215.103991] nix-daemon[2839]: accepted connection from pid 2954, user nixbot2004gitlab # [ 215.217923] gitaly[911]: time="2026-08-20T05:49:35.396Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVFEQACNQ2Z5HQNTGSFSCM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:49:35.380" grpc.time_ms=15.748 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2005gitlab # [ 215.245111] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:49:35 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 852006gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2007gitlab # [ 215.304479] gitaly[911]: time="2026-08-20T05:49:35.483Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVFET5W6G7W0VSV0B8T2AA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:49:35.471" pid=911 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2008gitlab # [ 215.327405] gitaly[911]: time="2026-08-20T05:49:35.483Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVFET5W6G7W0VSV0B8T2AA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:49:35.471" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2009gitlab # [ 215.345552] gitaly[911]: time="2026-08-20T05:49:35.524Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVFET5W6G7W0VSV0B8T2AA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:49:35.471" grpc.time_ms=52.812 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2010gitlab # [ 215.361704] gitlab-workhorse[827]: time="2026-08-20T05:49:35Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672011gitlab # [ 215.361996] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:49:35 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1112012gitlab # [ 215.373215] nixbot[2620]: INFO: ::ffff:127.0.0.1:36272 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2013gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.06 seconds)2014gitlab # [ 215.451343] nix-daemon[2839]: accepted connection from pid 2982, user nixbot2015gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2016gitlab # [ 216.414443] nixbot[2620]: INFO: ::ffff:127.0.0.1:36280 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2017gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)2018gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2019gitlab # [ 217.454852] nixbot[2620]: INFO: ::ffff:127.0.0.1:36292 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2020gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)2021gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2022gitlab # [ 218.493265] nixbot[2620]: INFO: ::ffff:127.0.0.1:36294 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2023gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)2024gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2025gitlab # [ 219.532808] nixbot[2620]: INFO: ::ffff:127.0.0.1:36304 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2026gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)2027gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2028gitlab # [ 220.573153] nixbot[2620]: INFO: ::ffff:127.0.0.1:36318 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2029gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)2030gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2031gitlab # [ 221.615352] nixbot[2620]: INFO: ::ffff:127.0.0.1:36334 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2032gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)2033gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2034gitlab # [ 222.655962] nixbot[2620]: INFO: ::ffff:127.0.0.1:36346 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2035gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)2036gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2037gitlab # [ 223.694374] nixbot[2620]: INFO: ::ffff:127.0.0.1:50406 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2038gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)2039gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2040gitlab # [ 224.720629] nixbot[2620]: INFO: ::ffff:127.0.0.1:50408 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2041gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.02 seconds)2042gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2043gitlab # [ 225.756505] nixbot[2620]: INFO: ::ffff:127.0.0.1:50416 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2044gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)2045gitlab # [ 226.463792] sidekiq-cluster[2570]: 2026-08-20T05:49:46.641Z pid=2570 tid=xb6 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2570, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>451223552}2046gitlab # [ 226.632836] sidekiq-cluster[2570]: W, [2026-08-20T05:49:46.811374 #2570] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.2047gitlab # [ 226.670439] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:49:46.849Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}2048gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2049gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)2050gitlab # [ 226.797688] nixbot[2620]: INFO: ::ffff:127.0.0.1:50430 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2051gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2052gitlab # [ 227.833236] nixbot[2620]: INFO: ::ffff:127.0.0.1:50440 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2053gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)2054gitlab # [ 228.522912] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:49:48.700Z","message":"GitLab reliable fetch activated!"}2055gitlab # [ 228.523308] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:49:48.701Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2056gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2057gitlab # [ 228.868786] nixbot[2620]: INFO: ::ffff:127.0.0.1:50452 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2058gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)2059gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2060gitlab # [ 229.906815] nixbot[2620]: INFO: ::ffff:127.0.0.1:50456 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2061gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)2062gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2063gitlab # [ 230.945922] nixbot[2620]: INFO: ::ffff:127.0.0.1:50464 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2064gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)2065gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2066gitlab # [ 231.981786] nixbot[2620]: INFO: ::ffff:127.0.0.1:50472 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2067gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)2068gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2069gitlab # [ 233.018674] nixbot[2620]: INFO: ::ffff:127.0.0.1:32872 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2070gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)2071gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2072gitlab # [ 234.055585] nixbot[2620]: INFO: ::ffff:127.0.0.1:32882 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2073gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)2074gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2075gitlab # [ 235.094479] nixbot[2620]: INFO: ::ffff:127.0.0.1:32888 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2076gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.03 seconds)2077gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2078gitlab # [ 236.129263] nixbot[2620]: INFO: ::ffff:127.0.0.1:32902 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2079gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)2080gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2081gitlab # [ 237.167437] nixbot[2620]: INFO: ::ffff:127.0.0.1:32914 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2082gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)2083gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2084gitlab # [ 238.204108] nixbot[2620]: INFO: ::ffff:127.0.0.1:32922 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2085gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)2086gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2087gitlab # [ 239.242135] nixbot[2620]: INFO: ::ffff:127.0.0.1:32932 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2088gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)2089gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2090gitlab # [ 240.278174] nixbot[2620]: INFO: ::ffff:127.0.0.1:32946 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2091gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)2092gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2093gitlab # [ 241.315482] nixbot[2620]: INFO: ::ffff:127.0.0.1:32958 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2094gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.03 seconds)2095gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2096gitlab # [ 242.350154] nixbot[2620]: INFO: ::ffff:127.0.0.1:32962 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2097gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.03 seconds)2098gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2099gitlab # [ 243.390484] nixbot[2620]: INFO: ::ffff:127.0.0.1:33046 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2100gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)2101gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2102gitlab # [ 244.427078] nixbot[2620]: INFO: ::ffff:127.0.0.1:33056 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2103gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)2104gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2105gitlab # [ 245.465446] nixbot[2620]: INFO: ::ffff:127.0.0.1:33066 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2106gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)2107gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2108gitlab # [ 246.501053] nixbot[2620]: INFO: ::ffff:127.0.0.1:33076 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2109gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.03 seconds)2110gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2111gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.02 seconds)2112gitlab # [ 247.527817] nixbot[2620]: INFO: ::ffff:127.0.0.1:33080 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2113gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2114gitlab # [ 248.560755] nixbot[2620]: INFO: ::ffff:127.0.0.1:33090 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2115gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)2116gitlab # [ 249.114392] postgres[3101]: [3101] ERROR: relation "table_without_models" does not exist2117gitlab # [ 249.117123] postgres[3101]: [3101] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')2118gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2119gitlab # [ 249.591916] nixbot[2620]: INFO: ::ffff:127.0.0.1:33098 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2120gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.03 seconds)2121gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2122gitlab # [ 250.630101] nixbot[2620]: INFO: ::ffff:127.0.0.1:33102 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2123gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)2124gitlab # [ 251.529721] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:11.708Z","message":"Booted Rails 7.2.3.1 application in production environment"}2125gitlab # [ 251.531256] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:11.710Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}2126gitlab # [ 251.532441] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:11.710Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}2127gitlab # [ 251.533397] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:11.710Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}2128gitlab # [ 251.537057] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:11.713Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2129gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2130gitlab # [ 251.668499] nixbot[2620]: INFO: ::ffff:127.0.0.1:33112 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2131gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)2132gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2133gitlab # [ 252.705113] nixbot[2620]: INFO: ::ffff:127.0.0.1:33114 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2134gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)2135gitlab # [ 253.018432] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:13.195Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"ef70c7ba7d62435e6c1b1eb6","created_at":"2026-08-20T05:49:18.317Z","trace_propagation_headers":{"sentry-trace":"6919297ccbfb47c791cfeeb19ae430c2-6313499624384427","baggage":"sentry-trace_id=6919297ccbfb47c791cfeeb19ae430c2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVEWT3GAB3V8CCNDG941PA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:18.346Z","job_size_bytes":2,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-ef70c7ba7d62435e6c1b1eb6: start","job_status":"start","queue_duration_s":54.849591,"scheduling_latency_s":54.84965}2136gitlab # [ 253.198752] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:13.377Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"ef70c7ba7d62435e6c1b1eb6","created_at":"2026-08-20T05:49:18.317Z","trace_propagation_headers":{"sentry-trace":"6919297ccbfb47c791cfeeb19ae430c2-6313499624384427","baggage":"sentry-trace_id=6919297ccbfb47c791cfeeb19ae430c2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVEWT3GAB3V8CCNDG941PA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:18.346Z","job_size_bytes":2,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-ef70c7ba7d62435e6c1b1eb6: done: 0.181535 sec","job_status":"done","queue_duration_s":54.849591,"scheduling_latency_s":54.84965,"redis_calls":23,"redis_duration_s":0.0058460000000000005,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.003,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001565,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001281,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.058411,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.084486436,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.181535,"completed_at":"2026-08-20T05:50:13.377Z","load_balancing_strategy":"primary","db_duration_s":0.0608,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2137gitlab # [ 253.200545] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:13.378Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"a09b5a1c2f6b9f177ff299ec","created_at":"2026-08-20T05:49:18.365Z","trace_propagation_headers":{"sentry-trace":"6919297ccbfb47c791cfeeb19ae430c2-6313499624384427","baggage":"sentry-trace_id=6919297ccbfb47c791cfeeb19ae430c2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVEWT3GAB3V8CCNDG941PA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:18.373Z","job_size_bytes":2,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-a09b5a1c2f6b9f177ff299ec: start","job_status":"start","queue_duration_s":55.004629,"scheduling_latency_s":55.004645}2138gitlab # [ 253.294289] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:13.472Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"a09b5a1c2f6b9f177ff299ec","created_at":"2026-08-20T05:49:18.365Z","trace_propagation_headers":{"sentry-trace":"6919297ccbfb47c791cfeeb19ae430c2-6313499624384427","baggage":"sentry-trace_id=6919297ccbfb47c791cfeeb19ae430c2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVEWT3GAB3V8CCNDG941PA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:18.373Z","job_size_bytes":2,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-a09b5a1c2f6b9f177ff299ec: done: 0.093976 sec","job_status":"done","queue_duration_s":55.004629,"scheduling_latency_s":55.004645,"redis_calls":14,"redis_duration_s":0.003106,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000697,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001426,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000983,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046386,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.076807528,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.093976,"completed_at":"2026-08-20T05:50:13.472Z","load_balancing_strategy":"primary","db_duration_s":0.037049,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2139gitlab # [ 253.330839] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:13.509Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"9a9aaa454ed49da78c91db8b","created_at":"2026-08-20T05:49:18.879Z","trace_propagation_headers":{"sentry-trace":"6919297ccbfb47c791cfeeb19ae430c2-6313499624384427","baggage":"sentry-trace_id=6919297ccbfb47c791cfeeb19ae430c2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVEWT3GAB3V8CCNDG941PA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:18.884Z","job_size_bytes":5,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-9a9aaa454ed49da78c91db8b: start","job_status":"start","queue_duration_s":54.624433,"scheduling_latency_s":54.624456}2140gitlab # [ 253.502576] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:13.680Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"9a9aaa454ed49da78c91db8b","created_at":"2026-08-20T05:49:18.879Z","trace_propagation_headers":{"sentry-trace":"6919297ccbfb47c791cfeeb19ae430c2-6313499624384427","baggage":"sentry-trace_id=6919297ccbfb47c791cfeeb19ae430c2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVEWT3GAB3V8CCNDG941PA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:18.884Z","job_size_bytes":5,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-9a9aaa454ed49da78c91db8b: done: 0.171752 sec","job_status":"done","queue_duration_s":54.624433,"scheduling_latency_s":54.624456,"redis_calls":12,"redis_duration_s":0.003678,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001129,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001935,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000614,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.120496,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000297244,"duration_s":0.171752,"completed_at":"2026-08-20T05:50:13.680Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026312,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2141gitlab # [ 253.504360] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:13.682Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"369a75d1acada6117eaa8c9f","created_at":"2026-08-20T05:49:18.906Z","trace_propagation_headers":{"sentry-trace":"6919297ccbfb47c791cfeeb19ae430c2-6313499624384427","baggage":"sentry-trace_id=6919297ccbfb47c791cfeeb19ae430c2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVEWT3GAB3V8CCNDG941PA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:18.915Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-369a75d1acada6117eaa8c9f: start","job_status":"start","queue_duration_s":54.767164,"scheduling_latency_s":54.767179}2142gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2143gitlab # [ 253.656160] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:13.834Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"369a75d1acada6117eaa8c9f","created_at":"2026-08-20T05:49:18.906Z","trace_propagation_headers":{"sentry-trace":"6919297ccbfb47c791cfeeb19ae430c2-6313499624384427","baggage":"sentry-trace_id=6919297ccbfb47c791cfeeb19ae430c2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVEWT3GAB3V8CCNDG941PA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:18.915Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-369a75d1acada6117eaa8c9f: done: 0.151938 sec","job_status":"done","queue_duration_s":54.767164,"scheduling_latency_s":54.767179,"redis_calls":11,"redis_duration_s":0.002466,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000631,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001431,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000404,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.127,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.127,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.083461,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000361498,"duration_s":0.151938,"completed_at":"2026-08-20T05:50:13.834Z","load_balancing_strategy":"primary","db_duration_s":0.067706,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2144gitlab # [ 253.658293] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:13.835Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"6d94fc77d48487fbe1d49ba8","created_at":"2026-08-20T05:49:18.920Z","trace_propagation_headers":{"sentry-trace":"6919297ccbfb47c791cfeeb19ae430c2-6313499624384427","baggage":"sentry-trace_id=6919297ccbfb47c791cfeeb19ae430c2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVEWT3GAB3V8CCNDG941PA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:18.927Z","job_size_bytes":89,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-6d94fc77d48487fbe1d49ba8: start","job_status":"start","queue_duration_s":54.908125,"scheduling_latency_s":54.90814}2145gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)2146gitlab # [ 253.735225] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:13.861Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"6d94fc77d48487fbe1d49ba8","created_at":"2026-08-20T05:49:18.920Z","trace_propagation_headers":{"sentry-trace":"6919297ccbfb47c791cfeeb19ae430c2-6313499624384427","baggage":"sentry-trace_id=6919297ccbfb47c791cfeeb19ae430c2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVEWT3GAB3V8CCNDG941PA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:18.927Z","job_size_bytes":89,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-6d94fc77d48487fbe1d49ba8: done: 0.02605 sec","job_status":"done","queue_duration_s":54.908125,"scheduling_latency_s":54.90814,"redis_calls":11,"redis_duration_s":0.002295,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000648,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001286,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000361,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015319,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00030367,"duration_s":0.02605,"completed_at":"2026-08-20T05:50:13.861Z","load_balancing_strategy":"primary","db_duration_s":0.005229,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2147gitlab # [ 253.753548] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:13.862Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 cdfad2516041998554ac4f31826da9c7a308d68b refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"28ce0969c574954e1e9a7e3c","created_at":"2026-08-20T05:49:20.404Z","trace_propagation_headers":{"sentry-trace":"d1b368de7b3a4446ab31509a1e3290e8-1824223a83514a52","baggage":"sentry-trace_id=d1b368de7b3a4446ab31509a1e3290e8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVEZJ57E2F4N71EH50MEM6","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:20.408Z","job_size_bytes":185,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-28ce0969c574954e1e9a7e3c: start","job_status":"start","queue_duration_s":53.454433,"scheduling_latency_s":53.454446}2148gitlab # [ 253.754219] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:13.873Z","message":"changes: \"0000000000000000000000000000000000000000 cdfad2516041998554ac4f31826da9c7a308d68b refs/heads/master\\n\""}2149gitlab # [ 253.754886] gitaly[911]: time="2026-08-20T05:50:13.900Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:50:23.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:50:13.893" grpc.time_ms=6.969 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2150gitlab # [ 253.793829] nixbot[2620]: INFO: ::ffff:127.0.0.1:50352 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2151gitlab # [ 253.794473] gitaly[911]: time="2026-08-20T05:50:13.913Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:50:23.017" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:50:13.908" grpc.time_ms=5.287 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2152gitlab # [ 253.795112] gitaly[911]: time="2026-08-20T05:50:13.968Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-20T05:50:23.065" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:50:13.955" grpc.time_ms=12.229 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2153gitlab # [ 253.825331] gitaly[911]: time="2026-08-20T05:50:14.004Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:50:14.003" grpc.time_ms=0.648 pid=911 span.kind=server system=grpc2154gitlab # [ 253.858610] gitaly[911]: time="2026-08-20T05:50:14.037Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:50:14.036" grpc.time_ms=0.247 pid=911 span.kind=server system=grpc2155gitlab # [ 253.877313] gitaly[911]: time="2026-08-20T05:50:14.056Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 diskcache=58f3591d-a6b9-4d27-a7ae-47d9f7d28a93 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:50:23.087" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:50:13.978" pid=911 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2156gitlab # [ 253.877839] gitaly[911]: time="2026-08-20T05:50:14.056Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=53 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4746 command.oublock=8 command.real_time_ms=68 command.spawn_token_fork_ms=0 command.system_time_ms=36 command.user_time_ms=17 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:50:23.087" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:50:13.978" grpc.time_ms=77.994 pid=911 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2157gitlab # [ 253.891659] gitaly[911]: time="2026-08-20T05:50:14.070Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:50:24.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:50:14.069" grpc.time_ms=0.337 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2158gitlab # [ 253.908711] gitaly[911]: time="2026-08-20T05:50:14.087Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=939 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-20T05:50:24.016" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:50:14.077" grpc.time_ms=10.072 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2159gitlab # [ 253.998437] gitaly[911]: time="2026-08-20T05:50:14.177Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=339 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-20T05:50:44.070" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:14.171" grpc.time_ms=5.744 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2160gitlab # [ 254.060822] gitaly[911]: time="2026-08-20T05:50:14.239Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T05:50:24.178" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:50:14.238" grpc.time_ms=0.427 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2161gitlab # [ 254.091162] gitaly[911]: time="2026-08-20T05:50:14.269Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=343 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-20T05:50:24.202" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-20T05:50:14.263" grpc.time_ms=6.619 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2162gitlab # [ 254.141793] gitaly[911]: time="2026-08-20T05:50:14.320Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:50:24.249" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:50:14.309" grpc.time_ms=10.856 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2163gitlab # [ 254.176743] gitaly[911]: time="2026-08-20T05:50:14.355Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:50:24.283" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:50:14.344" grpc.time_ms=10.607 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2164gitlab # [ 254.228513] gitaly[911]: time="2026-08-20T05:50:14.407Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=966 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T05:50:44.288" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:14.389" grpc.time_ms=17.763 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2165gitlab # [ 254.592814] gitaly[911]: time="2026-08-20T05:50:14.771Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-20T05:50:24.009" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:14.770" grpc.time_ms=1.002 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2166gitlab # [ 254.660992] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:14.838Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 cdfad2516041998554ac4f31826da9c7a308d68b refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"28ce0969c574954e1e9a7e3c","created_at":"2026-08-20T05:49:20.404Z","trace_propagation_headers":{"sentry-trace":"d1b368de7b3a4446ab31509a1e3290e8-1824223a83514a52","baggage":"sentry-trace_id=d1b368de7b3a4446ab31509a1e3290e8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVEZJ57E2F4N71EH50MEM6","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:20.408Z","job_size_bytes":185,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-28ce0969c574954e1e9a7e3c: done: 0.975319 sec","job_status":"done","queue_duration_s":53.454433,"scheduling_latency_s":53.454446,"gitaly_calls":13,"gitaly_duration_s":0.349302,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.045241,"redis_read_bytes":2103,"redis_write_bytes":21749,"redis_cache_calls":15,"redis_cache_duration_s":0.00449,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.006535,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.00148,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7837,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003162,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.017118,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.012456,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.053,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.176,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.198,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.053,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.547824,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000456762,"exclusive_lock_hold_duration_s":0.023741285999999997,"duration_s":0.975319,"completed_at":"2026-08-20T05:50:14.838Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.09376,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2167gitlab # [ 254.729070] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:14.907Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","cdfad2516041998554ac4f31826da9c7a308d68b 848de655fe66d2aaeff87afaf484143b3c9fcfeb refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"6ba974ca6f4aaddaba4b5771","created_at":"2026-08-20T05:49:23.962Z","trace_propagation_headers":{"sentry-trace":"6bf877b80af5414a94178d2a7e91c6fe-c52075ec629e4603","baggage":"sentry-trace_id=6bf877b80af5414a94178d2a7e91c6fe,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVF33XYQTWS112XM44RJZW","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:23.966Z","job_size_bytes":185,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-6ba974ca6f4aaddaba4b5771: start","job_status":"start","queue_duration_s":50.941321,"scheduling_latency_s":50.941355}2168gitlab # [ 254.750144] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:14.928Z","message":"changes: \"cdfad2516041998554ac4f31826da9c7a308d68b 848de655fe66d2aaeff87afaf484143b3c9fcfeb refs/heads/master\\n\""}2169gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2170gitlab # [ 254.786619] nixbot[2620]: INFO: ::ffff:127.0.0.1:50356 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2171gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.04 seconds)2172gitlab # [ 254.787879] gitaly[911]: time="2026-08-20T05:50:14.965Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVF33XYQTWS112XM44RJZW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:50:24.064" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:50:14.955" grpc.time_ms=9.755 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2173gitlab # [ 254.802111] gitaly[911]: time="2026-08-20T05:50:14.980Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF33XYQTWS112XM44RJZW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:50:24.080" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:50:14.970" grpc.time_ms=9.581 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2174gitlab # [ 254.808894] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:14.987Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"88174419d4ae03cf996619ac","created_at":"2026-08-20T05:50:14.984Z","trace_propagation_headers":{"sentry-trace":"6bf877b80af5414a94178d2a7e91c6fe-0f7e41d2aec8478e","baggage":"sentry-trace_id=6bf877b80af5414a94178d2a7e91c6fe,sentry-release=Unknown"},"correlation_id":"01M0EVF33XYQTWS112XM44RJZW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"91172c137cfa942d90d1e8ef","job_size_bytes":46,"pid":2570,"job_status":"deduplicated","message":"ProjectCacheWorker JID-88174419d4ae03cf996619ac: deduplicated: until executing","deduplication.type":"until executing"}2175gitlab # [ 254.835489] gitaly[911]: time="2026-08-20T05:50:15.014Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVF33XYQTWS112XM44RJZW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-20T05:50:25.003" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:50:15.003" grpc.time_ms=10.214 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2176gitlab # [ 254.852166] gitaly[911]: time="2026-08-20T05:50:15.030Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=654 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVF33XYQTWS112XM44RJZW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-20T05:50:45.018" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:15.019" grpc.time_ms=10.795 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2177gitlab # [ 254.882222] gitaly[911]: time="2026-08-20T05:50:15.060Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=345 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVF33XYQTWS112XM44RJZW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-20T05:50:25.054" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-20T05:50:15.054" grpc.time_ms=6.338 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2178gitlab # [ 254.903172] gitaly[911]: time="2026-08-20T05:50:15.081Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVF33XYQTWS112XM44RJZW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:50:25.011" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:50:15.072" grpc.time_ms=9.455 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2179gitlab # [ 255.081950] gitaly[911]: time="2026-08-20T05:50:15.260Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVF33XYQTWS112XM44RJZW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-20T05:50:25.127" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:15.188" grpc.time_ms=72.426 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2180gitlab # [ 255.111658] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:15.289Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","cdfad2516041998554ac4f31826da9c7a308d68b 848de655fe66d2aaeff87afaf484143b3c9fcfeb refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"6ba974ca6f4aaddaba4b5771","created_at":"2026-08-20T05:49:23.962Z","trace_propagation_headers":{"sentry-trace":"6bf877b80af5414a94178d2a7e91c6fe-c52075ec629e4603","baggage":"sentry-trace_id=6bf877b80af5414a94178d2a7e91c6fe,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVF33XYQTWS112XM44RJZW","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:49:23.966Z","job_size_bytes":185,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-6ba974ca6f4aaddaba4b5771: done: 0.382056 sec","job_status":"done","queue_duration_s":50.941321,"scheduling_latency_s":50.941355,"gitaly_calls":7,"gitaly_duration_s":0.160986,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.026389999999999997,"redis_read_bytes":500,"redis_write_bytes":11942,"redis_cache_calls":9,"redis_cache_duration_s":0.003165,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001406,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5719,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003224,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.009961,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.008634,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.027,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.027,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.255,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000918273,"exclusive_lock_hold_duration_s":0.023723965,"duration_s":0.382056,"completed_at":"2026-08-20T05:50:15.289Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027889,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2181gitlab # [ 255.156618] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:15.292Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"84db433c32191bb791dc7639","created_at":"2026-08-20T05:49:24.915Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-afe100c6592a432c","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:24.944Z","job_size_bytes":65,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-84db433c32191bb791dc7639: start","job_status":"start","queue_duration_s":50.347467,"scheduling_latency_s":50.347503}2182gitlab # [ 255.192282] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:15.370Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"84db433c32191bb791dc7639","created_at":"2026-08-20T05:49:24.915Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-afe100c6592a432c","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:24.944Z","job_size_bytes":65,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-84db433c32191bb791dc7639: done: 0.078699 sec","job_status":"done","queue_duration_s":50.347467,"scheduling_latency_s":50.347503,"redis_calls":16,"redis_duration_s":0.004679,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002444,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001661,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000574,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049251,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000286908,"duration_s":0.078699,"completed_at":"2026-08-20T05:50:15.370Z","load_balancing_strategy":"primary","db_duration_s":0.0202,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2183gitlab # [ 255.193730] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:15.372Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"a9b8e8de8a554085e7de2cde","created_at":"2026-08-20T05:49:24.945Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-afe100c6592a432c","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:24.950Z","job_size_bytes":65,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-a9b8e8de8a554085e7de2cde: start","job_status":"start","queue_duration_s":50.421329,"scheduling_latency_s":50.421344}2184gitlab # [ 255.331574] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:15.509Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"a9b8e8de8a554085e7de2cde","created_at":"2026-08-20T05:49:24.945Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-afe100c6592a432c","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:24.950Z","job_size_bytes":65,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-a9b8e8de8a554085e7de2cde: done: 0.137807 sec","job_status":"done","queue_duration_s":50.421329,"scheduling_latency_s":50.421344,"redis_calls":21,"redis_duration_s":0.047335,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.044817,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001247,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001271,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055737,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000291099,"duration_s":0.137807,"completed_at":"2026-08-20T05:50:15.509Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.030715,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2185gitlab # [ 255.334583] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:15.511Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"0d52fe10a5c8c0ca674d7323","created_at":"2026-08-20T05:49:25.074Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-afe100c6592a432c","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:25.078Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0d52fe10a5c8c0ca674d7323: start","job_status":"start","queue_duration_s":50.432259,"scheduling_latency_s":50.432275}2186gitlab # [ 255.506686] gitaly[911]: time="2026-08-20T05:50:15.685Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVF41ARCXRYZGTKQDC09F5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:50:15.684" grpc.time_ms=0.642 pid=911 span.kind=server system=grpc2187gitlab # [ 255.558601] gitaly[911]: time="2026-08-20T05:50:15.737Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVF41ARCXRYZGTKQDC09F5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:50:15.736" grpc.time_ms=0.621 pid=911 span.kind=server system=grpc2188gitlab # [ 255.619612] gitaly[911]: time="2026-08-20T05:50:15.798Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVF41ARCXRYZGTKQDC09F5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:50:15.797" grpc.time_ms=0.609 pid=911 span.kind=server system=grpc2189gitlab # [ 255.647416] gitaly[911]: time="2026-08-20T05:50:15.826Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF41ARCXRYZGTKQDC09F5 diskcache=88c05c79-2331-4207-9efa-025e810f81ff grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:50:45.642" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:50:15.642" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2190gitlab # [ 255.648210] gitaly[911]: time="2026-08-20T05:50:15.826Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=164 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7384 command.oublock=0 command.real_time_ms=173 command.spawn_token_fork_ms=0 command.system_time_ms=109 command.user_time_ms=55 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF41ARCXRYZGTKQDC09F5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:50:45.642" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:50:15.642" grpc.time_ms=183.455 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2191gitlab # [ 255.759168] gitaly[911]: time="2026-08-20T05:50:15.937Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVF41ARCXRYZGTKQDC09F5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T05:50:45.835" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:15.936" grpc.time_ms=1.247 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2192gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2193gitlab # [ 255.810256] gitaly[911]: time="2026-08-20T05:50:15.988Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF41ARCXRYZGTKQDC09F5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:50:45.886" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:15.987" grpc.time_ms=0.943 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2194gitlab # [ 255.823638] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:16.001Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"0d52fe10a5c8c0ca674d7323","created_at":"2026-08-20T05:49:25.074Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-afe100c6592a432c","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:25.078Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2570,"job_status":"rescheduled","message":"PipelineProcessWorker JID-0d52fe10a5c8c0ca674d7323: rescheduled"}2195gitlab # [ 255.832806] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:16.011Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"0d52fe10a5c8c0ca674d7323","created_at":"2026-08-20T05:49:25.074Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-afe100c6592a432c","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:49:25.078Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0d52fe10a5c8c0ca674d7323: done: 0.500134 sec","job_status":"done","queue_duration_s":50.432259,"scheduling_latency_s":50.432275,"gitaly_calls":3,"gitaly_duration_s":0.195163,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.030180000000000002,"redis_read_bytes":462,"redis_write_bytes":29293,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001528,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001647,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.009936,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.004592,"redis_queues_read_bytes":39,"redis_queues_write_bytes":15580,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.007164,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000855,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000599,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002331,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.056,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.026,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.03,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.026,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.22075,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.451309314,"duration_s":0.500134,"completed_at":"2026-08-20T05:50:16.011Z","load_balancing_strategy":"primary","db_duration_s":0.068219,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2196gitlab # [ 255.883790] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:16.012Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"91172c137cfa942d90d1e8ef","created_at":"2026-08-20T05:50:13.915Z","trace_propagation_headers":{"sentry-trace":"d1b368de7b3a4446ab31509a1e3290e8-f7c06455156d4840","baggage":"sentry-trace_id=d1b368de7b3a4446ab31509a1e3290e8,sentry-release=Unknown"},"correlation_id":"01M0EVEZJ57E2F4N71EH50MEM6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:13.929Z","job_size_bytes":46,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-91172c137cfa942d90d1e8ef: start","job_status":"start","queue_duration_s":2.083234,"scheduling_latency_s":2.083251}2197gitlab # [ 255.884783] gitaly[911]: time="2026-08-20T05:50:16.048Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-20T11:50:16.043" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:50:16.044" grpc.time_ms=4.406 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2198gitlab # [ 255.885749] gitaly[911]: time="2026-08-20T05:50:16.064Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=648 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-20T05:50:46.053" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:16.054" grpc.time_ms=9.571 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2199gitlab # [ 255.914326] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:16.092Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"91172c137cfa942d90d1e8ef","created_at":"2026-08-20T05:50:13.915Z","trace_propagation_headers":{"sentry-trace":"d1b368de7b3a4446ab31509a1e3290e8-f7c06455156d4840","baggage":"sentry-trace_id=d1b368de7b3a4446ab31509a1e3290e8,sentry-release=Unknown"},"correlation_id":"01M0EVEZJ57E2F4N71EH50MEM6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:13.929Z","job_size_bytes":46,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-91172c137cfa942d90d1e8ef: done: 0.080171 sec","job_status":"done","queue_duration_s":2.083234,"scheduling_latency_s":2.083251,"gitaly_calls":2,"gitaly_duration_s":0.018333,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.006143,"redis_read_bytes":69,"redis_write_bytes":4883,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001168,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000509,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001318,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.00254,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":748,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000608,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044571,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000333282,"duration_s":0.080171,"completed_at":"2026-08-20T05:50:16.092Z","load_balancing_strategy":"primary","db_duration_s":0.011884,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2200gitlab # [ 255.935861] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:16.093Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"5861611f7dcc56743b5d8801","created_at":"2026-08-20T05:50:13.946Z","trace_propagation_headers":{"sentry-trace":"d1b368de7b3a4446ab31509a1e3290e8-f7c06455156d4840","baggage":"sentry-trace_id=d1b368de7b3a4446ab31509a1e3290e8,sentry-release=Unknown"},"correlation_id":"01M0EVEZJ57E2F4N71EH50MEM6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:13.951Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-5861611f7dcc56743b5d8801: start","job_status":"start","queue_duration_s":2.142714,"scheduling_latency_s":2.142729}2201gitlab # [ 255.993317] gitaly[911]: time="2026-08-20T05:50:16.172Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 diskcache=4e513ddd-9677-4a08-9d1e-03a467ce2f24 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T11:50:16.108" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:16.108" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2202gitlab # [ 255.994899] nixbot[2620]: INFO: ::ffff:127.0.0.1:50366 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2203gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.22 seconds)2204gitlab # [ 256.003238] gitaly[911]: time="2026-08-20T05:50:16.181Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1283 command.oublock=0 command.real_time_ms=60 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T11:50:16.108" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:16.108" grpc.time_ms=63.794 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2205gitlab # [ 256.029138] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:16.207Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"5861611f7dcc56743b5d8801","created_at":"2026-08-20T05:50:13.946Z","trace_propagation_headers":{"sentry-trace":"d1b368de7b3a4446ab31509a1e3290e8-f7c06455156d4840","baggage":"sentry-trace_id=d1b368de7b3a4446ab31509a1e3290e8,sentry-release=Unknown"},"correlation_id":"01M0EVEZJ57E2F4N71EH50MEM6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:13.951Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-5861611f7dcc56743b5d8801: done: 0.1138 sec","job_status":"done","queue_duration_s":2.142714,"scheduling_latency_s":2.142729,"gitaly_calls":1,"gitaly_duration_s":0.075313,"redis_calls":15,"redis_duration_s":0.002051,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000237,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00075,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000341,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000723,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.013,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025863,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.099380228,"duration_s":0.1138,"completed_at":"2026-08-20T05:50:16.207Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009686,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2206gitlab # [ 256.067001] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:16.245Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"10aaed701bbf0c213f60daf0","created_at":"2026-08-20T05:50:14.065Z","trace_propagation_headers":{"sentry-trace":"d1b368de7b3a4446ab31509a1e3290e8-f7c06455156d4840","baggage":"sentry-trace_id=d1b368de7b3a4446ab31509a1e3290e8,sentry-release=Unknown"},"correlation_id":"01M0EVEZJ57E2F4N71EH50MEM6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:14.067Z","job_size_bytes":23,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-10aaed701bbf0c213f60daf0: start","job_status":"start","queue_duration_s":2.178097,"scheduling_latency_s":2.178124}2207gitlab # [ 256.099434] gitaly[911]: time="2026-08-20T05:50:16.278Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=652 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-20T05:50:46.268" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:16.268" grpc.time_ms=9.357 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2208gitlab # [ 256.115426] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:16.293Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"10aaed701bbf0c213f60daf0","created_at":"2026-08-20T05:50:14.065Z","trace_propagation_headers":{"sentry-trace":"d1b368de7b3a4446ab31509a1e3290e8-f7c06455156d4840","baggage":"sentry-trace_id=d1b368de7b3a4446ab31509a1e3290e8,sentry-release=Unknown"},"correlation_id":"01M0EVEZJ57E2F4N71EH50MEM6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:14.067Z","job_size_bytes":23,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-10aaed701bbf0c213f60daf0: done: 0.047936 sec","job_status":"done","queue_duration_s":2.178097,"scheduling_latency_s":2.178124,"gitaly_calls":1,"gitaly_duration_s":0.011743,"redis_calls":16,"redis_duration_s":0.004383,"redis_read_bytes":52,"redis_write_bytes":2047,"redis_queues_calls":1,"redis_queues_duration_s":0.000451,"redis_queues_read_bytes":1,"redis_queues_write_bytes":978,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001159,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001993,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00078,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026869,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.047936,"completed_at":"2026-08-20T05:50:16.293Z","load_balancing_strategy":"primary","db_duration_s":0.003372,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2209gitlab # [ 256.117609] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:16.296Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"03c92b009eddb1f7d7fde1c3","created_at":"2026-08-20T05:50:14.646Z","trace_propagation_headers":{"sentry-trace":"d1b368de7b3a4446ab31509a1e3290e8-f7c06455156d4840","baggage":"sentry-trace_id=d1b368de7b3a4446ab31509a1e3290e8,sentry-release=Unknown"},"correlation_id":"01M0EVEZJ57E2F4N71EH50MEM6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1964a3317e9145d45b0e883bd6175b9ac23c107d0176c177d3babd6a62cca5da","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:14.650Z","job_size_bytes":467,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-03c92b009eddb1f7d7fde1c3: start","job_status":"start","queue_duration_s":1.645461,"scheduling_latency_s":1.645502}2210gitlab # [ 256.152214] gitaly[911]: time="2026-08-20T05:50:16.330Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:50:46.329" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:16.329" grpc.time_ms=0.921 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2211gitlab # [ 256.163518] gitaly[911]: time="2026-08-20T05:50:16.342Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T05:50:26.003" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:50:16.333" grpc.time_ms=8.587 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2212gitlab # [ 256.249886] gitaly[911]: time="2026-08-20T05:50:16.428Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T05:50:46.426" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:16.427" grpc.time_ms=1.1 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2213gitlab # [ 256.278306] gitaly[911]: time="2026-08-20T05:50:16.457Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=29 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-20T05:50:46.454" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:16.454" grpc.time_ms=2.174 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2214gitlab # [ 256.397913] gitaly[911]: time="2026-08-20T05:50:16.576Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:50:26.234" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:50:16.565" grpc.time_ms=11.27 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2215gitlab # [ 256.789319] gitaly[911]: time="2026-08-20T05:50:16.967Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=969 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T05:50:46.050" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:16.950" grpc.time_ms=16.994 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2216gitlab # [ 256.804829] gitaly[911]: time="2026-08-20T05:50:16.983Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0EVEZJ57E2F4N71EH50MEM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-20T05:50:46.072" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:16.972" grpc.time_ms=10.843 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2217gitlab # [ 256.843106] sidekiq-cluster[2570]: {"severity":"WARN","time":"2026-08-20T05:50:17.021Z","class":"CreatePipelineWorker","correlation_id":"01M0EVEZJ57E2F4N71EH50MEM6","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"cdfad2516041998554ac4f31826da9c7a308d68b","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"cdfad2516041998554ac4f31826da9c7a308d68b","ref":"refs/heads/master"},"retry":0}2218gitlab # [ 256.851324] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:17.029Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"03c92b009eddb1f7d7fde1c3","created_at":"2026-08-20T05:50:14.646Z","trace_propagation_headers":{"sentry-trace":"d1b368de7b3a4446ab31509a1e3290e8-f7c06455156d4840","baggage":"sentry-trace_id=d1b368de7b3a4446ab31509a1e3290e8,sentry-release=Unknown"},"correlation_id":"01M0EVEZJ57E2F4N71EH50MEM6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1964a3317e9145d45b0e883bd6175b9ac23c107d0176c177d3babd6a62cca5da","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:14.650Z","job_size_bytes":467,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-03c92b009eddb1f7d7fde1c3: done: 0.73369 sec","job_status":"done","queue_duration_s":1.645461,"scheduling_latency_s":1.645502,"gitaly_calls":7,"gitaly_duration_s":0.13616,"redis_calls":51,"redis_duration_s":0.010902,"redis_read_bytes":169,"redis_write_bytes":4167,"redis_cache_calls":4,"redis_cache_duration_s":0.000885,"redis_cache_read_bytes":10,"redis_cache_write_bytes":342,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.004717,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001439,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002835,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001026,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.548297,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033887,"duration_s":0.73369,"completed_at":"2026-08-20T05:50:17.029Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.053944,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2219gitlab # [ 256.889654] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:17.032Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"c7fc04f9-0b96-4e1e-88aa-2c162f35d919\"}"],"class":"WebHookWorker","jid":"295c1f763f25045b608a530b","created_at":"2026-08-20T05:50:14.745Z","trace_propagation_headers":{"sentry-trace":"d1b368de7b3a4446ab31509a1e3290e8-f7c06455156d4840","baggage":"sentry-trace_id=d1b368de7b3a4446ab31509a1e3290e8,sentry-release=Unknown"},"correlation_id":"01M0EVEZJ57E2F4N71EH50MEM6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c0807baf9d589762c774f40896515a34d575ca5966b99055f6a745851f77e71c","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:14.750Z","job_size_bytes":1751,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-295c1f763f25045b608a530b: start","job_status":"start","queue_duration_s":2.281637,"scheduling_latency_s":2.281666}2220gitlab # [ 256.969251] nixbot[2620]: INFO: ::ffff:127.0.0.1:50380 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2221gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2222gitlab # [ 256.987460] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:17.165Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"c7fc04f9-0b96-4e1e-88aa-2c162f35d919\"}"],"class":"WebHookWorker","jid":"295c1f763f25045b608a530b","created_at":"2026-08-20T05:50:14.745Z","trace_propagation_headers":{"sentry-trace":"d1b368de7b3a4446ab31509a1e3290e8-f7c06455156d4840","baggage":"sentry-trace_id=d1b368de7b3a4446ab31509a1e3290e8,sentry-release=Unknown"},"correlation_id":"01M0EVEZJ57E2F4N71EH50MEM6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c0807baf9d589762c774f40896515a34d575ca5966b99055f6a745851f77e71c","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:14.750Z","job_size_bytes":1751,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-295c1f763f25045b608a530b: done: 0.133862 sec","job_status":"done","queue_duration_s":2.281637,"scheduling_latency_s":2.281666,"redis_calls":19,"redis_duration_s":0.004353,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001124,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000344,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001996,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000889,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.0542096830000105,"cpu_s":0.064717,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000533867,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.133862,"completed_at":"2026-08-20T05:50:17.165Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002703,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2223gitlab # [ 256.996624] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:17.172Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"91e321a61486e63bfd59f8e0","created_at":"2026-08-20T05:50:14.995Z","trace_propagation_headers":{"sentry-trace":"6bf877b80af5414a94178d2a7e91c6fe-0f7e41d2aec8478e","baggage":"sentry-trace_id=6bf877b80af5414a94178d2a7e91c6fe,sentry-release=Unknown"},"correlation_id":"01M0EVF33XYQTWS112XM44RJZW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"5861611f7dcc56743b5d8801","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:14.997Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-91e321a61486e63bfd59f8e0: start","job_status":"start","queue_duration_s":2.174605,"scheduling_latency_s":2.174633}2224gitlab # [ 257.053052] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:17.221Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"91e321a61486e63bfd59f8e0","created_at":"2026-08-20T05:50:14.995Z","trace_propagation_headers":{"sentry-trace":"6bf877b80af5414a94178d2a7e91c6fe-0f7e41d2aec8478e","baggage":"sentry-trace_id=6bf877b80af5414a94178d2a7e91c6fe,sentry-release=Unknown"},"correlation_id":"01M0EVF33XYQTWS112XM44RJZW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"5861611f7dcc56743b5d8801","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:14.997Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-91e321a61486e63bfd59f8e0: done: 0.049077 sec","job_status":"done","queue_duration_s":2.174605,"scheduling_latency_s":2.174633,"gitaly_calls":1,"gitaly_duration_s":0.014047,"redis_calls":12,"redis_duration_s":0.002788,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001158,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000515,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001115,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025339,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.030347992,"duration_s":0.049077,"completed_at":"2026-08-20T05:50:17.221Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005037,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2225gitlab # [ 257.067090] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:17.223Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"6a4f72f322cac5aac6287d21","created_at":"2026-08-20T05:50:15.144Z","trace_propagation_headers":{"sentry-trace":"6bf877b80af5414a94178d2a7e91c6fe-0f7e41d2aec8478e","baggage":"sentry-trace_id=6bf877b80af5414a94178d2a7e91c6fe,sentry-release=Unknown"},"correlation_id":"01M0EVF33XYQTWS112XM44RJZW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:538dba17b1ce26addf34cad82cea101f0a7c8c83e47c908083298c201a8e8be4","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:15.147Z","job_size_bytes":467,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-6a4f72f322cac5aac6287d21: start","job_status":"start","queue_duration_s":2.076301,"scheduling_latency_s":2.076334}2226gitlab # [ 257.110110] gitaly[911]: time="2026-08-20T05:50:17.198Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF33XYQTWS112XM44RJZW diskcache=9a4f0bd7-ef8d-46a0-ad56-427198d8cdf0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T11:50:17.186" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:17.187" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2227gitlab # [ 257.110759] gitaly[911]: time="2026-08-20T05:50:17.199Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=313 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF33XYQTWS112XM44RJZW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T11:50:17.186" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:17.187" grpc.time_ms=11.69 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2228gitlab # [ 257.111801] gitaly[911]: time="2026-08-20T05:50:17.254Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF33XYQTWS112XM44RJZW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:50:47.253" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:17.253" grpc.time_ms=1.05 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2229gitlab # [ 257.112545] gitaly[911]: time="2026-08-20T05:50:17.262Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF33XYQTWS112XM44RJZW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T05:50:27.255" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:50:17.256" grpc.time_ms=6.493 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2230gitlab # [ 257.150115] gitaly[911]: time="2026-08-20T05:50:17.284Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVF33XYQTWS112XM44RJZW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T05:50:47.283" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:17.283" grpc.time_ms=0.579 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2231gitlab # [ 257.151040] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:50:17 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1192232gitlab # [ 257.151546] gitaly[911]: time="2026-08-20T05:50:17.288Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=107 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVF33XYQTWS112XM44RJZW error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-20T05:50:47.286" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:17.286" grpc.time_ms=2.445 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2233gitlab # [ 257.152188] gitaly[911]: time="2026-08-20T05:50:17.309Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVGQK6YA5HEGAH396P8NYT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:50:17.303" grpc.time_ms=5.867 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2234gitlab # [ 257.176217] gitaly[911]: time="2026-08-20T05:50:17.354Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=48 command.spawn_token_fork_ms=45 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVF33XYQTWS112XM44RJZW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:50:27.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:50:17.305" grpc.time_ms=49.64 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2235gitlab # [ 257.177606] gitaly[911]: time="2026-08-20T05:50:17.356Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVGQPYZ1AVGJ1XRD206XX1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:50:17.349" pid=911 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2236gitlab # [ 257.178392] gitaly[911]: time="2026-08-20T05:50:17.356Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVGQPYZ1AVGJ1XRD206XX1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:50:17.349" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2237gitlab # [ 257.184235] gitlab-workhorse[827]: time="2026-08-20T05:50:17Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672238gitlab # [ 257.185722] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:50:17 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 462239gitlab # [ 257.187427] gitaly[911]: time="2026-08-20T05:50:17.356Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVGQPYZ1AVGJ1XRD206XX1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:50:17.349" grpc.time_ms=6.627 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2240gitlab # [ 257.241290] nixbot[2620]: INFO: ::ffff:127.0.0.1:50388 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2241gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.23 seconds)2242gitlab # [ 257.252767] nixbot[2620]: {"ts": "2026-08-20T05:50:17.431Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2243gitlab # [ 257.306338] gitaly[911]: time="2026-08-20T05:50:17.484Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVGQV1DZVJG1H4910B8205 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:50:47.383" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:17.483" grpc.time_ms=0.899 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2244gitlab # [ 257.355662] gitaly[911]: time="2026-08-20T05:50:17.534Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0EVGQV1DZVJG1H4910B8205 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:50:27.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:50:17.525" grpc.time_ms=8.878 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2245gitlab # [ 257.436682] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:50:17 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/cdfad2516041998554ac4f31826da9c7a308d68b HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 1732246gitlab # [ 257.437807] nixbot[2620]: {"ts": "2026-08-20T05:50:17.616Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/cdfad2516041998554ac4f31826da9c7a308d68b \"HTTP/1.1 201 Created\""}2247gitlab # [ 257.479966] gitaly[911]: time="2026-08-20T05:50:17.658Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVGR0K75472XZFENN3A5Z0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:50:47.557" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:17.657" grpc.time_ms=0.628 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2248gitlab # [ 257.547163] gitaly[911]: time="2026-08-20T05:50:17.725Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVGR0K75472XZFENN3A5Z0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:50:27.198" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:50:17.719" grpc.time_ms=6.353 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2249gitlab # [ 257.584468] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:50:17 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/cdfad2516041998554ac4f31826da9c7a308d68b HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1432250gitlab # [ 257.585260] nixbot[2620]: {"ts": "2026-08-20T05:50:17.763Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/cdfad2516041998554ac4f31826da9c7a308d68b \"HTTP/1.1 201 Created\""}2251gitlab # [ 257.594293] gitaly[911]: time="2026-08-20T05:50:17.773Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=966 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVF33XYQTWS112XM44RJZW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T05:50:47.753" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:17.753" grpc.time_ms=19.493 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2252gitlab # [ 257.614065] gitaly[911]: time="2026-08-20T05:50:17.792Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVF33XYQTWS112XM44RJZW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-20T05:50:47.785" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:17.785" grpc.time_ms=7.086 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2253gitlab # [ 257.634521] sidekiq-cluster[2570]: {"severity":"WARN","time":"2026-08-20T05:50:17.813Z","class":"CreatePipelineWorker","correlation_id":"01M0EVF33XYQTWS112XM44RJZW","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"cdfad2516041998554ac4f31826da9c7a308d68b","after":"848de655fe66d2aaeff87afaf484143b3c9fcfeb","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"848de655fe66d2aaeff87afaf484143b3c9fcfeb","ref":"refs/heads/master"},"retry":0}2254gitlab # [ 257.638639] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:17.816Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"6a4f72f322cac5aac6287d21","created_at":"2026-08-20T05:50:15.144Z","trace_propagation_headers":{"sentry-trace":"6bf877b80af5414a94178d2a7e91c6fe-0f7e41d2aec8478e","baggage":"sentry-trace_id=6bf877b80af5414a94178d2a7e91c6fe,sentry-release=Unknown"},"correlation_id":"01M0EVF33XYQTWS112XM44RJZW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:538dba17b1ce26addf34cad82cea101f0a7c8c83e47c908083298c201a8e8be4","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:15.147Z","job_size_bytes":467,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-6a4f72f322cac5aac6287d21: done: 0.593092 sec","job_status":"done","queue_duration_s":2.076301,"scheduling_latency_s":2.076334,"gitaly_calls":7,"gitaly_duration_s":0.147392,"redis_calls":33,"redis_duration_s":0.005792,"redis_read_bytes":185,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000361,"redis_cache_read_bytes":44,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001863,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002927,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000641,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.420489,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.593092,"completed_at":"2026-08-20T05:50:17.816Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01716,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2255gitlab # [ 257.642638] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:17.818Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"f3866185-4277-455b-a22b-19467b5ee07d\"}"],"class":"WebHookWorker","jid":"32a21fb06edc920cd3e44271","created_at":"2026-08-20T05:50:15.168Z","trace_propagation_headers":{"sentry-trace":"6bf877b80af5414a94178d2a7e91c6fe-0f7e41d2aec8478e","baggage":"sentry-trace_id=6bf877b80af5414a94178d2a7e91c6fe,sentry-release=Unknown"},"correlation_id":"01M0EVF33XYQTWS112XM44RJZW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6bbef32c6dd8c7eb79c5366982b7da44bee6354f2aabf94b1ef628cb24630f9a","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:15.171Z","job_size_bytes":1749,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-32a21fb06edc920cd3e44271: start","job_status":"start","queue_duration_s":2.647107,"scheduling_latency_s":2.647126}2256gitlab # [ 257.692610] gitaly[911]: time="2026-08-20T05:50:17.871Z" level=info msg="finished unary call with code OK" catfile.duration_ms=38 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=38 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVGR57JJA2ZVYNV9A1SAXK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:50:47.731" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:17.831" grpc.time_ms=39.267 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2257gitlab # [ 257.720764] nixbot[2620]: INFO: ::ffff:127.0.0.1:50396 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2258gitlab # [ 257.733611] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:17.911Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"f3866185-4277-455b-a22b-19467b5ee07d\"}"],"class":"WebHookWorker","jid":"32a21fb06edc920cd3e44271","created_at":"2026-08-20T05:50:15.168Z","trace_propagation_headers":{"sentry-trace":"6bf877b80af5414a94178d2a7e91c6fe-0f7e41d2aec8478e","baggage":"sentry-trace_id=6bf877b80af5414a94178d2a7e91c6fe,sentry-release=Unknown"},"correlation_id":"01M0EVF33XYQTWS112XM44RJZW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6bbef32c6dd8c7eb79c5366982b7da44bee6354f2aabf94b1ef628cb24630f9a","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:15.171Z","job_size_bytes":1749,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-32a21fb06edc920cd3e44271: done: 0.093548 sec","job_status":"done","queue_duration_s":2.647107,"scheduling_latency_s":2.647126,"redis_calls":14,"redis_duration_s":0.0030759999999999997,"redis_read_bytes":26,"redis_write_bytes":4685,"redis_queues_calls":2,"redis_queues_duration_s":0.000332,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001645,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001099,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.055,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.055,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.005525841999997283,"cpu_s":0.027496,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.093548,"completed_at":"2026-08-20T05:50:17.911Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.054474,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2259gitlab # [ 257.752628] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:17.913Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"76cd9dd95d4b271ce156a900","created_at":"2026-08-20T05:50:15.622Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-984069ce64054a9c","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:15.629Z","job_size_bytes":23,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-76cd9dd95d4b271ce156a900: start","job_status":"start","queue_duration_s":2.284088,"scheduling_latency_s":2.28411}2260gitlab # [ 257.754378] gitaly[911]: time="2026-08-20T05:50:17.932Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0EVGR57JJA2ZVYNV9A1SAXK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:50:27.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:50:17.926" grpc.time_ms=6.018 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2261gitlab # [ 257.798715] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:50:17 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/cdfad2516041998554ac4f31826da9c7a308d68b HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2062262gitlab # [ 257.802066] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:17.976Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"76cd9dd95d4b271ce156a900","created_at":"2026-08-20T05:50:15.622Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-984069ce64054a9c","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:15.629Z","job_size_bytes":23,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-76cd9dd95d4b271ce156a900: done: 0.063342 sec","job_status":"done","queue_duration_s":2.284088,"scheduling_latency_s":2.28411,"redis_calls":10,"redis_duration_s":0.003264,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001621,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00128,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000363,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043623,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000214273,"duration_s":0.063342,"completed_at":"2026-08-20T05:50:17.976Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011409,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2263gitlab # [ 257.821640] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:17.977Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"bfa4ea195450829e07d482a6","created_at":"2026-08-20T05:50:15.833Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-984069ce64054a9c","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:15.841Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-bfa4ea195450829e07d482a6: start","job_status":"start","queue_duration_s":2.136458,"scheduling_latency_s":2.136473}2264gitlab # [ 257.822389] nixbot[2620]: {"ts": "2026-08-20T05:50:17.975Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/cdfad2516041998554ac4f31826da9c7a308d68b \"HTTP/1.1 201 Created\""}2265gitlab # [ 257.822827] gitaly[911]: time="2026-08-20T05:50:17.979Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=15 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVGRA0QW05ZEAHQ3DDM6Q1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:50:17.959" grpc.time_ms=20.571 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2266gitlab # [ 257.861697] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:50:17 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 592267gitlab # [ 257.862674] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:17.999Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"bfa4ea195450829e07d482a6","created_at":"2026-08-20T05:50:15.833Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-984069ce64054a9c","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:15.841Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-bfa4ea195450829e07d482a6: done: 0.021229 sec","job_status":"done","queue_duration_s":2.136458,"scheduling_latency_s":2.136473,"redis_calls":10,"redis_duration_s":0.001765,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000266,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001208,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000291,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013493,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000210641,"duration_s":0.021229,"completed_at":"2026-08-20T05:50:17.999Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002839,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2268gitlab # [ 257.865772] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.000Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"7145595aeb4af35748d347b2","created_at":"2026-08-20T05:50:15.857Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-984069ce64054a9c","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:15.865Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-7145595aeb4af35748d347b2: start","job_status":"start","queue_duration_s":2.134621,"scheduling_latency_s":2.134635}2269gitlab # [ 257.878292] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.021Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"7145595aeb4af35748d347b2","created_at":"2026-08-20T05:50:15.857Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-984069ce64054a9c","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:15.865Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-7145595aeb4af35748d347b2: done: 0.021104 sec","job_status":"done","queue_duration_s":2.134621,"scheduling_latency_s":2.134635,"redis_calls":10,"redis_duration_s":0.001414,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000257,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000892,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000265,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013711,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000270705,"duration_s":0.021104,"completed_at":"2026-08-20T05:50:18.021Z","load_balancing_strategy":"primary","db_duration_s":0.003025,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2270gitlab # [ 257.923693] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.022Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"5f548569ca6973277664cce6","created_at":"2026-08-20T05:50:15.880Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-984069ce64054a9c","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:15.886Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-5f548569ca6973277664cce6: start","job_status":"start","queue_duration_s":2.135952,"scheduling_latency_s":2.135967}2271gitlab # [ 257.924678] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.074Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"5f548569ca6973277664cce6","created_at":"2026-08-20T05:50:15.880Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-984069ce64054a9c","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:15.886Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-5f548569ca6973277664cce6: done: 0.051979 sec","job_status":"done","queue_duration_s":2.135952,"scheduling_latency_s":2.135967,"redis_calls":13,"redis_duration_s":0.005801,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000236,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004861,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000374,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00033,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000270146,"duration_s":0.051979,"completed_at":"2026-08-20T05:50:18.074Z","load_balancing_strategy":"primary","db_duration_s":0.003154,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2272gitlab # [ 257.962936] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.075Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"0ae2a300eecf07e2ef8e36f3","created_at":"2026-08-20T05:50:15.886Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-984069ce64054a9c","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:15.891Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-0ae2a300eecf07e2ef8e36f3: start","job_status":"start","queue_duration_s":2.18401,"scheduling_latency_s":2.184032}2273gitlab # [ 257.998074] gitlab-workhorse[827]: time="2026-08-20T05:50:18Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672274gitlab # [ 257.998586] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:50:18 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1082275gitlab # [ 257.999067] gitaly[911]: time="2026-08-20T05:50:18.089Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVGRBYRZAVJ0W8XKV3NSHK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:50:18.082" pid=911 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2276gitlab # [ 257.999624] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.106Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"0ae2a300eecf07e2ef8e36f3","created_at":"2026-08-20T05:50:15.886Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-984069ce64054a9c","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:15.891Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-0ae2a300eecf07e2ef8e36f3: done: 0.031316 sec","job_status":"done","queue_duration_s":2.18401,"scheduling_latency_s":2.184032,"redis_calls":10,"redis_duration_s":0.001963,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000399,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001103,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000461,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000231873,"duration_s":0.031316,"completed_at":"2026-08-20T05:50:18.106Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004766,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2277gitlab # [ 258.018906] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.107Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"1eb953196c1bc0ef6173784a","created_at":"2026-08-20T05:50:15.892Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-984069ce64054a9c","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:15.897Z","job_size_bytes":19,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-1eb953196c1bc0ef6173784a: start","job_status":"start","queue_duration_s":2.21016,"scheduling_latency_s":2.210177}2278gitlab # [ 258.036771] nix-daemon[2839]: accepted connection from pid 3321, user nixbot2279gitlab # [ 258.037507] gitaly[911]: time="2026-08-20T05:50:18.089Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVGRBYRZAVJ0W8XKV3NSHK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:50:18.082" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2280gitlab # [ 258.043077] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.127Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"1eb953196c1bc0ef6173784a","created_at":"2026-08-20T05:50:15.892Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-984069ce64054a9c","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:15.897Z","job_size_bytes":19,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-1eb953196c1bc0ef6173784a: done: 0.019537 sec","job_status":"done","queue_duration_s":2.21016,"scheduling_latency_s":2.210177,"redis_calls":11,"redis_duration_s":0.001902,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000282,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001243,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000377,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012301,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023299,"duration_s":0.019537,"completed_at":"2026-08-20T05:50:18.127Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002373,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2281gitlab # [ 258.083168] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.128Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f5dc7cc2e4bb28fae0de8fa0","created_at":"2026-08-20T05:50:15.899Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-984069ce64054a9c","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:15.902Z","job_size_bytes":66,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f5dc7cc2e4bb28fae0de8fa0: start","job_status":"start","queue_duration_s":2.225889,"scheduling_latency_s":2.225902}2282gitlab # [ 258.091728] gitaly[911]: time="2026-08-20T05:50:18.090Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVGRBYRZAVJ0W8XKV3NSHK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:50:18.082" grpc.time_ms=7.283 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2283gitlab # [ 258.103643] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.148Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f5dc7cc2e4bb28fae0de8fa0","created_at":"2026-08-20T05:50:15.899Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-984069ce64054a9c","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:15.902Z","job_size_bytes":66,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f5dc7cc2e4bb28fae0de8fa0: done: 0.019994 sec","job_status":"done","queue_duration_s":2.225889,"scheduling_latency_s":2.225902,"redis_calls":10,"redis_duration_s":0.001203,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000238,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000717,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000248,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012706,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000203099,"duration_s":0.019994,"completed_at":"2026-08-20T05:50:18.148Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002941,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2284gitlab # [ 258.143193] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.149Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"2b498e1bebce01b814c6e4be","created_at":"2026-08-20T05:50:15.903Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-984069ce64054a9c","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:15.905Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-2b498e1bebce01b814c6e4be: start","job_status":"start","queue_duration_s":2.243414,"scheduling_latency_s":2.243428}2285gitlab # [ 258.181676] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.239Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"2b498e1bebce01b814c6e4be","created_at":"2026-08-20T05:50:15.903Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-984069ce64054a9c","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:15.905Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-2b498e1bebce01b814c6e4be: done: 0.090726 sec","job_status":"done","queue_duration_s":2.243414,"scheduling_latency_s":2.243428,"redis_calls":10,"redis_duration_s":0.001767,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000414,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001055,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000298,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.061,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.057,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022016,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000393626,"duration_s":0.090726,"completed_at":"2026-08-20T05:50:18.239Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.060726,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2286gitlab # [ 258.186776] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.241Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"de2a96de596edd9acffe4c63","created_at":"2026-08-20T05:50:15.910Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-984069ce64054a9c","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:15.912Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-de2a96de596edd9acffe4c63: start","job_status":"start","queue_duration_s":2.328211,"scheduling_latency_s":2.328226}2287gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2288gitlab # [ 258.199882] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.263Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"de2a96de596edd9acffe4c63","created_at":"2026-08-20T05:50:15.910Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-984069ce64054a9c","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:15.912Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-de2a96de596edd9acffe4c63: done: 0.022612 sec","job_status":"done","queue_duration_s":2.328211,"scheduling_latency_s":2.328226,"redis_calls":10,"redis_duration_s":0.00119,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000236,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000715,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000239,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012868,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000225448,"duration_s":0.022612,"completed_at":"2026-08-20T05:50:18.263Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005729,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2289gitlab # [ 258.235595] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.264Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"56a225e22d6cd0d69b75bc4e","created_at":"2026-08-20T05:50:15.913Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-984069ce64054a9c","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:15.915Z","job_size_bytes":6,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-56a225e22d6cd0d69b75bc4e: start","job_status":"start","queue_duration_s":2.348762,"scheduling_latency_s":2.348775}2290gitlab # [ 258.280602] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.278Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"56a225e22d6cd0d69b75bc4e","created_at":"2026-08-20T05:50:15.913Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-984069ce64054a9c","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:15.915Z","job_size_bytes":6,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-56a225e22d6cd0d69b75bc4e: done: 0.013581 sec","job_status":"done","queue_duration_s":2.348762,"scheduling_latency_s":2.348775,"redis_calls":10,"redis_duration_s":0.001199,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000234,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000727,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000238,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007996,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000192762,"duration_s":0.013581,"completed_at":"2026-08-20T05:50:18.278Z","load_balancing_strategy":"primary","db_duration_s":0.001548,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2291gitlab # [ 258.283701] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.278Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"fbbdc3e83ae35cceed486c2e","created_at":"2026-08-20T05:50:15.916Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-984069ce64054a9c","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:15.918Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-fbbdc3e83ae35cceed486c2e: start","job_status":"start","queue_duration_s":2.360168,"scheduling_latency_s":2.360181}2292gitlab # [ 258.322897] gitaly[911]: time="2026-08-20T05:50:18.416Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVF41ARCXRYZGTKQDC09F5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:50:18.414" grpc.time_ms=0.493 pid=911 span.kind=server system=grpc2293gitlab # [ 258.323609] gitaly[911]: time="2026-08-20T05:50:18.432Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVF41ARCXRYZGTKQDC09F5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:50:18.431" grpc.time_ms=0.245 pid=911 span.kind=server system=grpc2294gitlab # [ 258.324462] nixbot[2620]: INFO: ::ffff:127.0.0.1:50410 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2295gitlab # [ 258.325974] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.299Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"fbbdc3e83ae35cceed486c2e","created_at":"2026-08-20T05:50:15.916Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-984069ce64054a9c","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:15.918Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-fbbdc3e83ae35cceed486c2e: done: 0.020403 sec","job_status":"done","queue_duration_s":2.360168,"scheduling_latency_s":2.360181,"redis_calls":10,"redis_duration_s":0.001235,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000231,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00076,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000244,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013115,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000200026,"duration_s":0.020403,"completed_at":"2026-08-20T05:50:18.299Z","load_balancing_strategy":"primary","db_duration_s":0.003745,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2296gitlab # [ 258.362174] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.300Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"04da9dd7cd27668f1e604bfe","created_at":"2026-08-20T05:50:15.923Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-984069ce64054a9c","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:15.927Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-04da9dd7cd27668f1e604bfe: start","job_status":"start","queue_duration_s":2.373204,"scheduling_latency_s":2.373216}2297gitlab # [ 258.362816] gitaly[911]: time="2026-08-20T05:50:18.458Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVF41ARCXRYZGTKQDC09F5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:50:18.456" grpc.time_ms=0.883 pid=911 span.kind=server system=grpc2298gitlab # [ 258.366935] gitaly[911]: time="2026-08-20T05:50:18.469Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF41ARCXRYZGTKQDC09F5 diskcache=36169179-b4f6-4b97-b7d7-e46a0dab5cba grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:50:48.386" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:50:18.386" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2299gitlab # [ 258.375096] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:50:18 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 432300gitlab # [ 258.376654] gitlab-workhorse[827]: time="2026-08-20T05:50:18Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672301gitlab # [ 258.377963] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:50:18 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 452302gitlab # [ 258.379512] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.337Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"04da9dd7cd27668f1e604bfe","created_at":"2026-08-20T05:50:15.923Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-984069ce64054a9c","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:15.927Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-04da9dd7cd27668f1e604bfe: done: 0.037285 sec","job_status":"done","queue_duration_s":2.373204,"scheduling_latency_s":2.373216,"redis_calls":14,"redis_duration_s":0.001725,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00025,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000784,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000691,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024445,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000200584,"duration_s":0.037285,"completed_at":"2026-08-20T05:50:18.337Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007384,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2303gitlab # [ 258.433122] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.338Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"14ec4dcba86c35f5f086246b","created_at":"2026-08-20T05:50:16.002Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-984069ce64054a9c","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:16.004Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-14ec4dcba86c35f5f086246b: start","job_status":"start","queue_duration_s":2.333963,"scheduling_latency_s":2.333977}2304gitlab # [ 258.433846] gitaly[911]: time="2026-08-20T05:50:18.469Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=72 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7283 command.oublock=0 command.real_time_ms=75 command.spawn_token_fork_ms=1 command.system_time_ms=43 command.user_time_ms=29 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF41ARCXRYZGTKQDC09F5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:50:48.386" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:50:18.386" grpc.time_ms=82.403 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2305gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.23 seconds)2306gitlab # [ 258.437616] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.532Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"14ec4dcba86c35f5f086246b","created_at":"2026-08-20T05:50:16.002Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-984069ce64054a9c","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:16.004Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2570,"job_status":"rescheduled","message":"PipelineProcessWorker JID-14ec4dcba86c35f5f086246b: rescheduled"}2307gitlab # [ 258.449540] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.536Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"14ec4dcba86c35f5f086246b","created_at":"2026-08-20T05:50:16.002Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-984069ce64054a9c","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:16.004Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-14ec4dcba86c35f5f086246b: done: 0.198295 sec","job_status":"done","queue_duration_s":2.333963,"scheduling_latency_s":2.333977,"gitaly_calls":3,"gitaly_duration_s":0.090584,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.008527,"redis_read_bytes":149,"redis_write_bytes":18014,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000509,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000598,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.002215,"redis_queues_read_bytes":27,"redis_queues_write_bytes":12313,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.002864,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000224,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000334,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001274,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.007,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.07642,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.175568403,"duration_s":0.198295,"completed_at":"2026-08-20T05:50:18.536Z","load_balancing_strategy":"primary","db_duration_s":0.028818,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2308gitlab # [ 258.490042] gitaly[911]: time="2026-08-20T05:50:18.501Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVGRTTJK04GQ0M6JHGXK6M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:50:18.496" grpc.time_ms=5.168 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2309gitlab # [ 258.528505] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:50:18 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 402310gitlab # [ 258.529152] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.537Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"3d36bb816b4a111d2316a85b","created_at":"2026-08-20T05:50:16.076Z","trace_propagation_headers":{"sentry-trace":"d1b368de7b3a4446ab31509a1e3290e8-392e6aae769f4f21","baggage":"sentry-trace_id=d1b368de7b3a4446ab31509a1e3290e8,sentry-release=Unknown"},"correlation_id":"01M0EVEZJ57E2F4N71EH50MEM6","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:16.081Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-3d36bb816b4a111d2316a85b: start","job_status":"start","queue_duration_s":2.456326,"scheduling_latency_s":2.456341}2311gitlab # [ 258.529727] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.586Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"3d36bb816b4a111d2316a85b","created_at":"2026-08-20T05:50:16.076Z","trace_propagation_headers":{"sentry-trace":"d1b368de7b3a4446ab31509a1e3290e8-392e6aae769f4f21","baggage":"sentry-trace_id=d1b368de7b3a4446ab31509a1e3290e8,sentry-release=Unknown"},"correlation_id":"01M0EVEZJ57E2F4N71EH50MEM6","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:16.081Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-3d36bb816b4a111d2316a85b: done: 0.048759 sec","job_status":"done","queue_duration_s":2.456326,"scheduling_latency_s":2.456341,"redis_calls":19,"redis_duration_s":0.005833,"redis_read_bytes":22,"redis_write_bytes":4291,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000652,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000423,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2262,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001825,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.002933,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.007069334,"duration_s":0.048759,"completed_at":"2026-08-20T05:50:18.586Z","load_balancing_strategy":"primary","db_duration_s":0.007927,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2312gitlab # [ 258.565295] gitaly[911]: time="2026-08-20T05:50:18.508Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVF41ARCXRYZGTKQDC09F5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T05:50:48.507" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:18.507" grpc.time_ms=0.659 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2313gitlab # [ 258.565945] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.587Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","295c1f763f25045b608a530b"],"class":"WebHooks::LogExecutionWorker","jid":"41f22eeee415304e4b6eeea6","created_at":"2026-08-20T05:50:17.150Z","trace_propagation_headers":{"sentry-trace":"d1b368de7b3a4446ab31509a1e3290e8-7dc2649ab8a944ed","baggage":"sentry-trace_id=d1b368de7b3a4446ab31509a1e3290e8,sentry-release=Unknown"},"correlation_id":"01M0EVEZJ57E2F4N71EH50MEM6","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:edaea812d997ee98404068a00b019aa08c14dfb46cd8ce4072bdab5e0d80e27d","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:17.157Z","job_size_bytes":2593,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-41f22eeee415304e4b6eeea6: start","job_status":"start","queue_duration_s":1.43051,"scheduling_latency_s":1.430525}2314gitlab # [ 258.573197] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.620Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","295c1f763f25045b608a530b"],"class":"WebHooks::LogExecutionWorker","jid":"41f22eeee415304e4b6eeea6","created_at":"2026-08-20T05:50:17.150Z","trace_propagation_headers":{"sentry-trace":"d1b368de7b3a4446ab31509a1e3290e8-7dc2649ab8a944ed","baggage":"sentry-trace_id=d1b368de7b3a4446ab31509a1e3290e8,sentry-release=Unknown"},"correlation_id":"01M0EVEZJ57E2F4N71EH50MEM6","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:edaea812d997ee98404068a00b019aa08c14dfb46cd8ce4072bdab5e0d80e27d","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:17.157Z","job_size_bytes":2593,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-41f22eeee415304e4b6eeea6: done: 0.033157 sec","job_status":"done","queue_duration_s":1.43051,"scheduling_latency_s":1.430525,"redis_calls":10,"redis_duration_s":0.0035110000000000002,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000248,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002958,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000305,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020698,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000362058,"duration_s":0.033157,"completed_at":"2026-08-20T05:50:18.620Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005616,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2315gitlab # [ 258.616057] gitaly[911]: time="2026-08-20T05:50:18.527Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVF41ARCXRYZGTKQDC09F5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:50:48.526" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:18.526" grpc.time_ms=0.453 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2316gitlab # [ 258.618509] gitaly[911]: time="2026-08-20T05:50:18.547Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVGRW777PB9TCRBYVKJ7QW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:50:18.541" pid=911 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2317gitlab # [ 258.653996] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.624Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","32a21fb06edc920cd3e44271"],"class":"WebHooks::LogExecutionWorker","jid":"e8ff0fc0c04672af4a288323","created_at":"2026-08-20T05:50:17.900Z","trace_propagation_headers":{"sentry-trace":"6bf877b80af5414a94178d2a7e91c6fe-6bb177dbc9f245ae","baggage":"sentry-trace_id=6bf877b80af5414a94178d2a7e91c6fe,sentry-release=Unknown"},"correlation_id":"01M0EVF33XYQTWS112XM44RJZW","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a7a09c4cdfce873c6b1c1c39c1bc0e3a875a1cf2ac75249f9e8e9fbef463d96c","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:17.903Z","job_size_bytes":2592,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-e8ff0fc0c04672af4a288323: start","job_status":"start","queue_duration_s":0.720783,"scheduling_latency_s":0.720811}2318gitlab # [ 258.654577] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.646Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","32a21fb06edc920cd3e44271"],"class":"WebHooks::LogExecutionWorker","jid":"e8ff0fc0c04672af4a288323","created_at":"2026-08-20T05:50:17.900Z","trace_propagation_headers":{"sentry-trace":"6bf877b80af5414a94178d2a7e91c6fe-6bb177dbc9f245ae","baggage":"sentry-trace_id=6bf877b80af5414a94178d2a7e91c6fe,sentry-release=Unknown"},"correlation_id":"01M0EVF33XYQTWS112XM44RJZW","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a7a09c4cdfce873c6b1c1c39c1bc0e3a875a1cf2ac75249f9e8e9fbef463d96c","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:17.903Z","job_size_bytes":2592,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-e8ff0fc0c04672af4a288323: done: 0.022342 sec","job_status":"done","queue_duration_s":0.720783,"scheduling_latency_s":0.720811,"redis_calls":7,"redis_duration_s":0.002708,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002415,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000293,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012494,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022342,"completed_at":"2026-08-20T05:50:18.646Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003667,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2319gitlab # [ 258.707216] gitaly[911]: time="2026-08-20T05:50:18.547Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVGRW777PB9TCRBYVKJ7QW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:50:18.541" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2320gitlab # [ 258.707907] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.647Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"8d18f9680d76ad057389d46a","created_at":"2026-08-20T05:50:18.380Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-c15eab00133643c4","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:18.381Z","job_size_bytes":23,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-8d18f9680d76ad057389d46a: start","job_status":"start","queue_duration_s":0.265637,"scheduling_latency_s":0.265652}2321gitlab # [ 258.708563] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.684Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"8d18f9680d76ad057389d46a","created_at":"2026-08-20T05:50:18.380Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-c15eab00133643c4","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:18.381Z","job_size_bytes":23,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-8d18f9680d76ad057389d46a: done: 0.036394 sec","job_status":"done","queue_duration_s":0.265637,"scheduling_latency_s":0.265652,"redis_calls":7,"redis_duration_s":0.003892,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003626,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000266,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036394,"completed_at":"2026-08-20T05:50:18.683Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007462,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2322gitlab # [ 258.733696] gitaly[911]: time="2026-08-20T05:50:18.548Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVGRW777PB9TCRBYVKJ7QW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:50:18.541" grpc.time_ms=6.675 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2323gitlab # [ 258.773778] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.685Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"5a0913a7da4ef1c6769d0967","created_at":"2026-08-20T05:50:18.475Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-c15eab00133643c4","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:18.477Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-5a0913a7da4ef1c6769d0967: start","job_status":"start","queue_duration_s":0.207167,"scheduling_latency_s":0.207187}2324gitlab # [ 258.774530] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.701Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"5a0913a7da4ef1c6769d0967","created_at":"2026-08-20T05:50:18.475Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-c15eab00133643c4","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:18.477Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-5a0913a7da4ef1c6769d0967: done: 0.016448 sec","job_status":"done","queue_duration_s":0.207167,"scheduling_latency_s":0.207187,"redis_calls":7,"redis_duration_s":0.00086,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000624,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000236,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011107,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016448,"completed_at":"2026-08-20T05:50:18.701Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002519,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2325gitlab # [ 258.809497] gitaly[911]: time="2026-08-20T05:50:18.620Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVGRYMX49NW3NPWEFDRA4J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=196 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:50:18.612" grpc.time_ms=7.661 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2326gitlab # [ 258.809688] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.702Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"47c0c95dec9c4f22910f3a82","created_at":"2026-08-20T05:50:18.482Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-c15eab00133643c4","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:18.483Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-47c0c95dec9c4f22910f3a82: start","job_status":"start","queue_duration_s":0.219225,"scheduling_latency_s":0.219239}2327gitlab # [ 258.815414] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.718Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"47c0c95dec9c4f22910f3a82","created_at":"2026-08-20T05:50:18.482Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-c15eab00133643c4","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:18.483Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-47c0c95dec9c4f22910f3a82: done: 0.01648 sec","job_status":"done","queue_duration_s":0.219225,"scheduling_latency_s":0.219239,"redis_calls":7,"redis_duration_s":0.000861,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000629,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000232,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011189,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01648,"completed_at":"2026-08-20T05:50:18.718Z","load_balancing_strategy":"primary","db_duration_s":0.002556,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2328gitlab # [ 258.860977] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.719Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"2b0a0294379664d121a4a4e0","created_at":"2026-08-20T05:50:18.488Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-c15eab00133643c4","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:18.489Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-2b0a0294379664d121a4a4e0: start","job_status":"start","queue_duration_s":0.230742,"scheduling_latency_s":0.230756}2329gitlab # [ 258.861560] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.737Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"2b0a0294379664d121a4a4e0","created_at":"2026-08-20T05:50:18.488Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-c15eab00133643c4","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:18.489Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-2b0a0294379664d121a4a4e0: done: 0.017673 sec","job_status":"done","queue_duration_s":0.230742,"scheduling_latency_s":0.230756,"redis_calls":10,"redis_duration_s":0.0012230000000000001,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000634,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000359,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00023,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012414,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017673,"completed_at":"2026-08-20T05:50:18.737Z","load_balancing_strategy":"primary","db_duration_s":0.00271,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2330gitlab # [ 258.922073] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.738Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"95d4b551b1fd593524506062","created_at":"2026-08-20T05:50:18.489Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-c15eab00133643c4","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:18.490Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-95d4b551b1fd593524506062: start","job_status":"start","queue_duration_s":0.247778,"scheduling_latency_s":0.247793}2331gitlab # [ 258.922710] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.752Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"95d4b551b1fd593524506062","created_at":"2026-08-20T05:50:18.489Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-c15eab00133643c4","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:18.490Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-95d4b551b1fd593524506062: done: 0.014618 sec","job_status":"done","queue_duration_s":0.247778,"scheduling_latency_s":0.247793,"redis_calls":7,"redis_duration_s":0.000929,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00068,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000249,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009996,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014618,"completed_at":"2026-08-20T05:50:18.752Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002224,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2332gitlab # [ 258.943217] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.753Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"2ffccc6c67f3f4f1fb9b9900","created_at":"2026-08-20T05:50:18.490Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-c15eab00133643c4","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:18.492Z","job_size_bytes":19,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-2ffccc6c67f3f4f1fb9b9900: start","job_status":"start","queue_duration_s":0.261571,"scheduling_latency_s":0.261585}2333gitlab # [ 258.980067] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.767Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"2ffccc6c67f3f4f1fb9b9900","created_at":"2026-08-20T05:50:18.490Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-c15eab00133643c4","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:18.492Z","job_size_bytes":19,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-2ffccc6c67f3f4f1fb9b9900: done: 0.013951 sec","job_status":"done","queue_duration_s":0.261571,"scheduling_latency_s":0.261585,"redis_calls":8,"redis_duration_s":0.000997,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000744,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000253,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009218,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013951,"completed_at":"2026-08-20T05:50:18.767Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002127,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2334gitlab # [ 259.019083] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.768Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"4780c2652e2e1744cd5caa3b","created_at":"2026-08-20T05:50:18.492Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-c15eab00133643c4","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:18.493Z","job_size_bytes":66,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-4780c2652e2e1744cd5caa3b: start","job_status":"start","queue_duration_s":0.274817,"scheduling_latency_s":0.27483}2335gitlab # [ 259.019708] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.781Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"4780c2652e2e1744cd5caa3b","created_at":"2026-08-20T05:50:18.492Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-c15eab00133643c4","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:18.493Z","job_size_bytes":66,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-4780c2652e2e1744cd5caa3b: done: 0.012699 sec","job_status":"done","queue_duration_s":0.274817,"scheduling_latency_s":0.27483,"redis_calls":7,"redis_duration_s":0.000922,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000636,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000286,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008767,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012699,"completed_at":"2026-08-20T05:50:18.781Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001442,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2336gitlab # [ 259.056517] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.782Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"1242066143472601e3e74e8f","created_at":"2026-08-20T05:50:18.494Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-c15eab00133643c4","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:18.494Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-1242066143472601e3e74e8f: start","job_status":"start","queue_duration_s":0.287173,"scheduling_latency_s":0.287186}2337gitlab # [ 259.057140] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.797Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"1242066143472601e3e74e8f","created_at":"2026-08-20T05:50:18.494Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-c15eab00133643c4","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:18.494Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-1242066143472601e3e74e8f: done: 0.015591 sec","job_status":"done","queue_duration_s":0.287173,"scheduling_latency_s":0.287186,"redis_calls":7,"redis_duration_s":0.001039,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000652,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000387,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009652,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015591,"completed_at":"2026-08-20T05:50:18.797Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003548,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2338gitlab # [ 259.082784] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.798Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"9447d572059bad342a7fe960","created_at":"2026-08-20T05:50:18.495Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-c15eab00133643c4","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:18.496Z","job_size_bytes":6,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-9447d572059bad342a7fe960: start","job_status":"start","queue_duration_s":0.302393,"scheduling_latency_s":0.302408}2339gitlab # [ 259.095490] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.806Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"9447d572059bad342a7fe960","created_at":"2026-08-20T05:50:18.495Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-c15eab00133643c4","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:18.496Z","job_size_bytes":6,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-9447d572059bad342a7fe960: done: 0.008257 sec","job_status":"done","queue_duration_s":0.302393,"scheduling_latency_s":0.302408,"redis_calls":7,"redis_duration_s":0.000831,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000599,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000232,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005367,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008257,"completed_at":"2026-08-20T05:50:18.806Z","load_balancing_strategy":"primary","db_duration_s":0.000241,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2340gitlab # [ 259.155389] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.807Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"35728a643bf32d82e3916ab5","created_at":"2026-08-20T05:50:18.496Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-c15eab00133643c4","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:18.497Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-35728a643bf32d82e3916ab5: start","job_status":"start","queue_duration_s":0.310239,"scheduling_latency_s":0.310253}2341gitlab # [ 259.156044] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.820Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"35728a643bf32d82e3916ab5","created_at":"2026-08-20T05:50:18.496Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-c15eab00133643c4","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:18.497Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-35728a643bf32d82e3916ab5: done: 0.013067 sec","job_status":"done","queue_duration_s":0.310239,"scheduling_latency_s":0.310253,"redis_calls":7,"redis_duration_s":0.00084,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000606,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000234,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008959,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013067,"completed_at":"2026-08-20T05:50:18.820Z","load_balancing_strategy":"primary","db_duration_s":0.001767,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2342gitlab # [ 259.203294] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.821Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"646c4ddfdcae9d2d99d1164c","created_at":"2026-08-20T05:50:18.532Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-c15eab00133643c4","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:18.533Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-646c4ddfdcae9d2d99d1164c: start","job_status":"start","queue_duration_s":0.28807,"scheduling_latency_s":0.288084}2343gitlab # [ 259.203938] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.836Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"646c4ddfdcae9d2d99d1164c","created_at":"2026-08-20T05:50:18.532Z","trace_propagation_headers":{"sentry-trace":"6764c3bd9ca340f6bb43643822589578-c15eab00133643c4","baggage":"sentry-trace_id=6764c3bd9ca340f6bb43643822589578,sentry-release=Unknown"},"correlation_id":"01M0EVF41ARCXRYZGTKQDC09F5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:18.533Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-646c4ddfdcae9d2d99d1164c: done: 0.014672 sec","job_status":"done","queue_duration_s":0.28807,"scheduling_latency_s":0.288084,"redis_calls":8,"redis_duration_s":0.001036,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000799,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000237,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014672,"completed_at":"2026-08-20T05:50:18.836Z","load_balancing_strategy":"primary","db_duration_s":0.001968,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2344gitlab # [ 259.219026] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.837Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"ebe03eb8446f9776fb50a852","created_at":"2026-08-20T05:50:18.572Z","trace_propagation_headers":{"sentry-trace":"d1b368de7b3a4446ab31509a1e3290e8-0dccded2bdf84ea9","baggage":"sentry-trace_id=d1b368de7b3a4446ab31509a1e3290e8,sentry-release=Unknown"},"correlation_id":"01M0EVEZJ57E2F4N71EH50MEM6","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:18.577Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-ebe03eb8446f9776fb50a852: start","job_status":"start","queue_duration_s":0.259728,"scheduling_latency_s":0.259742}2345gitlab # [ 259.232626] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:18.890Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"ebe03eb8446f9776fb50a852","created_at":"2026-08-20T05:50:18.572Z","trace_propagation_headers":{"sentry-trace":"d1b368de7b3a4446ab31509a1e3290e8-0dccded2bdf84ea9","baggage":"sentry-trace_id=d1b368de7b3a4446ab31509a1e3290e8,sentry-release=Unknown"},"correlation_id":"01M0EVEZJ57E2F4N71EH50MEM6","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:18.577Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-ebe03eb8446f9776fb50a852: done: 0.053588 sec","job_status":"done","queue_duration_s":0.259728,"scheduling_latency_s":0.259742,"redis_calls":11,"redis_duration_s":0.001451,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000248,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000941,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000262,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038102,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000202261,"duration_s":0.053588,"completed_at":"2026-08-20T05:50:18.890Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012501,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2346gitlab # [ 259.309353] gitaly[911]: time="2026-08-20T05:50:19.488Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVGRZYEVN2DYJMW95BH8V8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:50:18.662" pid=911 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2347gitlab # [ 259.309732] gitaly[911]: time="2026-08-20T05:50:19.488Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=892928 command.minflt=1166 command.oublock=0 command.real_time_ms=823 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVGRZYEVN2DYJMW95BH8V8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:50:18.662" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2348gitlab # [ 259.310394] gitaly[911]: time="2026-08-20T05:50:19.488Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=892928 command.minflt=1166 command.oublock=0 command.real_time_ms=823 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVGRZYEVN2DYJMW95BH8V8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:50:18.662" grpc.time_ms=825.615 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2349gitlab # [ 259.310985] gitlab-workhorse[827]: time="2026-08-20T05:50:19Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162350gitlab # [ 259.311507] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:50:19 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 8662351gitlab # [ 259.377902] gitaly[911]: time="2026-08-20T05:50:19.556Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVGSVW6NQHE07K593QJ0XE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:50:49.455" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:19.555" grpc.time_ms=0.482 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2352gitlab # [ 259.397937] gitaly[911]: time="2026-08-20T05:50:19.576Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=649 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVGSVW6NQHE07K593QJ0XE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-20T05:50:49.470" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:50:19.570" grpc.time_ms=5.683 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2353gitlab # [ 259.414520] gitaly[911]: time="2026-08-20T05:50:19.593Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVGSVW6NQHE07K593QJ0XE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:50:29.077" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:50:19.588" grpc.time_ms=5.154 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2354gitlab # [ 259.440900] gitaly[911]: time="2026-08-20T05:50:19.619Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVGSVW6NQHE07K593QJ0XE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T05:50:29.109" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:50:19.619" grpc.time_ms=0.16 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2355gitlab # [ 259.450039] gitaly[911]: time="2026-08-20T05:50:19.628Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVGSVW6NQHE07K593QJ0XE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T05:50:29.111" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:50:19.621" grpc.time_ms=6.854 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2356gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb'2357gitlab # [ 259.504816] gitaly[911]: time="2026-08-20T05:50:19.683Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVGSVW6NQHE07K593QJ0XE grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:50:19.681" grpc.time_ms=1.93 pid=911 span.kind=server system=grpc2358gitlab # [ 259.533666] nixbot[2620]: INFO: ::ffff:127.0.0.1:50422 - "GET /api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 200 OK2359gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=848de655fe66d2aaeff87afaf484143b3c9fcfeb', in 0.05 seconds)2360(finished: subtest: push delivers the webhook, in 56.62 seconds)2361subtest: eval and build post commit statuses2362gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/848de655fe66d2aaeff87afaf484143b3c9fcfeb/statuses2363gitlab # [ 259.544801] gitaly[911]: time="2026-08-20T05:50:19.723Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVGSVW6NQHE07K593QJ0XE grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:50:19.723" grpc.time_ms=0.343 pid=911 span.kind=server system=grpc2364gitlab # [ 259.561580] gitaly[911]: time="2026-08-20T05:50:19.740Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVGSVW6NQHE07K593QJ0XE diskcache=0234a866-a1e3-4f87-9593-f366b96b1c32 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:50:29.131" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:50:19.641" pid=911 ref=refs/keep-around/848de655fe66d2aaeff87afaf484143b3c9fcfeb remote_ip="2001:db8:1::1" revision=848de655fe66d2aaeff87afaf484143b3c9fcfeb span.kind=server system=grpc username=root2365gitlab # [ 259.569572] gitaly[911]: time="2026-08-20T05:50:19.748Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVGSVW6NQHE07K593QJ0XE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:50:49.647" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:19.747" grpc.time_ms=0.458 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2366gitlab # [ 259.577133] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:19.754Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"2629481380d283cfdc04fe9e","created_at":"2026-08-20T05:50:19.749Z","trace_propagation_headers":{"sentry-trace":"d1a579075cec44baa1022320ac53384c-48ac0134c22946ad","baggage":"sentry-trace_id=d1a579075cec44baa1022320ac53384c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVGSVW6NQHE07K593QJ0XE","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:19.752Z","job_size_bytes":65,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-2629481380d283cfdc04fe9e: start","job_status":"start","queue_duration_s":0.002115,"scheduling_latency_s":0.002159}2367gitlab # [ 259.593693] gitaly[911]: time="2026-08-20T05:50:19.772Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=84 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5383 command.oublock=8 command.real_time_ms=90 command.spawn_token_fork_ms=0 command.system_time_ms=51 command.user_time_ms=33 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVGSVW6NQHE07K593QJ0XE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:50:29.131" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:50:19.641" grpc.time_ms=98.629 pid=911 ref=refs/keep-around/848de655fe66d2aaeff87afaf484143b3c9fcfeb remote_ip="2001:db8:1::1" revision=848de655fe66d2aaeff87afaf484143b3c9fcfeb span.kind=server system=grpc username=root2368gitlab # [ 259.602630] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:19.781Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"2629481380d283cfdc04fe9e","created_at":"2026-08-20T05:50:19.749Z","trace_propagation_headers":{"sentry-trace":"d1a579075cec44baa1022320ac53384c-48ac0134c22946ad","baggage":"sentry-trace_id=d1a579075cec44baa1022320ac53384c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVGSVW6NQHE07K593QJ0XE","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:19.752Z","job_size_bytes":65,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-2629481380d283cfdc04fe9e: done: 0.026785 sec","job_status":"done","queue_duration_s":0.002115,"scheduling_latency_s":0.002159,"redis_calls":7,"redis_duration_s":0.001064,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000744,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00032,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015457,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026785,"completed_at":"2026-08-20T05:50:19.781Z","load_balancing_strategy":"primary","db_duration_s":0.004204,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2369gitlab # [ 259.604682] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:19.783Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"ca910fb32d62bd33a0268ffc","created_at":"2026-08-20T05:50:19.753Z","trace_propagation_headers":{"sentry-trace":"d1a579075cec44baa1022320ac53384c-48ac0134c22946ad","baggage":"sentry-trace_id=d1a579075cec44baa1022320ac53384c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVGSVW6NQHE07K593QJ0XE","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:19.754Z","job_size_bytes":65,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-ca910fb32d62bd33a0268ffc: start","job_status":"start","queue_duration_s":0.028892,"scheduling_latency_s":0.028908}2370gitlab # [ 259.631732] gitaly[911]: time="2026-08-20T05:50:19.810Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVGT30C54N21FY4FW7AT3T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:50:49.709" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:19.809" grpc.time_ms=0.611 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2371gitlab # [ 259.649558] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:50:19 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/848de655fe66d2aaeff87afaf484143b3c9fcfeb/statuses HTTP/1.1" 200 2 "" "curl/8.21.0" 832372gitlab # [ 259.652042] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:19.830Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"ca910fb32d62bd33a0268ffc","created_at":"2026-08-20T05:50:19.753Z","trace_propagation_headers":{"sentry-trace":"d1a579075cec44baa1022320ac53384c-48ac0134c22946ad","baggage":"sentry-trace_id=d1a579075cec44baa1022320ac53384c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVGSVW6NQHE07K593QJ0XE","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:19.754Z","job_size_bytes":65,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-ca910fb32d62bd33a0268ffc: done: 0.047133 sec","job_status":"done","queue_duration_s":0.028892,"scheduling_latency_s":0.028908,"redis_calls":10,"redis_duration_s":0.001536,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000805,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.000731,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027597,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.047133,"completed_at":"2026-08-20T05:50:19.830Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013281,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2373gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/848de655fe66d2aaeff87afaf484143b3c9fcfeb/statuses, in 0.17 seconds)2374gitlab # [ 259.726642] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:19.905Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"7cd7467274875aee2c6b7528","created_at":"2026-08-20T05:50:19.901Z","trace_propagation_headers":{"sentry-trace":"d1a579075cec44baa1022320ac53384c-48ac0134c22946ad","baggage":"sentry-trace_id=d1a579075cec44baa1022320ac53384c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVGSVW6NQHE07K593QJ0XE","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:19.903Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7cd7467274875aee2c6b7528: start","job_status":"start","queue_duration_s":0.001229,"scheduling_latency_s":0.001265}2375gitlab # [ 259.739282] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:50:19 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 3972376gitlab # [ 259.739550] nixbot[2620]: {"ts": "2026-08-20T05:50:19.916Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/848de655fe66d2aaeff87afaf484143b3c9fcfeb \"HTTP/1.1 201 Created\""}2377gitlab # [ 259.748713] nixbot[2620]: {"ts": "2026-08-20T05:50:19.927Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-848de655fe66-4"}2378gitlab # [ 259.794681] nix-daemon[2839]: accepted connection from pid 3421, user nixbot2379gitlab # [ 259.800284] gitaly[911]: time="2026-08-20T05:50:19.979Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVGSVW6NQHE07K593QJ0XE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T05:50:49.077" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:19.978" grpc.time_ms=0.633 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2380gitlab # [ 259.829219] gitaly[911]: time="2026-08-20T05:50:20.007Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVGSVW6NQHE07K593QJ0XE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:50:50.006" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:20.007" grpc.time_ms=0.592 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2381gitlab # [ 259.850070] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:20.028Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"7cd7467274875aee2c6b7528","created_at":"2026-08-20T05:50:19.901Z","trace_propagation_headers":{"sentry-trace":"d1a579075cec44baa1022320ac53384c-48ac0134c22946ad","baggage":"sentry-trace_id=d1a579075cec44baa1022320ac53384c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVGSVW6NQHE07K593QJ0XE","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:19.903Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7cd7467274875aee2c6b7528: done: 0.123439 sec","job_status":"done","queue_duration_s":0.001229,"scheduling_latency_s":0.001265,"gitaly_calls":2,"gitaly_duration_s":0.015758,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.0067469999999999995,"redis_read_bytes":79,"redis_write_bytes":5121,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001355,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.00104,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000255,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001022,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000484,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.00047,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000766,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.004,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.08012,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.097214311,"duration_s":0.123439,"completed_at":"2026-08-20T05:50:20.028Z","load_balancing_strategy":"primary","db_duration_s":0.023215,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2382gitlab # [ 259.877577] nix-daemon[2839]: accepted connection from pid 3429, user nixbot2383gitlab # [ 259.892633] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:20.071Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"a31b5a05bd47c861691e93b3","created_at":"2026-08-20T05:50:19.964Z","trace_propagation_headers":{"sentry-trace":"d1a579075cec44baa1022320ac53384c-98c47bf4cd974d44","baggage":"sentry-trace_id=d1a579075cec44baa1022320ac53384c,sentry-release=Unknown"},"correlation_id":"01M0EVGSVW6NQHE07K593QJ0XE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:19.966Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-a31b5a05bd47c861691e93b3: start","job_status":"start","queue_duration_s":0.104826,"scheduling_latency_s":0.10485}2384gitlab # [ 259.913343] nixbot[2620]: {"ts": "2026-08-20T05:50:20.092Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-848de655fe66-4", "argv0": "bwrap"}2385gitlab # [ 259.920356] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:20.098Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"a31b5a05bd47c861691e93b3","created_at":"2026-08-20T05:50:19.964Z","trace_propagation_headers":{"sentry-trace":"d1a579075cec44baa1022320ac53384c-98c47bf4cd974d44","baggage":"sentry-trace_id=d1a579075cec44baa1022320ac53384c,sentry-release=Unknown"},"correlation_id":"01M0EVGSVW6NQHE07K593QJ0XE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:19.966Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-a31b5a05bd47c861691e93b3: done: 0.027736 sec","job_status":"done","queue_duration_s":0.104826,"scheduling_latency_s":0.10485,"redis_calls":7,"redis_duration_s":0.001457,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001073,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000384,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019839,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027736,"completed_at":"2026-08-20T05:50:20.098Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003873,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2386gitlab # [ 260.009883] nix-daemon[2839]: accepted connection from pid 3439, user nixbot2387gitlab # [ 260.054701] nix-daemon[2839]: accepted connection from pid 3449, user nixbot2388gitlab # [ 260.063598] nix-daemon[2839]: accepted connection from pid 3439, user nixbot2389gitlab # [ 260.129377] gitaly[911]: time="2026-08-20T05:50:20.308Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVGTKCWMQ5492D9C3F7536 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:50:50.206" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:20.307" grpc.time_ms=0.539 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2390gitlab # [ 260.191174] gitaly[911]: time="2026-08-20T05:50:20.369Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVGTKCWMQ5492D9C3F7536 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:50:30.161" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:50:20.361" grpc.time_ms=8.26 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2391gitlab # [ 260.218487] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:20.396Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"2e0ca4535d4d5c25f3acb05b","created_at":"2026-08-20T05:50:20.391Z","trace_propagation_headers":{"sentry-trace":"2b705d35d7b14e1494775730e633168b-1dd1390113c44258","baggage":"sentry-trace_id=2b705d35d7b14e1494775730e633168b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVGTKCWMQ5492D9C3F7536","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:20.394Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2e0ca4535d4d5c25f3acb05b: start","job_status":"start","queue_duration_s":0.00176,"scheduling_latency_s":0.001794}2392gitlab # [ 260.250051] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:50:20 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 1582393gitlab # [ 260.250650] nixbot[2620]: {"ts": "2026-08-20T05:50:20.429Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/848de655fe66d2aaeff87afaf484143b3c9fcfeb \"HTTP/1.1 201 Created\""}2394gitlab # [ 260.307910] gitaly[911]: time="2026-08-20T05:50:20.486Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVGTRJ88EYQN10JRMVWAT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:50:50.385" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:20.485" grpc.time_ms=0.759 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2395gitlab # [ 260.331553] gitaly[911]: time="2026-08-20T05:50:20.510Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVGTKCWMQ5492D9C3F7536 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:50:20.509" grpc.time_ms=0.396 pid=911 span.kind=server system=grpc2396gitlab # [ 260.349871] gitaly[911]: time="2026-08-20T05:50:20.528Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVGTRJ88EYQN10JRMVWAT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:50:30.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:50:20.522" grpc.time_ms=5.644 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2397gitlab # [ 260.369969] gitaly[911]: time="2026-08-20T05:50:20.548Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVGTKCWMQ5492D9C3F7536 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:50:20.548" grpc.time_ms=0.252 pid=911 span.kind=server system=grpc2398gitlab # [ 260.385504] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:50:20 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1292399gitlab # [ 260.386560] nixbot[2620]: {"ts": "2026-08-20T05:50:20.565Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/848de655fe66d2aaeff87afaf484143b3c9fcfeb \"HTTP/1.1 201 Created\""}2400gitlab # [ 260.397908] gitaly[911]: time="2026-08-20T05:50:20.576Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVGTKCWMQ5492D9C3F7536 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:50:20.576" grpc.time_ms=0.29 pid=911 span.kind=server system=grpc2401gitlab # [ 260.407401] gitaly[911]: time="2026-08-20T05:50:20.586Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVGTKCWMQ5492D9C3F7536 forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:50:50.469" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:50:20.470" operations="[repack_refs]" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2402gitlab # [ 260.415968] gitaly[911]: time="2026-08-20T05:50:20.587Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVGTKCWMQ5492D9C3F7536 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:50:50.469" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:50:20.470" pid=911 remote_ip="2001:db8:1::1" repository_info="{false {6 704 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-08-20 05:49:18.206526645 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2403gitlab # [ 260.416379] gitaly[911]: time="2026-08-20T05:50:20.592Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVGTKCWMQ5492D9C3F7536 diskcache=2d7ca942-ded8-4471-8533-d355404bfcd7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:50:50.469" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:50:20.470" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2404gitlab # [ 260.416676] gitaly[911]: time="2026-08-20T05:50:20.592Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=69 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7734 command.oublock=0 command.real_time_ms=116 command.spawn_token_fork_ms=0 command.system_time_ms=46 command.user_time_ms=23 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVGTKCWMQ5492D9C3F7536 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:50:50.469" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:50:20.470" grpc.time_ms=122.421 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2405gitlab # [ 260.425107] gitaly[911]: time="2026-08-20T05:50:20.603Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVGTKCWMQ5492D9C3F7536 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:50:50.469" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:50:20.470" pid=911 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2406gitlab # [ 260.425739] gitaly[911]: time="2026-08-20T05:50:20.604Z" level=info msg="optimized repository" clean_stale_data_time=15.834135ms clean_work_trees_time="68.723µs" commit_graph_time="3.632µs" correlation_id=01M0EVGTKCWMQ5492D9C3F7536 gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="3.632µs" pid=911 prune_time="3.073µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="4.47µs" storage_name=default system=housekeeping total_time=16.009018ms2407gitlab # [ 260.426128] gitaly[911]: time="2026-08-20T05:50:20.604Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVGTKCWMQ5492D9C3F7536 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:50:50.469" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:50:20.470" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2408gitlab # [ 260.437916] gitaly[911]: time="2026-08-20T05:50:20.616Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVGTWY5HY3RSF9C2KAK6TX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:50:50.515" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:20.616" grpc.time_ms=0.396 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2409gitlab # [ 260.463651] gitaly[911]: time="2026-08-20T05:50:20.642Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVGTWY5HY3RSF9C2KAK6TX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:50:30.117" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:50:20.637" grpc.time_ms=4.851 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2410gitlab # [ 260.493467] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/08/20:05:50:20 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/848de655fe66d2aaeff87afaf484143b3c9fcfeb HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 972411gitlab # [ 260.496952] nixbot[2620]: {"ts": "2026-08-20T05:50:20.675Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/848de655fe66d2aaeff87afaf484143b3c9fcfeb \"HTTP/1.1 201 Created\""}2412gitlab # [ 260.526035] gitaly[911]: time="2026-08-20T05:50:20.704Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVGTKCWMQ5492D9C3F7536 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T05:50:50.703" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:20.703" grpc.time_ms=0.702 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2413gitlab # [ 260.545638] gitaly[911]: time="2026-08-20T05:50:20.724Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVGTKCWMQ5492D9C3F7536 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:50:50.723" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:50:20.723" grpc.time_ms=0.498 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2414gitlab # [ 260.552064] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:20.730Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"41bdba28f42748a3e135f9fb","created_at":"2026-08-20T05:50:20.728Z","trace_propagation_headers":{"sentry-trace":"2b705d35d7b14e1494775730e633168b-a6bf4ebca4474ed3","baggage":"sentry-trace_id=2b705d35d7b14e1494775730e633168b,sentry-release=Unknown"},"correlation_id":"01M0EVGTKCWMQ5492D9C3F7536","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"2e0ca4535d4d5c25f3acb05b","job_size_bytes":3,"pid":2570,"job_status":"deduplicated","message":"PipelineProcessWorker JID-41bdba28f42748a3e135f9fb: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2415gitlab # [ 260.568065] nix-daemon[2839]: accepted connection from pid 3499, user nixbot2416gitlab # [ 260.568350] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:20.732Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"2e0ca4535d4d5c25f3acb05b","created_at":"2026-08-20T05:50:20.391Z","trace_propagation_headers":{"sentry-trace":"2b705d35d7b14e1494775730e633168b-1dd1390113c44258","baggage":"sentry-trace_id=2b705d35d7b14e1494775730e633168b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVGTKCWMQ5492D9C3F7536","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:20.394Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2570,"job_status":"rescheduled","message":"PipelineProcessWorker JID-2e0ca4535d4d5c25f3acb05b: rescheduled"}2417gitlab # [ 260.568949] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:20.736Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"2e0ca4535d4d5c25f3acb05b","created_at":"2026-08-20T05:50:20.391Z","trace_propagation_headers":{"sentry-trace":"2b705d35d7b14e1494775730e633168b-1dd1390113c44258","baggage":"sentry-trace_id=2b705d35d7b14e1494775730e633168b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVGTKCWMQ5492D9C3F7536","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:20.394Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2e0ca4535d4d5c25f3acb05b: done: 0.340117 sec","job_status":"done","queue_duration_s":0.00176,"scheduling_latency_s":0.001794,"gitaly_calls":3,"gitaly_duration_s":0.129719,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.012423,"redis_read_bytes":239,"redis_write_bytes":21781,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001264,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001143,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.002244,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14466,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.004746,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000272,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000299,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001191,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.095,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.011,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.014,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.078,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.101868,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.310576344,"duration_s":0.340117,"completed_at":"2026-08-20T05:50:20.736Z","load_balancing_strategy":"primary","db_duration_s":0.098689,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2418gitlab # [ 260.610651] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:20.737Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"875d897b27e99fb2d57d8b43","created_at":"2026-08-20T05:50:20.462Z","trace_propagation_headers":{"sentry-trace":"2b705d35d7b14e1494775730e633168b-a6bf4ebca4474ed3","baggage":"sentry-trace_id=2b705d35d7b14e1494775730e633168b,sentry-release=Unknown"},"correlation_id":"01M0EVGTKCWMQ5492D9C3F7536","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:20.464Z","job_size_bytes":23,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-875d897b27e99fb2d57d8b43: start","job_status":"start","queue_duration_s":0.272232,"scheduling_latency_s":0.272247}2419gitlab # [ 260.611366] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:20.771Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"875d897b27e99fb2d57d8b43","created_at":"2026-08-20T05:50:20.462Z","trace_propagation_headers":{"sentry-trace":"2b705d35d7b14e1494775730e633168b-a6bf4ebca4474ed3","baggage":"sentry-trace_id=2b705d35d7b14e1494775730e633168b,sentry-release=Unknown"},"correlation_id":"01M0EVGTKCWMQ5492D9C3F7536","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:20.464Z","job_size_bytes":23,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-875d897b27e99fb2d57d8b43: done: 0.03465 sec","job_status":"done","queue_duration_s":0.272232,"scheduling_latency_s":0.272247,"redis_calls":7,"redis_duration_s":0.000974,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00068,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000294,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018363,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03465,"completed_at":"2026-08-20T05:50:20.771Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013498,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2420gitlab # [ 260.659220] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:20.772Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"99a240fd464b5ad8a681c38b","created_at":"2026-08-20T05:50:20.667Z","trace_propagation_headers":{"sentry-trace":"2b705d35d7b14e1494775730e633168b-a6bf4ebca4474ed3","baggage":"sentry-trace_id=2b705d35d7b14e1494775730e633168b,sentry-release=Unknown"},"correlation_id":"01M0EVGTKCWMQ5492D9C3F7536","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:20.669Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-99a240fd464b5ad8a681c38b: start","job_status":"start","queue_duration_s":0.102978,"scheduling_latency_s":0.103006}2421gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/848de655fe66d2aaeff87afaf484143b3c9fcfeb/statuses2422gitlab # [ 260.659820] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:20.789Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"99a240fd464b5ad8a681c38b","created_at":"2026-08-20T05:50:20.667Z","trace_propagation_headers":{"sentry-trace":"2b705d35d7b14e1494775730e633168b-a6bf4ebca4474ed3","baggage":"sentry-trace_id=2b705d35d7b14e1494775730e633168b,sentry-release=Unknown"},"correlation_id":"01M0EVGTKCWMQ5492D9C3F7536","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:20.669Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-99a240fd464b5ad8a681c38b: done: 0.016679 sec","job_status":"done","queue_duration_s":0.102978,"scheduling_latency_s":0.103006,"redis_calls":7,"redis_duration_s":0.0010409999999999998,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000792,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000249,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010803,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016679,"completed_at":"2026-08-20T05:50:20.789Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002867,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2423gitlab # [ 260.697090] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:20.790Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"909070b76608bfff7189199c","created_at":"2026-08-20T05:50:20.675Z","trace_propagation_headers":{"sentry-trace":"2b705d35d7b14e1494775730e633168b-a6bf4ebca4474ed3","baggage":"sentry-trace_id=2b705d35d7b14e1494775730e633168b,sentry-release=Unknown"},"correlation_id":"01M0EVGTKCWMQ5492D9C3F7536","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:20.678Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-909070b76608bfff7189199c: start","job_status":"start","queue_duration_s":0.112272,"scheduling_latency_s":0.112287}2424gitlab # [ 260.697701] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:20.806Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"909070b76608bfff7189199c","created_at":"2026-08-20T05:50:20.675Z","trace_propagation_headers":{"sentry-trace":"2b705d35d7b14e1494775730e633168b-a6bf4ebca4474ed3","baggage":"sentry-trace_id=2b705d35d7b14e1494775730e633168b,sentry-release=Unknown"},"correlation_id":"01M0EVGTKCWMQ5492D9C3F7536","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:20.678Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-909070b76608bfff7189199c: done: 0.015914 sec","job_status":"done","queue_duration_s":0.112272,"scheduling_latency_s":0.112287,"redis_calls":7,"redis_duration_s":0.000855,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000623,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000232,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011048,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015914,"completed_at":"2026-08-20T05:50:20.806Z","load_balancing_strategy":"primary","db_duration_s":0.002501,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2425gitlab # [ 260.743828] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:20.807Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"9e225353ab988f8aac26c153","created_at":"2026-08-20T05:50:20.683Z","trace_propagation_headers":{"sentry-trace":"2b705d35d7b14e1494775730e633168b-a6bf4ebca4474ed3","baggage":"sentry-trace_id=2b705d35d7b14e1494775730e633168b,sentry-release=Unknown"},"correlation_id":"01M0EVGTKCWMQ5492D9C3F7536","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:20.684Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-9e225353ab988f8aac26c153: start","job_status":"start","queue_duration_s":0.122149,"scheduling_latency_s":0.122163}2426gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/848de655fe66d2aaeff87afaf484143b3c9fcfeb/statuses, in 0.11 seconds)2427(finished: subtest: eval and build post commit statuses, in 1.28 seconds)2428gitlab # [ 260.744529] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:20.824Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"9e225353ab988f8aac26c153","created_at":"2026-08-20T05:50:20.683Z","trace_propagation_headers":{"sentry-trace":"2b705d35d7b14e1494775730e633168b-a6bf4ebca4474ed3","baggage":"sentry-trace_id=2b705d35d7b14e1494775730e633168b,sentry-release=Unknown"},"correlation_id":"01M0EVGTKCWMQ5492D9C3F7536","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:20.684Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-9e225353ab988f8aac26c153: done: 0.017524 sec","job_status":"done","queue_duration_s":0.122149,"scheduling_latency_s":0.122163,"redis_calls":10,"redis_duration_s":0.001242,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000635,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000349,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000258,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012341,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017524,"completed_at":"2026-08-20T05:50:20.824Z","load_balancing_strategy":"primary","db_duration_s":0.002742,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2429(finished: run the VM test script, in 309.99 seconds)2430gitlab # [ 260.775978] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:20.825Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"c3f26dbccae9052240fe91b8","created_at":"2026-08-20T05:50:20.685Z","trace_propagation_headers":{"sentry-trace":"2b705d35d7b14e1494775730e633168b-a6bf4ebca4474ed3","baggage":"sentry-trace_id=2b705d35d7b14e1494775730e633168b,sentry-release=Unknown"},"correlation_id":"01M0EVGTKCWMQ5492D9C3F7536","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:20.686Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-c3f26dbccae9052240fe91b8: start","job_status":"start","queue_duration_s":0.139183,"scheduling_latency_s":0.139198}2431test script finished in 310.01s2432cleanup2433kill QemuMachine (pid 46)2434gitlab # [ 260.822698] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-08-20T05:50:20.844Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"c3f26dbccae9052240fe91b8","created_at":"2026-08-20T05:50:20.685Z","trace_propagation_headers":{"sentry-trace":"2b705d35d7b14e1494775730e633168b-a6bf4ebca4474ed3","baggage":"sentry-trace_id=2b705d35d7b14e1494775730e633168b,sentry-release=Unknown"},"correlation_id":"01M0EVGTKCWMQ5492D9C3F7536","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:20.686Z","jobqemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2435(finished: cleanup, in 1.84 seconds)2436additionally exposed symbols:2437 gitlab,2438 vlan1,2439 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2440[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-20T05:49:22.557Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2441[]2442[]2443[]2444[]2445[]2446[]2447[]2448[]2449[]2450[]2451[]2452[]2453[]2454[]2455[]2456[]2457[]2458[]2459[]2460[]2461[]2462[]2463[]2464[]2465[]2466[]2467[]2468[]2469[]2470[]2471[]2472[]2473[]2474[]2475[]2476[]2477[]2478[]2479[]2480[]2481[]2482[]2483[]2484[]2485[]2486[]2487[]2488[]2489[]2490[]2491[]2492[]2493[]2494[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '848de655fe66d2aaeff87afaf484143b3c9fcfeb', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'pending', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-20T05:50:19.512277Z', 'started_at': None, 'finished_at': None}]2495[]2496[{'id': 5, 'sha': '848de655fe66d2aaeff87afaf484143b3c9fcfeb', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded', 'created_at': '2026-08-20T05:50:19.897Z', 'started_at': None, 'finished_at': '2026-08-20T05:50:20.384Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '848de655fe66d2aaeff87afaf484143b3c9fcfeb', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-08-20T05:50:20.543Z', 'started_at': None, 'finished_at': '2026-08-20T05:50:20.655Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]