vm-test-run-nixbot-gitlab
checks.x86_64-linux.nixbot-gitlab
· build #246
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.pDx2784MCV', fmt=raw size=107374182412(finished: start all VMs, in 58.38 seconds)13gitlab # mke2fs 1.47.4 (6-Mar-2025)14gitlab: waiting for unit setup-gitlab.service15gitlab # Discarding device blocks: 0/262144 done16gitlab: waiting for the VM to finish booting17gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes18gitlab # Filesystem UUID: 8b3a4f43-0289-41e0-802f-c2066586306619gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/46qp8zy7ljml20a09jzc7gr551sbvb2m-nixos-system-gitlab-test/init regInfo=/nix/store/fxkghi72lpp8y19r00rr5lbm20v7wvqk-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000000] kvm-clock: using sched offset of 472944808 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000005] tsc: Detected 2400.008 MHz processor67gitlab # [ 0.000810] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000836] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000839] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000876] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002741] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002753] Using GB pages for direct mapping73gitlab # [ 0.002823] RAMDISK: [mem 0xbe31c000-0xbffcffff]74gitlab # [ 0.002831] ACPI: Early table checksum verification disabled75gitlab # [ 0.002834] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.002837] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.002840] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002847] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002849] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.002850] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.002852] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002854] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002855] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.002856] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.002857] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.002857] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.002857] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.002858] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003091] No NUMA configuration found90gitlab # [ 0.003092] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003094] NODE_DATA(0) allocated [mem 0x1bfffa780-0x1bffffcff]92gitlab # [ 0.005439] Zone ranges:93gitlab # [ 0.005440] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.005441] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.005442] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.005444] Device empty97gitlab # [ 0.005444] Movable zone start for each node98gitlab # [ 0.005445] Early memory node ranges99gitlab # [ 0.005445] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.005446] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.005447] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.005448] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.005469] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.005741] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.116115] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.116532] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.116546] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.116576] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.116579] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.116581] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.116582] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.116583] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.116584] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.116586] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.116588] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.116592] TSC deadline timer available117gitlab # [ 0.116597] CPU topo: Max. logical packages: 1118gitlab # [ 0.116598] CPU topo: Max. logical dies: 1119gitlab # [ 0.116598] CPU topo: Max. dies per package: 1120gitlab # [ 0.116601] CPU topo: Max. threads per core: 1121gitlab # [ 0.116602] CPU topo: Num. cores per package: 4122gitlab # [ 0.116602] CPU topo: Num. threads per package: 4123gitlab # [ 0.116603] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.116626] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.116643] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.116646] kvm-guest: setup PV sched yield127gitlab # [ 0.116662] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.116663] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.116664] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.116666] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.116667] Booting paravirtualized kernel on KVM132gitlab # [ 0.116671] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.121138] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.123372] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.123421] kvm-guest: PV spinlocks enabled136gitlab # [ 0.123423] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.123425] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/46qp8zy7ljml20a09jzc7gr551sbvb2m-nixos-system-gitlab-test/init regInfo=/nix/store/fxkghi72lpp8y19r00rr5lbm20v7wvqk-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.123520] Unknown kernel command line parameters "regInfo=/nix/store/fxkghi72lpp8y19r00rr5lbm20v7wvqk-closure-info/registration", will be passed to user space.139gitlab # [ 0.123533] random: crng init done140gitlab # [ 0.123533] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.132538] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.137182] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.137258] software IO TLB: area num 4.144gitlab # [ 0.212919] Fallback order for Node 0: 0145gitlab # [ 0.212927] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.212929] Policy zone: Normal147gitlab # [ 0.215495] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.225031] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.239219] allocated 12582912 bytes of page_ext150gitlab # [ 0.249334] ftrace: allocating 48717 entries in 192 pages151gitlab # [ 0.249337] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.250193] Dynamic Preempt: lazy153gitlab # [ 0.250376] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.250377] rcu: RCU event tracing is enabled.155gitlab # [ 0.250378] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.250379] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.250380] Rude variant of Tasks RCU enabled.158gitlab # [ 0.250380] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.250381] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.250382] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.250411] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.250412] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.250414] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.254822] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.255142] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.255150] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns167gitlab # [ 0.255253] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.258799] Console: colour VGA+ 80x25169gitlab # [ 0.258802] printk: legacy console [tty0] enabled170gitlab # [ 0.289642] printk: legacy console [ttyS0] enabled171gitlab # [ 0.384525] ACPI: Core revision 20250807172gitlab # [ 0.385347] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.386761] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.387683] x2apic enabled175gitlab # [ 0.388407] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.389316] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.390483] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.391907] kvm-guest: setup PV IPIs179gitlab # [ 0.393441] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.394488] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns181gitlab # [ 0.396214] Calibrating delay loop (skipped) preset value.. 4800.01 BogoMIPS (lpj=2400008)182gitlab # [ 0.397297] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.399336] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.401211] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.402215] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.404212] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.405212] Transient Scheduler Attacks: Vulnerable: No microcode188gitlab # [ 0.406212] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.407170] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.408211] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.409218] Spectre V2 : Enabling IBPB for BPF192gitlab # [ 0.410220] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier193gitlab # [ 0.411212] active return thunk: srso_alias_return_thunk194gitlab # [ 0.412919] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'195gitlab # [ 0.414191] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'196gitlab # [ 0.415211] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'197gitlab # [ 0.416210] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'198gitlab # [ 0.417211] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'199gitlab # [ 0.418211] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'200gitlab # [ 0.419211] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'201gitlab # [ 0.420212] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256202gitlab # [ 0.421211] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64203gitlab # [ 0.422211] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512204gitlab # [ 0.424003] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024205gitlab # [ 0.425000] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8206gitlab # [ 0.425976] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.207gitlab # [ 0.456030] Freeing SMP alternatives memory: 44K208gitlab # [ 0.456801] pid_max: default: 32768 minimum: 301209gitlab # [ 0.457313] LSM: initializing lsm=capability,landlock,yama,bpf,ima210gitlab # [ 0.458321] landlock: Up and running.211gitlab # [ 0.459212] Yama: becoming mindful.212gitlab # [ 0.460414] LSM support for eBPF active213gitlab # [ 0.461371] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)214gitlab # [ 0.462364] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)215gitlab # [ 0.465360] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)216gitlab # [ 0.466827] Performance Events: Fam17h+ core perfctr, AMD PMU driver.217gitlab # [ 0.467220] ... version: 2218gitlab # [ 0.467977] ... bit width: 48219gitlab # [ 0.468214] ... generic counters: 6220gitlab # [ 0.468965] ... generic bitmap: 000000000000003f221gitlab # [ 0.469213] ... fixed-purpose counters: 0222gitlab # [ 0.469983] ... fixed-purpose bitmap: 0000000000000000223gitlab # [ 0.470213] ... value mask: 0000ffffffffffff224gitlab # [ 0.471155] ... max period: 00007fffffffffff225gitlab # [ 0.471917] ... global_ctrl mask: 000000000000003f226gitlab # [ 0.472318] signal: max sigframe size: 3376227gitlab # [ 0.473101] rcu: Hierarchical SRCU implementation.228gitlab # [ 0.473822] rcu: Max phase no-delay instances is 400.229gitlab # [ 0.474402] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level230gitlab # [ 0.479746] smp: Bringing up secondary CPUs ...231gitlab # [ 0.480618] smpboot: x86: Booting SMP configuration:232gitlab # [ 0.481217] .... node #0, CPUs: #1 #2 #3233gitlab # [ 0.485280] smp: Brought up 1 node, 4 CPUs234gitlab # [ 0.486929] smpboot: Total of 4 processors activated (19200.06 BogoMIPS)235gitlab # [ 0.487565] Memory: 6011348K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260100K reserved, 0K cma-reserved)236gitlab # [ 0.489214] devtmpfs: initialized237gitlab # [ 0.490074] x86/mm: Memory block size: 128MB238gitlab # [ 0.493287] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)239gitlab # [ 0.494294] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).240gitlab # [ 0.495331] pinctrl core: initialized pinctrl subsystem241gitlab # [ 0.496556] PM: RTC time: 05:53:10, date: 2026-08-20242gitlab # [ 0.500348] NET: Registered PF_NETLINK/PF_ROUTE protocol family243gitlab # [ 0.502575] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations244gitlab # [ 0.503268] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations245gitlab # [ 0.505352] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations246gitlab # [ 0.506226] audit: initializing netlink subsys (disabled)247gitlab # [ 0.507276] audit: type=2000 audit(1787205191.011:1): state=initialized audit_enabled=0 res=1248gitlab # [ 0.507528] thermal_sys: Registered thermal governor 'fair_share'249gitlab # [ 0.509214] thermal_sys: Registered thermal governor 'bang_bang'250gitlab # [ 0.510214] thermal_sys: Registered thermal governor 'step_wise'251gitlab # [ 0.511214] thermal_sys: Registered thermal governor 'user_space'252gitlab # [ 0.512213] thermal_sys: Registered thermal governor 'power_allocator'253gitlab # [ 0.513227] cpuidle: using governor menu254gitlab # [ 0.515427] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5255gitlab # [ 0.516451] PCI: Using configuration type 1 for base access256gitlab # [ 0.517215] PCI: Using configuration type 1 for extended access257gitlab # [ 0.518335] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.258gitlab # [ 0.521245] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages259gitlab # [ 0.522215] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page260gitlab # [ 0.523214] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages261gitlab # [ 0.524216] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page262gitlab # [ 0.529938] ACPI: Added _OSI(Module Device)263gitlab # [ 0.532223] ACPI: Added _OSI(Processor Device)264gitlab # [ 0.535223] ACPI: Added _OSI(Processor Aggregator Device)265gitlab # [ 0.543935] ACPI: 1 ACPI AML tables successfully acquired and loaded266gitlab # [ 0.551249] ACPI: Interpreter enabled267gitlab # [ 0.551978] ACPI: PM: (supports S0 S3 S4 S5)268gitlab # [ 0.552217] ACPI: Using IOAPIC for interrupt routing269gitlab # [ 0.553117] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug270gitlab # [ 0.554220] PCI: Using E820 reservations for host bridge windows271gitlab # [ 0.556900] ACPI: Enabled 2 GPEs in block 00 to 0F272gitlab # [ 0.570143] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])273gitlab # [ 0.573271] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]274gitlab # [ 0.577409] acpiphp: Slot [3] registered275gitlab # [ 0.579294] acpiphp: Slot [4] registered276gitlab # [ 0.581296] acpiphp: Slot [5] registered277gitlab # [ 0.584287] acpiphp: Slot [6] registered278gitlab # [ 0.586293] acpiphp: Slot [7] registered279gitlab # [ 0.587275] acpiphp: Slot [8] registered280gitlab # [ 0.589270] acpiphp: Slot [9] registered281gitlab # [ 0.591320] acpiphp: Slot [10] registered282gitlab # [ 0.592270] acpiphp: Slot [11] registered283gitlab # [ 0.594272] acpiphp: Slot [12] registered284gitlab # [ 0.596273] acpiphp: Slot [13] registered285gitlab # [ 0.598294] acpiphp: Slot [14] registered286gitlab # [ 0.599272] acpiphp: Slot [15] registered287gitlab # [ 0.601268] acpiphp: Slot [16] registered288gitlab # [ 0.603269] acpiphp: Slot [17] registered289gitlab # [ 0.604253] acpiphp: Slot [18] registered290gitlab # [ 0.605114] acpiphp: Slot [19] registered291gitlab # [ 0.606841] acpiphp: Slot [20] registered292gitlab # [ 0.607239] acpiphp: Slot [21] registered293gitlab # [ 0.608072] acpiphp: Slot [22] registered294gitlab # [ 0.608809] acpiphp: Slot [23] registered295gitlab # [ 0.609246] acpiphp: Slot [24] registered296gitlab # [ 0.609969] acpiphp: Slot [25] registered297gitlab # [ 0.611237] acpiphp: Slot [26] registered298gitlab # [ 0.612089] acpiphp: Slot [27] registered299gitlab # [ 0.612813] acpiphp: Slot [28] registered300gitlab # [ 0.613254] acpiphp: Slot [29] registered301gitlab # [ 0.614104] acpiphp: Slot [30] registered302gitlab # [ 0.614837] acpiphp: Slot [31] registered303gitlab # [ 0.616257] PCI host bridge to bus 0000:00304gitlab # [ 0.617071] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]305gitlab # [ 0.618197] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]306gitlab # [ 0.619280] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]307gitlab # [ 0.622222] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]308gitlab # [ 0.625223] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]309gitlab # [ 0.628248] pci_bus 0000:00: root bus resource [bus 00-ff]310gitlab # [ 0.631193] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint311gitlab # [ 0.636688] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint312gitlab # [ 0.640275] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint313gitlab # [ 0.647289] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]314gitlab # [ 0.649296] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk315gitlab # [ 0.651219] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk316gitlab # [ 0.654219] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk317gitlab # [ 0.656220] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk318gitlab # [ 0.659680] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint319gitlab # [ 0.665396] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]320gitlab # [ 0.670670] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint321gitlab # [ 0.672735] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI322gitlab # [ 0.675229] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB323gitlab # [ 0.677703] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint324gitlab # [ 0.694224] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]325gitlab # [ 0.696282] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]326gitlab # [ 0.697238] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]327gitlab # [ 0.698566] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]328gitlab # [ 0.701233] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint329gitlab # [ 0.710241] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]330gitlab # [ 0.712235] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]331gitlab # [ 0.715275] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]332gitlab # [ 0.744235] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]333gitlab # [ 0.749391] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint334gitlab # [ 0.757246] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]335gitlab # [ 0.758226] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]336gitlab # [ 0.759209] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]337gitlab # [ 0.762929] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint338gitlab # [ 0.768244] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]339gitlab # [ 0.769150] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]340gitlab # [ 0.769923] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]341gitlab # [ 0.772932] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint342gitlab # [ 0.781245] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]343gitlab # [ 0.783241] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]344gitlab # [ 0.787292] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]345gitlab # [ 0.794629] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint346gitlab # [ 0.803249] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]347gitlab # [ 0.804077] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]348gitlab # [ 0.804906] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]349gitlab # [ 0.807354] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint350gitlab # [ 0.812241] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]351gitlab # [ 0.813072] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]352gitlab # [ 0.813930] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]353gitlab # [ 0.816330] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint354gitlab # [ 0.820245] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]355gitlab # [ 0.821089] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]356gitlab # [ 0.822915] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]357gitlab # [ 0.824080] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]358gitlab # [ 0.826175] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint359gitlab # [ 0.828226] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]360gitlab # [ 0.829164] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]361gitlab # [ 0.832388] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint362gitlab # [ 0.840265] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]363gitlab # [ 0.842246] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]364gitlab # [ 0.845274] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]365gitlab # [ 0.851260] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint366gitlab # [ 0.859258] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]367gitlab # [ 0.861236] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]368gitlab # [ 0.863272] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]369gitlab # [ 0.875434] ACPI: PCI: Interrupt link LNKA configured for IRQ 10370gitlab # [ 0.878637] ACPI: PCI: Interrupt link LNKB configured for IRQ 10371gitlab # [ 0.880491] ACPI: PCI: Interrupt link LNKC configured for IRQ 11372gitlab # [ 0.882480] ACPI: PCI: Interrupt link LNKD configured for IRQ 11373gitlab # [ 0.884425] ACPI: PCI: Interrupt link LNKS configured for IRQ 9374gitlab # [ 0.889502] iommu: Default domain type: Translated375gitlab # [ 0.891218] iommu: DMA domain TLB invalidation policy: lazy mode376gitlab # [ 0.893646] ACPI: bus type USB registered377gitlab # [ 0.895381] usbcore: registered new interface driver usbfs378gitlab # [ 0.897269] usbcore: registered new interface driver hub379gitlab # [ 0.898261] usbcore: registered new device driver usb380gitlab # [ 0.900609] NetLabel: Initializing381gitlab # [ 0.901203] NetLabel: domain hash size = 128382gitlab # [ 0.901740] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383gitlab # [ 0.902288] NetLabel: unlabeled traffic allowed by default384gitlab # [ 0.903169] PCI: Using ACPI for IRQ routing385gitlab # [ 0.904429] pci 0000:00:02.0: vgaarb: setting as boot VGA device386gitlab # [ 0.905179] pci 0000:00:02.0: vgaarb: bridge control possible387gitlab # [ 0.905210] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388gitlab # [ 0.908218] vgaarb: loaded389gitlab # [ 0.908911] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390gitlab # [ 0.909214] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391gitlab # [ 0.914342] clocksource: Switched to clocksource kvm-clock392gitlab # [ 0.915832] VFS: Disk quotas dquot_6.6.0393gitlab # [ 0.916535] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394gitlab # [ 0.917928] pnp: PnP ACPI init395gitlab # [ 0.919106] pnp: PnP ACPI: found 6 devices396gitlab # [ 0.927537] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns397gitlab # [ 0.928975] clocksource: Switched to clocksource acpi_pm398gitlab # [ 0.929920] NET: Registered PF_INET protocol family399gitlab # [ 0.932022] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)400gitlab # [ 0.950249] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)401gitlab # [ 0.951645] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)402gitlab # [ 0.952956] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)403gitlab # [ 0.956632] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)404gitlab # [ 0.957927] TCP: Hash tables configured (established 65536 bind 65536)405gitlab # [ 0.959010] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)406gitlab # [ 0.960272] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 0.961347] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)408gitlab # [ 0.962640] NET: Registered PF_UNIX/PF_LOCAL protocol family409gitlab # [ 0.963573] NET: Registered PF_XDP protocol family410gitlab # [ 0.964388] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]411gitlab # [ 0.965354] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]412gitlab # [ 0.966320] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]413gitlab # [ 0.967367] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]414gitlab # [ 0.968418] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]415gitlab # [ 0.969669] pci 0000:00:01.0: PIIX3: Enabling Passive Release416gitlab # [ 0.970597] pci 0000:00:00.0: Limiting direct PCI/PCI transfers417gitlab # [ 0.972951] ACPI: \_SB_.LNKD: Enabled at IRQ 11418gitlab # [ 0.975436] PCI: CLS 0 bytes, default 64419gitlab # [ 0.976170] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)420gitlab # [ 0.976691] Trying to unpack rootfs image as initramfs...421gitlab # [ 0.977174] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)422gitlab # [ 0.977293] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns423gitlab # [ 1.000699] Initialise system trusted keyrings424gitlab # [ 1.001853] workingset: timestamp_bits=40 max_order=21 bucket_order=0425gitlab # [ 1.013200] Key type asymmetric registered426gitlab # [ 1.013866] Asymmetric key parser 'x509' registered427gitlab # [ 1.014686] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)428gitlab # [ 1.016170] io scheduler mq-deadline registered429gitlab # [ 1.016888] io scheduler kyber registered430gitlab # [ 1.020856] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled431gitlab # [ 1.022182] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A432gitlab # [ 1.024530] Linux agpgart interface v0.103433gitlab # [ 1.025299] ACPI: bus type drm_connector registered434gitlab # [ 1.027843] usbcore: registered new interface driver usbserial_generic435gitlab # [ 1.028874] usbserial: USB Serial support registered for generic436gitlab # [ 1.029817] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.437gitlab # [ 1.029817] Please enable it if your BIOS has the CPPC option.438gitlab # [ 1.031919] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled439gitlab # [ 1.033232] drop_monitor: Initializing network drop monitor service440gitlab # [ 1.034371] NET: Registered PF_INET6 protocol family441gitlab # [ 1.036266] Segment Routing with IPv6442gitlab # [ 1.036882] In-situ OAM (IOAM) with IPv6443gitlab # [ 1.039623] IPI shorthand broadcast: enabled444gitlab # [ 1.044019] sched_clock: Marking stable (910012295, 133060720)->(1064743140, -21670125)445gitlab # [ 1.045705] registered taskstats version 1446gitlab # [ 1.046713] Loading compiled-in X.509 certificates447gitlab # [ 1.056314] Demotion targets for Node 0: null448gitlab # [ 1.057304] Key type .fscrypt registered449gitlab # [ 1.057946] Key type fscrypt-provisioning registered450gitlab # [ 1.058872] ima: No TPM chip found, activating TPM-bypass!451gitlab # [ 1.059801] ima: Allocated hash algorithm: sha1452gitlab # [ 1.060578] ima: No architecture policies found453gitlab # [ 1.061627] PM: Magic number: 6:383:871454gitlab # [ 1.062318] PM: hash matches drivers/base/power/main.c:1117455gitlab # [ 1.064125] RAS: Correctable Errors collector initialized.456gitlab # [ 1.068522] clk: Disabling unused clocks457gitlab # [ 1.069208] PM: genpd: Disabling unused power domains458gitlab # [ 1.270387] Freeing initrd memory: 29392K459gitlab # [ 1.277587] Freeing unused decrypted memory: 2028K460gitlab # [ 1.283774] Freeing unused kernel image (initmem) memory: 3640K461gitlab # [ 1.286479] Write protecting the kernel read-only data: 32768k462gitlab # [ 1.291337] Freeing unused kernel image (text/rodata gap) memory: 1220K463gitlab # [ 1.295223] Freeing unused kernel image (rodata/data gap) memory: 760K464gitlab # [ 1.363447] x86/mm: Checked W+X mappings: passed, no W+X pages found.465gitlab # [ 1.364699] Run /init as init process466gitlab # [ 1.376656] systemd[1]: Inserted module 'autofs4'467gitlab # [ 1.398576] fuse: init (API version 7.45)468gitlab # [ 1.419584] ACPI: \_SB_.LNKC: Enabled at IRQ 10469gitlab # [ 1.435592] ACPI: \_SB_.LNKA: Enabled at IRQ 10470gitlab # [ 1.443376] ACPI: \_SB_.LNKB: Enabled at IRQ 11471gitlab # [ 1.498415] systemd[1]: Successfully made /usr/ read-only.472gitlab # [ 1.834291] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)473gitlab # [ 1.870318] systemd[1]: Detected virtualization kvm.474gitlab # [ 1.872391] systemd[1]: Detected architecture x86-64.475gitlab # [ 1.874501] systemd[1]: Running in initrd.476gitlab # [ 1.876880] systemd[1]: Initializing machine ID from random generator.477gitlab # [ 1.879767] systemd[1]: Hostname set to <gitlab>.478gitlab # [ 2.004718] systemd[1]: bpf-restrict-fs: LSM BPF program attached479gitlab # [ 2.066852] systemd[1]: Queued start job for default target Initrd Default Target.480gitlab # [ 2.077952] systemd[1]: Created slice Slice /system/modprobe.481gitlab # [ 2.079097] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.482gitlab # [ 2.080470] systemd[1]: Expecting device /dev/disk/by-label/nix-store...483gitlab # [ 2.081909] systemd[1]: Expecting device /dev/disk/by-label/nixos...484gitlab # [ 2.083737] systemd[1]: Reached target Path Units.485gitlab # [ 2.084654] systemd[1]: Reached target Slice Units.486gitlab # [ 2.085546] systemd[1]: Reached target Swaps.487gitlab # [ 2.086371] systemd[1]: Reached target Timer Units.488gitlab # [ 2.087364] systemd[1]: Listening on D-Bus System Message Bus Socket.489gitlab # [ 2.088659] systemd[1]: Listening on Journal Socket (/dev/log).490gitlab # [ 2.089825] systemd[1]: Listening on Journal Sockets.491gitlab # [ 2.090852] systemd[1]: Listening on udev Control Socket.492gitlab # [ 2.091874] systemd[1]: Listening on udev Kernel Socket.493gitlab # [ 2.092839] systemd[1]: Reached target Socket Units.494gitlab # [ 2.094838] systemd[1]: Starting Create List of Static Device Nodes...495gitlab # [ 2.097002] systemd[1]: Starting Load Kernel Module 9pnet_virtio...496gitlab # [ 2.099263] systemd[1]: Starting Load Kernel Module configfs...497gitlab # [ 2.103246] systemd[1]: Starting Journal Service...498gitlab # [ 2.107287] systemd[1]: Starting Load Kernel Modules...499gitlab # [ 2.108278] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os500gitlab # [ 2.112141] systemd[1]: Starting Coldplug All udev Devices...501gitlab # [ 2.120789] systemd[1]: Finished Create List of Static Device Nodes.502gitlab # [ 2.124779] systemd[1]: modprobe@configfs.service: Deactivated successfully.503gitlab # [ 2.129452] systemd[1]: Finished Load Kernel Module configfs.504gitlab # [ 2.130772] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config505gitlab # [ 2.138746] systemd-journald[91]: Collecting audit messages is disabled.506gitlab # [ 2.142148] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...507gitlab # [ 2.157696] netfs: FS-Cache loaded508gitlab # [ 2.162408] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.509gitlab # [ 2.168711] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev510gitlab # [ 2.168844] 9pnet: Installing 9P2000 support511gitlab # [ 2.171199] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.512gitlab # [ 2.173166] systemd[1]: Finished Load Kernel Modules.513gitlab # [ 2.177187] systemd[1]: Starting Apply Kernel Variables...514gitlab # [ 2.179561] systemd[1]: Starting Create Static Device Nodes in /dev...515gitlab # [ 2.181170] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.516gitlab # [ 2.052325] systemd-modules-load[92]: Using 4 probe threads517gitlab # [ 2.186366] systemd[1]: Finished Load Kernel Module 9pnet_virtio.518gitlab # [ 2.053621] systemd-modules-load[92]: Inserted module 'virtio_balloon'519gitlab # [ 2.187568] systemd[1]: Started Journal Service.520gitlab # [ 2.055418] systemd-modules-load[92]: Inserted module 'virtio_gpu'521gitlab # [ 2.056888] systemd-modules-load[92]: Inserted module 'dm_mod'522gitlab # [ 2.057901] systemd[1]: Finished Apply Kernel Variables.523gitlab # [ 2.064631] systemd[1]: Finished Create Static Device Nodes in /dev.524gitlab # [ 2.065651] systemd[1]: Reached target Preparation for Local File Systems.525gitlab # [ 2.066632] systemd[1]: Reached target Local File Systems.526gitlab # [ 2.067417] systemd[1]: Starting Create System Files and Directories...527gitlab # [ 2.068289] systemd[1]: Starting Rule-based Manager for Device Events and Files...528gitlab # [ 2.077188] systemd[1]: Finished Create System Files and Directories.529gitlab # [ 2.089174] systemd-udevd[112]: Using default interface naming scheme 'v261'.530gitlab # [ 2.100722] systemd[1]: Started Rule-based Manager for Device Events and Files.531gitlab # [ 2.118872] systemd[1]: Finished Coldplug All udev Devices.532gitlab # [ 2.120559] systemd[1]: Reached target System Initialization.533gitlab # [ 2.122147] systemd[1]: Reached target Basic System.534gitlab # [ 2.346500] virtio_blk virtio4: 4/0/0 default/read/poll queues535gitlab # [ 2.357372] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)536gitlab # [ 2.366610] uhci_hcd 0000:00:01.2: UHCI Host Controller537gitlab # [ 2.370161] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1538gitlab # [ 2.373176] uhci_hcd 0000:00:01.2: detected 2 ports539gitlab # [ 2.377534] SCSI subsystem initialized540gitlab # [ 2.378869] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140541gitlab # [ 2.378886] virtio_blk virtio5: 4/0/0 default/read/poll queues542gitlab # [ 2.380082] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18543gitlab # [ 2.382345] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1544gitlab # [ 2.383348] usb usb1: Product: UHCI Host Controller545gitlab # [ 2.384006] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd546gitlab # [ 2.384876] usb usb1: SerialNumber: 0000:00:01.2547gitlab # [ 2.388827] virtio_blk virtio5: [vdb] 11789112 512-byte logical blocks (6.04 GB/5.62 GiB)548gitlab # [ 2.391244] hub 1-0:1.0: USB hub found549gitlab # [ 2.392006] hub 1-0:1.0: 2 ports detected550gitlab # [ 2.394836] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12551gitlab # [ 2.399164] serio: i8042 KBD port at 0x60,0x64 irq 1552gitlab # [ 2.399990] serio: i8042 AUX port at 0x60,0x64 irq 12553gitlab # [ 2.439181] scsi host0: ata_piix554gitlab # [ 2.440105] scsi host1: ata_piix555gitlab # [ 2.440710] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0556gitlab # [ 2.441739] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0557gitlab # [ 2.309187] systemd[1]: Starting Virtual Console Setup...558gitlab # [ 2.314757] (udev-worker)[137]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.559gitlab # [ 2.316901] (udev-worker)[137]: Network interface NamePolicy= disabled on kernel command line.560gitlab # [ 2.319086] (udev-worker)[132]: Network interface NamePolicy= disabled on kernel command line.561gitlab # [ 2.327077] systemd[1]: Found device /dev/disk/by-label/nixos.562gitlab # [ 2.327934] systemd[1]: Reached target Initrd Root Device.563gitlab # [ 2.329660] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...564gitlab # [ 2.331937] systemd-vconsole-setup[148]: Configuration of first virtual console was skipped, ignoring remaining ones.565gitlab # [ 2.340609] systemd[1]: Finished Virtual Console Setup.566gitlab # [ 2.343904] systemd[1]: Found device /dev/disk/by-label/nix-store.567gitlab # [ 2.355886] systemd-fsck[156]: nixos: clean, 12/65536 files, 13019/262144 blocks568gitlab # [ 2.359142] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.569gitlab # [ 2.612410] ata2: found unknown device (class 0)570gitlab # [ 2.613185] usb 1-1: new full-speed USB device number 2 using uhci_hcd571gitlab # [ 2.616248] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100572gitlab # [ 2.620769] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5573gitlab # [ 2.650691] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0574gitlab # [ 2.680287] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray575gitlab # [ 2.707799] cdrom: Uniform CD-ROM driver Revision: 3.20576gitlab # [ 2.783971] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00577gitlab # [ 2.786833] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10578gitlab # [ 2.789447] usb 1-1: Product: QEMU USB Tablet579gitlab # [ 2.791038] usb 1-1: Manufacturer: QEMU580gitlab # [ 2.792557] usb 1-1: SerialNumber: 28754-0000:00:01.2-1581gitlab # [ 2.826147] hid: raw HID events driver (C) Jiri Kosina582gitlab # [ 2.840394] usbcore: registered new interface driver usbhid583gitlab # [ 2.842347] usbhid: USB HID core driver584gitlab # [ 2.852010] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2585gitlab # [ 2.855863] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0586gitlab # [ 2.983913] systemd[1]: Mounting /sysroot...587gitlab # [ 3.271443] EXT4-fs (vda): mounted filesystem 8b3a4f43-0289-41e0-802f-c20665863066 r/w with ordered data mode. Quota mode: none.588gitlab # [ 3.144570] systemd[1]: Mounted /sysroot.589gitlab # [ 3.146271] systemd[1]: Reached target Initrd Root File System.590gitlab # [ 3.148237] systemd[1]: Mounting /sysroot/nix/.ro-store...591gitlab # [ 3.152433] systemd[1]: Mounting /sysroot/nix/.rw-store...592gitlab # [ 3.154418] systemd[1]: Mounting /sysroot/run...593gitlab # [ 3.156130] systemd[1]: Mounting /sysroot/tmp/shared...594gitlab # [ 3.158113] systemd[1]: Mounting /sysroot/tmp/xchg...595gitlab # [ 3.160604] systemd[1]: Starting Mountpoints Configured in the Real Root...596gitlab # [ 3.168578] systemd[1]: Mounted /sysroot/nix/.rw-store.597gitlab # [ 3.174284] systemd[1]: Starting rw-sysroot-nix-store.service...598gitlab # [ 3.312202] 9p: Installing v9fs 9p2000 file system support599gitlab # [ 3.179733] systemd[1]: Mounted /sysroot/run.600gitlab # [ 3.318467] erofs (device vdb): mounted with root inode @ nid 128.601gitlab # [ 3.188421] systemd[1]: Mounted /sysroot/nix/.ro-store.602gitlab # [ 3.190345] systemd-sysroot-fstab-check[176]: /sysroot should be mounted in the initrd, will request daemon-reload.603gitlab # [ 3.193864] systemd[1]: Mounted /sysroot/tmp/shared.604gitlab # [ 3.194567] systemd[1]: Mounted /sysroot/tmp/xchg.605gitlab # [ 3.195183] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.606gitlab # [ 3.196115] systemd[1]: Finished rw-sysroot-nix-store.service.607gitlab # [ 3.199061] systemd[1]: Reload requested from client PID 176 ('systemd-sysroot') (unit initrd-parse-etc.service)...608gitlab # [ 3.200438] systemd[1]: Reloading...609gitlab # [ 3.258352] systemd[1]: Reloading finished in 58 ms.610gitlab # [ 3.284657] systemd-sysroot-fstab-check[176]: Requesting initrd-fs.target/start/replace...611gitlab # [ 3.287332] systemd-sysroot-fstab-check[176]: Requesting swap.target/start/replace...612gitlab # [ 3.289782] systemd[1]: Starting rw-sysroot-nix-store.service...613gitlab # [ 3.291648] systemd[1]: initrd-parse-etc.service: Deactivated successfully.614gitlab # [ 3.293817] systemd[1]: Finished Mountpoints Configured in the Real Root.615gitlab # [ 3.295802] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.616gitlab # [ 3.321817] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.617gitlab # [ 3.324069] systemd[1]: Finished rw-sysroot-nix-store.service.618gitlab # [ 3.984991] systemd[1]: Mounting /sysroot/nix/store...619gitlab # [ 4.033488] systemd[1]: Mounted /sysroot/nix/store.620gitlab # [ 4.035178] systemd[1]: Reached target Initrd File Systems.621gitlab # [ 4.037100] systemd[1]: Starting Find NixOS closure...622gitlab # [ 4.039208] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...623gitlab # [ 4.065057] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.624gitlab # [ 4.068906] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.625gitlab # [ 4.087839] systemd[1]: Finished Find NixOS closure.626gitlab # [ 4.089697] systemd[1]: Reached target Initrd Default Target.627gitlab # [ 4.091658] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...628gitlab # [ 4.126898] systemd[1]: Stopped target Initrd Default Target.629gitlab # [ 4.128968] systemd[1]: Stopped target Basic System.630gitlab # [ 4.130787] systemd[1]: Stopped target Initrd Root Device.631gitlab # [ 4.132671] systemd[1]: Stopped target Path Units.632gitlab # [ 4.134446] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.633gitlab # [ 4.136927] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.634gitlab # [ 4.139537] systemd[1]: Stopped target Slice Units.635gitlab # [ 4.141341] systemd[1]: Stopped target Socket Units.636gitlab # [ 4.143146] systemd[1]: Stopped target System Initialization.637gitlab # [ 4.145471] systemd[1]: Stopped target Swaps.638gitlab # [ 4.147267] systemd[1]: Stopped target Timer Units.639gitlab # [ 4.149335] systemd[1]: dbus.socket: Deactivated successfully.640gitlab # [ 4.152062] systemd[1]: Closed D-Bus System Message Bus Socket.641gitlab # [ 4.154154] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.642gitlab # [ 4.156971] systemd[1]: Stopped Find NixOS closure.643gitlab # [ 4.159214] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio644gitlab # [ 4.163061] systemd[1]: Starting rw-sysroot-nix-store.service...645gitlab # [ 4.165319] systemd[1]: systemd-sysctl.service: Deactivated successfully.646gitlab # [ 4.167658] systemd[1]: Stopped Apply Kernel Variables.647gitlab # [ 4.169126] systemd[1]: systemd-modules-load.service: Deactivated successfully.648gitlab # [ 4.170931] systemd[1]: Stopped Load Kernel Modules.649gitlab # [ 4.172377] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.650gitlab # [ 4.174448] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.651gitlab # [ 4.176403] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.652gitlab # [ 4.178279] systemd[1]: Stopped Create System Files and Directories.653gitlab # [ 4.179913] systemd[1]: Stopped target Local File Systems.654gitlab # [ 4.181414] systemd[1]: Stopped target Preparation for Local File Systems.655gitlab # [ 4.183167] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.656gitlab # [ 4.185084] systemd[1]: Stopped Coldplug All udev Devices.657gitlab # [ 4.186430] systemd[1]: Stopping Rule-based Manager for Device Events and Files...658gitlab # [ 4.187362] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.659gitlab # [ 4.188313] systemd[1]: Stopped Virtual Console Setup.660gitlab # [ 4.188990] systemd[1]: initrd-cleanup.service: Deactivated successfully.661gitlab # [ 4.189856] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.662gitlab # [ 4.190738] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.663gitlab # [ 4.191830] systemd[1]: Finished rw-sysroot-nix-store.service.664gitlab # [ 4.192736] systemd[1]: systemd-udevd.service: Deactivated successfully.665gitlab # [ 4.193532] systemd[1]: Stopped Rule-based Manager for Device Events and Files.666gitlab # [ 4.194402] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.667gitlab # [ 4.195346] systemd[1]: Closed udev Control Socket.668gitlab # [ 4.195978] systemd[1]: Starting Cleanup udev Database...669gitlab # [ 4.196644] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.670gitlab # [ 4.197542] systemd[1]: Stopped Create Static Device Nodes in /dev.671gitlab # [ 4.198338] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.672gitlab # [ 4.199301] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.673gitlab # [ 4.200181] systemd[1]: kmod-static-nodes.service: Deactivated successfully.674gitlab # [ 4.201031] systemd[1]: Stopped Create List of Static Device Nodes.675gitlab # [ 4.214117] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.676gitlab # [ 4.215179] systemd[1]: Finished Cleanup udev Database.677gitlab # [ 4.216496] systemd[1]: Reached target Switch Root.678gitlab # [ 4.218381] systemd[1]: Starting NixOS Activation...679gitlab # [ 4.363222] initrd-nixos-activation-start[224]: booting system configuration /nix/store/46qp8zy7ljml20a09jzc7gr551sbvb2m-nixos-system-gitlab-test680gitlab # [ 4.408120] initrd-nixos-activation-start[224]: running activation script...681gitlab # [ 4.666084] initrd-nixos-activation-start[247]: setting up /etc...682gitlab # [ 4.783487] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.683gitlab # [ 4.786141] systemd[1]: Finished NixOS Activation.684gitlab # [ 4.787916] systemd[1]: Starting Switch Root...685gitlab # [ 4.810689] systemd[1]: Switching root.686gitlab # [ 5.011735] systemd-journald[91]: Received SIGTERM from PID 1 (systemd).687gitlab # [ 5.176870] NET: Registered PF_VSOCK protocol family688gitlab # [ 5.548420] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)689gitlab # [ 5.558153] systemd[1]: Detected virtualization kvm.690gitlab # [ 5.559952] systemd[1]: Detected architecture x86-64.691gitlab # [ 5.561852] systemd[1]: Detected first boot.692gitlab # [ 5.564385] systemd[1]: Initializing machine ID from random generator.693gitlab # [ 5.709730] systemd[1]: bpf-restrict-fs: LSM BPF program attached694gitlab # [ 5.802274] systemd[1]: Applying preset policy.695gitlab # [ 6.011293] systemd[1]: Populated /etc with preset unit settings.696gitlab # [ 6.132508] systemd[1]: initrd-switch-root.service: Deactivated successfully.697gitlab # [ 6.133794] systemd[1]: Stopped initrd-switch-root.service.698gitlab # [ 6.135695] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.699gitlab # [ 6.137815] systemd[1]: Created slice Slice /system/getty.700gitlab # [ 6.139141] systemd[1]: Created slice GitLab DevOps Platform Slice.701gitlab # [ 6.140528] systemd[1]: Created slice User and Session Slice.702gitlab # [ 6.141457] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.703gitlab # [ 6.142617] systemd[1]: Started Forward Password Requests to Wall Directory Watch.704gitlab # [ 6.143665] systemd[1]: Expecting device /dev/hvc0...705gitlab # [ 6.144384] systemd[1]: Expecting device /dev/ttyS0...706gitlab # [ 6.145174] systemd[1]: Reached target Local Encrypted Volumes.707gitlab # [ 6.145954] systemd[1]: Stopped target initrd-fs.target.708gitlab # [ 6.146693] systemd[1]: Stopped target initrd-root-fs.target.709gitlab # [ 6.147503] systemd[1]: Stopped target initrd-switch-root.target.710gitlab # [ 6.148347] systemd[1]: Reached target Virtual Machines and Containers.711gitlab # [ 6.149282] systemd[1]: Reached target Path Units.712gitlab # [ 6.149963] systemd[1]: Reached target Remote File Systems.713gitlab # [ 6.150738] systemd[1]: Reached target Slice Units.714gitlab # [ 6.151457] systemd[1]: Reached target Swaps.715gitlab # [ 6.152805] systemd[1]: Listening on Query the User Interactively for a Password.716gitlab # [ 6.154687] systemd[1]: Listening on Process Core Dump Socket.717gitlab # [ 6.156006] systemd[1]: Listening on Credential Encryption/Decryption.718gitlab # [ 6.157557] systemd[1]: Listening on Factory Reset Management.719gitlab # [ 6.158460] systemd[1]: Listening on Hostname Service Socket.720gitlab # [ 6.160657] systemd[1]: Starting Journal Log Access Socket...721gitlab # [ 6.162013] systemd[1]: Listening on Journal Audit Socket.722gitlab # [ 6.163606] systemd[1]: Listening on Console Output Muting Service Socket.723gitlab # [ 6.164689] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.724gitlab # [ 6.165803] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os725gitlab # [ 6.167040] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki726gitlab # [ 6.169597] systemd[1]: Listening on Disk Repartitioning Service Socket.727gitlab # [ 6.170673] systemd[1]: Listening on udev Control Socket.728gitlab # [ 6.171534] systemd[1]: Listening on udev Varlink Socket.729gitlab # [ 6.174850] systemd[1]: Mounting Huge Pages File System...730gitlab # [ 6.176841] systemd[1]: Mounting POSIX Message Queue File System...731gitlab # [ 6.178784] systemd[1]: Mounting Kernel Debug File System...732gitlab # [ 6.183324] systemd[1]: Mounting Kernel Trace File System...733gitlab # [ 6.195518] systemd[1]: Starting Create List of Static Device Nodes...734gitlab # [ 6.196516] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio735gitlab # [ 6.199356] systemd[1]: Starting Load Kernel Module configfs...736gitlab # [ 6.200258] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm737gitlab # [ 6.201648] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore738gitlab # [ 6.203201] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse739gitlab # [ 6.220548] systemd[1]: Mounting FUSE Control File System...740gitlab # [ 6.222919] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67741gitlab # [ 6.231895] systemd[1]: Starting Journal Service...742gitlab # [ 6.234097] systemd[1]: Starting Load Kernel Modules...743gitlab # [ 6.236990] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...744gitlab # [ 6.239842] systemd[1]: Starting Remount Root and Kernel File Systems...745gitlab # [ 6.241837] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os746gitlab # [ 6.249401] systemd[1]: Starting Coldplug All udev Devices...747gitlab # [ 6.252307] systemd[1]: Listening on Journal Log Access Socket.748gitlab # [ 6.253341] systemd[1]: Mounted Huge Pages File System.749gitlab # [ 6.254326] systemd[1]: Mounted POSIX Message Queue File System.750gitlab # [ 6.255344] systemd[1]: Mounted Kernel Debug File System.751gitlab # [ 6.256311] systemd[1]: Mounted Kernel Trace File System.752gitlab # [ 6.257680] systemd[1]: Finished Create List of Static Device Nodes.753gitlab # [ 6.259103] systemd[1]: modprobe@configfs.service: Deactivated successfully.754gitlab # [ 6.260571] systemd[1]: Finished Load Kernel Module configfs.755gitlab # [ 6.261780] systemd[1]: Mounted FUSE Control File System.756gitlab # [ 6.263403] EXT4-fs (vda): re-mounted 8b3a4f43-0289-41e0-802f-c20665863066.757gitlab # [ 6.265087] systemd-journald[318]: Collecting audit messages is enabled.758gitlab # [ 6.265548] systemd[1]: Mounting Kernel Configuration File System...759gitlab # [ 6.272308] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...760gitlab # [ 6.145967] systemd[1]: Queued start job for default target Multi-User System.761gitlab # [ 6.147218] systemd[1]: Unnecessary job was removed for /dev/vdb.762gitlab # [ 6.148840] systemd[1]: systemd-journald.service: Deactivated successfully.763gitlab # [ 6.150194] systemd-modules-load[319]: Using 3 probe threads764gitlab # [ 6.284211] loop: module loaded765gitlab # [ 6.284406] systemd[1]: Started Journal Service.766gitlab # [ 6.152899] systemd-modules-load[319]: Inserted module 'tls'767gitlab # [ 6.154546] systemd-modules-load[319]: Inserted module 'loop'768gitlab # [ 6.155902] systemd[1]: Finished Load Kernel Modules.769gitlab # [ 6.156905] systemd[1]: Finished Remount Root and Kernel File Systems.770gitlab # [ 6.158075] systemd[1]: Mounted Kernel Configuration File System.771gitlab # [ 6.159736] systemd[1]: Listening on Disk Image Download Service Socket.772gitlab # [ 6.160898] systemd-oomd[320]: No swap; memory pressure usage will be degraded773gitlab # [ 6.162388] systemd[1]: Starting Firewall...774gitlab # [ 6.163707] systemd[1]: Starting Flush Journal to Persistent Storage...775gitlab # [ 6.165343] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore776gitlab # [ 6.171120] systemd[1]: Starting Load/Save OS Random Seed...777gitlab # [ 6.174261] systemd[1]: Starting Apply Kernel Variables...778gitlab # [ 6.175018] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os779gitlab # [ 6.176254] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.780gitlab # [ 6.178165] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.781gitlab # [ 6.315733] systemd-journald[318]: Received client request to flush runtime journal.782gitlab # [ 6.219695] systemd[1]: Starting Create Static Device Nodes in /dev...783gitlab # [ 6.220945] systemd[1]: Finished Apply Kernel Variables.784gitlab # [ 6.221834] systemd[1]: Finished Load/Save OS Random Seed.785gitlab # [ 6.222660] systemd[1]: Reached target First Boot Complete.786gitlab # [ 6.223421] systemd[1]: Finished Create Static Device Nodes in /dev.787gitlab # [ 6.224267] systemd[1]: Reached target Preparation for Local File Systems.788gitlab # [ 6.225201] systemd[1]: Starting Rule-based Manager for Device Events and Files...789gitlab # [ 6.226179] systemd[1]: Finished Flush Journal to Persistent Storage.790gitlab # [ 6.236650] systemd-udevd[351]: Using default interface naming scheme 'v261'.791gitlab # [ 6.267083] systemd[1]: Started Rule-based Manager for Device Events and Files.792gitlab # [ 6.275724] systemd[1]: Finished Coldplug All udev Devices.793gitlab # [ 6.334162] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse794gitlab # [ 6.353306] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.795gitlab # [ 6.397153] (udev-worker)[426]: Network interface NamePolicy= disabled on kernel command line.796gitlab # [ 6.399403] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.797gitlab # [ 6.401956] (udev-worker)[410]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.798gitlab # [ 6.404161] (udev-worker)[410]: Network interface NamePolicy= disabled on kernel command line.799gitlab # [ 6.419304] systemd[1]: Condition check resulted in Virtio network device being skipped.800gitlab # [ 6.421181] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore801gitlab # [ 6.422594] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67802gitlab # [ 6.424568] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore803gitlab # [ 6.425975] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os804gitlab # [ 6.427178] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os805gitlab # [ 6.570906] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3806gitlab # [ 6.577996] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console807gitlab # [ 6.579712] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0808gitlab # [ 6.579775] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD809gitlab # [ 6.580901] ACPI: button: Power Button [PWRF]810gitlab # [ 6.587312] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input4811gitlab # [ 6.596678] Console: switching to colour dummy device 80x25812gitlab # [ 6.600037] [drm] Found bochs VGA, ID 0xb0c5.813gitlab # [ 6.600039] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.814gitlab # [ 6.601632] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic815gitlab # [ 6.602487] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0816gitlab # [ 6.602815] rtc_cmos 00:05: RTC can wake from S4817gitlab # [ 6.609923] rtc_cmos 00:05: registered as rtc0818gitlab # [ 6.610760] rtc_cmos 00:05: setting system clock to 2026-08-20T05:53:17 UTC (1787205197)819gitlab # [ 6.612747] parport_pc 00:03: reported by Plug and Play ACPI820gitlab # [ 6.613677] Floppy drive(s): fd0 is 2.88M AMI BIOS821gitlab # [ 6.613877] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs822gitlab # [ 6.614261] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]823gitlab # [ 6.625500] FDC 0 is a S82078B824gitlab # [ 6.633670] Console: switching to colour frame buffer device 160x50825gitlab # [ 6.636186] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device826gitlab # [ 6.648971] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6827gitlab # [ 6.652531] mousedev: PS/2 mouse device common for all mice828gitlab # [ 6.655184] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5829gitlab # [ 6.529993] systemd[1]: Finished Firewall.830gitlab # [ 6.580530] systemd[1]: Starting Virtual Console Setup...831gitlab # [ 6.590359] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.832gitlab # [ 6.592150] systemd[1]: Stopped Virtual Console Setup.833gitlab # [ 6.595150] systemd[1]: Starting Virtual Console Setup...834gitlab # [ 6.609336] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.835gitlab # [ 6.610417] systemd[1]: Stopped Virtual Console Setup.836gitlab # [ 6.617291] systemd[1]: Starting Virtual Console Setup...837gitlab # [ 6.769576] ppdev: user-space parallel port driver838gitlab # [ 6.794682] kvm_amd: TSC scaling supported839gitlab # [ 6.795260] kvm_amd: Nested Virtualization enabled840gitlab # [ 6.795774] kvm_amd: Nested Paging enabled841gitlab # [ 6.796512] kvm_amd: LBR virtualization supported842gitlab # [ 6.797038] kvm_amd: Virtual VMLOAD VMSAVE supported843gitlab # [ 6.797659] kvm_amd: Virtual GIF supported844gitlab # [ 6.798220] kvm_amd: Virtual NMI enabled845gitlab # [ 6.830979] EDAC MC: Ver: 3.0.0846gitlab # [ 6.698097] systemd-vconsole-setup[491]: Configuration of first virtual console was skipped, ignoring remaining ones.847gitlab # [ 6.700360] systemd[1]: Finished Virtual Console Setup.848gitlab # [ 7.004350] systemd[1]: Mounting /run/wrappers...849gitlab # [ 7.029070] systemd[1]: Mounted /run/wrappers.850gitlab # [ 7.030642] systemd[1]: Reached target Local File Systems.851gitlab # [ 7.032507] systemd[1]: Listening on Boot Loader Control Service Socket.852gitlab # [ 7.034666] systemd[1]: Starting register-nix-paths.service...853gitlab # [ 7.036938] systemd[1]: Starting Create SUID/SGID Wrappers...854gitlab # [ 7.038821] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.855gitlab # [ 7.041534] systemd[1]: Starting Save Transient machine-id to Disk...856gitlab # [ 7.048200] systemd[1]: Starting Create System Files and Directories...857gitlab # [ 7.093056] systemd[1]: Finished Create System Files and Directories.858gitlab # [ 7.097280] systemd[1]: Starting Rebuild Journal Catalog...859gitlab # [ 7.100300] systemd[1]: Starting Record System Boot/Shutdown in UTMP...860gitlab # [ 7.104190] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.861gitlab # [ 7.109102] systemd[1]: Finished Save Transient machine-id to Disk.862gitlab # [ 7.119610] systemd[1]: Finished Record System Boot/Shutdown in UTMP.863gitlab # [ 7.136378] systemd[1]: Finished Rebuild Journal Catalog.864gitlab # [ 7.137655] systemd[1]: Starting Update is Completed...865gitlab # [ 7.153120] systemd[1]: Finished Update is Completed.866gitlab # [ 7.188628] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.867gitlab # [ 7.189736] systemd[1]: Finished Create SUID/SGID Wrappers.868gitlab # [ 7.463679] systemd[1]: Finished register-nix-paths.service.869gitlab # [ 7.465892] systemd[1]: Reached target System Initialization.870gitlab # [ 7.467908] systemd[1]: Started Discard unused filesystem blocks once a week.871gitlab # [ 7.470301] systemd[1]: Started logrotate.timer.872gitlab # [ 7.472102] systemd[1]: Started Daily Cleanup of Temporary Directories.873gitlab # [ 7.474523] systemd[1]: Reached target Timer Units.874gitlab # [ 7.476537] systemd[1]: Listening on D-Bus System Message Bus Socket.875gitlab # [ 7.478804] systemd[1]: Listening on Nix Daemon Socket.876gitlab # [ 7.480752] systemd[1]: Starting nixbot CI service socket...877gitlab # [ 7.482805] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.878gitlab # [ 7.485682] systemd[1]: Listening on nixbot CI service socket.879gitlab # [ 7.487762] systemd[1]: Reached target Socket Units.880gitlab # [ 7.489617] systemd[1]: Starting D-Bus System Message Bus...881gitlab # [ 7.551380] dbus-broker-launch[575]: Looking up NSS user entry for 'systemd-timesync'...882gitlab # [ 7.554684] dbus-broker-launch[575]: NSS returned no entry for 'systemd-timesync'883gitlab # [ 7.557433] dbus-broker-launch[575]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"884gitlab # [ 7.562391] systemd[1]: Started D-Bus System Message Bus.885gitlab # [ 7.583765] dbus-broker-launch[575]: Ready886gitlab # [ 7.586401] systemd[1]: Reached target Basic System.887gitlab # [ 7.589222] systemd[1]: Started backdoor.service.888gitlab # [ 7.592162] systemd[1]: Starting gitlab-config.service...889gitlab # [ 7.596145] systemd[1]: Starting Import lastlog data into lastlog2 database...890gitlab # [ 7.607208] systemd[1]: Starting Logrotate configuration check...891gitlab # [ 7.612131] systemd[1]: Starting Name Service Cache Daemon (nsncd)...892gitlab # [ 7.618303] systemd[1]: Starting Post-Boot Actions...893gitlab # connecting to host...894gitlab # [ 7.632945] logrotate[580]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.895gitlab # [ 7.638392] logrotate[580]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf896gitlab # [ 7.640712] logrotate[580]: note: 'monthly' overrides previously specified 'weekly'897gitlab # [ 7.642785] systemd[1]: Started Reset console on configuration changes.898gitlab # [ 7.644658] systemd[1]: Starting resolvconf update...899gitlab: Guest shell says: b'Spawning backdoor root shell...\n'900gitlab # [ 7.646474] logrotate[580]: Reading state from file: /var/lib/logrotate.status901gitlab # [ 7.647829] logrotate[580]: state file /var/lib/logrotate.status does not exist902gitlab: connected to guest root shell903gitlab # [ 7.650298] logrotate[580]: Allocating hash table for state file, size 64 entries904gitlab: (connecting took 8.26 seconds)905gitlab # [ 7.650674] logrotate[580]: Handling 4 logs906gitlab: (finished: waiting for the VM to finish booting, in 8.26 seconds)907gitlab # [ 7.651121] logrotate[580]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed908gitlab # [ 7.651492] logrotate[580]: considering log /var/log/btmp909gitlab # [ 7.651889] logrotate[580]: Creating new state910gitlab # [ 7.652894] logrotate[580]: Now: 2026-08-20 05:53911gitlab # [ 7.655441] logrotate[580]: Last rotated at 2026-08-20 05:00912gitlab # [ 7.655661] logrotate[580]: log does not need rotating (log has already been rotated)913gitlab # [ 7.658082] logrotate[580]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed914gitlab # [ 7.658336] logrotate[580]: considering log /var/log/wtmp915gitlab # [ 7.658711] logrotate[580]: Creating new state916gitlab # [ 7.659172] logrotate[580]: Now: 2026-08-20 05:53917gitlab # [ 7.659584] logrotate[580]: Last rotated at 2026-08-20 05:00918gitlab # [ 7.663141] logrotate[580]: log does not need rotating (log has already been rotated)919gitlab # [ 7.663408] logrotate[580]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed920gitlab # [ 7.663810] logrotate[580]: switching euid from 0 to 165 and egid from 0 to 165 (pid 580)921gitlab # [ 7.664394] logrotate[580]: considering log /var/gitlab/state/log/*.log922gitlab # [ 7.664793] logrotate[580]: log /var/gitlab/state/log/*.log does not exist -- skipping923gitlab # [ 7.665375] logrotate[580]: Creating new state924gitlab # [ 7.665865] logrotate[580]: switching euid from 165 to 0 and egid from 165 to 0 (pid 580)925gitlab # [ 7.667406] logrotate[580]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed926gitlab # [ 7.670850] logrotate[580]: switching euid from 0 to 60 and egid from 0 to 60 (pid 580)927gitlab # [ 7.671359] logrotate[580]: considering log /var/log/nginx/*.log928gitlab # [ 7.671915] logrotate[580]: log /var/log/nginx/*.log does not exist -- skipping929gitlab # [ 7.672478] logrotate[580]: Creating new state930gitlab # [ 7.672948] logrotate[580]: not running postrotate script, since no logs were rotated931gitlab # [ 7.673580] logrotate[580]: switching euid from 60 to 0 and egid from 60 to 0 (pid 580)932gitlab # [ 7.674074] systemd[1]: Finished Logrotate configuration check.933gitlab # [ 7.674706] nsncd[581]: Aug 20 05:53:18.685 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"934gitlab # [ 7.675467] systemd[1]: Finished Post-Boot Actions.935gitlab # [ 7.676442] systemd[1]: Started Name Service Cache Daemon (nsncd).936gitlab # [ 7.677241] systemd[1]: Reached target Host and Network Name Lookups.937gitlab # [ 7.677740] systemd[1]: Reached target User and Group Name Lookups.938gitlab # [ 7.678394] systemd[1]: Starting User Login Management...939gitlab # [ 7.687949] systemd[1]: Finished Import lastlog data into lastlog2 database.940gitlab # [ 7.711974] systemd-logind[615]: New seat seat0.941gitlab # [ 7.715207] systemd-logind[615]: Watching system buttons on /dev/input/event2 (Power Button)942gitlab # [ 7.715541] systemd-logind[615]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)943gitlab # [ 7.715944] systemd-logind[615]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)944gitlab # [ 7.716500] systemd[1]: Started User Login Management.945gitlab # [ 7.716993] systemd[1]: Stopped target Host and Network Name Lookups.946gitlab # [ 7.717438] systemd[1]: Stopping Host and Network Name Lookups...947gitlab # [ 7.717859] systemd[1]: Stopped target User and Group Name Lookups.948gitlab # [ 7.719138] systemd[1]: Stopping User and Group Name Lookups...949gitlab # [ 7.719731] systemd[1]: Starting linger-users.service...950gitlab # [ 7.720221] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...951gitlab # [ 7.723476] systemd[1]: nscd.service: Deactivated successfully.952gitlab # [ 7.725911] systemd[1]: Stopped Name Service Cache Daemon (nsncd).953gitlab # [ 7.726377] systemd[1]: nscd.service: Consumed 23ms CPU time over 111ms wall clock time, 7.3M memory peak, 5.5M read from disk.954gitlab # [ 7.729563] systemd[1]: Starting Name Service Cache Daemon (nsncd)...955gitlab # [ 7.739743] systemd[1]: linger-users.service: Deactivated successfully.956gitlab # [ 7.741258] systemd[1]: Finished linger-users.service.957gitlab # [ 7.748099] systemd[1]: Finished resolvconf update.958gitlab # [ 7.749125] nsncd[673]: Aug 20 05:53:18.771 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"959gitlab # [ 7.751046] systemd[1]: Started Name Service Cache Daemon (nsncd).960gitlab # [ 7.751879] systemd[1]: Reached target Preparation for Network.961gitlab # [ 7.752727] systemd[1]: Reached target Host and Network Name Lookups.962gitlab # [ 7.753618] systemd[1]: Reached target User and Group Name Lookups.963gitlab # [ 7.754460] systemd[1]: Starting DHCP Client...964gitlab # [ 7.755099] systemd[1]: Starting Address configuration of eth1...965gitlab # [ 7.757428] systemd[1]: Starting Extra networking commands....966gitlab # [ 7.776614] network-addresses-eth1-start[698]: adding address 192.168.1.1/24... done967gitlab # [ 7.779670] network-addresses-eth1-start[698]: adding address 2001:db8:1::1/64... done968gitlab # [ 7.783827] systemd[1]: Finished Address configuration of eth1.969gitlab # [ 7.812663] systemd[1]: Finished Extra networking commands..970gitlab # [ 7.813469] systemd[1]: Reached target Network.971gitlab # [ 7.815731] systemd[1]: Starting gitlab-workhorse.service...972gitlab # [ 7.816754] systemd[1]: Starting Nginx Web Server...973gitlab # [ 7.818692] systemd[1]: Starting PostgreSQL Server...974gitlab # [ 7.819860] dhcpcd[707]: dhcpcd-10.3.2 starting975gitlab # [ 7.822669] dhcpcd[766]: dev: loaded udev976gitlab # [ 7.823487] systemd[1]: Starting Redis Server - redis-gitlab...977gitlab # [ 7.824748] systemd[1]: Starting Permit User Sessions...978gitlab # [ 7.962623] 8021q: 802.1Q VLAN Support v1.8979gitlab # [ 7.963033] 8021q: adding VLAN 0 to HW filter on device eth1980gitlab # [ 7.841609] systemd[1]: Finished Permit User Sessions.981gitlab # [ 7.843997] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.982gitlab # [ 7.846823] systemd[1]: Started Getty on tty1.983gitlab # [ 7.849302] systemd[1]: Reached target Login Prompts.984gitlab # [ 8.044629] cfg80211: Loading compiled-in X.509 certificates for regulatory database985gitlab # [ 8.053035] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'986gitlab # [ 8.053897] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'987gitlab # [ 8.055757] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2988gitlab # [ 8.056735] cfg80211: failed to load regulatory.db989gitlab # [ 8.081265] 8021q: adding VLAN 0 to HW filter on device eth0990gitlab # [ 7.949321] dhcpcd[766]: eth0: waiting for carrier991gitlab # [ 7.950143] dhcpcd[766]: eth0: carrier acquired992gitlab # [ 7.950985] redis-server[787]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.993gitlab # [ 7.951390] redis-server[787]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo994gitlab # [ 7.952236] redis-server[787]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=787, just started995gitlab # [ 7.952680] redis-server[787]: Configuration loaded996gitlab # [ 7.953527] redis[787]: monotonic clock: POSIX clock_gettime997gitlab # [ 7.954477] nginx-pre-start[792]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok998gitlab # [ 7.955445] nginx-pre-start[792]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful999gitlab # [ 7.955982] redis[787]: Running mode=standalone, port=0.1000gitlab # [ 7.957022] redis[787]: Server initialized1001gitlab # [ 7.957670] redis[787]: Ready to accept connections unix1002gitlab # [ 7.958220] redis[787]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1003gitlab # [ 7.958801] dhcpcd[766]: DUID 00:01:00:01:32:19:52:ce:52:54:00:12:34:561004gitlab # [ 7.960044] dhcpcd[766]: eth0: IAID 00:12:34:561005gitlab # [ 7.960858] dhcpcd[766]: eth0: adding address fe80::5054:ff:fe12:34561006gitlab # [ 7.962323] systemd[1]: Started Redis Server - redis-gitlab.1007gitlab # [ 7.968070] systemd[1]: Started Nginx Web Server.1008gitlab # [ 7.973940] postgresql-pre-start[791]: The files belonging to this database system will be owned by user "postgres".1009gitlab # [ 7.975489] postgresql-pre-start[791]: This user must also own the server process.1010gitlab # [ 7.980697] postgresql-pre-start[791]: The database cluster will be initialized with locale "en_US.UTF-8".1011gitlab # [ 7.981967] postgresql-pre-start[791]: The default database encoding has accordingly been set to "UTF8".1012gitlab # [ 7.983249] postgresql-pre-start[791]: The default text search configuration will be set to "english".1013gitlab # [ 7.984565] postgresql-pre-start[791]: Data page checksums are enabled.1014gitlab # [ 7.985581] postgresql-pre-start[791]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1015gitlab # [ 7.986784] postgresql-pre-start[791]: creating subdirectories ... ok1016gitlab # [ 7.987738] postgresql-pre-start[791]: selecting dynamic shared memory implementation ... posix1017gitlab # [ 8.015207] postgresql-pre-start[791]: selecting default "max_connections" ... 1001018gitlab # [ 8.050021] postgresql-pre-start[791]: selecting default "shared_buffers" ... 128MB1019gitlab # [ 8.304418] dhcpcd[766]: eth0: soliciting a DHCP lease1020gitlab # [ 8.450731] NET: Registered PF_PACKET protocol family1021gitlab # [ 8.318770] systemd[1]: Started gitlab-workhorse.service.1022gitlab # [ 8.324628] dhcpcd[766]: eth0: offered 10.0.2.15 from 10.0.2.21023gitlab # [ 8.328271] dhcpcd[766]: eth0: probing address 10.0.2.15/241024gitlab # [ 8.420356] postgresql-pre-start[791]: selecting default time zone ... UTC1025gitlab # [ 8.422843] postgresql-pre-start[791]: creating configuration files ... ok1026gitlab # [ 8.528967] gitlab-workhorse[824]: time="2026-08-20T05:53:19Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41027gitlab # [ 8.529700] gitlab-workhorse[824]: time="2026-08-20T05:53:19Z" level=info msg="Using redis/go-redis"1028gitlab # [ 8.530583] gitlab-workhorse[824]: time="2026-08-20T05:53:19Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1029gitlab # [ 8.594874] postgresql-pre-start[791]: running bootstrap script ... ok1030gitlab # [ 9.005590] postgresql-pre-start[791]: performing post-bootstrap initialization ... ok1031gitlab # [ 9.287122] postgresql-pre-start[791]: syncing data to disk ... ok1032gitlab # [ 9.287794] postgresql-pre-start[791]: initdb: warning: enabling "trust" authentication for local connections1033gitlab # [ 9.288456] postgresql-pre-start[791]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1034gitlab # [ 9.289097] postgresql-pre-start[791]: Success. You can now start the database server using:1035gitlab # [ 9.289740] postgresql-pre-start[791]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1036gitlab # [ 9.389213] postgres[850]: [850] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1037gitlab # [ 9.390117] postgres[850]: [850] LOG: listening on IPv6 address "::1", port 54321038gitlab # [ 9.390922] postgres[850]: [850] LOG: listening on IPv4 address "127.0.0.1", port 54321039gitlab # [ 9.394325] postgres[850]: [850] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1040gitlab # [ 9.406597] postgres[859]: [859] LOG: database system was shut down at 2026-08-20 05:53:20 GMT1041gitlab # [ 9.412559] postgres[850]: [850] LOG: database system is ready to accept connections1042gitlab # [ 9.418121] systemd[1]: Started PostgreSQL Server.1043gitlab # [ 9.422087] systemd[1]: Starting PostgreSQL Setup Scripts...1044gitlab # [ 9.604287] postgresql-setup-start[870]: CREATE DATABASE1045gitlab # [ 9.630480] postgresql-setup-start[880]: CREATE ROLE1046gitlab # [ 9.644580] postgresql-setup-start[882]: ALTER DATABASE1047gitlab # [ 9.667828] postgresql-setup-start[887]: CREATE ROLE1048gitlab # [ 9.671469] systemd[1]: Finished PostgreSQL Setup Scripts.1049gitlab # [ 9.671956] systemd[1]: Reached target PostgreSQL.1050gitlab # [ 9.673226] systemd[1]: Starting gitlab-postgresql.service...1051gitlab # [ 9.718263] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[875]: mkdir -p /var/gitlab/state/home/.ssh: OK1052gitlab # [ 9.723722] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[875]: chmod 700 /var/gitlab/state/home/.ssh: OK1053gitlab # [ 9.769338] gitlab-postgresql-start[895]: CREATE DATABASE1054gitlab # [ 9.776690] systemd[1]: Finished gitlab-config.service.1055gitlab # [ 9.780501] systemd[1]: Started gitaly.service.1056gitlab # [ 9.782127] systemd[1]: Starting gitlab-db-config.service...1057gitlab # [ 9.807437] gitlab-postgresql-start[922]: CREATE EXTENSION1058gitlab # [ 9.880690] gitlab-postgresql-start[926]: CREATE EXTENSION1059gitlab # [ 9.883588] systemd[1]: Finished gitlab-postgresql.service.1060gitlab # [ 10.037814] dhcpcd[766]: eth0: soliciting an IPv6 router1061gitlab # [ 10.038633] dhcpcd[766]: eth0: Router Advertisement from fe80::21062gitlab # [ 10.040247] dhcpcd[766]: eth0: adding address fec0::5054:ff:fe12:3456/641063gitlab # [ 10.043033] dhcpcd[766]: eth0: adding route to fec0::/641064gitlab # [ 10.043846] dhcpcd[766]: eth0: adding default route via fe80::21065gitlab # [ 10.368257] gitaly[919]: time="2026-08-20T05:53:21.389Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=9191066gitlab # [ 10.368948] gitaly[919]: time="2026-08-20T05:53:21.389Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=9191067gitlab # [ 10.369688] gitaly[919]: time="2026-08-20T05:53:21.390Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=9191068gitlab # [ 10.370564] gitaly[919]: time="2026-08-20T05:53:21.390Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=9191069gitlab # [ 10.371049] gitaly[919]: time="2026-08-20T05:53:21.390Z" level=info msg="Starting Gitaly" pid=919 version=1070gitlab # [ 10.558249] gitaly[919]: time="2026-08-20T05:53:21.580Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=180 pid=9191071gitlab # [ 10.558562] gitaly[919]: time="2026-08-20T05:53:21.580Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=9191072gitlab # [ 10.561267] gitaly[919]: time="2026-08-20T05:53:21.583Z" level=info msg="finished initializing command factory" duration_ms=2 pid=9191073gitlab # [ 10.561658] gitaly[919]: time="2026-08-20T05:53:21.583Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-919/git-exec-3506821567.d/git pid=9191074gitlab # [ 10.568341] gitaly[919]: time="2026-08-20T05:53:21.590Z" level=info msg="finished detecting git version" duration_ms=6 pid=9191075gitlab # [ 10.568845] gitaly[919]: time="2026-08-20T05:53:21.590Z" level=info msg="using Git version" pid=919 version=2.53.g1076gitlab # [ 10.571376] gitaly[919]: time="2026-08-20T05:53:21.593Z" level=info msg="clearing disk cache object folder" pid=919 storage=default1077gitlab # [ 10.571644] gitaly[919]: time="2026-08-20T05:53:21.593Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2212846892 pid=919 storage=default1078gitlab # [ 10.572124] gitaly[919]: time="2026-08-20T05:53:21.593Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2212846892 pid=919 storage=default1079gitlab # [ 10.572566] gitaly[919]: time="2026-08-20T05:53:21.593Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=9191080gitlab # [ 10.572952] gitaly[919]: time="2026-08-20T05:53:21.593Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=9191081gitlab # [ 10.573614] gitaly[919]: time="2026-08-20T05:53:21.593Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2212846892 clear_duration_ms=0 pid=919 storage=default1082gitlab # [ 10.604210] gitaly[919]: time="2026-08-20T05:53:21.626Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9191083gitlab # [ 10.604558] gitaly[919]: time="2026-08-20T05:53:21.626Z" level=info msg="counting repositories" pid=9191084gitlab # [ 10.604931] gitaly[919]: time="2026-08-20T05:53:21.626Z" level=info msg="starting to count repositories" pid=919 storage_path=/var/gitlab/state/repositories1085gitlab # [ 10.605644] gitaly[919]: time="2026-08-20T05:53:21.626Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=919 storage_path=/var/gitlab/state/repositories1086gitlab # [ 10.606116] gitaly[919]: time="2026-08-20T05:53:21.626Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9191087gitlab # [ 10.606574] gitaly[919]: time="2026-08-20T05:53:21.626Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=919 schema=unix1088gitlab # [ 10.607230] gitaly[919]: time="2026-08-20T05:53:21.626Z" level=info msg="listening at address" address=/run/gitaly/gitaly-919/sock.d/intern pid=919 schema=unix1089gitlab # [ 10.616264] gitaly[919]: time="2026-08-20T05:53:21.638Z" level=info msg="finished tempdir cleaner walk" pid=919 storage=default time_ms=111090gitlab # [ 10.617120] gitaly[919]: time="2026-08-20T05:53:21.639Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9191091gitlab # [ 10.617743] gitaly[919]: time="2026-08-20T05:53:21.639Z" level=info msg="Started Gitaly" duration_ms=249 pid=9191092gitlab # [ 10.618201] gitaly[919]: time="2026-08-20T05:53:21.639Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9191093gitlab # [ 10.622088] gitaly[919]: time="2026-08-20T05:53:21.644Z" level=info msg="maintenance: daily scheduled" pid=919 scheduled="2026-08-20 12:00:00 +0000 UTC"1094gitlab # [ 11.358498] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[925]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1095gitlab # [ 11.359466] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[925]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1096gitlab # [ 11.384425] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[925]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1097gitlab # [ 12.557321] gitaly[919]: time="2026-08-20T05:53:23.578Z" level=info msg="License database preloaded" duration_ms=2188 pid=9191098gitlab # [ 13.173595] dhcpcd[766]: eth0: leased 10.0.2.15 for 86400 seconds1099gitlab # [ 13.174389] dhcpcd[766]: eth0: adding route to 10.0.2.0/241100gitlab # [ 13.175618] dhcpcd[766]: eth0: adding default route via 10.0.2.21101gitlab # [ 13.290554] systemd[1]: Started DHCP Client.1102gitlab # [ 13.293546] systemd[1]: Reached target Network is Online.1103gitlab # [ 40.176872] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[925]: W, [2026-08-20T05:53:51.198445 #925] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1104gitlab # [ 42.140879] postgres[1299]: [1299] ERROR: relation "feature_gates" does not exist at character 5231105gitlab # [ 42.141469] postgres[1299]: [1299] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1106gitlab # [ 42.141857] postgres[1299]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1107gitlab # [ 42.142502] postgres[1299]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1108gitlab # [ 42.143192] postgres[1299]: attidentity AS identity,1109gitlab # [ 42.143822] postgres[1299]: attgenerated as attgenerated1110gitlab # [ 42.144671] postgres[1299]: FROM pg_attribute a1111gitlab # [ 42.145512] postgres[1299]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1112gitlab # [ 42.146190] postgres[1299]: LEFT JOIN pg_type t ON a.atttypid = t.oid1113gitlab # [ 42.146835] postgres[1299]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1114gitlab # [ 42.147689] postgres[1299]: WHERE a.attrelid = '"feature_gates"'::regclass1115gitlab # [ 42.148537] postgres[1299]: AND a.attnum > 0 AND NOT a.attisdropped1116gitlab # [ 42.149206] postgres[1299]: ORDER BY a.attnum1117gitlab # [ 42.149863] postgres[1299]:1118gitlab # [ 45.422654] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1341]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1119gitlab # [ 45.423565] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1341]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1120gitlab # [ 48.581751] gitlab-workhorse[824]: time="2026-08-20T05:53:59Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1121gitlab # [ 58.586877] gitlab-workhorse[824]: time="2026-08-20T05:54:09Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1122gitlab # [ 60.112955] postgres[1407]: [1407] ERROR: relation "table_without_models" does not exist1123gitlab # [ 60.114408] postgres[1407]: [1407] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1124gitlab # [ 68.588276] gitlab-workhorse[824]: time="2026-08-20T05:54:19Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1125gitlab # [ 71.304792] systemd[1]: Finished gitlab-db-config.service.1126gitlab # [ 71.308212] systemd[1]: Started gitlab-sidekiq.service.1127gitlab # [ 71.311478] systemd[1]: Starting gitlab.service...1128gitlab # [ 71.659726] bundle[1565]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1129gitlab # [ 71.660528] bundle[1565]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1130gitlab # [ 71.661618] bundle[1565]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1131gitlab # [ 74.305365] sidekiq-cluster[1564]: {"severity":"INFO","time":"2026-08-20T05:54:25.310Z","message":"Starting cluster with 1 processes"}1132gitlab # [ 74.390861] bundle[1565]: {"timestamp":"2026-08-20T05:54:25.393Z","pid":1565,"message":"* Enabling systemd notification integration"}1133gitlab # [ 74.391226] bundle[1565]: {"timestamp":"2026-08-20T05:54:25.412Z","pid":1565,"message":"Puma starting in cluster mode..."}1134gitlab # [ 74.393157] bundle[1565]: {"timestamp":"2026-08-20T05:54:25.412Z","pid":1565,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1135gitlab # [ 74.394502] bundle[1565]: {"timestamp":"2026-08-20T05:54:25.412Z","pid":1565,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1136gitlab # [ 74.396223] bundle[1565]: {"timestamp":"2026-08-20T05:54:25.412Z","pid":1565,"message":"* Min threads: 0"}1137gitlab # [ 74.398105] bundle[1565]: {"timestamp":"2026-08-20T05:54:25.412Z","pid":1565,"message":"* Max threads: 4"}1138gitlab # [ 74.399111] bundle[1565]: {"timestamp":"2026-08-20T05:54:25.412Z","pid":1565,"message":"* Environment: production"}1139gitlab # [ 74.400352] bundle[1565]: {"timestamp":"2026-08-20T05:54:25.412Z","pid":1565,"message":"* Master PID: 1565"}1140gitlab # [ 74.401478] bundle[1565]: {"timestamp":"2026-08-20T05:54:25.412Z","pid":1565,"message":"* Workers: 2"}1141gitlab # [ 74.402645] bundle[1565]: {"timestamp":"2026-08-20T05:54:25.412Z","pid":1565,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1142gitlab # [ 74.403454] bundle[1565]: {"timestamp":"2026-08-20T05:54:25.412Z","pid":1565,"message":"* Preloading application"}1143gitlab # [ 78.597786] gitlab-workhorse[824]: time="2026-08-20T05:54:29Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1144gitlab # [ 88.606656] gitlab-workhorse[824]: time="2026-08-20T05:54:39Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1145gitlab # [ 96.421949] bundle[1565]: W, [2026-08-20T05:54:47.443350 #1565] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1146gitlab # [ 98.616538] gitlab-workhorse[824]: time="2026-08-20T05:54:49Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1147gitlab # [ 99.010574] sidekiq-cluster[1595]: 2026-08-20T05:54:50.032Z pid=1595 tid=wib INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1595, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>450187264}1148gitlab # [ 99.185220] sidekiq-cluster[1595]: W, [2026-08-20T05:54:50.207345 #1595] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1149gitlab # [ 99.223956] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:50.246Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1150gitlab # [ 101.160717] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.182Z","message":"GitLab reliable fetch activated!"}1151gitlab # [ 101.161196] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.182Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1152gitlab # [ 101.205123] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.227Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1153gitlab # [ 101.210457] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.232Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1154gitlab # [ 101.216316] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.238Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1155gitlab # [ 101.222283] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.244Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1156gitlab # [ 101.228345] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.250Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1157gitlab # [ 101.234326] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.256Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1158gitlab # [ 101.240476] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.262Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1159gitlab # [ 101.245082] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.267Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1160gitlab # [ 101.249689] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.271Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1161gitlab # [ 101.254815] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.276Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1162gitlab # [ 101.259680] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.281Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1163gitlab # [ 101.265294] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.287Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1164gitlab # [ 101.270056] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.292Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1165gitlab # [ 101.274866] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.297Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1166gitlab # [ 101.279918] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.302Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1167gitlab # [ 101.285097] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.307Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1168gitlab # [ 101.291289] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.313Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1169gitlab # [ 101.296875] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.319Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1170gitlab # [ 101.302305] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.324Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1171gitlab # [ 101.307382] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.329Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1172gitlab # [ 101.312603] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.334Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1173gitlab # [ 101.318142] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.340Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1174gitlab # [ 101.322886] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.345Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1175gitlab # [ 101.327582] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.349Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1176gitlab # [ 101.332536] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.354Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1177gitlab # [ 101.337564] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.359Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1178gitlab # [ 101.342382] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.364Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1179gitlab # [ 101.347241] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.369Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1180gitlab # [ 101.352234] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.374Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1181gitlab # [ 101.357574] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.379Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1182gitlab # [ 101.361944] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.384Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1183gitlab # [ 101.367105] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.389Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1184gitlab # [ 101.371724] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.393Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1185gitlab # [ 101.376825] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.398Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1186gitlab # [ 101.381528] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.403Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1187gitlab # [ 101.386364] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.408Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1188gitlab # [ 101.390866] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.413Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1189gitlab # [ 101.395640] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.417Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1190gitlab # [ 101.399882] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.422Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1191gitlab # [ 101.404195] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.426Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1192gitlab # [ 101.408668] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.430Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1193gitlab # [ 101.412917] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.434Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1194gitlab # [ 101.417195] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.439Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1195gitlab # [ 101.422334] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.444Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1196gitlab # [ 101.427512] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.449Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1197gitlab # [ 101.431863] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.454Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1198gitlab # [ 101.436085] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.458Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1199gitlab # [ 101.440594] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.462Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1200gitlab # [ 101.445510] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.467Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1201gitlab # [ 101.450206] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.472Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1202gitlab # [ 101.455161] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.477Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1203gitlab # [ 101.460306] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.482Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1204gitlab # [ 101.489939] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.511Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1205gitlab # [ 101.493350] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.515Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1206gitlab # [ 101.497665] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.519Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1207gitlab # [ 101.501077] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.523Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1208gitlab # [ 101.504752] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.526Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1209gitlab # [ 101.508540] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.530Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1210gitlab # [ 101.512201] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.534Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1211gitlab # [ 101.515839] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.538Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1212gitlab # [ 101.519100] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.541Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1213gitlab # [ 101.522183] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.544Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1214gitlab # [ 101.526864] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.549Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1215gitlab # [ 101.531184] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.553Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1216gitlab # [ 101.534619] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.556Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1217gitlab # [ 101.539220] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.561Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1218gitlab # [ 101.542357] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.564Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1219gitlab # [ 101.545840] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.568Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1220gitlab # [ 101.548993] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.571Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1221gitlab # [ 101.552263] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.574Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1222gitlab # [ 101.555617] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.577Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1223gitlab # [ 101.558845] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.581Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1224gitlab # [ 101.562425] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.584Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1225gitlab # [ 101.565632] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.587Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1226gitlab # [ 101.569325] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.591Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1227gitlab # [ 101.573480] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.595Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1228gitlab # [ 101.577228] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.599Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1229gitlab # [ 101.581626] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.603Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1230gitlab # [ 101.585380] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.607Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1231gitlab # [ 101.589801] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.611Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1232gitlab # [ 101.593697] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.615Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1233gitlab # [ 101.598890] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.621Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1234gitlab # [ 101.604258] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.626Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1235gitlab # [ 101.607100] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.629Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1236gitlab # [ 101.610736] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.632Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1237gitlab # [ 101.613974] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.635Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1238gitlab # [ 101.617570] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.639Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1239gitlab # [ 101.622283] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.644Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1240gitlab # [ 101.627044] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.649Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1241gitlab # [ 101.632309] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.654Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1242gitlab # [ 101.637200] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.659Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1243gitlab # [ 101.642251] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.664Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1244gitlab # [ 101.646826] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.668Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1245gitlab # [ 101.652304] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.674Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1246gitlab # [ 101.658310] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.680Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1247gitlab # [ 101.664730] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.686Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1248gitlab # [ 101.669266] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.691Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1249gitlab # [ 101.674556] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.696Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1250gitlab # [ 101.693280] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.715Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1251gitlab # [ 101.698534] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.720Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1252gitlab # [ 101.702902] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.725Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1253gitlab # [ 101.708608] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.730Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1254gitlab # [ 101.713598] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.735Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1255gitlab # [ 101.718891] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.741Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1256gitlab # [ 101.724272] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.746Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1257gitlab # [ 101.728885] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.751Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1258gitlab # [ 101.733104] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.755Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1259gitlab # [ 101.738937] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.761Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1260gitlab # [ 101.743077] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:54:52.765Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1261gitlab # [ 104.172550] sidekiq-cluster[1595]: InitializerConnections Query: SET client_min_messages TO 'warning'1262gitlab # [ 104.176144] sidekiq-cluster[1595]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1263gitlab # [ 104.176242] sidekiq-cluster[1595]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1264gitlab # [ 104.176973] sidekiq-cluster[1595]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1265gitlab # [ 104.177988] sidekiq-cluster[1595]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1266gitlab # [ 104.179036] sidekiq-cluster[1595]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1267gitlab # [ 104.179729] sidekiq-cluster[1595]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1268gitlab # [ 104.186715] sidekiq-cluster[1595]: InitializerConnections Query: SET standard_conforming_strings = on1269gitlab # [ 104.187666] sidekiq-cluster[1595]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1270gitlab # [ 104.188680] sidekiq-cluster[1595]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1271gitlab # [ 104.189707] sidekiq-cluster[1595]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1272gitlab # [ 104.190403] sidekiq-cluster[1595]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1273gitlab # [ 104.191453] sidekiq-cluster[1595]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1274gitlab # [ 104.192481] sidekiq-cluster[1595]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1275gitlab # [ 104.218774] sidekiq-cluster[1595]: InitializerConnections Query: SET intervalstyle = iso_86011276gitlab # [ 104.219081] sidekiq-cluster[1595]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1277gitlab # [ 104.220102] sidekiq-cluster[1595]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1278gitlab # [ 104.221180] sidekiq-cluster[1595]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1279gitlab # [ 104.222211] sidekiq-cluster[1595]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1280gitlab # [ 104.223285] sidekiq-cluster[1595]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1281gitlab # [ 104.224334] sidekiq-cluster[1595]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1282gitlab # [ 104.237387] sidekiq-cluster[1595]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT t.oid, t.typname1283gitlab # [ 104.237855] sidekiq-cluster[1595]: FROM pg_type as t1284gitlab # [ 104.238990] sidekiq-cluster[1595]: WHERE t.typname IN ('int2', 'int4', 'int8', 'oid', 'float4', 'float8', 'numeric', 'bool', 'timestamp', 'timestamptz')1285gitlab # [ 104.239895] sidekiq-cluster[1595]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1286gitlab # [ 104.240990] sidekiq-cluster[1595]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1287gitlab # [ 104.241899] sidekiq-cluster[1595]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1288gitlab # [ 104.243068] sidekiq-cluster[1595]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1289gitlab # [ 104.243905] sidekiq-cluster[1595]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1290gitlab # [ 104.245111] sidekiq-cluster[1595]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1291gitlab # [ 104.257497] sidekiq-cluster[1595]: InitializerConnections Query: SET SESSION timezone TO 'UTC'1292gitlab # [ 104.258059] sidekiq-cluster[1595]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1293gitlab # [ 104.258753] sidekiq-cluster[1595]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1294gitlab # [ 104.259514] sidekiq-cluster[1595]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1295gitlab # [ 104.260139] sidekiq-cluster[1595]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1296gitlab # [ 104.260704] sidekiq-cluster[1595]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1297gitlab # [ 104.261462] sidekiq-cluster[1595]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1298gitlab # [ 104.267917] sidekiq-cluster[1595]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT "feature_gates"."key", "feature_gates"."value" FROM "feature_gates" WHERE "feature_gates"."feature_key" = 'per_thread_db_connection_pool_metrics'1299gitlab # [ 104.268584] sidekiq-cluster[1595]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1300gitlab # [ 104.269210] sidekiq-cluster[1595]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1301gitlab # [ 104.269909] sidekiq-cluster[1595]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1302gitlab # [ 104.270675] sidekiq-cluster[1595]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1303gitlab # [ 104.271443] sidekiq-cluster[1595]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1304gitlab # [ 104.272068] sidekiq-cluster[1595]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1305gitlab # [ 108.625663] gitlab-workhorse[824]: time="2026-08-20T05:54:59Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1306gitlab # [ 118.634209] gitlab-workhorse[824]: time="2026-08-20T05:55:09Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1307gitlab # [ 124.676688] postgres[2043]: [2043] ERROR: relation "table_without_models" does not exist1308gitlab # [ 124.677492] postgres[2043]: [2043] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1309gitlab # [ 125.047078] postgres[2042]: [2042] ERROR: relation "table_without_models" does not exist1310gitlab # [ 125.049616] postgres[2042]: [2042] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1311gitlab # [ 127.474335] bundle[1565]: {"timestamp":"2026-08-20T05:55:18.495Z","pid":1565,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1312gitlab # [ 127.474987] bundle[1565]: {"timestamp":"2026-08-20T05:55:18.495Z","pid":1565,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1313gitlab # [ 127.475986] bundle[1565]: {"timestamp":"2026-08-20T05:55:18.495Z","pid":1565,"message":"! #\u003cThread:0x000070f33a31c1a0 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1314gitlab # [ 127.478176] bundle[1565]: {"timestamp":"2026-08-20T05:55:18.495Z","pid":1565,"message":"! #\u003cThread:0x000070f339208c38 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1315gitlab # [ 127.479159] bundle[1565]: {"timestamp":"2026-08-20T05:55:18.496Z","pid":1565,"message":"Use Ctrl-C to stop"}1316gitlab # [ 127.503521] bundle[1565]: {"timestamp":"2026-08-20T05:55:18.496Z","pid":1565,"message":"Sending status to systemd every 1.0 sec"}1317gitlab # [ 127.954914] bundle[1565]: {"timestamp":"2026-08-20T05:55:18.977Z","pid":1565,"message":"- Worker 0 (PID: 2116) booted in 0.42s, phase: 0"}1318gitlab # [ 127.982551] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:19.000Z","message":"Booted Rails 7.2.3.1 application in production environment"}1319gitlab # [ 127.983236] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:19.005Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1320gitlab # [ 127.983844] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:19.005Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1321gitlab # [ 127.984410] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:19.005Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1322gitlab # [ 127.984843] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:19.006Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1323gitlab # [ 128.029799] bundle[1565]: {"timestamp":"2026-08-20T05:55:19.051Z","pid":1565,"message":"- Worker 1 (PID: 2120) booted in 0.46s, phase: 0"}1324gitlab # [ 128.034737] systemd[1]: Started gitlab.service.1325gitlab # [ 128.035332] systemd[1]: Reached target Common target for all GitLab services..1326gitlab # [ 128.039115] systemd[1]: Starting setup-gitlab.service...1327gitlab # [ 128.053075] setup-gitlab-start[2155]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1328gitlab # [ 129.321460] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:20.342Z","message":"Cleaning working queues"}1329gitlab # [ 129.324154] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:20.345Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"d30f7734862a7c81a20ac285","created_at":"2026-08-20T05:54:21.978Z","trace_propagation_headers":{"sentry-trace":"bb8a93e27f674ed8a0c6e9e6a2a34be0-f4b7d616b05a4d41","baggage":"sentry-trace_id=bb8a93e27f674ed8a0c6e9e6a2a34be0,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"e8014993070bcf09e0898fa1ec18064a","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:21.985Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-d30f7734862a7c81a20ac285: start","job_status":"start","queue_duration_s":58.359736,"scheduling_latency_s":58.359847}1330gitlab # [ 129.507124] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:20.528Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"d30f7734862a7c81a20ac285","created_at":"2026-08-20T05:54:21.978Z","trace_propagation_headers":{"sentry-trace":"bb8a93e27f674ed8a0c6e9e6a2a34be0-f4b7d616b05a4d41","baggage":"sentry-trace_id=bb8a93e27f674ed8a0c6e9e6a2a34be0,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"e8014993070bcf09e0898fa1ec18064a","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:21.985Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-d30f7734862a7c81a20ac285: done: 0.183599 sec","job_status":"done","queue_duration_s":58.359736,"scheduling_latency_s":58.359847,"redis_calls":26,"redis_duration_s":0.00651,"redis_read_bytes":914,"redis_write_bytes":2887,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.003855,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001459,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001196,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.074672,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.097499542,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.183599,"completed_at":"2026-08-20T05:55:20.528Z","load_balancing_strategy":"primary","db_duration_s":0.056788,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1331gitlab # [ 130.392378] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:55:21 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 23011332gitlab # [ 130.396315] setup-gitlab-start[2155]: + TOKEN=nixbot-test-token-of-20-chars1333gitlab # [ 130.397007] setup-gitlab-start[2155]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1334gitlab # [ 130.412743] runuser[2185]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1335gitlab # [ 130.768863] setup-gitlab-start[2186]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1336gitlab # [ 130.769321] setup-gitlab-start[2186]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1337gitlab # [ 130.770440] setup-gitlab-start[2186]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1338gitlab # [ 131.344333] setup-gitlab-start[2186]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1339gitlab # [ 131.344869] setup-gitlab-start[2186]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1340gitlab # [ 131.346141] setup-gitlab-start[2186]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1341gitlab # [ 142.561588] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:33.582Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"2ab41ad931b26c8e7342376a","created_at":"2026-08-20T05:55:33.548Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"56eeaba3269f0bbbc091a18c60fe0e75","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:33.579Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-2ab41ad931b26c8e7342376a: start","job_status":"start","queue_duration_s":0.00305,"scheduling_latency_s":0.003111}1342gitlab # [ 142.761536] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:33.782Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"2ab41ad931b26c8e7342376a","created_at":"2026-08-20T05:55:33.548Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"56eeaba3269f0bbbc091a18c60fe0e75","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:33.579Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-2ab41ad931b26c8e7342376a: done: 0.200289 sec","job_status":"done","queue_duration_s":0.00305,"scheduling_latency_s":0.003111,"redis_calls":12,"redis_duration_s":0.040615,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.029413,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008263,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002939,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.032,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.062473,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001287035,"exclusive_lock_hold_duration_s":0.068522397,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.200289,"completed_at":"2026-08-20T05:55:33.782Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.040257,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1343gitlab # [ 142.829791] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:33.789Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"c34db2eadd8aa493b84e2885","created_at":"2026-08-20T05:55:33.621Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5b177feaaa919c5d9564447575fc2df9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:55:33.637Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-c34db2eadd8aa493b84e2885: start","job_status":"start","queue_duration_s":0.15186,"scheduling_latency_s":0.151899}1344gitlab # [ 142.863977] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:33.885Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"c34db2eadd8aa493b84e2885","created_at":"2026-08-20T05:55:33.621Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5b177feaaa919c5d9564447575fc2df9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:55:33.637Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-c34db2eadd8aa493b84e2885: done: 0.096265 sec","job_status":"done","queue_duration_s":0.15186,"scheduling_latency_s":0.151899,"redis_calls":10,"redis_duration_s":0.019408,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000913,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.009147,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.009348,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001227531,"duration_s":0.096265,"completed_at":"2026-08-20T05:55:33.885Z","load_balancing_strategy":"primary","db_duration_s":0.030225,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1345gitlab # [ 142.882850] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:33.891Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"7530afbf50dff4b0bee87925","created_at":"2026-08-20T05:55:33.678Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5580714f1934aae8c01aeeefb08b6067","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:33.736Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-7530afbf50dff4b0bee87925: start","job_status":"start","queue_duration_s":0.155551,"scheduling_latency_s":0.155592}1346gitlab # [ 142.940170] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:33.962Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"7530afbf50dff4b0bee87925","created_at":"2026-08-20T05:55:33.678Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5580714f1934aae8c01aeeefb08b6067","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:33.736Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-7530afbf50dff4b0bee87925: done: 0.070258 sec","job_status":"done","queue_duration_s":0.155551,"scheduling_latency_s":0.155592,"redis_calls":12,"redis_duration_s":0.035201,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.020156,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.013236,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001809,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013298,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000730819,"duration_s":0.070258,"completed_at":"2026-08-20T05:55:33.961Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003799,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347gitlab # [ 142.942142] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:33.963Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"7ac13db999f79409c5b40187","created_at":"2026-08-20T05:55:33.749Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a52da6cfcd03692a03f3576d141749f9","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:33.756Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-7ac13db999f79409c5b40187: start","job_status":"start","queue_duration_s":0.207827,"scheduling_latency_s":0.207844}1348gitlab # [ 143.020839] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:34.042Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"7ac13db999f79409c5b40187","created_at":"2026-08-20T05:55:33.749Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a52da6cfcd03692a03f3576d141749f9","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:33.756Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-7ac13db999f79409c5b40187: done: 0.07879 sec","job_status":"done","queue_duration_s":0.207827,"scheduling_latency_s":0.207844,"redis_calls":17,"redis_duration_s":0.018285,"redis_read_bytes":15,"redis_write_bytes":2007,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.011615,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1150,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003891,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000658,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002121,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020499,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001162439,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.07879,"completed_at":"2026-08-20T05:55:34.042Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02809,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 143.039078] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:34.049Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"b88665999df2c8265eabd21e","created_at":"2026-08-20T05:55:33.768Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"87d10c0b4b64c2aff3c96d4f2982d8ae","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:33.787Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-b88665999df2c8265eabd21e: start","job_status":"start","queue_duration_s":0.26202,"scheduling_latency_s":0.262061}1350gitlab # [ 143.085554] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:34.107Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"b88665999df2c8265eabd21e","created_at":"2026-08-20T05:55:33.768Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"87d10c0b4b64c2aff3c96d4f2982d8ae","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:33.787Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-b88665999df2c8265eabd21e: done: 0.057917 sec","job_status":"done","queue_duration_s":0.26202,"scheduling_latency_s":0.262061,"redis_calls":10,"redis_duration_s":0.010881,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001241,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008446,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001194,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013599,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000614603,"duration_s":0.057917,"completed_at":"2026-08-20T05:55:34.107Z","load_balancing_strategy":"primary","db_duration_s":0.0232,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1351gitlab # [ 143.122237] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:34.144Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"a397ab932682040e453b8ace","created_at":"2026-08-20T05:55:33.807Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2bbbc6c5697af541d421a8cffc8cb1ad","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:33.830Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-a397ab932682040e453b8ace: start","job_status":"start","queue_duration_s":0.313696,"scheduling_latency_s":0.313739}1352gitlab # [ 143.169108] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:34.190Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1353gitlab # [ 143.185929] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:34.207Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"a397ab932682040e453b8ace","created_at":"2026-08-20T05:55:33.807Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2bbbc6c5697af541d421a8cffc8cb1ad","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:33.830Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-a397ab932682040e453b8ace: done: 0.063572 sec","job_status":"done","queue_duration_s":0.313696,"scheduling_latency_s":0.313739,"redis_calls":10,"redis_duration_s":0.02,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001211,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.01629,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002499,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01859,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000876368,"duration_s":0.063572,"completed_at":"2026-08-20T05:55:34.207Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004323,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354gitlab # [ 143.212297] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:34.234Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"004e50016e6a55243a7dfe53","created_at":"2026-08-20T05:55:33.853Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5cdb6c231a109e500ccebc95c3bdda9e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:55:33.868Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-004e50016e6a55243a7dfe53: start","job_status":"start","queue_duration_s":0.365461,"scheduling_latency_s":0.365506}1355gitlab # [ 143.236768] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:34.258Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1356gitlab # [ 143.248668] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:34.270Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"004e50016e6a55243a7dfe53","created_at":"2026-08-20T05:55:33.853Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5cdb6c231a109e500ccebc95c3bdda9e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:55:33.868Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-004e50016e6a55243a7dfe53: done: 0.036279 sec","job_status":"done","queue_duration_s":0.365461,"scheduling_latency_s":0.365506,"redis_calls":10,"redis_duration_s":0.011112,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004175,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005372,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001565,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012231,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000886984,"duration_s":0.036279,"completed_at":"2026-08-20T05:55:34.270Z","load_balancing_strategy":"primary","db_duration_s":0.00071,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357gitlab # [ 143.291336] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:34.313Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"aae34ce005547b80b6d28ab5","created_at":"2026-08-20T05:55:33.887Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"883f38a04359199290fc79cb9ccf1730","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:33.897Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-aae34ce005547b80b6d28ab5: start","job_status":"start","queue_duration_s":0.415912,"scheduling_latency_s":0.415956}1358gitlab # [ 143.345209] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:34.366Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"aae34ce005547b80b6d28ab5","created_at":"2026-08-20T05:55:33.887Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"883f38a04359199290fc79cb9ccf1730","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:33.897Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-aae34ce005547b80b6d28ab5: done: 0.053884 sec","job_status":"done","queue_duration_s":0.415912,"scheduling_latency_s":0.415956,"redis_calls":10,"redis_duration_s":0.007718,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000982,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005627,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001109,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021497,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001292064,"duration_s":0.053884,"completed_at":"2026-08-20T05:55:34.366Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01106,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1359gitlab # [ 143.385489] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:34.407Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"709e651380df26389e963d61","created_at":"2026-08-20T05:55:33.931Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bcbb77f88ac3f483dd70a248f0058823","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:33.941Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-709e651380df26389e963d61: start","job_status":"start","queue_duration_s":0.465849,"scheduling_latency_s":0.465895}1360gitlab # [ 143.593334] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:34.614Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"709e651380df26389e963d61","created_at":"2026-08-20T05:55:33.931Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bcbb77f88ac3f483dd70a248f0058823","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:33.941Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-709e651380df26389e963d61: done: 0.207013 sec","job_status":"done","queue_duration_s":0.465849,"scheduling_latency_s":0.465895,"redis_calls":14,"redis_duration_s":0.006641,"redis_read_bytes":13,"redis_write_bytes":1641,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002961,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002024,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001656,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.06,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.05,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.121771,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001037562,"exclusive_lock_hold_duration_s":0.161423869,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.207013,"completed_at":"2026-08-20T05:55:34.614Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.078183,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1361gitlab # [ 143.654891] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:34.676Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"66faee2822384f14339cfd24","created_at":"2026-08-20T05:55:33.958Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3451331eb7189682742dc8590e33d9bf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:33.977Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-66faee2822384f14339cfd24: start","job_status":"start","queue_duration_s":0.699592,"scheduling_latency_s":0.69962}1362gitlab # [ 143.696846] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:34.718Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"66faee2822384f14339cfd24","created_at":"2026-08-20T05:55:33.958Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3451331eb7189682742dc8590e33d9bf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:33.977Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-66faee2822384f14339cfd24: done: 0.041665 sec","job_status":"done","queue_duration_s":0.699592,"scheduling_latency_s":0.69962,"redis_calls":10,"redis_duration_s":0.0032129999999999997,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000722,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001818,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000673,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016972,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000494476,"duration_s":0.041665,"completed_at":"2026-08-20T05:55:34.718Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000598,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363gitlab # [ 143.732854] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:34.754Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"bee0066245030b0e75bfe566","created_at":"2026-08-20T05:55:34.006Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d19515b2eccc89a1ddd4bebc1a23d24a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.014Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-bee0066245030b0e75bfe566: start","job_status":"start","queue_duration_s":0.74026,"scheduling_latency_s":0.740307}1364gitlab # [ 143.751502] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:34.773Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1365gitlab # [ 143.763974] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:34.785Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"bee0066245030b0e75bfe566","created_at":"2026-08-20T05:55:34.006Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d19515b2eccc89a1ddd4bebc1a23d24a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.014Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-bee0066245030b0e75bfe566: done: 0.031217 sec","job_status":"done","queue_duration_s":0.74026,"scheduling_latency_s":0.740307,"redis_calls":10,"redis_duration_s":0.003068,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000629,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001826,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000613,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016667,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000533867,"duration_s":0.031217,"completed_at":"2026-08-20T05:55:34.785Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000591,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 143.799876] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:34.821Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"c6bbf1190b1c6a83b3c6e003","created_at":"2026-08-20T05:55:34.025Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.031Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-c6bbf1190b1c6a83b3c6e003: start","job_status":"start","queue_duration_s":0.790618,"scheduling_latency_s":0.790669}1367gitlab # [ 143.924155] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:34.945Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"c6bbf1190b1c6a83b3c6e003","created_at":"2026-08-20T05:55:34.025Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.031Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-c6bbf1190b1c6a83b3c6e003: done: 0.124086 sec","job_status":"done","queue_duration_s":0.790618,"scheduling_latency_s":0.790669,"redis_calls":71,"redis_duration_s":0.018708,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002241,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001151,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.014526,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00079,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.093023,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000321829,"duration_s":0.124086,"completed_at":"2026-08-20T05:55:34.945Z","load_balancing_strategy":"primary","db_duration_s":0.001788,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 143.925470] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:34.947Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"a3a6c1f5771a36edf368dfbc","created_at":"2026-08-20T05:55:34.037Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"812f94d948818f212adbf9be31cf8095","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.048Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-a3a6c1f5771a36edf368dfbc: start","job_status":"start","queue_duration_s":0.898411,"scheduling_latency_s":0.898432}1369gitlab # [ 143.973671] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:34.995Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1370gitlab # [ 143.980138] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:35.001Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"a3a6c1f5771a36edf368dfbc","created_at":"2026-08-20T05:55:34.037Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"812f94d948818f212adbf9be31cf8095","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.048Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-a3a6c1f5771a36edf368dfbc: done: 0.054827 sec","job_status":"done","queue_duration_s":0.898411,"scheduling_latency_s":0.898432,"redis_calls":10,"redis_duration_s":0.002311,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000598,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001295,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000418,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.038,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009902,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000296407,"duration_s":0.054827,"completed_at":"2026-08-20T05:55:35.001Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.038346,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 143.981291] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:35.003Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"940b0e613e30f67f2609e423","created_at":"2026-08-20T05:55:34.067Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f29a047a57eca4b3529604a75ca7fd4e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.075Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-940b0e613e30f67f2609e423: start","job_status":"start","queue_duration_s":0.927377,"scheduling_latency_s":0.927394}1372gitlab # [ 144.061494] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:35.082Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"940b0e613e30f67f2609e423","created_at":"2026-08-20T05:55:34.067Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f29a047a57eca4b3529604a75ca7fd4e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.075Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-940b0e613e30f67f2609e423: done: 0.079458 sec","job_status":"done","queue_duration_s":0.927377,"scheduling_latency_s":0.927394,"redis_calls":12,"redis_duration_s":0.00298,"redis_read_bytes":11,"redis_write_bytes":1612,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000553,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001198,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001229,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.048,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.038,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022543,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000634717,"exclusive_lock_hold_duration_s":0.021072231,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.079458,"completed_at":"2026-08-20T05:55:35.082Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.048816,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373gitlab # [ 144.099656] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:35.121Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"102af561c206bd2da0c55933","created_at":"2026-08-20T05:55:34.089Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e2e984853e54600be20e2c46199630cc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.097Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-102af561c206bd2da0c55933: start","job_status":"start","queue_duration_s":1.024231,"scheduling_latency_s":1.024334}1374gitlab # [ 144.155956] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:35.177Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"102af561c206bd2da0c55933","created_at":"2026-08-20T05:55:34.089Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e2e984853e54600be20e2c46199630cc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.097Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-102af561c206bd2da0c55933: done: 0.056644 sec","job_status":"done","queue_duration_s":1.024231,"scheduling_latency_s":1.024334,"redis_calls":19,"redis_duration_s":0.005365,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001231,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000324,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002903,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000907,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033113,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000456762,"duration_s":0.056644,"completed_at":"2026-08-20T05:55:35.177Z","load_balancing_strategy":"primary","db_duration_s":0.001895,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375gitlab # [ 144.157338] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:35.178Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"729bea738dcf39a77a279509","created_at":"2026-08-20T05:55:34.105Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"45c958768b32e8a365233083b5f464ea","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.145Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-729bea738dcf39a77a279509: start","job_status":"start","queue_duration_s":1.03297,"scheduling_latency_s":1.032986}1376gitlab # [ 144.227612] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:35.249Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"729bea738dcf39a77a279509","created_at":"2026-08-20T05:55:34.105Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"45c958768b32e8a365233083b5f464ea","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.145Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-729bea738dcf39a77a279509: done: 0.0701 sec","job_status":"done","queue_duration_s":1.03297,"scheduling_latency_s":1.032986,"redis_calls":12,"redis_duration_s":0.003227,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000547,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001366,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001314,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017797,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000711263,"exclusive_lock_hold_duration_s":0.010142628999999998,"duration_s":0.0701,"completed_at":"2026-08-20T05:55:35.248Z","load_balancing_strategy":"primary","db_duration_s":0.042765,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 144.262840] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:35.284Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"adaff5fa32469d1f8130cb23","created_at":"2026-08-20T05:55:34.180Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e6cbd1fd86a54cdef2541c807ac7155e","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.197Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-adaff5fa32469d1f8130cb23: start","job_status":"start","queue_duration_s":1.087426,"scheduling_latency_s":1.087473}1378gitlab # [ 144.564874] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:35.586Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"adaff5fa32469d1f8130cb23","created_at":"2026-08-20T05:55:34.180Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e6cbd1fd86a54cdef2541c807ac7155e","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.197Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-adaff5fa32469d1f8130cb23: done: 0.302281 sec","job_status":"done","queue_duration_s":1.087426,"scheduling_latency_s":1.087473,"redis_calls":565,"redis_duration_s":0.092804,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001097,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001334,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.090373,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.235589,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023327,"duration_s":0.302281,"completed_at":"2026-08-20T05:55:35.586Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000796,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 144.599796] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:35.620Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"269a4095b8f04ae694b6bc6e","created_at":"2026-08-20T05:55:34.231Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7a93c7a8bb25a5e8c111d03e7856ef53","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.247Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-269a4095b8f04ae694b6bc6e: start","job_status":"start","queue_duration_s":1.37283,"scheduling_latency_s":1.372857}1380gitlab # [ 144.608661] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:35.630Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1381gitlab # [ 144.614404] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:35.636Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"269a4095b8f04ae694b6bc6e","created_at":"2026-08-20T05:55:34.231Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7a93c7a8bb25a5e8c111d03e7856ef53","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.247Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-269a4095b8f04ae694b6bc6e: done: 0.015543 sec","job_status":"done","queue_duration_s":1.37283,"scheduling_latency_s":1.372857,"redis_calls":10,"redis_duration_s":0.00136,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000261,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000818,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000281,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008035,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023802,"duration_s":0.015543,"completed_at":"2026-08-20T05:55:35.636Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000612,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 144.649263] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:35.671Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"91c488895a77d4705a2f0b3a","created_at":"2026-08-20T05:55:34.260Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1060ae0b25b1fe8124b7b843f0a8a7ff","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:55:34.267Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-91c488895a77d4705a2f0b3a: start","job_status":"start","queue_duration_s":1.403175,"scheduling_latency_s":1.403206}1383gitlab # [ 144.674963] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:35.697Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1384gitlab # [ 144.686416] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:35.707Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"91c488895a77d4705a2f0b3a","created_at":"2026-08-20T05:55:34.260Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1060ae0b25b1fe8124b7b843f0a8a7ff","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:55:34.267Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-91c488895a77d4705a2f0b3a: done: 0.036806 sec","job_status":"done","queue_duration_s":1.403175,"scheduling_latency_s":1.403206,"redis_calls":10,"redis_duration_s":0.003268,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000482,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002308,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000478,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011663,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000385244,"duration_s":0.036806,"completed_at":"2026-08-20T05:55:35.707Z","load_balancing_strategy":"primary","db_duration_s":0.000714,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 144.720821] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:35.742Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"f4dff9cb741581a388e3d42f","created_at":"2026-08-20T05:55:34.310Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a18123f68d11819de8759f8d62079c2f","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.328Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-f4dff9cb741581a388e3d42f: start","job_status":"start","queue_duration_s":1.414106,"scheduling_latency_s":1.414144}1386gitlab # [ 144.780878] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:35.802Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"f4dff9cb741581a388e3d42f","created_at":"2026-08-20T05:55:34.310Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a18123f68d11819de8759f8d62079c2f","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.328Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-f4dff9cb741581a388e3d42f: done: 0.059593 sec","job_status":"done","queue_duration_s":1.414106,"scheduling_latency_s":1.414144,"redis_calls":10,"redis_duration_s":0.002288,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000498,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001356,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000434,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023162,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000417651,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.059593,"completed_at":"2026-08-20T05:55:35.802Z","load_balancing_strategy":"primary","db_duration_s":0.016558,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387gitlab # [ 144.817144] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:35.838Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"a51c845c913a61aa2f2fc54c","created_at":"2026-08-20T05:55:34.348Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ca2fc6d3857d2e7d337ca058f694a752","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.369Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-a51c845c913a61aa2f2fc54c: start","job_status":"start","queue_duration_s":1.469459,"scheduling_latency_s":1.469524}1388gitlab # [ 144.867865] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:35.889Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"a51c845c913a61aa2f2fc54c","created_at":"2026-08-20T05:55:34.348Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ca2fc6d3857d2e7d337ca058f694a752","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.369Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-a51c845c913a61aa2f2fc54c: done: 0.050486 sec","job_status":"done","queue_duration_s":1.469459,"scheduling_latency_s":1.469524,"redis_calls":13,"redis_duration_s":0.004313,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00063,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002189,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001494,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03116,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.017308623999999998,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.050486,"completed_at":"2026-08-20T05:55:35.888Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00575,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1389gitlab # [ 144.869518] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:35.891Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"f11bc59125d242196552d5cc","created_at":"2026-08-20T05:55:34.432Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"931ae4cfc93552051ad29cf374846fde","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.443Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-f11bc59125d242196552d5cc: start","job_status":"start","queue_duration_s":1.447932,"scheduling_latency_s":1.447959}1390gitlab # [ 145.007257] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.029Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"f11bc59125d242196552d5cc","created_at":"2026-08-20T05:55:34.432Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"931ae4cfc93552051ad29cf374846fde","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.443Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-f11bc59125d242196552d5cc: done: 0.137697 sec","job_status":"done","queue_duration_s":1.447932,"scheduling_latency_s":1.447959,"redis_calls":28,"redis_duration_s":0.006084,"redis_read_bytes":36,"redis_write_bytes":10593,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001042,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":680,"redis_queues_calls":2,"redis_queues_duration_s":0.000436,"redis_queues_read_bytes":3,"redis_queues_write_bytes":8305,"redis_queues_metadata_calls":16,"redis_queues_metadata_duration_s":0.003208,"redis_queues_metadata_read_bytes":24,"redis_queues_metadata_write_bytes":1162,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001398,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":446,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.039,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.039,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.083452,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000287467,"duration_s":0.137697,"completed_at":"2026-08-20T05:55:36.029Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.042362,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1391gitlab # [ 145.008436] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.030Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"bc2b43bedfc8485c86f78d01","created_at":"2026-08-20T05:55:34.449Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"859556c53fd1ff54fc3b98ce0b2f9f33","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.455Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-bc2b43bedfc8485c86f78d01: start","job_status":"start","queue_duration_s":1.574856,"scheduling_latency_s":1.574871}1392gitlab # [ 145.066215] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.088Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"bc2b43bedfc8485c86f78d01","created_at":"2026-08-20T05:55:34.449Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"859556c53fd1ff54fc3b98ce0b2f9f33","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.455Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-bc2b43bedfc8485c86f78d01: done: 0.057927 sec","job_status":"done","queue_duration_s":1.574856,"scheduling_latency_s":1.574871,"redis_calls":12,"redis_duration_s":0.0022510000000000004,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000313,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001066,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000872,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.042,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.042,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009682,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000394743,"exclusive_lock_hold_duration_s":0.0025696010000000004,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.057927,"completed_at":"2026-08-20T05:55:36.088Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.042397,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1393gitlab # [ 145.067584] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.089Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"ec251dae5b6908c2925f82dd","created_at":"2026-08-20T05:55:34.461Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b1e9854d25bbfb35bd064251919d8040","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.465Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-ec251dae5b6908c2925f82dd: start","job_status":"start","queue_duration_s":1.623119,"scheduling_latency_s":1.623133}1394gitlab # [ 145.145154] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.166Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"ec251dae5b6908c2925f82dd","created_at":"2026-08-20T05:55:34.461Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b1e9854d25bbfb35bd064251919d8040","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.465Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-ec251dae5b6908c2925f82dd: done: 0.077564 sec","job_status":"done","queue_duration_s":1.623119,"scheduling_latency_s":1.623133,"redis_calls":10,"redis_duration_s":0.002419,"redis_read_bytes":9,"redis_write_bytes":1109,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000601,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001372,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000446,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.051,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.051,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018085,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00053694,"duration_s":0.077564,"completed_at":"2026-08-20T05:55:36.166Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.051454,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1395gitlab # [ 145.180156] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.201Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49748161c7aff71b900510ae","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49748161c7aff71b900510ae: start","job_status":"start","queue_duration_s":1.264696,"scheduling_latency_s":1.264738}1396gitlab # [ 145.212904] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.234Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49748161c7aff71b900510ae","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49748161c7aff71b900510ae: done: 0.032682 sec","job_status":"done","queue_duration_s":1.264696,"scheduling_latency_s":1.264738,"redis_calls":16,"redis_duration_s":0.004619,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000567,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001343,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002709,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01944,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000468216,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032682,"completed_at":"2026-08-20T05:55:36.234Z","load_balancing_strategy":"primary","db_duration_s":0.000653,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397gitlab # [ 145.248141] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.269Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b48680cebe212b4c8de648f","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b48680cebe212b4c8de648f: start","job_status":"start","queue_duration_s":1.332611,"scheduling_latency_s":1.332653}1398gitlab # [ 145.279141] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b48680cebe212b4c8de648f","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b48680cebe212b4c8de648f: done: 0.030221 sec","job_status":"done","queue_duration_s":1.332611,"scheduling_latency_s":1.332653,"redis_calls":13,"redis_duration_s":0.002545,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000858,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001687,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030221,"completed_at":"2026-08-20T05:55:36.299Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1399gitlab # [ 145.311898] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.333Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8610c7f4027159d93baa8692","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8610c7f4027159d93baa8692: start","job_status":"start","queue_duration_s":1.396478,"scheduling_latency_s":1.396532}1400gitlab # [ 145.335572] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.357Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8610c7f4027159d93baa8692","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8610c7f4027159d93baa8692: done: 0.023471 sec","job_status":"done","queue_duration_s":1.396478,"scheduling_latency_s":1.396532,"redis_calls":13,"redis_duration_s":0.003554,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001162,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002392,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014634,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023471,"completed_at":"2026-08-20T05:55:36.357Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401gitlab # [ 145.337424] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.359Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0bafdcc6650e9601914a51a","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0bafdcc6650e9601914a51a: start","job_status":"start","queue_duration_s":1.422051,"scheduling_latency_s":1.422083}1402gitlab # [ 145.358054] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.379Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0bafdcc6650e9601914a51a","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0bafdcc6650e9601914a51a: done: 0.02058 sec","job_status":"done","queue_duration_s":1.422051,"scheduling_latency_s":1.422083,"redis_calls":13,"redis_duration_s":0.003211,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001035,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002176,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01316,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02058,"completed_at":"2026-08-20T05:55:36.379Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403gitlab # [ 145.373444] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.381Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4019d2a10e8f560d6e61b2e3","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4019d2a10e8f560d6e61b2e3: start","job_status":"start","queue_duration_s":1.444289,"scheduling_latency_s":1.444315}1404gitlab # [ 145.383800] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.392Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4019d2a10e8f560d6e61b2e3","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4019d2a10e8f560d6e61b2e3: done: 0.011134 sec","job_status":"done","queue_duration_s":1.444289,"scheduling_latency_s":1.444315,"redis_calls":13,"redis_duration_s":0.001642,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001113,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006692,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011134,"completed_at":"2026-08-20T05:55:36.392Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1405gitlab # [ 145.443707] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.393Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28708df792531ad16c4c7f24","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28708df792531ad16c4c7f24: start","job_status":"start","queue_duration_s":1.456332,"scheduling_latency_s":1.456348}1406gitlab # [ 145.444429] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.404Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28708df792531ad16c4c7f24","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28708df792531ad16c4c7f24: done: 0.010664 sec","job_status":"done","queue_duration_s":1.456332,"scheduling_latency_s":1.456348,"redis_calls":13,"redis_duration_s":0.0015739999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001018,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00639,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010664,"completed_at":"2026-08-20T05:55:36.404Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407gitlab # [ 145.455260] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.405Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee3d701f8a653194cb49e32a","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee3d701f8a653194cb49e32a: start","job_status":"start","queue_duration_s":1.468367,"scheduling_latency_s":1.468384}1408gitlab # [ 145.465225] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.416Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee3d701f8a653194cb49e32a","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee3d701f8a653194cb49e32a: done: 0.010473 sec","job_status":"done","queue_duration_s":1.468367,"scheduling_latency_s":1.468384,"redis_calls":13,"redis_duration_s":0.001557,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001042,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006695,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010473,"completed_at":"2026-08-20T05:55:36.415Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409gitlab # [ 145.517125] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.417Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3472799ccbe7df40ac545a23","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3472799ccbe7df40ac545a23: start","job_status":"start","queue_duration_s":1.479806,"scheduling_latency_s":1.47982}1410gitlab # [ 145.517780] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.426Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3472799ccbe7df40ac545a23","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3472799ccbe7df40ac545a23: done: 0.009705 sec","job_status":"done","queue_duration_s":1.479806,"scheduling_latency_s":1.47982,"redis_calls":13,"redis_duration_s":0.001535,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001027,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006216,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009705,"completed_at":"2026-08-20T05:55:36.426Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 145.536267] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.427Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"61b1a8596ef7540b0a17bc6a","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-61b1a8596ef7540b0a17bc6a: start","job_status":"start","queue_duration_s":1.49037,"scheduling_latency_s":1.490383}1412gitlab # [ 145.570675] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.437Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"61b1a8596ef7540b0a17bc6a","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-61b1a8596ef7540b0a17bc6a: done: 0.009511 sec","job_status":"done","queue_duration_s":1.49037,"scheduling_latency_s":1.490383,"redis_calls":13,"redis_duration_s":0.001693,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000495,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001198,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006211,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009511,"completed_at":"2026-08-20T05:55:36.437Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 145.576260] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.438Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ae93f27d8782faf59d4e5c1","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ae93f27d8782faf59d4e5c1: start","job_status":"start","queue_duration_s":1.50078,"scheduling_latency_s":1.500792}1414gitlab # [ 145.613798] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.447Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ae93f27d8782faf59d4e5c1","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ae93f27d8782faf59d4e5c1: done: 0.009361 sec","job_status":"done","queue_duration_s":1.50078,"scheduling_latency_s":1.500792,"redis_calls":13,"redis_duration_s":0.001532,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000488,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001044,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005673,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009361,"completed_at":"2026-08-20T05:55:36.447Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 145.616232] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.448Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb048a7dbf661ba36d3ca022","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb048a7dbf661ba36d3ca022: start","job_status":"start","queue_duration_s":1.510944,"scheduling_latency_s":1.510956}1416gitlab # [ 145.626095] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.457Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb048a7dbf661ba36d3ca022","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb048a7dbf661ba36d3ca022: done: 0.009017 sec","job_status":"done","queue_duration_s":1.510944,"scheduling_latency_s":1.510956,"redis_calls":13,"redis_duration_s":0.0014489999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000463,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006086,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009017,"completed_at":"2026-08-20T05:55:36.457Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417gitlab # [ 145.657695] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.457Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df64249b50de1688eb5392c6","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df64249b50de1688eb5392c6: start","job_status":"start","queue_duration_s":1.520777,"scheduling_latency_s":1.52079}1418gitlab # [ 145.692617] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.467Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df64249b50de1688eb5392c6","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df64249b50de1688eb5392c6: done: 0.009075 sec","job_status":"done","queue_duration_s":1.520777,"scheduling_latency_s":1.52079,"redis_calls":13,"redis_duration_s":0.001543,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001036,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009075,"completed_at":"2026-08-20T05:55:36.467Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 145.697033] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.467Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee977d7a03ffde4876ca5b5c","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee977d7a03ffde4876ca5b5c: start","job_status":"start","queue_duration_s":1.53075,"scheduling_latency_s":1.530764}1420gitlab # [ 145.706823] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.477Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee977d7a03ffde4876ca5b5c","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee977d7a03ffde4876ca5b5c: done: 0.009705 sec","job_status":"done","queue_duration_s":1.53075,"scheduling_latency_s":1.530764,"redis_calls":13,"redis_duration_s":0.001551,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001041,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005803,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009705,"completed_at":"2026-08-20T05:55:36.477Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421gitlab # [ 145.753878] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.478Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5d552c7bce5f6dbd844472e","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5d552c7bce5f6dbd844472e: start","job_status":"start","queue_duration_s":1.541705,"scheduling_latency_s":1.541718}1422gitlab # [ 145.754528] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.488Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5d552c7bce5f6dbd844472e","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5d552c7bce5f6dbd844472e: done: 0.009234 sec","job_status":"done","queue_duration_s":1.541705,"scheduling_latency_s":1.541718,"redis_calls":13,"redis_duration_s":0.001522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005913,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009234,"completed_at":"2026-08-20T05:55:36.488Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423gitlab # [ 145.778035] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.489Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44d41f83126682bcc1b4c4fe","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44d41f83126682bcc1b4c4fe: start","job_status":"start","queue_duration_s":1.551842,"scheduling_latency_s":1.551855}1424gitlab # [ 145.788020] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.498Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44d41f83126682bcc1b4c4fe","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44d41f83126682bcc1b4c4fe: done: 0.009214 sec","job_status":"done","queue_duration_s":1.551842,"scheduling_latency_s":1.551855,"redis_calls":13,"redis_duration_s":0.001539,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001025,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005966,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009214,"completed_at":"2026-08-20T05:55:36.498Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 145.824092] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.499Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6545650d46b6b0ff6a948189","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6545650d46b6b0ff6a948189: start","job_status":"start","queue_duration_s":1.561875,"scheduling_latency_s":1.561887}1426gitlab # [ 145.828128] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.508Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6545650d46b6b0ff6a948189","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6545650d46b6b0ff6a948189: done: 0.009178 sec","job_status":"done","queue_duration_s":1.561875,"scheduling_latency_s":1.561887,"redis_calls":13,"redis_duration_s":0.0015329999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00048,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001053,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009178,"completed_at":"2026-08-20T05:55:36.508Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427gitlab # [ 145.859669] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.509Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f790148d94b3703de43159e","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f790148d94b3703de43159e: start","job_status":"start","queue_duration_s":1.571867,"scheduling_latency_s":1.57188}1428gitlab # [ 145.869787] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.518Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f790148d94b3703de43159e","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f790148d94b3703de43159e: done: 0.00906 sec","job_status":"done","queue_duration_s":1.571867,"scheduling_latency_s":1.57188,"redis_calls":13,"redis_duration_s":0.0014880000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000486,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001002,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005495,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00906,"completed_at":"2026-08-20T05:55:36.518Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1429gitlab # [ 145.904977] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.519Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e2441306cd0a155a6eb69332","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e2441306cd0a155a6eb69332: start","job_status":"start","queue_duration_s":1.582148,"scheduling_latency_s":1.582161}1430gitlab # [ 145.941510] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.528Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e2441306cd0a155a6eb69332","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e2441306cd0a155a6eb69332: done: 0.009462 sec","job_status":"done","queue_duration_s":1.582148,"scheduling_latency_s":1.582161,"redis_calls":13,"redis_duration_s":0.001521,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000497,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001024,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006162,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009462,"completed_at":"2026-08-20T05:55:36.528Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1431gitlab # [ 145.942535] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.529Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"636f5f7ba6db6816473c30bd","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-636f5f7ba6db6816473c30bd: start","job_status":"start","queue_duration_s":1.592478,"scheduling_latency_s":1.5925}1432gitlab # [ 145.979112] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.538Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"636f5f7ba6db6816473c30bd","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-636f5f7ba6db6816473c30bd: done: 0.009261 sec","job_status":"done","queue_duration_s":1.592478,"scheduling_latency_s":1.5925,"redis_calls":13,"redis_duration_s":0.001818,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001305,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009261,"completed_at":"2026-08-20T05:55:36.538Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433gitlab # [ 145.981440] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.539Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04e1f346a20c4f17862eb10a","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04e1f346a20c4f17862eb10a: start","job_status":"start","queue_duration_s":1.602613,"scheduling_latency_s":1.602626}1434gitlab # [ 145.991396] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.549Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04e1f346a20c4f17862eb10a","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04e1f346a20c4f17862eb10a: done: 0.009426 sec","job_status":"done","queue_duration_s":1.602613,"scheduling_latency_s":1.602626,"redis_calls":13,"redis_duration_s":0.001767,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001253,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006017,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009426,"completed_at":"2026-08-20T05:55:36.549Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435gitlab # [ 146.051167] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.550Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c5527db29c184dbc5445f4b","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c5527db29c184dbc5445f4b: start","job_status":"start","queue_duration_s":1.612857,"scheduling_latency_s":1.61287}1436gitlab # [ 146.051824] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.559Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c5527db29c184dbc5445f4b","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c5527db29c184dbc5445f4b: done: 0.009174 sec","job_status":"done","queue_duration_s":1.612857,"scheduling_latency_s":1.61287,"redis_calls":13,"redis_duration_s":0.0014949999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000481,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001014,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005612,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009174,"completed_at":"2026-08-20T05:55:36.559Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437gitlab # [ 146.063437] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.560Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f23b88c07a1ee1e349bd916c","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f23b88c07a1ee1e349bd916c: start","job_status":"start","queue_duration_s":1.623249,"scheduling_latency_s":1.623261}1438gitlab # [ 146.073482] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.569Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f23b88c07a1ee1e349bd916c","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f23b88c07a1ee1e349bd916c: done: 0.009425 sec","job_status":"done","queue_duration_s":1.623249,"scheduling_latency_s":1.623261,"redis_calls":13,"redis_duration_s":0.001536,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000474,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001062,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00634,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009425,"completed_at":"2026-08-20T05:55:36.569Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439gitlab # [ 146.123574] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.570Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a2aaa570daa6e5af8b05b134","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a2aaa570daa6e5af8b05b134: start","job_status":"start","queue_duration_s":1.633557,"scheduling_latency_s":1.633569}1440gitlab # [ 146.124299] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.580Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a2aaa570daa6e5af8b05b134","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a2aaa570daa6e5af8b05b134: done: 0.00927 sec","job_status":"done","queue_duration_s":1.633557,"scheduling_latency_s":1.633569,"redis_calls":13,"redis_duration_s":0.00197,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000464,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001506,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006376,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00927,"completed_at":"2026-08-20T05:55:36.579Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441gitlab # [ 146.177089] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.580Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5bcaf71a15ad2c45cf89a23b","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5bcaf71a15ad2c45cf89a23b: start","job_status":"start","queue_duration_s":1.643617,"scheduling_latency_s":1.64363}1442gitlab # [ 146.177746] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.590Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5bcaf71a15ad2c45cf89a23b","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5bcaf71a15ad2c45cf89a23b: done: 0.009205 sec","job_status":"done","queue_duration_s":1.643617,"scheduling_latency_s":1.64363,"redis_calls":13,"redis_duration_s":0.001372,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000457,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000915,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006296,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009205,"completed_at":"2026-08-20T05:55:36.589Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1443gitlab # [ 146.185675] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.590Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"95eec17f7d6f41a7c81d3e26","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-95eec17f7d6f41a7c81d3e26: start","job_status":"start","queue_duration_s":1.653703,"scheduling_latency_s":1.653716}1444gitlab # [ 146.195610] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.600Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"95eec17f7d6f41a7c81d3e26","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-95eec17f7d6f41a7c81d3e26: done: 0.009772 sec","job_status":"done","queue_duration_s":1.653703,"scheduling_latency_s":1.653716,"redis_calls":13,"redis_duration_s":0.0014860000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000484,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001002,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005563,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009772,"completed_at":"2026-08-20T05:55:36.600Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445gitlab # [ 146.255736] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.601Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06b259c085d037fb475e1aa8","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06b259c085d037fb475e1aa8: start","job_status":"start","queue_duration_s":1.664313,"scheduling_latency_s":1.664326}1446gitlab # [ 146.256581] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.610Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06b259c085d037fb475e1aa8","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06b259c085d037fb475e1aa8: done: 0.009287 sec","job_status":"done","queue_duration_s":1.664313,"scheduling_latency_s":1.664326,"redis_calls":13,"redis_duration_s":0.001572,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001066,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006004,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009287,"completed_at":"2026-08-20T05:55:36.610Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1447gitlab # [ 146.267543] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.611Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e3917d764fafa45c94ac4ad","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e3917d764fafa45c94ac4ad: start","job_status":"start","queue_duration_s":1.67445,"scheduling_latency_s":1.674463}1448gitlab # [ 146.277537] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.620Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e3917d764fafa45c94ac4ad","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e3917d764fafa45c94ac4ad: done: 0.009143 sec","job_status":"done","queue_duration_s":1.67445,"scheduling_latency_s":1.674463,"redis_calls":13,"redis_duration_s":0.0016799999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000658,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005833,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009143,"completed_at":"2026-08-20T05:55:36.620Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449gitlab # [ 146.339524] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.621Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9690111cc6303336d29be1ec","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9690111cc6303336d29be1ec: start","job_status":"start","queue_duration_s":1.684433,"scheduling_latency_s":1.684446}1450gitlab # [ 146.340218] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.630Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9690111cc6303336d29be1ec","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9690111cc6303336d29be1ec: done: 0.008965 sec","job_status":"done","queue_duration_s":1.684433,"scheduling_latency_s":1.684446,"redis_calls":13,"redis_duration_s":0.001495,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000995,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005603,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008965,"completed_at":"2026-08-20T05:55:36.630Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 146.349020] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.631Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f36b25d792be18d59113175b","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f36b25d792be18d59113175b: start","job_status":"start","queue_duration_s":1.694308,"scheduling_latency_s":1.694322}1452gitlab # [ 146.358965] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.640Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f36b25d792be18d59113175b","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f36b25d792be18d59113175b: done: 0.009142 sec","job_status":"done","queue_duration_s":1.694308,"scheduling_latency_s":1.694322,"redis_calls":13,"redis_duration_s":0.001608,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000589,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001019,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005861,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009142,"completed_at":"2026-08-20T05:55:36.640Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453gitlab # [ 146.410795] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.641Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf96f583889c648f15619327","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf96f583889c648f15619327: start","job_status":"start","queue_duration_s":1.704311,"scheduling_latency_s":1.704324}1454gitlab # [ 146.411668] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.650Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf96f583889c648f15619327","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf96f583889c648f15619327: done: 0.00911 sec","job_status":"done","queue_duration_s":1.704311,"scheduling_latency_s":1.704324,"redis_calls":13,"redis_duration_s":0.0015080000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001002,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005795,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00911,"completed_at":"2026-08-20T05:55:36.650Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455gitlab # [ 146.430468] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.651Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f72332187f974bc2f6c2ac3b","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f72332187f974bc2f6c2ac3b: start","job_status":"start","queue_duration_s":1.714264,"scheduling_latency_s":1.714277}1456gitlab # [ 146.440118] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.660Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f72332187f974bc2f6c2ac3b","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f72332187f974bc2f6c2ac3b: done: 0.009139 sec","job_status":"done","queue_duration_s":1.714264,"scheduling_latency_s":1.714277,"redis_calls":13,"redis_duration_s":0.001546,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001011,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005877,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009139,"completed_at":"2026-08-20T05:55:36.660Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457gitlab # [ 146.482686] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.661Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c0e9721c7c93275e37ba48e","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c0e9721c7c93275e37ba48e: start","job_status":"start","queue_duration_s":1.724275,"scheduling_latency_s":1.724289}1458gitlab # [ 146.483520] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.670Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c0e9721c7c93275e37ba48e","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c0e9721c7c93275e37ba48e: done: 0.00922 sec","job_status":"done","queue_duration_s":1.724275,"scheduling_latency_s":1.724289,"redis_calls":13,"redis_duration_s":0.001565,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001063,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005681,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00922,"completed_at":"2026-08-20T05:55:36.670Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459gitlab # [ 146.529639] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.672Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0d9a3544f369d0a45e0ca4d","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0d9a3544f369d0a45e0ca4d: start","job_status":"start","queue_duration_s":1.734943,"scheduling_latency_s":1.734957}1460gitlab # [ 146.530179] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.685Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0d9a3544f369d0a45e0ca4d","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0d9a3544f369d0a45e0ca4d: done: 0.013664 sec","job_status":"done","queue_duration_s":1.734943,"scheduling_latency_s":1.734957,"redis_calls":13,"redis_duration_s":0.0028320000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000606,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002226,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006461,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013664,"completed_at":"2026-08-20T05:55:36.685Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1461gitlab # [ 146.551673] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.686Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"376909b5596bd4618eed57b4","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-376909b5596bd4618eed57b4: start","job_status":"start","queue_duration_s":1.74953,"scheduling_latency_s":1.749545}1462gitlab # [ 146.590673] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.696Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"376909b5596bd4618eed57b4","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-376909b5596bd4618eed57b4: done: 0.009947 sec","job_status":"done","queue_duration_s":1.74953,"scheduling_latency_s":1.749545,"redis_calls":13,"redis_duration_s":0.0015340000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001028,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009947,"completed_at":"2026-08-20T05:55:36.696Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463gitlab # [ 146.591765] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.697Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b91b9c4ac68432fc208b49de","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b91b9c4ac68432fc208b49de: start","job_status":"start","queue_duration_s":1.76036,"scheduling_latency_s":1.760374}1464gitlab # [ 146.628927] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.706Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b91b9c4ac68432fc208b49de","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b91b9c4ac68432fc208b49de: done: 0.009261 sec","job_status":"done","queue_duration_s":1.76036,"scheduling_latency_s":1.760374,"redis_calls":13,"redis_duration_s":0.001481,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00048,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005962,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009261,"completed_at":"2026-08-20T05:55:36.706Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1465gitlab # [ 146.631802] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.707Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a26f263102fe590f7104770","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a26f263102fe590f7104770: start","job_status":"start","queue_duration_s":1.770475,"scheduling_latency_s":1.770497}1466gitlab # [ 146.641820] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.716Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a26f263102fe590f7104770","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a26f263102fe590f7104770: done: 0.009225 sec","job_status":"done","queue_duration_s":1.770475,"scheduling_latency_s":1.770497,"redis_calls":13,"redis_duration_s":0.001496,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000482,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001014,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005654,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009225,"completed_at":"2026-08-20T05:55:36.716Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1467gitlab # [ 146.678878] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.717Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"25b48051841825535c1c3cc9","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-25b48051841825535c1c3cc9: start","job_status":"start","queue_duration_s":1.780576,"scheduling_latency_s":1.78059}1468gitlab # [ 146.681729] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.726Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"25b48051841825535c1c3cc9","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-25b48051841825535c1c3cc9: done: 0.009011 sec","job_status":"done","queue_duration_s":1.780576,"scheduling_latency_s":1.78059,"redis_calls":13,"redis_duration_s":0.001522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00048,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001042,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005749,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009011,"completed_at":"2026-08-20T05:55:36.726Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1469gitlab # [ 146.736668] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.727Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b85b6864a6a509ac1284350","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b85b6864a6a509ac1284350: start","job_status":"start","queue_duration_s":1.790444,"scheduling_latency_s":1.790457}1470gitlab # [ 146.737428] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.736Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b85b6864a6a509ac1284350","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b85b6864a6a509ac1284350: done: 0.009331 sec","job_status":"done","queue_duration_s":1.790444,"scheduling_latency_s":1.790457,"redis_calls":13,"redis_duration_s":0.001545,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001015,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006055,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009331,"completed_at":"2026-08-20T05:55:36.736Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1471gitlab # [ 146.752941] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.737Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d241ab3416e0dff7250e36f","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d241ab3416e0dff7250e36f: start","job_status":"start","queue_duration_s":1.800641,"scheduling_latency_s":1.800654}1472gitlab # [ 146.762957] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.746Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d241ab3416e0dff7250e36f","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d241ab3416e0dff7250e36f: done: 0.00903 sec","job_status":"done","queue_duration_s":1.800641,"scheduling_latency_s":1.800654,"redis_calls":13,"redis_duration_s":0.001486,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005655,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00903,"completed_at":"2026-08-20T05:55:36.746Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1473gitlab # [ 146.813961] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.747Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f7594d63546fa0227e7f149","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f7594d63546fa0227e7f149: start","job_status":"start","queue_duration_s":1.810676,"scheduling_latency_s":1.810689}1474gitlab # [ 146.814568] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.757Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f7594d63546fa0227e7f149","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f7594d63546fa0227e7f149: done: 0.009535 sec","job_status":"done","queue_duration_s":1.810676,"scheduling_latency_s":1.810689,"redis_calls":13,"redis_duration_s":0.001792,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001292,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005936,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009535,"completed_at":"2026-08-20T05:55:36.757Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1475gitlab # [ 146.857631] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.758Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb1beb63e784b35c62e83900","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb1beb63e784b35c62e83900: start","job_status":"start","queue_duration_s":1.821082,"scheduling_latency_s":1.821096}1476gitlab # [ 146.858294] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.767Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb1beb63e784b35c62e83900","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb1beb63e784b35c62e83900: done: 0.00913 sec","job_status":"done","queue_duration_s":1.821082,"scheduling_latency_s":1.821096,"redis_calls":13,"redis_duration_s":0.001653,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000489,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001164,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005842,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00913,"completed_at":"2026-08-20T05:55:36.767Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1477gitlab # [ 146.900451] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.768Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c0b8511767ec757951d38c4","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c0b8511767ec757951d38c4: start","job_status":"start","queue_duration_s":1.83109,"scheduling_latency_s":1.831103}1478gitlab # [ 146.901087] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.777Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c0b8511767ec757951d38c4","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c0b8511767ec757951d38c4: done: 0.009308 sec","job_status":"done","queue_duration_s":1.83109,"scheduling_latency_s":1.831103,"redis_calls":13,"redis_duration_s":0.001643,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000635,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001008,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005878,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009308,"completed_at":"2026-08-20T05:55:36.777Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1479gitlab # [ 146.913808] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.778Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f13b5c6d38f07d2ce07c8fe9","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f13b5c6d38f07d2ce07c8fe9: start","job_status":"start","queue_duration_s":1.84128,"scheduling_latency_s":1.841293}1480gitlab # [ 146.923606] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.787Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f13b5c6d38f07d2ce07c8fe9","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f13b5c6d38f07d2ce07c8fe9: done: 0.009093 sec","job_status":"done","queue_duration_s":1.84128,"scheduling_latency_s":1.841293,"redis_calls":13,"redis_duration_s":0.001513,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00048,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001033,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005661,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009093,"completed_at":"2026-08-20T05:55:36.787Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1481gitlab # [ 146.976824] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.788Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d4d5b9596254a7f39fed68e","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d4d5b9596254a7f39fed68e: start","job_status":"start","queue_duration_s":1.851418,"scheduling_latency_s":1.851431}1482gitlab # [ 146.977440] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.797Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d4d5b9596254a7f39fed68e","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d4d5b9596254a7f39fed68e: done: 0.00906 sec","job_status":"done","queue_duration_s":1.851418,"scheduling_latency_s":1.851431,"redis_calls":13,"redis_duration_s":0.00169,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000709,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000981,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005808,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00906,"completed_at":"2026-08-20T05:55:36.797Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1483gitlab # [ 146.994733] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.798Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d3ca844fa1ee4fbeb6ee07f","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d3ca844fa1ee4fbeb6ee07f: start","job_status":"start","queue_duration_s":1.861424,"scheduling_latency_s":1.861437}1484gitlab # [ 147.004517] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.807Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d3ca844fa1ee4fbeb6ee07f","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d3ca844fa1ee4fbeb6ee07f: done: 0.009143 sec","job_status":"done","queue_duration_s":1.861424,"scheduling_latency_s":1.861437,"redis_calls":13,"redis_duration_s":0.0015149999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005863,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009143,"completed_at":"2026-08-20T05:55:36.807Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1485gitlab # [ 147.051695] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.808Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bfe34cd710db1c0a33bae314","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bfe34cd710db1c0a33bae314: start","job_status":"start","queue_duration_s":1.871429,"scheduling_latency_s":1.871443}1486gitlab # [ 147.052482] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.820Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bfe34cd710db1c0a33bae314","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bfe34cd710db1c0a33bae314: done: 0.01181 sec","job_status":"done","queue_duration_s":1.871429,"scheduling_latency_s":1.871443,"redis_calls":13,"redis_duration_s":0.002051,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000685,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001366,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007995,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01181,"completed_at":"2026-08-20T05:55:36.820Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1487gitlab # [ 147.075684] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.821Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a44dba586511dd3c739546e2","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a44dba586511dd3c739546e2: start","job_status":"start","queue_duration_s":1.884323,"scheduling_latency_s":1.884343}1488gitlab # [ 147.109606] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.831Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a44dba586511dd3c739546e2","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a44dba586511dd3c739546e2: done: 0.009804 sec","job_status":"done","queue_duration_s":1.884323,"scheduling_latency_s":1.884343,"redis_calls":13,"redis_duration_s":0.001482,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000477,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001005,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006139,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009804,"completed_at":"2026-08-20T05:55:36.831Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1489gitlab # [ 147.115547] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.832Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"290dcf06620dccaf7ddb5abd","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-290dcf06620dccaf7ddb5abd: start","job_status":"start","queue_duration_s":1.895103,"scheduling_latency_s":1.895145}1490gitlab # [ 147.154790] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.841Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"290dcf06620dccaf7ddb5abd","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-290dcf06620dccaf7ddb5abd: done: 0.008987 sec","job_status":"done","queue_duration_s":1.895103,"scheduling_latency_s":1.895145,"redis_calls":13,"redis_duration_s":0.001464,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000474,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00099,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008987,"completed_at":"2026-08-20T05:55:36.841Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1491gitlab # [ 147.155873] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.842Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b235bd6a38441eaa3d43186","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b235bd6a38441eaa3d43186: start","job_status":"start","queue_duration_s":1.904927,"scheduling_latency_s":1.90494}1492gitlab # [ 147.193706] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.854Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b235bd6a38441eaa3d43186","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b235bd6a38441eaa3d43186: done: 0.012265 sec","job_status":"done","queue_duration_s":1.904927,"scheduling_latency_s":1.90494,"redis_calls":13,"redis_duration_s":0.0035510000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002291,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00126,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006998,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012265,"completed_at":"2026-08-20T05:55:36.854Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1493gitlab # [ 147.196051] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.855Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ef07642685c1e3044c6b373","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ef07642685c1e3044c6b373: start","job_status":"start","queue_duration_s":1.918238,"scheduling_latency_s":1.918255}1494gitlab # [ 147.234824] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.864Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ef07642685c1e3044c6b373","created_at":"2026-08-20T05:55:34.858Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-3ab8dd48cd5c498b","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c38c3970c9404d086ff1510ea27a29c1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:34.937Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ef07642685c1e3044c6b373: done: 0.009494 sec","job_status":"done","queue_duration_s":1.918238,"scheduling_latency_s":1.918255,"redis_calls":13,"redis_duration_s":0.001525,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00101,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005908,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009494,"completed_at":"2026-08-20T05:55:36.864Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1495gitlab # [ 147.236251] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:36.865Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4986466a6bdf78b62c8003f1","created_at":"2026-08-20T05:55:35.153Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-b5991cb818204cc4","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e2e984853e54600be20e2c46199630cc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:35.169Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4986466a6bdf78b62c8003f1: start","job_status":"start","queue_duration_s":1.696161,"scheduling_latency_s":1.696174}1496gitlab # [ 147.271658] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:37.907Z","message":"No existing merge request to be cleaned up."}1497gitlab # [ 147.272461] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:37.915Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4986466a6bdf78b62c8003f1","created_at":"2026-08-20T05:55:35.153Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-b5991cb818204cc4","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e2e984853e54600be20e2c46199630cc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:35.169Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4986466a6bdf78b62c8003f1: done: 1.049736 sec","job_status":"done","queue_duration_s":1.696161,"scheduling_latency_s":1.696174,"redis_calls":13,"redis_duration_s":0.0018119999999999998,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000361,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000619,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000832,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":1.03,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":1.03,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015293,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022461,"duration_s":1.049736,"completed_at":"2026-08-20T05:55:37.915Z","load_balancing_strategy":"primary","db_duration_s":1.03132,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498gitlab # [ 147.278614] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:37.916Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7dbba6091634ce54db809164","created_at":"2026-08-20T05:55:35.153Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-b5991cb818204cc4","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e2e984853e54600be20e2c46199630cc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:35.169Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7dbba6091634ce54db809164: start","job_status":"start","queue_duration_s":2.746868,"scheduling_latency_s":2.746883}1499gitlab # [ 147.288630] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:37.927Z","message":"No existing merge request to be cleaned up."}1500gitlab # [ 147.289748] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:37.937Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7dbba6091634ce54db809164","created_at":"2026-08-20T05:55:35.153Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-b5991cb818204cc4","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e2e984853e54600be20e2c46199630cc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:35.169Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7dbba6091634ce54db809164: done: 0.020894 sec","job_status":"done","queue_duration_s":2.746868,"scheduling_latency_s":2.746883,"redis_calls":10,"redis_duration_s":0.005933000000000001,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001311,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.004622,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007487,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020894,"completed_at":"2026-08-20T05:55:37.937Z","load_balancing_strategy":"primary","db_duration_s":0.009492,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1501gitlab # [ 147.336525] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:37.940Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c4eb17ce40e91104ff0ba569","created_at":"2026-08-20T05:55:35.153Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-b5991cb818204cc4","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e2e984853e54600be20e2c46199630cc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:35.169Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c4eb17ce40e91104ff0ba569: start","job_status":"start","queue_duration_s":2.770995,"scheduling_latency_s":2.77101}1502gitlab # [ 147.337079] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:37.951Z","message":"No existing merge request to be cleaned up."}1503gitlab # [ 147.337531] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:37.959Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c4eb17ce40e91104ff0ba569","created_at":"2026-08-20T05:55:35.153Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-b5991cb818204cc4","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e2e984853e54600be20e2c46199630cc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:35.169Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c4eb17ce40e91104ff0ba569: done: 0.019259 sec","job_status":"done","queue_duration_s":2.770995,"scheduling_latency_s":2.77101,"redis_calls":10,"redis_duration_s":0.006941,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002452,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.004489,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007426,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019259,"completed_at":"2026-08-20T05:55:37.959Z","load_balancing_strategy":"primary","db_duration_s":0.003024,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1504gitlab # [ 147.377938] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:37.962Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"43cf182e05df5c5ea1a8cb9f","created_at":"2026-08-20T05:55:35.153Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-b5991cb818204cc4","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e2e984853e54600be20e2c46199630cc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:35.169Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-43cf182e05df5c5ea1a8cb9f: start","job_status":"start","queue_duration_s":2.7929,"scheduling_latency_s":2.792915}1505gitlab # [ 147.378570] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:37.969Z","message":"No existing merge request to be cleaned up."}1506gitlab # [ 147.379049] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:37.973Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"43cf182e05df5c5ea1a8cb9f","created_at":"2026-08-20T05:55:35.153Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-b5991cb818204cc4","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e2e984853e54600be20e2c46199630cc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:35.169Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-43cf182e05df5c5ea1a8cb9f: done: 0.011225 sec","job_status":"done","queue_duration_s":2.7929,"scheduling_latency_s":2.792915,"redis_calls":10,"redis_duration_s":0.001191,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000479,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000712,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006971,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011225,"completed_at":"2026-08-20T05:55:37.973Z","load_balancing_strategy":"primary","db_duration_s":0.000944,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507gitlab # [ 147.420119] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:37.974Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"236ef9658f08c635c64f6316","created_at":"2026-08-20T05:55:36.010Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-0017bff5c87440f0","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931ae4cfc93552051ad29cf374846fde","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:36.023Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-236ef9658f08c635c64f6316: start","job_status":"start","queue_duration_s":1.951197,"scheduling_latency_s":1.95121}1508gitlab # [ 147.420766] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:37.997Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"236ef9658f08c635c64f6316","created_at":"2026-08-20T05:55:36.010Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-0017bff5c87440f0","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931ae4cfc93552051ad29cf374846fde","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:36.023Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-236ef9658f08c635c64f6316: done: 0.023129 sec","job_status":"done","queue_duration_s":1.951197,"scheduling_latency_s":1.95121,"redis_calls":16,"redis_duration_s":0.002092,"redis_read_bytes":14,"redis_write_bytes":1526,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000234,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00059,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":423,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001268,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":802,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012756,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000205892,"duration_s":0.023129,"completed_at":"2026-08-20T05:55:37.997Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005879,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1509gitlab # [ 147.469759] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:37.999Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"ccc6487a8b470e57614d2fac","created_at":"2026-08-20T05:55:36.010Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-0017bff5c87440f0","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931ae4cfc93552051ad29cf374846fde","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:36.023Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-ccc6487a8b470e57614d2fac: start","job_status":"start","queue_duration_s":1.975752,"scheduling_latency_s":1.975765}1510gitlab # [ 147.470464] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:38.018Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"ccc6487a8b470e57614d2fac","created_at":"2026-08-20T05:55:36.010Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-0017bff5c87440f0","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931ae4cfc93552051ad29cf374846fde","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:36.023Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-ccc6487a8b470e57614d2fac: done: 0.019769 sec","job_status":"done","queue_duration_s":1.975752,"scheduling_latency_s":1.975765,"redis_calls":13,"redis_duration_s":0.008316,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002138,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006178,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006478,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019769,"completed_at":"2026-08-20T05:55:38.018Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003306,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1511gitlab # [ 147.486213] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:38.021Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"60e47438c0ecb5def01f04a2","created_at":"2026-08-20T05:55:36.010Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-0017bff5c87440f0","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931ae4cfc93552051ad29cf374846fde","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:36.023Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-60e47438c0ecb5def01f04a2: start","job_status":"start","queue_duration_s":1.998205,"scheduling_latency_s":1.998219}1512gitlab # [ 147.529753] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:38.036Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"60e47438c0ecb5def01f04a2","created_at":"2026-08-20T05:55:36.010Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-0017bff5c87440f0","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931ae4cfc93552051ad29cf374846fde","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:36.023Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-60e47438c0ecb5def01f04a2: done: 0.015316 sec","job_status":"done","queue_duration_s":1.998205,"scheduling_latency_s":1.998219,"redis_calls":13,"redis_duration_s":0.00544,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003898,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006294,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015316,"completed_at":"2026-08-20T05:55:38.036Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001122,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1513gitlab # [ 147.530615] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:38.037Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"dfdb1cfcb210de3f068e3116","created_at":"2026-08-20T05:55:36.010Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-0017bff5c87440f0","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931ae4cfc93552051ad29cf374846fde","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:36.023Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-dfdb1cfcb210de3f068e3116: start","job_status":"start","queue_duration_s":2.014388,"scheduling_latency_s":2.014402}1514gitlab # [ 147.537802] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:38.047Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"dfdb1cfcb210de3f068e3116","created_at":"2026-08-20T05:55:36.010Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-0017bff5c87440f0","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931ae4cfc93552051ad29cf374846fde","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:36.023Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-dfdb1cfcb210de3f068e3116: done: 0.00938 sec","job_status":"done","queue_duration_s":2.014388,"scheduling_latency_s":2.014402,"redis_calls":13,"redis_duration_s":0.001482,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00048,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001002,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005993,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.00938,"completed_at":"2026-08-20T05:55:38.047Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00047,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1515gitlab # [ 147.578991] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:38.047Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"b4d255df2aed161ff22087b8","created_at":"2026-08-20T05:55:36.010Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-0017bff5c87440f0","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931ae4cfc93552051ad29cf374846fde","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:36.023Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-b4d255df2aed161ff22087b8: start","job_status":"start","queue_duration_s":2.024571,"scheduling_latency_s":2.024583}1516gitlab # [ 147.580566] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:38.058Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"b4d255df2aed161ff22087b8","created_at":"2026-08-20T05:55:36.010Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-0017bff5c87440f0","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931ae4cfc93552051ad29cf374846fde","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:36.023Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-b4d255df2aed161ff22087b8: done: 0.010723 sec","job_status":"done","queue_duration_s":2.024571,"scheduling_latency_s":2.024583,"redis_calls":13,"redis_duration_s":0.0027340000000000003,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00223,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006087,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010723,"completed_at":"2026-08-20T05:55:38.058Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00056,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1517gitlab # [ 147.623074] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:38.059Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"c2be61817b74758525af8b1d","created_at":"2026-08-20T05:55:36.010Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-0017bff5c87440f0","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931ae4cfc93552051ad29cf374846fde","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:36.023Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-c2be61817b74758525af8b1d: start","job_status":"start","queue_duration_s":2.036108,"scheduling_latency_s":2.036121}1518gitlab # [ 147.623675] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:38.068Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"c2be61817b74758525af8b1d","created_at":"2026-08-20T05:55:36.010Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-0017bff5c87440f0","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931ae4cfc93552051ad29cf374846fde","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:36.023Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-c2be61817b74758525af8b1d: done: 0.009312 sec","job_status":"done","queue_duration_s":2.036108,"scheduling_latency_s":2.036121,"redis_calls":13,"redis_duration_s":0.001421,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00045,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000971,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005959,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009312,"completed_at":"2026-08-20T05:55:38.068Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000472,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1519gitlab # [ 147.673964] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:38.069Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"7fae70bb77c5e847396f3d4d","created_at":"2026-08-20T05:55:36.010Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-0017bff5c87440f0","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931ae4cfc93552051ad29cf374846fde","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:36.023Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-7fae70bb77c5e847396f3d4d: start","job_status":"start","queue_duration_s":2.046237,"scheduling_latency_s":2.046249}1520gitlab # [ 147.674578] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:38.090Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"7fae70bb77c5e847396f3d4d","created_at":"2026-08-20T05:55:36.010Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-0017bff5c87440f0","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931ae4cfc93552051ad29cf374846fde","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:36.023Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-7fae70bb77c5e847396f3d4d: done: 0.021176 sec","job_status":"done","queue_duration_s":2.046237,"scheduling_latency_s":2.046249,"redis_calls":13,"redis_duration_s":0.010741,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001229,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.009512,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006287,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021176,"completed_at":"2026-08-20T05:55:38.090Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002798,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1521gitlab # [ 147.729330] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:38.093Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"5aa265ed36033e3381e04a8b","created_at":"2026-08-20T05:55:36.010Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-0017bff5c87440f0","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931ae4cfc93552051ad29cf374846fde","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:36.023Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-5aa265ed36033e3381e04a8b: start","job_status":"start","queue_duration_s":2.070259,"scheduling_latency_s":2.070273}1522gitlab # [ 147.729942] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:38.104Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"5aa265ed36033e3381e04a8b","created_at":"2026-08-20T05:55:36.010Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-0017bff5c87440f0","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931ae4cfc93552051ad29cf374846fde","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:36.023Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-5aa265ed36033e3381e04a8b: done: 0.010811 sec","job_status":"done","queue_duration_s":2.070259,"scheduling_latency_s":2.070273,"redis_calls":13,"redis_duration_s":0.002057,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000647,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00141,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006066,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010811,"completed_at":"2026-08-20T05:55:38.104Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000415,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1523gitlab # [ 147.766921] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:38.105Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"1650b63413f80dc57426ffa6","created_at":"2026-08-20T05:55:36.010Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-0017bff5c87440f0","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931ae4cfc93552051ad29cf374846fde","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:36.023Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-1650b63413f80dc57426ffa6: start","job_status":"start","queue_duration_s":2.081851,"scheduling_latency_s":2.081864}1524gitlab # [ 147.767607] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:38.114Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"1650b63413f80dc57426ffa6","created_at":"2026-08-20T05:55:36.010Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-0017bff5c87440f0","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931ae4cfc93552051ad29cf374846fde","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:36.023Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-1650b63413f80dc57426ffa6: done: 0.009025 sec","job_status":"done","queue_duration_s":2.081851,"scheduling_latency_s":2.081864,"redis_calls":13,"redis_duration_s":0.0014559999999999998,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000445,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001011,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005855,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009025,"completed_at":"2026-08-20T05:55:38.114Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00038,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1525gitlab # [ 147.808276] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:38.115Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"eccc8f5ecd1140bae5299108","created_at":"2026-08-20T05:55:36.010Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-0017bff5c87440f0","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931ae4cfc93552051ad29cf374846fde","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:36.023Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-eccc8f5ecd1140bae5299108: start","job_status":"start","queue_duration_s":2.091671,"scheduling_latency_s":2.091685}1526gitlab # [ 147.808998] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:55:38.124Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"eccc8f5ecd1140bae5299108","created_at":"2026-08-20T05:55:36.010Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-0017bff5c87440f0","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931ae4cfc93552051ad29cf374846fde","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:36.023Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-eccc8f5ecd1140bae5299108: done: 0.009005 sec","job_status":"done","queue_duration_s":2.091671,"scheduling_latency_s":2.091685,"redis_calls":13,"redis_duration_s":0.0014520000000000002,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000463,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000989,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005869,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009005,"completed_at":"2026-08-20T05:55:38.123Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000339,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1527gitlab # [ 147.989568] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 1585852631 wd_nsec: 15858528041528gitlab # [ 156.279541] setup-gitlab-start[2186]: W, [2026-08-20T05:55:47.300995 #2186] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1529gitlab # [ 174.231313] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:05.252Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"69bd3bb8023d44d4dfa330f6","created_at":"2026-08-20T05:56:05.205Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6f1d23ad62d1caa3fb26caf42608db16","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.249Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-69bd3bb8023d44d4dfa330f6: start","job_status":"start","queue_duration_s":0.002354,"scheduling_latency_s":0.0024}1530gitlab # [ 174.376613] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:05.397Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"69bd3bb8023d44d4dfa330f6","created_at":"2026-08-20T05:56:05.205Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6f1d23ad62d1caa3fb26caf42608db16","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.249Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-69bd3bb8023d44d4dfa330f6: done: 0.145836 sec","job_status":"done","queue_duration_s":0.002354,"scheduling_latency_s":0.0024,"redis_calls":9,"redis_duration_s":0.02613,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.020604,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005526,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.042,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.042,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030441,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.003372216,"exclusive_lock_hold_duration_s":0.027580041,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.145836,"completed_at":"2026-08-20T05:56:05.397Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.064541,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1531gitlab # [ 174.378619] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:05.400Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"bda0d0993d490ddd29e3c2e5","created_at":"2026-08-20T05:56:05.260Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a35241b340d6cca04a51b03d582774d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:56:05.265Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-bda0d0993d490ddd29e3c2e5: start","job_status":"start","queue_duration_s":0.135088,"scheduling_latency_s":0.135124}1532gitlab # [ 174.512260] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:05.533Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"bda0d0993d490ddd29e3c2e5","created_at":"2026-08-20T05:56:05.260Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a35241b340d6cca04a51b03d582774d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:56:05.265Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-bda0d0993d490ddd29e3c2e5: done: 0.13327 sec","job_status":"done","queue_duration_s":0.135088,"scheduling_latency_s":0.135124,"redis_calls":7,"redis_duration_s":0.032947,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007804,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.025143,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022101,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.13327,"completed_at":"2026-08-20T05:56:05.533Z","load_balancing_strategy":"primary","db_duration_s":0.002759,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1533gitlab # [ 174.514846] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:05.536Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"514fdc9f403daa2aa035ba01","created_at":"2026-08-20T05:56:05.294Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"136e6be9a508fc5534f2c29d48326ae8","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.305Z","job_size_bytes":3,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-514fdc9f403daa2aa035ba01: start","job_status":"start","queue_duration_s":0.231329,"scheduling_latency_s":0.231365}1534gitlab # [ 174.541846] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:05.563Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"514fdc9f403daa2aa035ba01","created_at":"2026-08-20T05:56:05.294Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"136e6be9a508fc5534f2c29d48326ae8","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.305Z","job_size_bytes":3,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-514fdc9f403daa2aa035ba01: done: 0.026642 sec","job_status":"done","queue_duration_s":0.231329,"scheduling_latency_s":0.231365,"redis_calls":10,"redis_duration_s":0.002244,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000517,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00126,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000467,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013427,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000252266,"duration_s":0.026642,"completed_at":"2026-08-20T05:56:05.563Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001508,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1535gitlab # [ 174.582643] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:05.565Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"65080a889627e3be3fc88c98","created_at":"2026-08-20T05:56:05.310Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9d5dfb9b72cbbdb8f39e40fdb5add612","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.313Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-65080a889627e3be3fc88c98: start","job_status":"start","queue_duration_s":0.252365,"scheduling_latency_s":0.25238}1536gitlab # [ 174.585523] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:05.577Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"65080a889627e3be3fc88c98","created_at":"2026-08-20T05:56:05.310Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9d5dfb9b72cbbdb8f39e40fdb5add612","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.313Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-65080a889627e3be3fc88c98: done: 0.012013 sec","job_status":"done","queue_duration_s":0.252365,"scheduling_latency_s":0.25238,"redis_calls":7,"redis_duration_s":0.001435,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001072,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000363,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006902,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012013,"completed_at":"2026-08-20T05:56:05.577Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1537gitlab # [ 174.640209] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:05.578Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"ae98262cb22359d131c2fa53","created_at":"2026-08-20T05:56:05.327Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2f8f63c468b4674a05d4bf72136b7192","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.330Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-ae98262cb22359d131c2fa53: start","job_status":"start","queue_duration_s":0.248782,"scheduling_latency_s":0.248796}1538gitlab # [ 174.640764] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:05.583Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1539gitlab # [ 174.641209] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:05.586Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"ae98262cb22359d131c2fa53","created_at":"2026-08-20T05:56:05.327Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2f8f63c468b4674a05d4bf72136b7192","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.330Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-ae98262cb22359d131c2fa53: done: 0.008158 sec","job_status":"done","queue_duration_s":0.248782,"scheduling_latency_s":0.248796,"redis_calls":7,"redis_duration_s":0.000835,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000603,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000232,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005115,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008158,"completed_at":"2026-08-20T05:56:05.586Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1540gitlab # [ 174.689321] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:05.587Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"6f0d9f015a93d7b1a7f30c58","created_at":"2026-08-20T05:56:05.342Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cc34d08e7ad8cdeeedb3b2c9daec8ecf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:56:05.346Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-6f0d9f015a93d7b1a7f30c58: start","job_status":"start","queue_duration_s":0.241475,"scheduling_latency_s":0.241487}1541gitlab # [ 174.689867] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:05.592Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1542gitlab # [ 174.690444] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:05.595Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"6f0d9f015a93d7b1a7f30c58","created_at":"2026-08-20T05:56:05.342Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cc34d08e7ad8cdeeedb3b2c9daec8ecf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:56:05.346Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-6f0d9f015a93d7b1a7f30c58: done: 0.007545 sec","job_status":"done","queue_duration_s":0.241475,"scheduling_latency_s":0.241487,"redis_calls":7,"redis_duration_s":0.000821,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000585,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000236,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004562,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.007545,"completed_at":"2026-08-20T05:56:05.595Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1543gitlab # [ 174.727177] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:05.596Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"8145b1cdfbf650ef498635ac","created_at":"2026-08-20T05:56:05.352Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"045aa32e781e383d2bb5ff0de1c30d53","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-8145b1cdfbf650ef498635ac: start","job_status":"start","queue_duration_s":0.239104,"scheduling_latency_s":0.239116}1544gitlab # [ 174.727788] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:05.606Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"8145b1cdfbf650ef498635ac","created_at":"2026-08-20T05:56:05.352Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"045aa32e781e383d2bb5ff0de1c30d53","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-8145b1cdfbf650ef498635ac: done: 0.010794 sec","job_status":"done","queue_duration_s":0.239104,"scheduling_latency_s":0.239116,"redis_calls":7,"redis_duration_s":0.0009320000000000001,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000698,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000234,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006439,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010794,"completed_at":"2026-08-20T05:56:05.606Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00081,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1545gitlab # [ 174.772890] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:05.608Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"8ac0fb9d3595c041ec5afb8a","created_at":"2026-08-20T05:56:05.366Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cd94a0c4bd66f32195c5e299a30fa0f0","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.381Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-8ac0fb9d3595c041ec5afb8a: start","job_status":"start","queue_duration_s":0.226585,"scheduling_latency_s":0.226606}1546gitlab # [ 174.773609] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:05.625Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"8ac0fb9d3595c041ec5afb8a","created_at":"2026-08-20T05:56:05.366Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cd94a0c4bd66f32195c5e299a30fa0f0","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.381Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-8ac0fb9d3595c041ec5afb8a: done: 0.016888 sec","job_status":"done","queue_duration_s":0.226585,"scheduling_latency_s":0.226606,"redis_calls":12,"redis_duration_s":0.001623,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000275,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000796,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000552,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009674,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000358705,"exclusive_lock_hold_duration_s":0.003792661,"duration_s":0.016888,"completed_at":"2026-08-20T05:56:05.625Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002118,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1547gitlab # [ 174.828995] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:05.626Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"ad2b8b469adbe2afbb309b4c","created_at":"2026-08-20T05:56:05.396Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"09a618deb3315fcb7400e58020c72ec4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.452Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-ad2b8b469adbe2afbb309b4c: start","job_status":"start","queue_duration_s":0.173374,"scheduling_latency_s":0.173387}1548gitlab # [ 174.829692] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:05.744Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"ad2b8b469adbe2afbb309b4c","created_at":"2026-08-20T05:56:05.396Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"09a618deb3315fcb7400e58020c72ec4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.452Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-ad2b8b469adbe2afbb309b4c: done: 0.118208 sec","job_status":"done","queue_duration_s":0.173374,"scheduling_latency_s":0.173387,"redis_calls":11,"redis_duration_s":0.001769,"redis_read_bytes":9,"redis_write_bytes":1262,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000264,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":275,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000695,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00081,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":130,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.097279,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000434134,"exclusive_lock_hold_duration_s":0.106723062,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.118208,"completed_at":"2026-08-20T05:56:05.744Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026384,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1549gitlab # [ 174.866120] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:05.745Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"85f7afca900df1d75734ed42","created_at":"2026-08-20T05:56:05.475Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0970bbf0c9d7a0c044903574c06fbc3d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.479Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-85f7afca900df1d75734ed42: start","job_status":"start","queue_duration_s":0.265903,"scheduling_latency_s":0.265917}1550gitlab # [ 174.866795] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:05.753Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"85f7afca900df1d75734ed42","created_at":"2026-08-20T05:56:05.475Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0970bbf0c9d7a0c044903574c06fbc3d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.479Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-85f7afca900df1d75734ed42: done: 0.008309 sec","job_status":"done","queue_duration_s":0.265903,"scheduling_latency_s":0.265917,"redis_calls":7,"redis_duration_s":0.000892,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000639,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000253,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004927,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008309,"completed_at":"2026-08-20T05:56:05.753Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1551gitlab # [ 174.904552] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:05.754Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"643e11e778cabf1283f3ef93","created_at":"2026-08-20T05:56:05.523Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0cd7dec6a4daac0a46b38e3e96fba49b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.531Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-643e11e778cabf1283f3ef93: start","job_status":"start","queue_duration_s":0.22336,"scheduling_latency_s":0.223372}1552gitlab # [ 174.905228] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:05.759Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1553gitlab # [ 174.905652] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:05.762Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"643e11e778cabf1283f3ef93","created_at":"2026-08-20T05:56:05.523Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0cd7dec6a4daac0a46b38e3e96fba49b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.531Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-643e11e778cabf1283f3ef93: done: 0.007483 sec","job_status":"done","queue_duration_s":0.22336,"scheduling_latency_s":0.223372,"redis_calls":7,"redis_duration_s":0.000929,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000648,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000281,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004418,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.007483,"completed_at":"2026-08-20T05:56:05.762Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1554gitlab # [ 174.976526] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:05.998Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"0230a2a43051fa0765fffd11","created_at":"2026-08-20T05:56:05.994Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.997Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-0230a2a43051fa0765fffd11: start","job_status":"start","queue_duration_s":0.001086,"scheduling_latency_s":0.001116}1555gitlab # [ 175.255946] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:06.276Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"0230a2a43051fa0765fffd11","created_at":"2026-08-20T05:56:05.994Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.997Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-0230a2a43051fa0765fffd11: done: 0.278303 sec","job_status":"done","queue_duration_s":0.001086,"scheduling_latency_s":0.001116,"redis_calls":60,"redis_duration_s":0.12377700000000001,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.000835,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.12137,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001572,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.101592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.278303,"completed_at":"2026-08-20T05:56:06.276Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1556gitlab # [ 175.309693] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:06.331Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"9b2c88907150412c7db48bd9","created_at":"2026-08-20T05:56:06.005Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c075e418fc5ad5d64c26d4425c38cb28","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.007Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-9b2c88907150412c7db48bd9: start","job_status":"start","queue_duration_s":0.324193,"scheduling_latency_s":0.324243}1557gitlab # [ 175.345502] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:06.367Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1558gitlab # [ 175.353360] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:06.374Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"9b2c88907150412c7db48bd9","created_at":"2026-08-20T05:56:06.005Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c075e418fc5ad5d64c26d4425c38cb28","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.007Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-9b2c88907150412c7db48bd9: done: 0.043798 sec","job_status":"done","queue_duration_s":0.324193,"scheduling_latency_s":0.324243,"redis_calls":7,"redis_duration_s":0.011233,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.010596,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000637,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011383,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.043798,"completed_at":"2026-08-20T05:56:06.374Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1559gitlab # [ 175.355485] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:06.377Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"4abe6c78107db9281b5eb2d0","created_at":"2026-08-20T05:56:06.019Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"63b7c79e5fd54cc07e26d3001f5fc3ca","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.023Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-4abe6c78107db9281b5eb2d0: start","job_status":"start","queue_duration_s":0.353722,"scheduling_latency_s":0.353756}1560gitlab # [ 175.453301] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:06.474Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"4abe6c78107db9281b5eb2d0","created_at":"2026-08-20T05:56:06.019Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"63b7c79e5fd54cc07e26d3001f5fc3ca","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.023Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-4abe6c78107db9281b5eb2d0: done: 0.097487 sec","job_status":"done","queue_duration_s":0.353722,"scheduling_latency_s":0.353756,"redis_calls":9,"redis_duration_s":0.003117,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001636,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001481,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.02,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028527,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00066433,"exclusive_lock_hold_duration_s":0.077098626,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.097487,"completed_at":"2026-08-20T05:56:06.474Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.069134,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1561gitlab # [ 175.509164] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:06.530Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"5fe7d0772ac9cf39fdbf499c","created_at":"2026-08-20T05:56:06.032Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d0b4fefd179e8e68343e90659304b26","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.041Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-5fe7d0772ac9cf39fdbf499c: start","job_status":"start","queue_duration_s":0.488712,"scheduling_latency_s":0.488775}1562gitlab # [ 175.638681] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:06.660Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"5fe7d0772ac9cf39fdbf499c","created_at":"2026-08-20T05:56:06.032Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d0b4fefd179e8e68343e90659304b26","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.041Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-5fe7d0772ac9cf39fdbf499c: done: 0.12998 sec","job_status":"done","queue_duration_s":0.488712,"scheduling_latency_s":0.488775,"redis_calls":12,"redis_duration_s":0.003456,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000543,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001599,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001314,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.100773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000776635,"exclusive_lock_hold_duration_s":0.10596095200000001,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.12998,"completed_at":"2026-08-20T05:56:06.660Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016368,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null}1563gitlab # [ 175.640424] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:06.661Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"8587a7e6231be956bbbc7395","created_at":"2026-08-20T05:56:06.060Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b443142383fe9cfff18346de087f66f7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.064Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-8587a7e6231be956bbbc7395: start","job_status":"start","queue_duration_s":0.596855,"scheduling_latency_s":0.59687}1564gitlab # [ 175.745760] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:06.767Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"8587a7e6231be956bbbc7395","created_at":"2026-08-20T05:56:06.060Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b443142383fe9cfff18346de087f66f7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.064Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-8587a7e6231be956bbbc7395: done: 0.105566 sec","job_status":"done","queue_duration_s":0.596855,"scheduling_latency_s":0.59687,"redis_calls":14,"redis_duration_s":0.004164999999999999,"redis_read_bytes":16,"redis_write_bytes":4026,"redis_queues_calls":2,"redis_queues_duration_s":0.000432,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002717,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001016,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.077,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.077,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021655,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.105566,"completed_at":"2026-08-20T05:56:06.767Z","load_balancing_strategy":"primary","db_duration_s":0.077268,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1565gitlab # [ 175.781204] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:06.802Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"38fcf97eb52338e2b32cf029","created_at":"2026-08-20T05:56:06.078Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"09f6b87cb6d43f49e53d444a56ecaed6","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.083Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-38fcf97eb52338e2b32cf029: start","job_status":"start","queue_duration_s":0.719345,"scheduling_latency_s":0.719394}1566gitlab # [ 175.807552] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:06.829Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"38fcf97eb52338e2b32cf029","created_at":"2026-08-20T05:56:06.078Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"09f6b87cb6d43f49e53d444a56ecaed6","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.083Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-38fcf97eb52338e2b32cf029: done: 0.026389 sec","job_status":"done","queue_duration_s":0.719345,"scheduling_latency_s":0.719394,"redis_calls":9,"redis_duration_s":0.003235,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001783,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001452,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015832,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000893969,"exclusive_lock_hold_duration_s":0.004609246,"duration_s":0.026389,"completed_at":"2026-08-20T05:56:06.829Z","load_balancing_strategy":"primary","db_duration_s":0.001509,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1567gitlab # [ 175.841536] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:06.863Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"7fdfb5458a87d7eb3bb44225","created_at":"2026-08-20T05:56:06.098Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fefd9025c2ff2aaa14536892f4466ec7","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.109Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-7fdfb5458a87d7eb3bb44225: start","job_status":"start","queue_duration_s":0.753303,"scheduling_latency_s":0.753342}1568gitlab # [ 175.888450] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:06.909Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"7fdfb5458a87d7eb3bb44225","created_at":"2026-08-20T05:56:06.098Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fefd9025c2ff2aaa14536892f4466ec7","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.109Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-7fdfb5458a87d7eb3bb44225: done: 0.04676 sec","job_status":"done","queue_duration_s":0.753303,"scheduling_latency_s":0.753342,"redis_calls":10,"redis_duration_s":0.002529,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000402,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001622,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000505,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023859,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000443912,"duration_s":0.04676,"completed_at":"2026-08-20T05:56:06.909Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003604,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1569gitlab # [ 175.924502] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:06.946Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"30ae33f7ac93676fb3ade3a4","created_at":"2026-08-20T05:56:06.123Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bcb81e8d673d26b25e603d5085fcb315","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.128Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-30ae33f7ac93676fb3ade3a4: start","job_status":"start","queue_duration_s":0.818111,"scheduling_latency_s":0.818154}1570gitlab # [ 176.182568] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.204Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"30ae33f7ac93676fb3ade3a4","created_at":"2026-08-20T05:56:06.123Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bcb81e8d673d26b25e603d5085fcb315","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.128Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-30ae33f7ac93676fb3ade3a4: done: 0.258263 sec","job_status":"done","queue_duration_s":0.818111,"scheduling_latency_s":0.818154,"redis_calls":562,"redis_duration_s":0.088779,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001373,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.087406,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.19247,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.258263,"completed_at":"2026-08-20T05:56:07.204Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1571gitlab # [ 176.184118] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.205Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"495207bb3f79e286dcfba931","created_at":"2026-08-20T05:56:06.164Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5b0057960decc0f726bd1bc070e5e337","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.174Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-495207bb3f79e286dcfba931: start","job_status":"start","queue_duration_s":1.031879,"scheduling_latency_s":1.031908}1572gitlab # [ 176.244773] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.212Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1573gitlab # [ 176.245437] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.215Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"495207bb3f79e286dcfba931","created_at":"2026-08-20T05:56:06.164Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5b0057960decc0f726bd1bc070e5e337","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.174Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-495207bb3f79e286dcfba931: done: 0.009959 sec","job_status":"done","queue_duration_s":1.031879,"scheduling_latency_s":1.031908,"redis_calls":7,"redis_duration_s":0.0009370000000000001,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000671,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000266,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005522,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009959,"completed_at":"2026-08-20T05:56:07.215Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1574gitlab # [ 176.247682] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.216Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"7446e8f1e11f311ddcb8ecba","created_at":"2026-08-20T05:56:06.189Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1caaa5974a430f079988afdc43f73c99","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:56:06.194Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-7446e8f1e11f311ddcb8ecba: start","job_status":"start","queue_duration_s":1.022543,"scheduling_latency_s":1.022555}1575gitlab # [ 176.259565] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.221Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1576gitlab # [ 176.261910] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.223Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"7446e8f1e11f311ddcb8ecba","created_at":"2026-08-20T05:56:06.189Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1caaa5974a430f079988afdc43f73c99","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:56:06.194Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-7446e8f1e11f311ddcb8ecba: done: 0.007286 sec","job_status":"done","queue_duration_s":1.022543,"scheduling_latency_s":1.022555,"redis_calls":7,"redis_duration_s":0.0008770000000000001,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000635,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000242,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004515,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.007286,"completed_at":"2026-08-20T05:56:07.223Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1577gitlab # [ 176.299097] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.224Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"d721da88f9ecb16d862fe485","created_at":"2026-08-20T05:56:06.206Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ed49171692683dbc60cf142635c33b85","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.210Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-d721da88f9ecb16d862fe485: start","job_status":"start","queue_duration_s":1.014084,"scheduling_latency_s":1.014098}1578gitlab # [ 176.303867] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.241Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"d721da88f9ecb16d862fe485","created_at":"2026-08-20T05:56:06.206Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ed49171692683dbc60cf142635c33b85","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.210Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-d721da88f9ecb16d862fe485: done: 0.016818 sec","job_status":"done","queue_duration_s":1.014084,"scheduling_latency_s":1.014098,"redis_calls":7,"redis_duration_s":0.000924,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000648,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000276,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005863,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.016818,"completed_at":"2026-08-20T05:56:07.241Z","load_balancing_strategy":"primary","db_duration_s":0.00832,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1579gitlab # [ 176.343150] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.242Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"4efc13eb2f65660d9c7a6043","created_at":"2026-08-20T05:56:06.222Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57d32b2238704a2e5f030eb265faae9f","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.230Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-4efc13eb2f65660d9c7a6043: start","job_status":"start","queue_duration_s":1.012356,"scheduling_latency_s":1.012369}1580gitlab # [ 176.347599] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.254Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"4efc13eb2f65660d9c7a6043","created_at":"2026-08-20T05:56:06.222Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57d32b2238704a2e5f030eb265faae9f","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.230Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-4efc13eb2f65660d9c7a6043: done: 0.012179 sec","job_status":"done","queue_duration_s":1.012356,"scheduling_latency_s":1.012369,"redis_calls":10,"redis_duration_s":0.0013289999999999999,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000777,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000552,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007397,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.003297346,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.012179,"completed_at":"2026-08-20T05:56:07.254Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001966,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1581gitlab # [ 176.383604] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.255Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"2659ba8a25e28cbbe607ca7d","created_at":"2026-08-20T05:56:06.243Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2792c4b61c2fc4294af350cabbf6ef6f","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.254Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-2659ba8a25e28cbbe607ca7d: start","job_status":"start","queue_duration_s":1.000489,"scheduling_latency_s":1.000502}1582gitlab # [ 176.423944] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.266Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"2659ba8a25e28cbbe607ca7d","created_at":"2026-08-20T05:56:06.243Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2792c4b61c2fc4294af350cabbf6ef6f","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.254Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-2659ba8a25e28cbbe607ca7d: done: 0.011289 sec","job_status":"done","queue_duration_s":1.000489,"scheduling_latency_s":1.000502,"redis_calls":12,"redis_duration_s":0.001815,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.00032,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000291,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000954,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00025,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006614,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000230197,"duration_s":0.011289,"completed_at":"2026-08-20T05:56:07.266Z","load_balancing_strategy":"primary","db_duration_s":0.000357,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1583gitlab # [ 176.424883] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.267Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6975b18491c040e1ab591f64","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6975b18491c040e1ab591f64: start","job_status":"start","queue_duration_s":1.007563,"scheduling_latency_s":1.007577}1584gitlab # [ 176.434671] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.276Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6975b18491c040e1ab591f64","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6975b18491c040e1ab591f64: done: 0.008901 sec","job_status":"done","queue_duration_s":1.007563,"scheduling_latency_s":1.007577,"redis_calls":13,"redis_duration_s":0.00148,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000474,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001006,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005895,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008901,"completed_at":"2026-08-20T05:56:07.276Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1585gitlab # [ 176.485181] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.277Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06f202464db05ea0772017a2","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06f202464db05ea0772017a2: start","job_status":"start","queue_duration_s":1.017265,"scheduling_latency_s":1.017279}1586gitlab # [ 176.485831] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.285Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06f202464db05ea0772017a2","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06f202464db05ea0772017a2: done: 0.008631 sec","job_status":"done","queue_duration_s":1.017265,"scheduling_latency_s":1.017279,"redis_calls":13,"redis_duration_s":0.001435,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000472,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000963,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005681,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008631,"completed_at":"2026-08-20T05:56:07.285Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1587gitlab # [ 176.527928] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.286Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f263c6febddf3b80c14b4ff3","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f263c6febddf3b80c14b4ff3: start","job_status":"start","queue_duration_s":1.02668,"scheduling_latency_s":1.026693}1588gitlab # [ 176.528617] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.295Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f263c6febddf3b80c14b4ff3","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f263c6febddf3b80c14b4ff3: done: 0.008586 sec","job_status":"done","queue_duration_s":1.02668,"scheduling_latency_s":1.026693,"redis_calls":13,"redis_duration_s":0.001438,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000485,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000953,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005705,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008586,"completed_at":"2026-08-20T05:56:07.295Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1589gitlab # [ 176.564630] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.296Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"783dadf90ab80ad47f60ab54","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-783dadf90ab80ad47f60ab54: start","job_status":"start","queue_duration_s":1.036076,"scheduling_latency_s":1.036089}1590gitlab # [ 176.565475] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.307Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"783dadf90ab80ad47f60ab54","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-783dadf90ab80ad47f60ab54: done: 0.010919 sec","job_status":"done","queue_duration_s":1.036076,"scheduling_latency_s":1.036089,"redis_calls":13,"redis_duration_s":0.0016579999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000636,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007478,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010919,"completed_at":"2026-08-20T05:56:07.307Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1591gitlab # [ 176.618617] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.308Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b585624fdb1dcc8e3443f21","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b585624fdb1dcc8e3443f21: start","job_status":"start","queue_duration_s":1.048056,"scheduling_latency_s":1.048076}1592gitlab # [ 176.619242] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.317Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b585624fdb1dcc8e3443f21","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b585624fdb1dcc8e3443f21: done: 0.009669 sec","job_status":"done","queue_duration_s":1.048056,"scheduling_latency_s":1.048076,"redis_calls":13,"redis_duration_s":0.0014429999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000468,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000975,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009669,"completed_at":"2026-08-20T05:56:07.317Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1593gitlab # [ 176.628285] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.318Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cdc4f1c51cf44d0421906483","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cdc4f1c51cf44d0421906483: start","job_status":"start","queue_duration_s":1.058502,"scheduling_latency_s":1.058514}1594gitlab # [ 176.666923] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.328Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cdc4f1c51cf44d0421906483","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cdc4f1c51cf44d0421906483: done: 0.009739 sec","job_status":"done","queue_duration_s":1.058502,"scheduling_latency_s":1.058514,"redis_calls":13,"redis_duration_s":0.00179,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000647,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001143,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006388,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009739,"completed_at":"2026-08-20T05:56:07.328Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1595gitlab # [ 176.668798] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.329Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66f4808dad4c7b8078319cee","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66f4808dad4c7b8078319cee: start","job_status":"start","queue_duration_s":1.069129,"scheduling_latency_s":1.069143}1596gitlab # [ 176.678875] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.338Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66f4808dad4c7b8078319cee","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66f4808dad4c7b8078319cee: done: 0.009022 sec","job_status":"done","queue_duration_s":1.069129,"scheduling_latency_s":1.069143,"redis_calls":13,"redis_duration_s":0.001439,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00047,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000969,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005946,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009022,"completed_at":"2026-08-20T05:56:07.338Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1597gitlab # [ 176.716922] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.339Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e359f448e239a09d47ae399","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e359f448e239a09d47ae399: start","job_status":"start","queue_duration_s":1.078951,"scheduling_latency_s":1.078964}1598gitlab # [ 176.719102] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.370Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e359f448e239a09d47ae399","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e359f448e239a09d47ae399: done: 0.031174 sec","job_status":"done","queue_duration_s":1.078951,"scheduling_latency_s":1.078964,"redis_calls":13,"redis_duration_s":0.0014329999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000922,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027769,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031174,"completed_at":"2026-08-20T05:56:07.370Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1599gitlab # [ 176.765956] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.371Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8557d85793baee93f8f4b25b","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8557d85793baee93f8f4b25b: start","job_status":"start","queue_duration_s":1.111068,"scheduling_latency_s":1.111083}1600gitlab # [ 176.766678] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.381Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8557d85793baee93f8f4b25b","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8557d85793baee93f8f4b25b: done: 0.010025 sec","job_status":"done","queue_duration_s":1.111068,"scheduling_latency_s":1.111083,"redis_calls":13,"redis_duration_s":0.001471,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000476,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000995,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006807,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010025,"completed_at":"2026-08-20T05:56:07.381Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1601gitlab # [ 176.813298] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.381Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ed806364e93d5b80a753a34","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ed806364e93d5b80a753a34: start","job_status":"start","queue_duration_s":1.1219,"scheduling_latency_s":1.121913}1602gitlab # [ 176.813954] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.390Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ed806364e93d5b80a753a34","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ed806364e93d5b80a753a34: done: 0.00865 sec","job_status":"done","queue_duration_s":1.1219,"scheduling_latency_s":1.121913,"redis_calls":13,"redis_duration_s":0.001414,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005724,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00865,"completed_at":"2026-08-20T05:56:07.390Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1603gitlab # [ 176.831125] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.391Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5671281afd5c822bf02370b","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5671281afd5c822bf02370b: start","job_status":"start","queue_duration_s":1.131335,"scheduling_latency_s":1.131348}1604gitlab # [ 176.841205] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.400Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5671281afd5c822bf02370b","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5671281afd5c822bf02370b: done: 0.009344 sec","job_status":"done","queue_duration_s":1.131335,"scheduling_latency_s":1.131348,"redis_calls":13,"redis_duration_s":0.001436,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000465,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000971,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005694,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009344,"completed_at":"2026-08-20T05:56:07.400Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1605gitlab # [ 176.880609] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.401Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f388c17cf097062fa79296b","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f388c17cf097062fa79296b: start","job_status":"start","queue_duration_s":1.141453,"scheduling_latency_s":1.141466}1606gitlab # [ 176.883497] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.410Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f388c17cf097062fa79296b","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f388c17cf097062fa79296b: done: 0.008801 sec","job_status":"done","queue_duration_s":1.141453,"scheduling_latency_s":1.141466,"redis_calls":13,"redis_duration_s":0.001714,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00047,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001244,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005938,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008801,"completed_at":"2026-08-20T05:56:07.410Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1607gitlab # [ 176.932710] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.411Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5187272acc35705736770ad8","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5187272acc35705736770ad8: start","job_status":"start","queue_duration_s":1.151041,"scheduling_latency_s":1.151053}1608gitlab # [ 176.933529] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.419Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5187272acc35705736770ad8","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5187272acc35705736770ad8: done: 0.008876 sec","job_status":"done","queue_duration_s":1.151041,"scheduling_latency_s":1.151053,"redis_calls":13,"redis_duration_s":0.001433,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00046,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000973,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00603,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008876,"completed_at":"2026-08-20T05:56:07.419Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1609gitlab # [ 176.976611] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.420Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"363bcf1c60eba55a40c624fd","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-363bcf1c60eba55a40c624fd: start","job_status":"start","queue_duration_s":1.160707,"scheduling_latency_s":1.160719}1610gitlab # [ 176.977297] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.431Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"363bcf1c60eba55a40c624fd","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-363bcf1c60eba55a40c624fd: done: 0.010989 sec","job_status":"done","queue_duration_s":1.160707,"scheduling_latency_s":1.160719,"redis_calls":13,"redis_duration_s":0.002906,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000467,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002439,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006268,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010989,"completed_at":"2026-08-20T05:56:07.431Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1611gitlab # [ 176.996635] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.432Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1015e849e8c197679cd14a9","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1015e849e8c197679cd14a9: start","job_status":"start","queue_duration_s":1.172512,"scheduling_latency_s":1.172525}1612gitlab # [ 177.031779] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.442Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1015e849e8c197679cd14a9","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1015e849e8c197679cd14a9: done: 0.009605 sec","job_status":"done","queue_duration_s":1.172512,"scheduling_latency_s":1.172525,"redis_calls":13,"redis_duration_s":0.001503,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000491,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001012,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009605,"completed_at":"2026-08-20T05:56:07.442Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1613gitlab # [ 177.037629] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.442Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0afe0ed182cd5f42e56bb91","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0afe0ed182cd5f42e56bb91: start","job_status":"start","queue_duration_s":1.182912,"scheduling_latency_s":1.182924}1614gitlab # [ 177.072796] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.452Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0afe0ed182cd5f42e56bb91","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0afe0ed182cd5f42e56bb91: done: 0.009433 sec","job_status":"done","queue_duration_s":1.182912,"scheduling_latency_s":1.182924,"redis_calls":13,"redis_duration_s":0.001458,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000468,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00099,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005613,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009433,"completed_at":"2026-08-20T05:56:07.452Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1615gitlab # [ 177.077879] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.453Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aeae59648e83d3ac8f41d694","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aeae59648e83d3ac8f41d694: start","job_status":"start","queue_duration_s":1.193107,"scheduling_latency_s":1.19312}1616gitlab # [ 177.087922] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.462Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aeae59648e83d3ac8f41d694","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aeae59648e83d3ac8f41d694: done: 0.00904 sec","job_status":"done","queue_duration_s":1.193107,"scheduling_latency_s":1.19312,"redis_calls":13,"redis_duration_s":0.001386,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00045,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00622,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00904,"completed_at":"2026-08-20T05:56:07.462Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1617gitlab # [ 177.119623] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.463Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1a56321bbb779421cfd986a","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1a56321bbb779421cfd986a: start","job_status":"start","queue_duration_s":1.20292,"scheduling_latency_s":1.202933}1618gitlab # [ 177.158217] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.473Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1a56321bbb779421cfd986a","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1a56321bbb779421cfd986a: done: 0.010105 sec","job_status":"done","queue_duration_s":1.20292,"scheduling_latency_s":1.202933,"redis_calls":13,"redis_duration_s":0.0024029999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000629,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001774,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006248,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010105,"completed_at":"2026-08-20T05:56:07.473Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1619gitlab # [ 177.160441] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.474Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d1927070353efea4dea4886","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d1927070353efea4dea4886: start","job_status":"start","queue_duration_s":1.214074,"scheduling_latency_s":1.214087}1620gitlab # [ 177.170591] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.483Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d1927070353efea4dea4886","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d1927070353efea4dea4886: done: 0.00953 sec","job_status":"done","queue_duration_s":1.214074,"scheduling_latency_s":1.214087,"redis_calls":13,"redis_duration_s":0.0017590000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000638,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001121,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005726,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00953,"completed_at":"2026-08-20T05:56:07.483Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1621gitlab # [ 177.220102] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.484Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"079777498a0e881b701bb796","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-079777498a0e881b701bb796: start","job_status":"start","queue_duration_s":1.224875,"scheduling_latency_s":1.224887}1622gitlab # [ 177.220757] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.494Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"079777498a0e881b701bb796","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-079777498a0e881b701bb796: done: 0.009165 sec","job_status":"done","queue_duration_s":1.224875,"scheduling_latency_s":1.224887,"redis_calls":13,"redis_duration_s":0.001484,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000487,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000997,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006235,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009165,"completed_at":"2026-08-20T05:56:07.494Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1623gitlab # [ 177.256196] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.494Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"00a55afdf24ac284b90cac41","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-00a55afdf24ac284b90cac41: start","job_status":"start","queue_duration_s":1.234829,"scheduling_latency_s":1.234841}1624gitlab # [ 177.256778] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.503Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"00a55afdf24ac284b90cac41","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-00a55afdf24ac284b90cac41: done: 0.009047 sec","job_status":"done","queue_duration_s":1.234829,"scheduling_latency_s":1.234841,"redis_calls":13,"redis_duration_s":0.001411,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000465,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000946,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006144,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009047,"completed_at":"2026-08-20T05:56:07.503Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1625gitlab # [ 177.300026] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.504Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ea5b94349904262416b21be","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ea5b94349904262416b21be: start","job_status":"start","queue_duration_s":1.244668,"scheduling_latency_s":1.244681}1626gitlab # [ 177.300705] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.514Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ea5b94349904262416b21be","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ea5b94349904262416b21be: done: 0.010175 sec","job_status":"done","queue_duration_s":1.244668,"scheduling_latency_s":1.244681,"redis_calls":13,"redis_duration_s":0.002522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000749,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001773,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0057,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010175,"completed_at":"2026-08-20T05:56:07.514Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1627gitlab # [ 177.350147] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.516Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8e0fc18408a3aa2c200687c","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8e0fc18408a3aa2c200687c: start","job_status":"start","queue_duration_s":1.256682,"scheduling_latency_s":1.256695}1628gitlab # [ 177.350694] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.526Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8e0fc18408a3aa2c200687c","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8e0fc18408a3aa2c200687c: done: 0.010247 sec","job_status":"done","queue_duration_s":1.256682,"scheduling_latency_s":1.256695,"redis_calls":13,"redis_duration_s":0.002451,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000786,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001665,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006276,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010247,"completed_at":"2026-08-20T05:56:07.526Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1629gitlab # [ 177.385717] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.528Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d54cddbd22a6bf59bc7b8aa","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d54cddbd22a6bf59bc7b8aa: start","job_status":"start","queue_duration_s":1.267951,"scheduling_latency_s":1.267964}1630gitlab # [ 177.386539] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.537Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d54cddbd22a6bf59bc7b8aa","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d54cddbd22a6bf59bc7b8aa: done: 0.009805 sec","job_status":"done","queue_duration_s":1.267951,"scheduling_latency_s":1.267964,"redis_calls":13,"redis_duration_s":0.002018,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000601,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001417,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006261,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009805,"completed_at":"2026-08-20T05:56:07.537Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1631gitlab # [ 177.427079] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.538Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c5542a750c2aea46e1d5237","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c5542a750c2aea46e1d5237: start","job_status":"start","queue_duration_s":1.27855,"scheduling_latency_s":1.278563}1632gitlab # [ 177.427610] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.547Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c5542a750c2aea46e1d5237","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c5542a750c2aea46e1d5237: done: 0.00903 sec","job_status":"done","queue_duration_s":1.27855,"scheduling_latency_s":1.278563,"redis_calls":13,"redis_duration_s":0.001444,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000472,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000972,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006162,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00903,"completed_at":"2026-08-20T05:56:07.547Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1633gitlab # [ 177.463985] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.548Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0929662cdd427a462536039","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0929662cdd427a462536039: start","job_status":"start","queue_duration_s":1.288402,"scheduling_latency_s":1.288415}1634gitlab # [ 177.464660] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.558Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0929662cdd427a462536039","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0929662cdd427a462536039: done: 0.010513 sec","job_status":"done","queue_duration_s":1.288402,"scheduling_latency_s":1.288415,"redis_calls":13,"redis_duration_s":0.0022960000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000711,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001585,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005657,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010513,"completed_at":"2026-08-20T05:56:07.558Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1635gitlab # [ 177.486530] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.560Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6df7147f84377bbb6309befc","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6df7147f84377bbb6309befc: start","job_status":"start","queue_duration_s":1.299973,"scheduling_latency_s":1.299986}1636gitlab # [ 177.496659] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.570Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6df7147f84377bbb6309befc","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6df7147f84377bbb6309befc: done: 0.010664 sec","job_status":"done","queue_duration_s":1.299973,"scheduling_latency_s":1.299986,"redis_calls":13,"redis_duration_s":0.00289,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000844,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002046,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00631,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010664,"completed_at":"2026-08-20T05:56:07.570Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1637gitlab # [ 177.536621] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.571Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c6574fed845d657fbc9ee524","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c6574fed845d657fbc9ee524: start","job_status":"start","queue_duration_s":1.311693,"scheduling_latency_s":1.311706}1638gitlab # [ 177.537194] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.581Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c6574fed845d657fbc9ee524","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c6574fed845d657fbc9ee524: done: 0.009936 sec","job_status":"done","queue_duration_s":1.311693,"scheduling_latency_s":1.311706,"redis_calls":13,"redis_duration_s":0.002334,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000753,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001581,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006124,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009936,"completed_at":"2026-08-20T05:56:07.581Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1639gitlab # [ 177.575092] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.582Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"579d38064ec177cb3b6422ec","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-579d38064ec177cb3b6422ec: start","job_status":"start","queue_duration_s":1.32266,"scheduling_latency_s":1.322673}1640gitlab # [ 177.577672] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.592Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"579d38064ec177cb3b6422ec","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-579d38064ec177cb3b6422ec: done: 0.009957 sec","job_status":"done","queue_duration_s":1.32266,"scheduling_latency_s":1.322673,"redis_calls":13,"redis_duration_s":0.002333,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000764,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001569,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005696,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009957,"completed_at":"2026-08-20T05:56:07.592Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1641gitlab # [ 177.641119] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.595Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0178a980b9d304d35d8c1a12","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0178a980b9d304d35d8c1a12: start","job_status":"start","queue_duration_s":1.3351,"scheduling_latency_s":1.335146}1642gitlab # [ 177.641706] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.618Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0178a980b9d304d35d8c1a12","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0178a980b9d304d35d8c1a12: done: 0.023495 sec","job_status":"done","queue_duration_s":1.3351,"scheduling_latency_s":1.335146,"redis_calls":13,"redis_duration_s":0.002243,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000782,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001461,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015462,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023495,"completed_at":"2026-08-20T05:56:07.618Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1643gitlab # [ 177.679831] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.620Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b77baee21c4af842b46fd37","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b77baee21c4af842b46fd37: start","job_status":"start","queue_duration_s":1.360107,"scheduling_latency_s":1.360137}1644gitlab # [ 177.680625] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.634Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b77baee21c4af842b46fd37","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b77baee21c4af842b46fd37: done: 0.014559 sec","job_status":"done","queue_duration_s":1.360107,"scheduling_latency_s":1.360137,"redis_calls":13,"redis_duration_s":0.001862,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001307,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010189,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014559,"completed_at":"2026-08-20T05:56:07.634Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1645gitlab # [ 177.716055] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.635Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e35ec002303e375540869cef","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e35ec002303e375540869cef: start","job_status":"start","queue_duration_s":1.375396,"scheduling_latency_s":1.375408}1646gitlab # [ 177.716604] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.644Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e35ec002303e375540869cef","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e35ec002303e375540869cef: done: 0.009439 sec","job_status":"done","queue_duration_s":1.375396,"scheduling_latency_s":1.375408,"redis_calls":13,"redis_duration_s":0.0015379999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001024,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006315,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009439,"completed_at":"2026-08-20T05:56:07.644Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1647gitlab # [ 177.750947] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.645Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d543e6db2d1bc80be94624b2","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d543e6db2d1bc80be94624b2: start","job_status":"start","queue_duration_s":1.385665,"scheduling_latency_s":1.385678}1648gitlab # [ 177.751694] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.655Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d543e6db2d1bc80be94624b2","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d543e6db2d1bc80be94624b2: done: 0.009655 sec","job_status":"done","queue_duration_s":1.385665,"scheduling_latency_s":1.385678,"redis_calls":13,"redis_duration_s":0.00145,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000486,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000964,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005501,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009655,"completed_at":"2026-08-20T05:56:07.655Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1649gitlab # [ 177.800985] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.656Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0be01b0ace8815c5be4698d","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0be01b0ace8815c5be4698d: start","job_status":"start","queue_duration_s":1.396092,"scheduling_latency_s":1.396105}1650gitlab # [ 177.801766] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.665Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0be01b0ace8815c5be4698d","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0be01b0ace8815c5be4698d: done: 0.009536 sec","job_status":"done","queue_duration_s":1.396092,"scheduling_latency_s":1.396105,"redis_calls":13,"redis_duration_s":0.001521,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000987,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00633,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009536,"completed_at":"2026-08-20T05:56:07.665Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1651gitlab # [ 177.812093] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.666Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4c235b5b8a22db9045a5d7d","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4c235b5b8a22db9045a5d7d: start","job_status":"start","queue_duration_s":1.406564,"scheduling_latency_s":1.406576}1652gitlab # [ 177.822077] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.676Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4c235b5b8a22db9045a5d7d","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4c235b5b8a22db9045a5d7d: done: 0.009438 sec","job_status":"done","queue_duration_s":1.406564,"scheduling_latency_s":1.406576,"redis_calls":13,"redis_duration_s":0.001465,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000475,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00099,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006377,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009438,"completed_at":"2026-08-20T05:56:07.676Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1653gitlab # [ 177.853917] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.676Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a1ca122639185fd481a5fcc","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a1ca122639185fd481a5fcc: start","job_status":"start","queue_duration_s":1.416764,"scheduling_latency_s":1.416777}1654gitlab # [ 177.895574] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.685Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a1ca122639185fd481a5fcc","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a1ca122639185fd481a5fcc: done: 0.008815 sec","job_status":"done","queue_duration_s":1.416764,"scheduling_latency_s":1.416777,"redis_calls":13,"redis_duration_s":0.001338,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000422,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005642,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008815,"completed_at":"2026-08-20T05:56:07.685Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1655gitlab # [ 177.896406] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.686Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5100338b3ec7c88e98a765a2","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5100338b3ec7c88e98a765a2: start","job_status":"start","queue_duration_s":1.426794,"scheduling_latency_s":1.426806}1656gitlab # [ 177.904922] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.698Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5100338b3ec7c88e98a765a2","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5100338b3ec7c88e98a765a2: done: 0.011822 sec","job_status":"done","queue_duration_s":1.426794,"scheduling_latency_s":1.426806,"redis_calls":13,"redis_duration_s":0.001741,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001236,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008334,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011822,"completed_at":"2026-08-20T05:56:07.698Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1657gitlab # [ 177.954557] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.699Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"912b10d23b17833c78fdc2f8","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-912b10d23b17833c78fdc2f8: start","job_status":"start","queue_duration_s":1.439644,"scheduling_latency_s":1.439663}1658gitlab # [ 177.955222] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.709Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"912b10d23b17833c78fdc2f8","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-912b10d23b17833c78fdc2f8: done: 0.010295 sec","job_status":"done","queue_duration_s":1.439644,"scheduling_latency_s":1.439663,"redis_calls":13,"redis_duration_s":0.0015600000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001038,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006571,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010295,"completed_at":"2026-08-20T05:56:07.709Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1659gitlab # [ 178.006908] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.710Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aac804d679e4250b05f1b8a5","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aac804d679e4250b05f1b8a5: start","job_status":"start","queue_duration_s":1.450759,"scheduling_latency_s":1.450771}1660gitlab # [ 178.007571] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.720Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aac804d679e4250b05f1b8a5","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aac804d679e4250b05f1b8a5: done: 0.00943 sec","job_status":"done","queue_duration_s":1.450759,"scheduling_latency_s":1.450771,"redis_calls":13,"redis_duration_s":0.001455,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000475,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005683,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00943,"completed_at":"2026-08-20T05:56:07.720Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1661gitlab # [ 178.041380] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.721Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4411ff1d6d9457705b8a2e30","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4411ff1d6d9457705b8a2e30: start","job_status":"start","queue_duration_s":1.46101,"scheduling_latency_s":1.461022}1662gitlab # [ 178.041933] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.730Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4411ff1d6d9457705b8a2e30","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4411ff1d6d9457705b8a2e30: done: 0.009365 sec","job_status":"done","queue_duration_s":1.46101,"scheduling_latency_s":1.461022,"redis_calls":13,"redis_duration_s":0.001664,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000655,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006175,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009365,"completed_at":"2026-08-20T05:56:07.730Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1663gitlab # [ 178.059568] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.731Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1e641018742f5023f4cf4a5","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1e641018742f5023f4cf4a5: start","job_status":"start","queue_duration_s":1.471155,"scheduling_latency_s":1.471168}1664gitlab # [ 178.069561] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.739Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1e641018742f5023f4cf4a5","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1e641018742f5023f4cf4a5: done: 0.008763 sec","job_status":"done","queue_duration_s":1.471155,"scheduling_latency_s":1.471168,"redis_calls":13,"redis_duration_s":0.001466,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000476,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00099,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005832,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008763,"completed_at":"2026-08-20T05:56:07.739Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1665gitlab # [ 178.114574] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.740Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dba4e40f66c1730af7f54a59","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dba4e40f66c1730af7f54a59: start","job_status":"start","queue_duration_s":1.480705,"scheduling_latency_s":1.480718}1666gitlab # [ 178.115112] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.749Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dba4e40f66c1730af7f54a59","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dba4e40f66c1730af7f54a59: done: 0.008906 sec","job_status":"done","queue_duration_s":1.480705,"scheduling_latency_s":1.480718,"redis_calls":13,"redis_duration_s":0.001469,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000477,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000992,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005699,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008906,"completed_at":"2026-08-20T05:56:07.749Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1667gitlab # [ 178.166092] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.750Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e01452b7b3a46d06128ddfb","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e01452b7b3a46d06128ddfb: start","job_status":"start","queue_duration_s":1.490404,"scheduling_latency_s":1.490416}1668gitlab # [ 178.166755] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.759Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e01452b7b3a46d06128ddfb","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e01452b7b3a46d06128ddfb: done: 0.008787 sec","job_status":"done","queue_duration_s":1.490404,"scheduling_latency_s":1.490416,"redis_calls":13,"redis_duration_s":0.001565,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000468,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005898,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008787,"completed_at":"2026-08-20T05:56:07.759Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1669gitlab # [ 178.182620] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.760Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"add55cf099535ba486787e6c","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-add55cf099535ba486787e6c: start","job_status":"start","queue_duration_s":1.50001,"scheduling_latency_s":1.500023}1670gitlab # [ 178.192551] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.769Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"add55cf099535ba486787e6c","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-add55cf099535ba486787e6c: done: 0.009014 sec","job_status":"done","queue_duration_s":1.50001,"scheduling_latency_s":1.500023,"redis_calls":13,"redis_duration_s":0.001614,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000642,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000972,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005897,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009014,"completed_at":"2026-08-20T05:56:07.769Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1671gitlab # [ 178.230290] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.769Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79e075682260bfce4f36a4bb","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79e075682260bfce4f36a4bb: start","job_status":"start","queue_duration_s":1.509837,"scheduling_latency_s":1.50985}1672gitlab # [ 178.233059] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.778Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79e075682260bfce4f36a4bb","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79e075682260bfce4f36a4bb: done: 0.008849 sec","job_status":"done","queue_duration_s":1.509837,"scheduling_latency_s":1.50985,"redis_calls":13,"redis_duration_s":0.001422,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000468,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000954,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005743,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008849,"completed_at":"2026-08-20T05:56:07.778Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1673gitlab # [ 178.293763] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.779Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e48437b8ecf6c3898adc765","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e48437b8ecf6c3898adc765: start","job_status":"start","queue_duration_s":1.519655,"scheduling_latency_s":1.519668}1674gitlab # [ 178.294584] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.788Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e48437b8ecf6c3898adc765","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e48437b8ecf6c3898adc765: done: 0.008799 sec","job_status":"done","queue_duration_s":1.519655,"scheduling_latency_s":1.519668,"redis_calls":13,"redis_duration_s":0.0014550000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000955,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005883,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008799,"completed_at":"2026-08-20T05:56:07.788Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1675gitlab # [ 178.330269] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.789Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d63ebc481a320e40e18bc527","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d63ebc481a320e40e18bc527: start","job_status":"start","queue_duration_s":1.529267,"scheduling_latency_s":1.52928}1676gitlab # [ 178.330841] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.798Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d63ebc481a320e40e18bc527","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d63ebc481a320e40e18bc527: done: 0.008928 sec","job_status":"done","queue_duration_s":1.529267,"scheduling_latency_s":1.52928,"redis_calls":13,"redis_duration_s":0.0014620000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000468,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000994,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005964,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008928,"completed_at":"2026-08-20T05:56:07.798Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1677gitlab # [ 178.371763] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.799Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da4abf88dfdd04d09aec8301","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da4abf88dfdd04d09aec8301: start","job_status":"start","queue_duration_s":1.538978,"scheduling_latency_s":1.538991}1678gitlab # [ 178.372230] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.807Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da4abf88dfdd04d09aec8301","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da4abf88dfdd04d09aec8301: done: 0.008823 sec","job_status":"done","queue_duration_s":1.538978,"scheduling_latency_s":1.538991,"redis_calls":13,"redis_duration_s":0.001441,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000464,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000977,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00589,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008823,"completed_at":"2026-08-20T05:56:07.807Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1679gitlab # [ 178.386898] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.808Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c22f0d4c92b04effd064eb3e","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c22f0d4c92b04effd064eb3e: start","job_status":"start","queue_duration_s":1.548624,"scheduling_latency_s":1.548637}1680gitlab # [ 178.396875] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.817Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c22f0d4c92b04effd064eb3e","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c22f0d4c92b04effd064eb3e: done: 0.008793 sec","job_status":"done","queue_duration_s":1.548624,"scheduling_latency_s":1.548637,"redis_calls":13,"redis_duration_s":0.0014449999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000454,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000991,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005749,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008793,"completed_at":"2026-08-20T05:56:07.817Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1681gitlab # [ 178.428766] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.818Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37a1a59eb4a90509d78b32dd","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37a1a59eb4a90509d78b32dd: start","job_status":"start","queue_duration_s":1.558377,"scheduling_latency_s":1.55839}1682gitlab # [ 178.438719] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.827Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37a1a59eb4a90509d78b32dd","created_at":"2026-08-20T05:56:06.007Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d2f143ca8118470f","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa79f46ca6a9c5b71769a3b0fd1a1c63","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.260Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37a1a59eb4a90509d78b32dd: done: 0.008797 sec","job_status":"done","queue_duration_s":1.558377,"scheduling_latency_s":1.55839,"redis_calls":13,"redis_duration_s":0.001444,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000462,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000982,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008797,"completed_at":"2026-08-20T05:56:07.827Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1683gitlab # [ 178.475207] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.828Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"5777f508fc5e779a2056dfb1","created_at":"2026-08-20T05:56:06.268Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df3d4273060f827a11a46a4ea97a4a76","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.271Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-5777f508fc5e779a2056dfb1: start","job_status":"start","queue_duration_s":1.556221,"scheduling_latency_s":1.556233}1684gitlab # [ 178.480040] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.838Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"5777f508fc5e779a2056dfb1","created_at":"2026-08-20T05:56:06.268Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df3d4273060f827a11a46a4ea97a4a76","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.271Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-5777f508fc5e779a2056dfb1: done: 0.010046 sec","job_status":"done","queue_duration_s":1.556221,"scheduling_latency_s":1.556233,"redis_calls":9,"redis_duration_s":0.00114,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000605,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000535,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006415,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000289701,"exclusive_lock_hold_duration_s":0.002482718,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.010046,"completed_at":"2026-08-20T05:56:07.838Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000914,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1685gitlab # [ 178.513034] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.838Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"e748a00b95a451844a577c8a","created_at":"2026-08-20T05:56:06.330Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"58918321e2ad24f859648690ae525603","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.347Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-e748a00b95a451844a577c8a: start","job_status":"start","queue_duration_s":1.490953,"scheduling_latency_s":1.490965}1686gitlab # [ 178.524618] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.850Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"e748a00b95a451844a577c8a","created_at":"2026-08-20T05:56:06.330Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-d28654a7cd3443c5","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"58918321e2ad24f859648690ae525603","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.347Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-e748a00b95a451844a577c8a: done: 0.011146 sec","job_status":"done","queue_duration_s":1.490953,"scheduling_latency_s":1.490965,"redis_calls":7,"redis_duration_s":0.000884,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000653,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000231,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011146,"completed_at":"2026-08-20T05:56:07.850Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002158,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1687gitlab # [ 178.556525] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.850Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"613876568e5b6226bc38e989","created_at":"2026-08-20T05:56:06.746Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-79c5fa5f1ede4155","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b443142383fe9cfff18346de087f66f7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.759Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-613876568e5b6226bc38e989: start","job_status":"start","queue_duration_s":1.091366,"scheduling_latency_s":1.09138}1688gitlab # [ 178.566539] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.857Z","message":"No existing merge request to be cleaned up."}1689gitlab # [ 178.567709] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.862Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"613876568e5b6226bc38e989","created_at":"2026-08-20T05:56:06.746Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-79c5fa5f1ede4155","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b443142383fe9cfff18346de087f66f7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.759Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-613876568e5b6226bc38e989: done: 0.011182 sec","job_status":"done","queue_duration_s":1.091366,"scheduling_latency_s":1.09138,"redis_calls":10,"redis_duration_s":0.001269,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000765,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007399,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011182,"completed_at":"2026-08-20T05:56:07.862Z","load_balancing_strategy":"primary","db_duration_s":0.001089,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1690gitlab # [ 178.619574] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.862Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0b99787ec3454a51412770f1","created_at":"2026-08-20T05:56:06.746Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-79c5fa5f1ede4155","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b443142383fe9cfff18346de087f66f7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.759Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0b99787ec3454a51412770f1: start","job_status":"start","queue_duration_s":1.103367,"scheduling_latency_s":1.10338}1691gitlab # [ 178.620106] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.869Z","message":"No existing merge request to be cleaned up."}1692gitlab # [ 178.620592] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.873Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0b99787ec3454a51412770f1","created_at":"2026-08-20T05:56:06.746Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-79c5fa5f1ede4155","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b443142383fe9cfff18346de087f66f7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.759Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0b99787ec3454a51412770f1: done: 0.010375 sec","job_status":"done","queue_duration_s":1.103367,"scheduling_latency_s":1.10338,"redis_calls":10,"redis_duration_s":0.0013189999999999999,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000807,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006978,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010375,"completed_at":"2026-08-20T05:56:07.873Z","load_balancing_strategy":"primary","db_duration_s":0.000953,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1693gitlab # [ 178.639890] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.874Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9da69518650a5cfb85a76a98","created_at":"2026-08-20T05:56:06.746Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-79c5fa5f1ede4155","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b443142383fe9cfff18346de087f66f7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.759Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9da69518650a5cfb85a76a98: start","job_status":"start","queue_duration_s":1.114564,"scheduling_latency_s":1.114576}1694gitlab # [ 178.649658] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.880Z","message":"No existing merge request to be cleaned up."}1695gitlab # [ 178.650974] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.884Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9da69518650a5cfb85a76a98","created_at":"2026-08-20T05:56:06.746Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-79c5fa5f1ede4155","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b443142383fe9cfff18346de087f66f7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.759Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9da69518650a5cfb85a76a98: done: 0.0107 sec","job_status":"done","queue_duration_s":1.114564,"scheduling_latency_s":1.114576,"redis_calls":10,"redis_duration_s":0.001256,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000744,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007138,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0107,"completed_at":"2026-08-20T05:56:07.884Z","load_balancing_strategy":"primary","db_duration_s":0.0009,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1696gitlab # [ 178.691671] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.885Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"52154b660be73a89873d9e16","created_at":"2026-08-20T05:56:06.746Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-79c5fa5f1ede4155","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b443142383fe9cfff18346de087f66f7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.759Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-52154b660be73a89873d9e16: start","job_status":"start","queue_duration_s":1.126238,"scheduling_latency_s":1.126251}1697gitlab # [ 178.692304] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.891Z","message":"No existing merge request to be cleaned up."}1698gitlab # [ 178.692748] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:07.896Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"52154b660be73a89873d9e16","created_at":"2026-08-20T05:56:06.746Z","trace_propagation_headers":{"sentry-trace":"65a9dca818424a188236dab1edb72e8a-79c5fa5f1ede4155","baggage":"sentry-trace_id=65a9dca818424a188236dab1edb72e8a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b443142383fe9cfff18346de087f66f7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.759Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-52154b660be73a89873d9e16: done: 0.010659 sec","job_status":"done","queue_duration_s":1.126238,"scheduling_latency_s":1.126251,"redis_calls":10,"redis_duration_s":0.001308,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000774,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00718,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010659,"completed_at":"2026-08-20T05:56:07.896Z","load_balancing_strategy":"primary","db_duration_s":0.00098,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1699gitlab # [ 180.297321] postgres[2384]: [2384] ERROR: relation "table_without_models" does not exist1700gitlab # [ 180.297686] postgres[2384]: [2384] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1701gitlab # [ 183.240406] runuser[2185]: pam_unix(runuser:session): session closed for user gitlab1702gitlab # [ 183.241610] setup-gitlab-start[2155]: + systemctl restart gitlab-sidekiq.service1703gitlab # [ 183.263704] systemd[1]: Stopping gitlab-sidekiq.service...1704gitlab # [ 183.264856] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:14.285Z","message":"Shutting down"}1705gitlab # [ 183.266072] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:14.286Z","message":"Scheduler exiting..."}1706gitlab # [ 183.267295] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:14.286Z","message":"Terminating quiet threads for default capsule"}1707gitlab # [ 183.268790] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:14.286Z","message":"Scheduler exiting..."}1708gitlab # [ 183.766268] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:14.787Z","message":"Pausing to allow jobs to finish..."}1709gitlab # [ 187.271285] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:18.292Z","message":"Bye!"}1710gitlab # [ 187.295653] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-20T05:56:18.317Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1595,"worker_id":"sidekiq_0","memwd_rss_bytes":924254208,"retry":0}1711gitlab # [ 188.338599] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1712gitlab # [ 188.339337] systemd[1]: Stopped gitlab-sidekiq.service.1713gitlab # [ 188.341132] systemd[1]: gitlab-sidekiq.service: Consumed 58.236s CPU time over 1min 57.030s wall clock time, 940.5M memory peak, 4.3M read from disk.1714gitlab # [ 188.344276] systemd[1]: Started gitlab-sidekiq.service.1715gitlab # [ 188.348658] setup-gitlab-start[2155]: + mkdir -p /var/lib/secrets1716gitlab # [ 188.351763] setup-gitlab-start[2155]: + echo nixbot-test-token-of-20-chars1717gitlab # [ 188.353847] setup-gitlab-start[2155]: + chmod 644 /var/lib/secrets/gitlab-token1718gitlab # [ 188.359342] setup-gitlab-start[2155]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1719gitlab # [ 189.214204] gitaly[919]: time="2026-08-20T05:56:20.236Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVSABBGCYJ3T1SH7NB7RZ error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:56:30.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:20.235" pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1720gitlab # [ 189.223187] gitaly[919]: time="2026-08-20T05:56:20.245Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVSABBGCYJ3T1SH7NB7RZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:56:30.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:20.235" grpc.time_ms=9.089 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1721gitlab # [ 189.353446] gitaly[919]: time="2026-08-20T05:56:20.375Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVSABBGCYJ3T1SH7NB7RZ error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:56:30.144" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:20.375" pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1722gitlab # [ 189.375616] gitaly[919]: time="2026-08-20T05:56:20.396Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVSABBGCYJ3T1SH7NB7RZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:56:30.144" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:20.375" grpc.time_ms=21.448 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1723gitlab # [ 189.420563] gitaly[919]: time="2026-08-20T05:56:20.442Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVSABBGCYJ3T1SH7NB7RZ diskcache=a773f152-2c35-4f57-a5f3-0047e5ce92c0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T05:56:30.171" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:20.402" pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1724gitlab # [ 189.421426] gitaly[919]: time="2026-08-20T05:56:20.442Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1575 command.oublock=32 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVSABBGCYJ3T1SH7NB7RZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T05:56:30.171" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:20.402" grpc.time_ms=40.226 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1725gitlab # [ 189.477986] gitaly[919]: time="2026-08-20T05:56:20.499Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVSABBGCYJ3T1SH7NB7RZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:56:30.268" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:20.499" pid=919 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1726gitlab # [ 189.493561] gitaly[919]: time="2026-08-20T05:56:20.500Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVSABBGCYJ3T1SH7NB7RZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:56:30.268" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:20.499" grpc.time_ms=0.861 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1727gitlab # [ 189.502319] gitaly[919]: time="2026-08-20T05:56:20.522Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=5 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVSABBGCYJ3T1SH7NB7RZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:56:30.278" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:20.508" grpc.time_ms=13.198 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1728gitlab # [ 189.559912] gitaly[919]: time="2026-08-20T05:56:20.582Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVSABBGCYJ3T1SH7NB7RZ error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:56:30.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:20.581" pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1729gitlab # [ 189.579613] gitaly[919]: time="2026-08-20T05:56:20.582Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVSABBGCYJ3T1SH7NB7RZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:56:30.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:20.581" grpc.time_ms=0.424 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1730gitlab # [ 189.620391] gitaly[919]: time="2026-08-20T05:56:20.642Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVSABBGCYJ3T1SH7NB7RZ diskcache=4d62bb0a-6b0a-4312-a824-7ff6ca29248e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T05:56:30.003" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:20.584" pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1731gitlab # [ 189.630931] gitaly[919]: time="2026-08-20T05:56:20.653Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1572 command.oublock=32 command.real_time_ms=32 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVSABBGCYJ3T1SH7NB7RZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T05:56:30.003" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:20.584" grpc.time_ms=58.419 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1732gitlab # [ 189.647813] gitaly[919]: time="2026-08-20T05:56:20.669Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVSABBGCYJ3T1SH7NB7RZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:56:30.088" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:20.669" pid=919 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1733gitlab # [ 189.648656] gitaly[919]: time="2026-08-20T05:56:20.670Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVSABBGCYJ3T1SH7NB7RZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:56:30.088" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:20.669" grpc.time_ms=0.617 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1734gitlab # [ 189.678791] gitaly[919]: time="2026-08-20T05:56:20.700Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVSABBGCYJ3T1SH7NB7RZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:56:30.109" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:20.690" grpc.time_ms=10.379 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1735gitlab # [ 189.727634] gitaly[919]: time="2026-08-20T05:56:20.749Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVSABBGCYJ3T1SH7NB7RZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:56:30.168" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:20.749" grpc.time_ms=0.204 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1736gitlab # [ 189.746908] gitaly[919]: time="2026-08-20T05:56:20.768Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVSABBGCYJ3T1SH7NB7RZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T05:56:30.187" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:20.768" grpc.time_ms=0.49 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1737gitlab # [ 190.154343] gitaly[919]: time="2026-08-20T05:56:21.176Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVSABBGCYJ3T1SH7NB7RZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:56:31.005" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:21.165" grpc.time_ms=10.704 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1738gitlab # [ 190.491387] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:21 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 21091739gitlab # [ 190.497684] setup-gitlab-start[2155]: + mkdir -p /tmp/test-flake1740gitlab # [ 190.499778] setup-gitlab-start[2155]: + cd /tmp/test-flake1741gitlab # [ 190.501628] setup-gitlab-start[2155]: + git init -b master1742gitlab # [ 190.520233] setup-gitlab-start[2486]: Initialized empty Git repository in /tmp/test-flake/.git/1743gitlab # [ 190.523073] setup-gitlab-start[2155]: + git config user.name test1744gitlab # [ 190.524993] setup-gitlab-start[2155]: + git config user.email test@example.com1745gitlab # [ 190.527270] setup-gitlab-start[2155]: + cat1746gitlab # [ 190.528717] setup-gitlab-start[2155]: + git add flake.nix1747gitlab # [ 190.530455] setup-gitlab-start[2155]: + git commit -m 'initial commit'1748gitlab # [ 190.538690] setup-gitlab-start[2491]: [master (root-commit) 1903537] initial commit1749gitlab # [ 190.541058] setup-gitlab-start[2491]: 1 file changed, 10 insertions(+)1750gitlab # [ 190.543106] setup-gitlab-start[2491]: create mode 100644 flake.nix1751gitlab # [ 190.545119] setup-gitlab-start[2155]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1752gitlab # [ 190.548421] setup-gitlab-start[2155]: + git push -u origin master1753gitlab # [ 190.690316] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:21 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 1251754gitlab # [ 190.908875] gitaly[919]: time="2026-08-20T05:56:21.930Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVVJHAG8BR2CC6AQKANMC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:21.918" grpc.time_ms=11.892 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1755gitlab # [ 190.920043] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:21 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 2171756gitlab # [ 191.174359] gitaly[919]: time="2026-08-20T05:56:22.196Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:56:32.022" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:22.184" grpc.time_ms=11.765 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1757gitlab # [ 191.220852] gitaly[919]: time="2026-08-20T05:56:22.242Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=330 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-20T05:56:52.036" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-20T05:56:22.237" grpc.time_ms=5.488 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1758gitlab # [ 191.247140] gitaly[919]: time="2026-08-20T05:56:22.269Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0EVVVT0SER04XCE19PA5A7M duration_ms=143ns method=POST pid=919 status=200 url="http://unix/api/v4/internal/allowed"1759gitlab # [ 191.324288] gitaly[919]: time="2026-08-20T05:56:22.346Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0EVVVT0SER04XCE19PA5A7M duration_ms=74ns method=POST pid=919 status=200 url="http://unix/api/v4/internal/pre_receive"1760gitlab # [ 191.330629] gitaly[919]: time="2026-08-20T05:56:22.352Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:22.123" grpc.time_ms=229.075 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1761gitlab # [ 191.366633] sidekiq-cluster[2438]: {"severity":"INFO","time":"2026-08-20T05:56:22.372Z","message":"Starting cluster with 1 processes"}1762gitlab # [ 191.390728] gitaly[919]: time="2026-08-20T05:56:22.412Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:22.411" grpc.time_ms=0.809 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1763gitlab # [ 191.446122] gitaly[919]: time="2026-08-20T05:56:22.468Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:22.467" grpc.time_ms=0.618 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1764gitlab # [ 191.494056] gitaly[919]: time="2026-08-20T05:56:22.516Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:22.515" grpc.time_ms=0.766 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1765gitlab # [ 191.640699] gitaly[919]: time="2026-08-20T05:56:22.662Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:56:32.001" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:22.652" grpc.time_ms=10.439 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1766gitlab # [ 191.695560] gitaly[919]: time="2026-08-20T05:56:22.717Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1571 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=0 command.system_time_ms=13 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-20T05:56:32.044" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:56:22.695" grpc.time_ms=22.436 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1767gitlab # [ 191.718778] gitaly[919]: time="2026-08-20T05:56:22.731Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0EVVVT0SER04XCE19PA5A7M duration_ms=171ns method=POST pid=919 status=200 url="http://unix/api/v4/internal/post_receive"1768gitlab # [ 191.721709] gitaly[919]: time="2026-08-20T05:56:22.732Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:22.559" grpc.time_ms=172.302 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1769gitlab # [ 191.736181] gitaly[919]: time="2026-08-20T05:56:22.758Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M diskcache=6b48cb78-1a8e-48ed-a471-550c96d51fa2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:22.063" pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1770gitlab # [ 191.744509] gitaly[919]: time="2026-08-20T05:56:22.766Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=199 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13536 command.oublock=32 command.real_time_ms=679 command.spawn_token_fork_ms=0 command.system_time_ms=120 command.user_time_ms=79 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:22.063" grpc.time_ms=695.069 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1771gitlab # [ 191.756289] gitlab-workhorse[824]: time="2026-08-20T05:56:22Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521772gitlab # [ 191.758234] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:22 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 8251773gitlab # [ 191.759351] setup-gitlab-start[2495]: To http://gitlab/root/test-flake.git1774gitlab # [ 191.760125] setup-gitlab-start[2495]: * [new branch] master -> master1775gitlab # [ 191.766443] setup-gitlab-start[2495]: branch 'master' set up to track 'origin/master'.1776gitlab # [ 191.770083] systemd[1]: Finished setup-gitlab.service.1777gitlab # [ 191.773320] systemd[1]: Starting nixbot CI service...1778gitlab: (finished: waiting for unit setup-gitlab.service, in 192.76 seconds)1779gitlab: waiting for unit nixbot.service1780gitlab # [ 192.817611] nixbot[2586]: {"ts": "2026-08-20T05:56:23.839Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1781gitlab # [ 192.844193] nixbot[2586]: {"ts": "2026-08-20T05:56:23.866Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1782gitlab # [ 192.875512] nixbot[2586]: {"ts": "2026-08-20T05:56:23.897Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1783gitlab # [ 192.884666] nixbot[2586]: {"ts": "2026-08-20T05:56:23.906Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1784gitlab # [ 192.895378] nixbot[2586]: {"ts": "2026-08-20T05:56:23.917Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1785gitlab # [ 192.904209] nixbot[2586]: {"ts": "2026-08-20T05:56:23.926Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1786gitlab # [ 192.908857] nixbot[2586]: {"ts": "2026-08-20T05:56:23.930Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1787gitlab # [ 192.914436] nixbot[2586]: {"ts": "2026-08-20T05:56:23.933Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1788gitlab # [ 192.919953] nixbot[2586]: {"ts": "2026-08-20T05:56:23.942Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1789gitlab # [ 192.927275] nixbot[2586]: {"ts": "2026-08-20T05:56:23.949Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1790gitlab # [ 192.935445] nixbot[2586]: {"ts": "2026-08-20T05:56:23.957Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1791gitlab # [ 192.947790] nixbot[2586]: {"ts": "2026-08-20T05:56:23.969Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1792gitlab # [ 192.957110] nixbot[2586]: {"ts": "2026-08-20T05:56:23.979Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1793gitlab # [ 192.965058] nixbot[2586]: {"ts": "2026-08-20T05:56:23.987Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1794gitlab # [ 192.974948] nixbot[2586]: {"ts": "2026-08-20T05:56:23.996Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1795gitlab # [ 192.978336] nixbot[2586]: {"ts": "2026-08-20T05:56:24.000Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1796gitlab # [ 192.981343] nixbot[2586]: {"ts": "2026-08-20T05:56:24.003Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1797gitlab # [ 192.983994] nixbot[2586]: {"ts": "2026-08-20T05:56:24.006Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1798gitlab # [ 192.990932] nixbot[2586]: {"ts": "2026-08-20T05:56:24.012Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1799gitlab # [ 192.996996] nixbot[2586]: {"ts": "2026-08-20T05:56:24.019Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1800gitlab # [ 193.003754] nixbot[2586]: {"ts": "2026-08-20T05:56:24.025Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1801gitlab # [ 193.014313] nixbot[2586]: {"ts": "2026-08-20T05:56:24.036Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1802gitlab # [ 193.021108] nixbot[2586]: {"ts": "2026-08-20T05:56:24.043Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1803gitlab # [ 193.028267] nixbot[2586]: {"ts": "2026-08-20T05:56:24.050Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1804gitlab # [ 193.033808] nixbot[2586]: {"ts": "2026-08-20T05:56:24.055Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1805gitlab # [ 193.420397] nixbot[2586]: INFO: Started server process [2586]1806gitlab # [ 193.420979] nixbot[2586]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1807gitlab # [ 193.453238] nixbot[2586]: INFO: ::ffff:127.0.0.1:40604 - "GET /health HTTP/1.1" 200 OK1808gitlab # [ 193.459575] systemd[1]: Started nixbot CI service.1809gitlab # [ 193.462767] systemd[1]: Reached target Multi-User System.1810gitlab # [ 193.464667] systemd[1]: Startup finished in 1.235s (kernel) + 3.754s (initrd) + 3min 8.474s (userspace) = 3min 13.464s.1811gitlab # [ 193.629149] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:24 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1751812gitlab # [ 193.630695] nixbot[2586]: {"ts": "2026-08-20T05:56:24.652Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1813gitlab # [ 193.645911] nixbot[2586]: {"ts": "2026-08-20T05:56:24.667Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1814gitlab # [ 193.703272] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:24 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 431815gitlab # [ 193.703950] nixbot[2586]: {"ts": "2026-08-20T05:56:24.723Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1816gitlab # [ 193.705409] nixbot[2586]: {"ts": "2026-08-20T05:56:24.727Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1817gitlab # [ 193.901991] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:24 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 1931818gitlab # [ 193.903870] nixbot[2586]: {"ts": "2026-08-20T05:56:24.925Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1819gitlab # [ 194.046568] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:25 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1321820gitlab # [ 194.047856] nixbot[2586]: {"ts": "2026-08-20T05:56:25.069Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1821gitlab # [ 194.153284] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:25 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 951822gitlab # [ 194.154745] nixbot[2586]: {"ts": "2026-08-20T05:56:25.176Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1823gitlab # [ 194.238693] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:25 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 781824gitlab: (finished: waiting for unit nixbot.service, in 2.08 seconds)1825gitlab # [ 194.240709] nixbot[2586]: {"ts": "2026-08-20T05:56:25.262Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1826gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1827gitlab # [ 194.262053] nixbot[2586]: INFO: ::ffff:127.0.0.1:40694 - "GET /health HTTP/1.1" 200 OK1828gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.02 seconds)1829subtest: project discovered and webhook registered1830gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1831gitlab # [ 194.310488] gitaly[919]: time="2026-08-20T05:56:25.332Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVZ1NSF4GASA3Q6JQ50MR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-20T05:56:55.118" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:56:25.319" grpc.time_ms=12.15 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1832gitlab # [ 194.322684] gitaly[919]: time="2026-08-20T05:56:25.344Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVZ1NSF4GASA3Q6JQ50MR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:56:55.142" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:56:25.344" grpc.time_ms=0.618 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1833gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.08 seconds)1834(finished: subtest: project discovered and webhook registered, in 0.08 seconds)1835subtest: push delivers the webhook1836gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1837gitlab # [ 194.334177] gitaly[919]: time="2026-08-20T05:56:25.355Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVZ1NSF4GASA3Q6JQ50MR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-20T05:56:35.116" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:56:25.347" grpc.time_ms=6.772 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1838gitlab # [ 194.338995] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:25 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 511839gitlab # [ 194.354612] nixbot[2586]: {"ts": "2026-08-20T05:56:25.376Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1840gitlab # [ 194.356461] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:25 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1081841gitlab # [ 194.399689] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:25 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 191842gitlab # [ 194.451144] gitaly[919]: time="2026-08-20T05:56:25.473Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVZ6EH2JZ9DBKZ0W5N4AV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:25.466" grpc.time_ms=6.056 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1843gitlab # [ 194.462759] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:25 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 621844gitlab # Enumerating objects: 5, done.1845gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1846gitlab # Delta compression using up to 4 threads1847gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1848gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 274.00 KiB/s, done.1849gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1850gitlab # [ 194.499073] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:25 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1381851gitlab # [ 194.501408] nixbot[2586]: {"ts": "2026-08-20T05:56:25.523Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1852gitlab # [ 194.506951] nixbot[2586]: {"ts": "2026-08-20T05:56:25.528Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1853gitlab # [ 194.581262] gitaly[919]: time="2026-08-20T05:56:25.603Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVZAP5FA7R9KVDKEJ3VP1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:25.597" grpc.time_ms=5.714 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc1854gitlab # [ 194.586821] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:25 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 491855gitlab # [ 194.624763] gitaly[919]: time="2026-08-20T05:56:25.646Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=330 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVZ8VF12AMGBX3QXQHKSP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-20T05:56:55.040" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-20T05:56:25.640" grpc.time_ms=6.268 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1856gitlab # [ 194.657922] gitaly[919]: time="2026-08-20T05:56:25.679Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0EVVZ8VF12AMGBX3QXQHKSP duration_ms=86ns method=POST pid=919 status=200 url="http://unix/api/v4/internal/allowed"1857gitlab # [ 194.661047] gitaly[919]: time="2026-08-20T05:56:25.683Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVZCDSEWR8MDF1XZB38CR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:25.675" pid=919 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1858gitlab # [ 194.670068] gitaly[919]: time="2026-08-20T05:56:25.683Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVZCDSEWR8MDF1XZB38CR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:25.675" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc1859gitlab # [ 194.670643] gitlab-workhorse[824]: time="2026-08-20T05:56:25Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131860gitlab # [ 194.671056] gitaly[919]: time="2026-08-20T05:56:25.691Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVZCDSEWR8MDF1XZB38CR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:25.675" grpc.time_ms=15.725 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc1861gitlab # [ 194.687458] gitaly[919]: time="2026-08-20T05:56:25.709Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0EVVZ8VF12AMGBX3QXQHKSP duration_ms=29ns method=POST pid=919 status=200 url="http://unix/api/v4/internal/pre_receive"1862gitlab # [ 194.688665] gitaly[919]: time="2026-08-20T05:56:25.710Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVZ8VF12AMGBX3QXQHKSP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:25.592" grpc.time_ms=117.768 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1863gitlab # [ 194.705675] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:25 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 791864gitlab # [ 194.725418] gitaly[919]: time="2026-08-20T05:56:25.747Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVZ8VF12AMGBX3QXQHKSP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:25.747" grpc.time_ms=0.378 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1865gitlab # [ 194.756676] gitaly[919]: time="2026-08-20T05:56:25.778Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVZ8VF12AMGBX3QXQHKSP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:25.776" grpc.time_ms=1.451 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1866gitlab # [ 194.775592] gitaly[919]: time="2026-08-20T05:56:25.797Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVZG54HDHX1QC00QHPKHG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:25.778" pid=919 remote_ip="2001:db8:1::1" request_sha=2c5a3d0a4dc9674af3aaa7b569c28b3324e61673 response_bytes=223 span.kind=server system=grpc1867gitlab # [ 194.782980] gitaly[919]: time="2026-08-20T05:56:25.805Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVZ8VF12AMGBX3QXQHKSP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:25.804" grpc.time_ms=0.226 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1868gitlab # [ 194.792195] gitaly[919]: time="2026-08-20T05:56:25.797Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1206 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVZG54HDHX1QC00QHPKHG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:25.778" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc1869gitlab # [ 194.803324] gitaly[919]: time="2026-08-20T05:56:25.815Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1206 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVZG54HDHX1QC00QHPKHG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:25.778" grpc.time_ms=36.466 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc1870gitlab # [ 194.815111] gitlab-workhorse[824]: time="2026-08-20T05:56:25Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231871gitlab # [ 194.816721] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:25 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 811872gitlab # [ 194.878714] gitaly[919]: time="2026-08-20T05:56:25.900Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0EVVZ8VF12AMGBX3QXQHKSP duration_ms=44ns method=POST pid=919 status=200 url="http://unix/api/v4/internal/post_receive"1873gitlab # [ 194.881665] gitaly[919]: time="2026-08-20T05:56:25.902Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVZ8VF12AMGBX3QXQHKSP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:25.855" grpc.time_ms=46.518 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1874gitlab # [ 194.897917] gitaly[919]: time="2026-08-20T05:56:25.919Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVZ8VF12AMGBX3QXQHKSP diskcache=7270aaa6-1340-4e0e-b1cd-9e4ec65a42aa grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:25.545" pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1875gitlab # [ 194.906052] gitaly[919]: time="2026-08-20T05:56:25.920Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=113 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=892928 command.minflt=13133 command.oublock=32 command.real_time_ms=366 command.spawn_token_fork_ms=1 command.system_time_ms=75 command.user_time_ms=38 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVZ8VF12AMGBX3QXQHKSP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:25.545" grpc.time_ms=374.236 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1876gitlab # [ 194.917279] gitlab-workhorse[824]: time="2026-08-20T05:56:25Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521877gitlab # [ 194.917535] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:25 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 4201878gitlab # To http://gitlab/root/test-flake.git1879gitlab # 1903537..a6ac1b7 master -> master1880gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.58 seconds)1881gitlab: must succeed: git -C /tmp/test-flake rev-parse master1882gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1883gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'1884gitlab # [ 194.947306] gitaly[919]: time="2026-08-20T05:56:25.969Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVZME1ZTYQFYSQB00NXJS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=198 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:25.959" grpc.time_ms=9.865 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc1885gitlab # [ 194.957865] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:25 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1001886gitlab # [ 194.999286] gitaly[919]: time="2026-08-20T05:56:26.021Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVZQM47VQVCDQVPAK8SE8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:26.014" pid=919 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1887gitlab # [ 194.999844] gitaly[919]: time="2026-08-20T05:56:26.021Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVZQM47VQVCDQVPAK8SE8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:26.014" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc1888gitlab # [ 195.001219] gitaly[919]: time="2026-08-20T05:56:26.023Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVZQM47VQVCDQVPAK8SE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:26.014" grpc.time_ms=8.712 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc1889gitlab # [ 195.005572] nixbot[2586]: INFO: ::ffff:127.0.0.1:40708 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK1890gitlab # [ 195.031543] gitlab-workhorse[824]: time="2026-08-20T05:56:26Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671891gitlab # [ 195.031755] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:26 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 811892gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.10 seconds)1893gitlab # [ 195.081254] gitaly[919]: time="2026-08-20T05:56:26.103Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVZT6W6TAJMS5BJ1TER6A grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:26.092" pid=919 remote_ip="2001:db8:1::1" request_sha=cb9b9eea1ac78d0b1373ba7aa47a8d5597aac300 response_bytes=338 span.kind=server system=grpc1894gitlab # [ 195.081739] gitaly[919]: time="2026-08-20T05:56:26.103Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1199 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVZT6W6TAJMS5BJ1TER6A grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:26.092" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc1895gitlab # [ 195.082495] gitaly[919]: time="2026-08-20T05:56:26.103Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1199 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVZT6W6TAJMS5BJ1TER6A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:26.092" grpc.time_ms=10.81 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc1896gitlab # [ 195.092196] gitlab-workhorse[824]: time="2026-08-20T05:56:26Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3381897gitlab # [ 195.092788] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:26 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 338 "" "git/2.55.0" 591898gitlab # [ 195.189879] gitaly[919]: time="2026-08-20T05:56:26.212Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVZXSDBSCMJNJWD1BZF06 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=194 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:26.205" grpc.time_ms=6.275 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc1899gitlab # [ 195.214560] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:26 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 671900gitlab # [ 195.274541] gitaly[919]: time="2026-08-20T05:56:26.296Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVW000BSP4XWYEKKSJVEA5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:26.275" pid=919 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1901gitlab # [ 195.294603] gitaly[919]: time="2026-08-20T05:56:26.297Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1167 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=0 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVW000BSP4XWYEKKSJVEA5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:26.275" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc1902gitlab # [ 195.319353] gitlab-workhorse[824]: time="2026-08-20T05:56:26Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091903gitlab # [ 195.322812] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:26 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 581904gitlab # [ 195.323246] gitaly[919]: time="2026-08-20T05:56:26.298Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1167 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=0 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVW000BSP4XWYEKKSJVEA5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:26.275" grpc.time_ms=22.36 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc1905gitlab # [ 195.397845] gitaly[919]: time="2026-08-20T05:56:26.419Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVW049GGJ3FRADN66SJBTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:56:56.018" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:56:26.418" grpc.time_ms=0.775 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1906gitlab # [ 195.473736] gitaly[919]: time="2026-08-20T05:56:26.495Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=648 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVW049GGJ3FRADN66SJBTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-20T05:56:56.082" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:56:26.483" grpc.time_ms=12.584 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1907gitlab # [ 195.498954] gitaly[919]: time="2026-08-20T05:56:26.520Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVW049GGJ3FRADN66SJBTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:56:36.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:56:26.512" grpc.time_ms=8.056 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1908gitlab # [ 195.511522] gitaly[919]: time="2026-08-20T05:56:26.533Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVW049GGJ3FRADN66SJBTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:56:36.017" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:56:26.528" grpc.time_ms=5.263 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1909gitlab # [ 195.569728] gitaly[919]: time="2026-08-20T05:56:26.591Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVW049GGJ3FRADN66SJBTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T05:56:36.081" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:26.591" grpc.time_ms=0.191 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1910gitlab # [ 195.607826] gitaly[919]: time="2026-08-20T05:56:26.629Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVW049GGJ3FRADN66SJBTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T05:56:36.110" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:56:26.620" grpc.time_ms=9.171 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1911gitlab # [ 195.676399] gitaly[919]: time="2026-08-20T05:56:26.698Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVW049GGJ3FRADN66SJBTT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:26.697" grpc.time_ms=0.5 pid=919 span.kind=server system=grpc1912gitlab # [ 195.724835] gitaly[919]: time="2026-08-20T05:56:26.746Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVW049GGJ3FRADN66SJBTT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:26.746" grpc.time_ms=0.598 pid=919 span.kind=server system=grpc1913gitlab # [ 195.742985] gitaly[919]: time="2026-08-20T05:56:26.765Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVW049GGJ3FRADN66SJBTT diskcache=b04e786b-be1e-4fb1-93e2-12f6f9c7fe22 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:56:36.138" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:26.649" pid=919 ref=refs/keep-around/19035372a5ad1e6968ea42004b9f5bb68ce33a49 remote_ip="2001:db8:1::1" revision=19035372a5ad1e6968ea42004b9f5bb68ce33a49 span.kind=server system=grpc username=root1914gitlab # [ 195.752563] gitaly[919]: time="2026-08-20T05:56:26.765Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=99 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5511 command.oublock=8 command.real_time_ms=106 command.spawn_token_fork_ms=0 command.system_time_ms=56 command.user_time_ms=43 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVW049GGJ3FRADN66SJBTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:56:36.138" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:26.649" grpc.time_ms=116 pid=919 ref=refs/keep-around/19035372a5ad1e6968ea42004b9f5bb68ce33a49 remote_ip="2001:db8:1::1" revision=19035372a5ad1e6968ea42004b9f5bb68ce33a49 span.kind=server system=grpc username=root1915gitlab # [ 195.757353] gitaly[919]: time="2026-08-20T05:56:26.779Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVW049GGJ3FRADN66SJBTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:56:56.178" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:56:26.778" grpc.time_ms=0.503 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1916gitlab # [ 195.906110] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:26 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/19035372a5ad1e6968ea42004b9f5bb68ce33a49 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 5501917gitlab # [ 195.906460] nixbot[2586]: {"ts": "2026-08-20T05:56:26.928Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/19035372a5ad1e6968ea42004b9f5bb68ce33a49 \"HTTP/1.1 201 Created\""}1918gitlab # [ 195.914993] nixbot[2586]: {"ts": "2026-08-20T05:56:26.937Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-19035372a5ad-0"}1919gitlab # [ 195.972287] systemd[1]: Started Nix Daemon.1920gitlab # [ 196.019645] nix-daemon[2795]: accepted connection from pid 2789, user nixbot1921gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'1922gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.02 seconds)1923gitlab # [ 196.058347] nixbot[2586]: INFO: ::ffff:127.0.0.1:40716 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK1924gitlab # [ 196.106453] nix-daemon[2795]: accepted connection from pid 2802, user nixbot1925gitlab # [ 196.124251] nixbot[2586]: {"ts": "2026-08-20T05:56:27.146Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-19035372a5ad-0", "argv0": "bwrap"}1926gitlab # [ 196.252206] nix-daemon[2795]: accepted connection from pid 2815, user nixbot1927gitlab # [ 196.336967] nix-daemon[2795]: accepted connection from pid 2824, user nixbot1928gitlab # [ 196.356754] nix-daemon[2795]: accepted connection from pid 2815, user nixbot1929gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'1930gitlab # [ 197.094149] nixbot[2586]: INFO: ::ffff:127.0.0.1:40728 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK1931gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.04 seconds)1932gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'1933gitlab # [ 198.131269] nixbot[2586]: INFO: ::ffff:127.0.0.1:40736 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK1934gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.04 seconds)1935gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'1936gitlab # [ 199.167582] nixbot[2586]: INFO: ::ffff:127.0.0.1:40750 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK1937gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.04 seconds)1938gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'1939gitlab # [ 200.204386] nixbot[2586]: INFO: ::ffff:127.0.0.1:40752 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK1940gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.04 seconds)1941gitlab # [ 200.624274] nix-daemon[2795]: accepted connection from pid 2849, user nixbot1942gitlab # [ 200.658033] gitaly[919]: time="2026-08-20T05:56:31.679Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVW5873C6SQWCT1YD92DQN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:01.078" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:56:31.679" grpc.time_ms=0.6 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1943gitlab # [ 200.710293] gitaly[919]: time="2026-08-20T05:56:31.732Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVW5873C6SQWCT1YD92DQN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:56:41.074" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:56:31.724" grpc.time_ms=7.542 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1944gitlab # [ 200.777151] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:31 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/19035372a5ad1e6968ea42004b9f5bb68ce33a49 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 1751945gitlab # [ 200.784037] nixbot[2586]: {"ts": "2026-08-20T05:56:31.806Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/19035372a5ad1e6968ea42004b9f5bb68ce33a49 \"HTTP/1.1 201 Created\""}1946gitlab # [ 200.829694] gitaly[919]: time="2026-08-20T05:56:31.851Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVW5E9TC1XJ9YXNXPBEWWY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:01.250" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:56:31.850" grpc.time_ms=0.735 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1947gitlab # [ 200.881533] gitaly[919]: time="2026-08-20T05:56:31.903Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVW5E9TC1XJ9YXNXPBEWWY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:56:41.246" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:56:31.897" grpc.time_ms=5.996 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1948gitlab # [ 200.914570] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:31 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/19035372a5ad1e6968ea42004b9f5bb68ce33a49 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1191949gitlab # [ 200.919982] nixbot[2586]: {"ts": "2026-08-20T05:56:31.942Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/19035372a5ad1e6968ea42004b9f5bb68ce33a49 \"HTTP/1.1 201 Created\""}1950gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'1951gitlab # [ 201.244397] nixbot[2586]: INFO: ::ffff:127.0.0.1:40764 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK1952gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.04 seconds)1953gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'1954gitlab # [ 202.280577] nixbot[2586]: INFO: ::ffff:127.0.0.1:40780 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK1955gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.04 seconds)1956gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'1957gitlab # [ 203.318421] nixbot[2586]: INFO: ::ffff:127.0.0.1:55164 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK1958gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.04 seconds)1959gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'1960gitlab # [ 204.356541] nixbot[2586]: INFO: ::ffff:127.0.0.1:55174 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK1961gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.04 seconds)1962gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'1963gitlab # [ 205.392160] nixbot[2586]: INFO: ::ffff:127.0.0.1:55182 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK1964gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.03 seconds)1965gitlab # [ 205.406977] nix-daemon[2795]: accepted connection from pid 2900, user nixbot1966gitlab # [ 205.493919] gitaly[919]: time="2026-08-20T05:56:36.514Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVW9Z870B5QX4Z75JNY5FS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:06.113" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:56:36.513" grpc.time_ms=0.931 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1967gitlab # [ 205.531454] gitaly[919]: time="2026-08-20T05:56:36.553Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVW9Z870B5QX4Z75JNY5FS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:56:46.035" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:56:36.546" grpc.time_ms=7.147 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1968gitlab # [ 205.564402] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:36 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/19035372a5ad1e6968ea42004b9f5bb68ce33a49 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1291969gitlab # [ 205.569408] nixbot[2586]: {"ts": "2026-08-20T05:56:36.591Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/19035372a5ad1e6968ea42004b9f5bb68ce33a49 \"HTTP/1.1 201 Created\""}1970gitlab # [ 205.655876] nix-daemon[2795]: accepted connection from pid 2917, user nixbot1971gitlab # [ 205.761080] gitaly[919]: time="2026-08-20T05:56:36.783Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWA7Y2STAX2G7MCJ3PWTG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:36.772" grpc.time_ms=10.589 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc1972gitlab # [ 205.789266] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:36 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 761973gitlab # [ 205.871717] gitaly[919]: time="2026-08-20T05:56:36.893Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWAAHZTEBYN11CM1TTWKT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:36.881" pid=919 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1974gitlab # [ 205.872153] gitaly[919]: time="2026-08-20T05:56:36.893Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWAAHZTEBYN11CM1TTWKT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:36.881" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc1975gitlab # [ 205.915234] gitaly[919]: time="2026-08-20T05:56:36.937Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWAAHZTEBYN11CM1TTWKT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:36.881" grpc.time_ms=55.525 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc1976gitlab # [ 205.930861] gitlab-workhorse[824]: time="2026-08-20T05:56:36Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671977gitlab # [ 205.932538] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:36 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1341978gitlab # [ 206.020095] nix-daemon[2795]: accepted connection from pid 2942, user nixbot1979gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'1980gitlab # [ 206.429307] nixbot[2586]: INFO: ::ffff:127.0.0.1:55190 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK1981gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.04 seconds)1982gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'1983gitlab # [ 207.467507] nixbot[2586]: INFO: ::ffff:127.0.0.1:55194 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK1984gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.04 seconds)1985gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'1986gitlab # [ 208.504861] nixbot[2586]: INFO: ::ffff:127.0.0.1:55200 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK1987gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.04 seconds)1988gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'1989gitlab # [ 209.542752] nixbot[2586]: INFO: ::ffff:127.0.0.1:55204 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK1990gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.04 seconds)1991gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'1992gitlab # [ 210.579154] nixbot[2586]: INFO: ::ffff:127.0.0.1:55208 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK1993gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.04 seconds)1994gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'1995gitlab # [ 211.616519] nixbot[2586]: INFO: ::ffff:127.0.0.1:55210 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK1996gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.04 seconds)1997gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'1998gitlab # [ 212.655143] nixbot[2586]: INFO: ::ffff:127.0.0.1:55220 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK1999gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.04 seconds)2000gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'2001gitlab # [ 213.691319] nixbot[2586]: INFO: ::ffff:127.0.0.1:59436 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK2002gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.04 seconds)2003gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'2004gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.03 seconds)2005gitlab # [ 214.719662] nixbot[2586]: INFO: ::ffff:127.0.0.1:59446 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK2006gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'2007gitlab # [ 215.754148] nixbot[2586]: INFO: ::ffff:127.0.0.1:59452 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK2008gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.03 seconds)2009gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'2010gitlab # [ 216.787542] nixbot[2586]: INFO: ::ffff:127.0.0.1:59468 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK2011gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.03 seconds)2012gitlab # [ 217.087891] sidekiq-cluster[2540]: 2026-08-20T05:56:48.108Z pid=2540 tid=xtw INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2540, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>449318912}2013gitlab # [ 217.261802] sidekiq-cluster[2540]: W, [2026-08-20T05:56:48.283758 #2540] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.2014gitlab # [ 217.300502] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:56:48.322Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}2015gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'2016gitlab # [ 217.820534] nixbot[2586]: INFO: ::ffff:127.0.0.1:59484 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK2017gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.03 seconds)2018gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'2019gitlab # [ 218.853616] nixbot[2586]: INFO: ::ffff:127.0.0.1:59486 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK2020gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.03 seconds)2021gitlab # [ 219.044560] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:56:50.065Z","message":"GitLab reliable fetch activated!"}2022gitlab # [ 219.045109] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:56:50.066Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2023gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'2024gitlab # [ 219.887978] nixbot[2586]: INFO: ::ffff:127.0.0.1:59490 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK2025gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.03 seconds)2026gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'2027gitlab # [ 220.921929] nixbot[2586]: INFO: ::ffff:127.0.0.1:59506 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK2028gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.03 seconds)2029gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'2030gitlab # [ 221.955407] nixbot[2586]: INFO: ::ffff:127.0.0.1:59518 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK2031gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.03 seconds)2032gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'2033gitlab # [ 222.990794] nixbot[2586]: INFO: ::ffff:127.0.0.1:42824 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK2034gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.03 seconds)2035gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'2036gitlab # [ 224.026322] nixbot[2586]: INFO: ::ffff:127.0.0.1:42828 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK2037gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.03 seconds)2038gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'2039gitlab # [ 225.061073] nixbot[2586]: INFO: ::ffff:127.0.0.1:42842 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK2040gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.04 seconds)2041gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'2042gitlab # [ 226.098638] nixbot[2586]: INFO: ::ffff:127.0.0.1:42858 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK2043gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.04 seconds)2044gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'2045gitlab # [ 227.136428] nixbot[2586]: INFO: ::ffff:127.0.0.1:42868 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK2046gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.04 seconds)2047gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'2048gitlab # [ 228.172533] nixbot[2586]: INFO: ::ffff:127.0.0.1:42880 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK2049gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.04 seconds)2050gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'2051gitlab # [ 229.210384] nixbot[2586]: INFO: ::ffff:127.0.0.1:42886 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK2052gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.04 seconds)2053gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'2054gitlab # [ 230.248173] nixbot[2586]: INFO: ::ffff:127.0.0.1:42892 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK2055gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.04 seconds)2056gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'2057gitlab # [ 231.288553] nixbot[2586]: INFO: ::ffff:127.0.0.1:42908 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK2058gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.04 seconds)2059gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'2060gitlab # [ 232.326191] nixbot[2586]: INFO: ::ffff:127.0.0.1:42914 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK2061gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.04 seconds)2062gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'2063gitlab # [ 233.363125] nixbot[2586]: INFO: ::ffff:127.0.0.1:49790 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK2064gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.04 seconds)2065gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'2066gitlab # [ 234.401162] nixbot[2586]: INFO: ::ffff:127.0.0.1:49796 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK2067gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.04 seconds)2068gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'2069gitlab # [ 235.439286] nixbot[2586]: INFO: ::ffff:127.0.0.1:49810 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK2070gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.04 seconds)2071gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'2072gitlab # [ 236.476772] nixbot[2586]: INFO: ::ffff:127.0.0.1:49824 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK2073gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.04 seconds)2074gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'2075gitlab # [ 237.515729] nixbot[2586]: INFO: ::ffff:127.0.0.1:49826 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK2076gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.04 seconds)2077gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'2078gitlab # [ 238.551946] nixbot[2586]: INFO: ::ffff:127.0.0.1:49838 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK2079gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.04 seconds)2080gitlab # [ 239.066669] postgres[3061]: [3061] ERROR: relation "table_without_models" does not exist2081gitlab # [ 239.067092] postgres[3061]: [3061] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')2082gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'2083gitlab # [ 239.590255] nixbot[2586]: INFO: ::ffff:127.0.0.1:49852 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK2084gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.03 seconds)2085gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'2086gitlab # [ 240.624574] nixbot[2586]: INFO: ::ffff:127.0.0.1:49860 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK2087gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.03 seconds)2088gitlab # [ 241.446073] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:12.467Z","message":"Booted Rails 7.2.3.1 application in production environment"}2089gitlab # [ 241.449864] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:12.471Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}2090gitlab # [ 241.451601] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:12.471Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}2091gitlab # [ 241.453138] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:12.471Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}2092gitlab # [ 241.455065] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:12.477Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2093gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'2094gitlab # [ 241.657752] nixbot[2586]: INFO: ::ffff:127.0.0.1:49866 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK2095gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.04 seconds)2096gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'2097gitlab # [ 242.694079] nixbot[2586]: INFO: ::ffff:127.0.0.1:49878 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK2098gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.04 seconds)2099gitlab # [ 242.881317] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:13.902Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"79d5ae5d8ec8272cbf0d57cd","created_at":"2026-08-20T05:56:20.535Z","trace_propagation_headers":{"sentry-trace":"4c185e6fce6440fc8777eea6f8054c54-d8c0b966a389482b","baggage":"sentry-trace_id=4c185e6fce6440fc8777eea6f8054c54,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVVSABBGCYJ3T1SH7NB7RZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:20.563Z","job_size_bytes":2,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-79d5ae5d8ec8272cbf0d57cd: start","job_status":"start","queue_duration_s":53.33848,"scheduling_latency_s":53.33852}2100gitlab # [ 243.064933] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:14.086Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"79d5ae5d8ec8272cbf0d57cd","created_at":"2026-08-20T05:56:20.535Z","trace_propagation_headers":{"sentry-trace":"4c185e6fce6440fc8777eea6f8054c54-d8c0b966a389482b","baggage":"sentry-trace_id=4c185e6fce6440fc8777eea6f8054c54,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVVSABBGCYJ3T1SH7NB7RZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:20.563Z","job_size_bytes":2,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-79d5ae5d8ec8272cbf0d57cd: done: 0.183994 sec","job_status":"done","queue_duration_s":53.33848,"scheduling_latency_s":53.33852,"redis_calls":25,"redis_duration_s":0.008003,"redis_read_bytes":912,"redis_write_bytes":2805,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.004432,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002127,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001444,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":11,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.100552,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.097422158,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.183994,"completed_at":"2026-08-20T05:57:14.086Z","load_balancing_strategy":"primary","db_duration_s":0.052669,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2101gitlab # [ 243.140854] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:14.088Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"95a98df1a2f3587460cc97b2","created_at":"2026-08-20T05:56:20.573Z","trace_propagation_headers":{"sentry-trace":"4c185e6fce6440fc8777eea6f8054c54-d8c0b966a389482b","baggage":"sentry-trace_id=4c185e6fce6440fc8777eea6f8054c54,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVVSABBGCYJ3T1SH7NB7RZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:20.577Z","job_size_bytes":2,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-95a98df1a2f3587460cc97b2: start","job_status":"start","queue_duration_s":53.510865,"scheduling_latency_s":53.510892}2102gitlab # [ 243.153859] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:14.175Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"95a98df1a2f3587460cc97b2","created_at":"2026-08-20T05:56:20.573Z","trace_propagation_headers":{"sentry-trace":"4c185e6fce6440fc8777eea6f8054c54-d8c0b966a389482b","baggage":"sentry-trace_id=4c185e6fce6440fc8777eea6f8054c54,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVVSABBGCYJ3T1SH7NB7RZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:20.577Z","job_size_bytes":2,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-95a98df1a2f3587460cc97b2: done: 0.087361 sec","job_status":"done","queue_duration_s":53.510865,"scheduling_latency_s":53.510892,"redis_calls":14,"redis_duration_s":0.003437,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000703,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001679,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001055,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051885,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.061838307,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.087361,"completed_at":"2026-08-20T05:57:14.175Z","load_balancing_strategy":"primary","db_duration_s":0.022454,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2103gitlab # [ 243.172149] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:14.177Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"de2266c73b7a32b25282f276","created_at":"2026-08-20T05:56:21.093Z","trace_propagation_headers":{"sentry-trace":"4c185e6fce6440fc8777eea6f8054c54-d8c0b966a389482b","baggage":"sentry-trace_id=4c185e6fce6440fc8777eea6f8054c54,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVVSABBGCYJ3T1SH7NB7RZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:21.097Z","job_size_bytes":5,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-de2266c73b7a32b25282f276: start","job_status":"start","queue_duration_s":53.079155,"scheduling_latency_s":53.07917}2104gitlab # [ 243.306785] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:14.328Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"de2266c73b7a32b25282f276","created_at":"2026-08-20T05:56:21.093Z","trace_propagation_headers":{"sentry-trace":"4c185e6fce6440fc8777eea6f8054c54-d8c0b966a389482b","baggage":"sentry-trace_id=4c185e6fce6440fc8777eea6f8054c54,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVVSABBGCYJ3T1SH7NB7RZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:21.097Z","job_size_bytes":5,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-de2266c73b7a32b25282f276: done: 0.151344 sec","job_status":"done","queue_duration_s":53.079155,"scheduling_latency_s":53.07917,"redis_calls":12,"redis_duration_s":0.003281,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000893,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001953,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000435,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.117094,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000315124,"duration_s":0.151344,"completed_at":"2026-08-20T05:57:14.328Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026693,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2105gitlab # [ 243.307769] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:14.329Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"a3a694d54e38f92a72d09f90","created_at":"2026-08-20T05:56:21.118Z","trace_propagation_headers":{"sentry-trace":"4c185e6fce6440fc8777eea6f8054c54-d8c0b966a389482b","baggage":"sentry-trace_id=4c185e6fce6440fc8777eea6f8054c54,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVVSABBGCYJ3T1SH7NB7RZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:21.121Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-a3a694d54e38f92a72d09f90: start","job_status":"start","queue_duration_s":53.207857,"scheduling_latency_s":53.207871}2106gitlab # [ 243.459161] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:14.480Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"a3a694d54e38f92a72d09f90","created_at":"2026-08-20T05:56:21.118Z","trace_propagation_headers":{"sentry-trace":"4c185e6fce6440fc8777eea6f8054c54-d8c0b966a389482b","baggage":"sentry-trace_id=4c185e6fce6440fc8777eea6f8054c54,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVVSABBGCYJ3T1SH7NB7RZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:21.121Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-a3a694d54e38f92a72d09f90: done: 0.150889 sec","job_status":"done","queue_duration_s":53.207857,"scheduling_latency_s":53.207871,"redis_calls":11,"redis_duration_s":0.002491,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000671,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001386,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000434,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.126,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.126,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.081781,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031233,"duration_s":0.150889,"completed_at":"2026-08-20T05:57:14.480Z","load_balancing_strategy":"primary","db_duration_s":0.069164,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2107gitlab # [ 243.460806] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:14.482Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"7425aee3cb41f76df1f73c4b","created_at":"2026-08-20T05:56:21.124Z","trace_propagation_headers":{"sentry-trace":"4c185e6fce6440fc8777eea6f8054c54-d8c0b966a389482b","baggage":"sentry-trace_id=4c185e6fce6440fc8777eea6f8054c54,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVVSABBGCYJ3T1SH7NB7RZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:21.127Z","job_size_bytes":89,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-7425aee3cb41f76df1f73c4b: start","job_status":"start","queue_duration_s":53.354926,"scheduling_latency_s":53.354941}2108gitlab # [ 243.587502] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:14.609Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"7425aee3cb41f76df1f73c4b","created_at":"2026-08-20T05:56:21.124Z","trace_propagation_headers":{"sentry-trace":"4c185e6fce6440fc8777eea6f8054c54-d8c0b966a389482b","baggage":"sentry-trace_id=4c185e6fce6440fc8777eea6f8054c54,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVVSABBGCYJ3T1SH7NB7RZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:21.127Z","job_size_bytes":89,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-7425aee3cb41f76df1f73c4b: done: 0.126897 sec","job_status":"done","queue_duration_s":53.354926,"scheduling_latency_s":53.354941,"redis_calls":11,"redis_duration_s":0.003542,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001152,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001812,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000578,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033918,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000511797,"duration_s":0.126897,"completed_at":"2026-08-20T05:57:14.609Z","load_balancing_strategy":"primary","db_duration_s":0.006887,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2109gitlab # [ 243.589361] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:14.611Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 19035372a5ad1e6968ea42004b9f5bb68ce33a49 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"40a339d990ee1697a7e49e1a","created_at":"2026-08-20T05:56:22.601Z","trace_propagation_headers":{"sentry-trace":"11b4dd4cfb2148618199bd8ba8ee8fae-974a189d4fd14317","baggage":"sentry-trace_id=11b4dd4cfb2148618199bd8ba8ee8fae,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVVVT0SER04XCE19PA5A7M","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:22.622Z","job_size_bytes":185,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-40a339d990ee1697a7e49e1a: start","job_status":"start","queue_duration_s":51.988376,"scheduling_latency_s":51.988402}2110gitlab # [ 243.619145] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:14.626Z","message":"changes: \"0000000000000000000000000000000000000000 19035372a5ad1e6968ea42004b9f5bb68ce33a49 refs/heads/master\\n\""}2111gitlab # [ 243.636460] gitaly[919]: time="2026-08-20T05:57:14.657Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:24.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:14.646" grpc.time_ms=10.965 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2112gitlab # [ 243.651646] gitaly[919]: time="2026-08-20T05:57:14.673Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:57:24.024" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:57:14.664" grpc.time_ms=8.691 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2113gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'2114gitlab # [ 243.718627] gitaly[919]: time="2026-08-20T05:57:14.740Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-20T05:57:24.089" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:14.730" grpc.time_ms=10.401 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2115gitlab # [ 243.732604] nixbot[2586]: INFO: ::ffff:127.0.0.1:38100 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK2116gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.04 seconds)2117gitlab # [ 243.758494] gitaly[919]: time="2026-08-20T05:57:14.780Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:14.780" grpc.time_ms=0.514 pid=919 span.kind=server system=grpc2118gitlab # [ 243.786548] gitaly[919]: time="2026-08-20T05:57:14.808Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:14.807" grpc.time_ms=0.728 pid=919 span.kind=server system=grpc2119gitlab # [ 243.801436] gitaly[919]: time="2026-08-20T05:57:14.823Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M diskcache=13a4d780-dbc8-4fe2-97e3-78abd20426ba grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:57:24.115" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:57:14.756" pid=919 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2120gitlab # [ 243.801607] gitaly[919]: time="2026-08-20T05:57:14.823Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=52 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5198 command.oublock=8 command.real_time_ms=61 command.spawn_token_fork_ms=0 command.system_time_ms=33 command.user_time_ms=19 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:57:24.115" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:57:14.756" grpc.time_ms=67.546 pid=919 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2121gitlab # [ 243.817571] gitaly[919]: time="2026-08-20T05:57:14.839Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:57:24.199" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:57:14.839" grpc.time_ms=0.137 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2122gitlab # [ 243.826648] gitaly[919]: time="2026-08-20T05:57:14.848Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=944 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-20T05:57:24.201" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:14.842" grpc.time_ms=6.7 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2123gitlab # [ 243.879215] gitaly[919]: time="2026-08-20T05:57:14.901Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=339 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-20T05:57:44.094" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:14.895" grpc.time_ms=6.15 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2124gitlab # [ 243.906668] gitaly[919]: time="2026-08-20T05:57:14.928Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T05:57:24.288" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:57:14.928" grpc.time_ms=0.173 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2125gitlab # [ 243.923784] gitaly[919]: time="2026-08-20T05:57:14.945Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=342 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-20T05:57:24.010" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-20T05:57:14.940" grpc.time_ms=5.445 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2126gitlab # [ 243.957705] gitaly[919]: time="2026-08-20T05:57:14.979Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:24.039" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:14.970" grpc.time_ms=9.477 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2127gitlab # [ 243.976294] gitaly[919]: time="2026-08-20T05:57:14.998Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:24.061" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:14.991" grpc.time_ms=6.774 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2128gitlab # [ 244.002833] gitaly[919]: time="2026-08-20T05:57:15.024Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=960 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T05:57:45.009" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:15.009" grpc.time_ms=15.373 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2129gitlab # [ 244.362645] gitaly[919]: time="2026-08-20T05:57:15.384Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-20T05:57:25.002" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:15.383" grpc.time_ms=1.651 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2130gitlab # [ 244.399071] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:15.420Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 19035372a5ad1e6968ea42004b9f5bb68ce33a49 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"40a339d990ee1697a7e49e1a","created_at":"2026-08-20T05:56:22.601Z","trace_propagation_headers":{"sentry-trace":"11b4dd4cfb2148618199bd8ba8ee8fae-974a189d4fd14317","baggage":"sentry-trace_id=11b4dd4cfb2148618199bd8ba8ee8fae,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVVVT0SER04XCE19PA5A7M","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:22.622Z","job_size_bytes":185,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-40a339d990ee1697a7e49e1a: done: 0.809243 sec","job_status":"done","queue_duration_s":51.988376,"scheduling_latency_s":51.988402,"gitaly_calls":13,"gitaly_duration_s":0.210398,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.043136,"redis_read_bytes":2103,"redis_write_bytes":21749,"redis_cache_calls":15,"redis_cache_duration_s":0.003415,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.00673,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001764,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7837,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003368,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.01596,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.011899,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.048,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.177,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.191,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.048,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.50669,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000472686,"exclusive_lock_hold_duration_s":0.02779208,"duration_s":0.809243,"completed_at":"2026-08-20T05:57:15.420Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.082781,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2131gitlab # [ 244.440972] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:15.421Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","19035372a5ad1e6968ea42004b9f5bb68ce33a49 a6ac1b7991d2bc1bc95c8c78e7358dd194da811f refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"d8055ff38bc5bfb261ac820a","created_at":"2026-08-20T05:56:25.886Z","trace_propagation_headers":{"sentry-trace":"7d8dfbc99890482e81e840140f445e84-0ed502363fdb4b83","baggage":"sentry-trace_id=7d8dfbc99890482e81e840140f445e84,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVVZ8VF12AMGBX3QXQHKSP","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:25.888Z","job_size_bytes":185,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-d8055ff38bc5bfb261ac820a: start","job_status":"start","queue_duration_s":49.53289,"scheduling_latency_s":49.532928}2132gitlab # [ 244.442044] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:15.430Z","message":"changes: \"19035372a5ad1e6968ea42004b9f5bb68ce33a49 a6ac1b7991d2bc1bc95c8c78e7358dd194da811f refs/heads/master\\n\""}2133gitlab # [ 244.444238] gitaly[919]: time="2026-08-20T05:57:15.452Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVZ8VF12AMGBX3QXQHKSP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:25.063" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:15.443" grpc.time_ms=8.406 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2134gitlab # [ 244.479119] gitaly[919]: time="2026-08-20T05:57:15.466Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVZ8VF12AMGBX3QXQHKSP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:57:25.075" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:57:15.455" grpc.time_ms=10.206 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2135gitlab # [ 244.479710] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:15.471Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"dd8d8ccf9f8da2752cac4936","created_at":"2026-08-20T05:57:15.468Z","trace_propagation_headers":{"sentry-trace":"7d8dfbc99890482e81e840140f445e84-5762740324154427","baggage":"sentry-trace_id=7d8dfbc99890482e81e840140f445e84,sentry-release=Unknown"},"correlation_id":"01M0EVVZ8VF12AMGBX3QXQHKSP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"41bb1df502fea2d42e42c355","job_size_bytes":46,"pid":2540,"job_status":"deduplicated","message":"ProjectCacheWorker JID-dd8d8ccf9f8da2752cac4936: deduplicated: until executing","deduplication.type":"until executing"}2136gitlab # [ 244.480450] gitaly[919]: time="2026-08-20T05:57:15.491Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVZ8VF12AMGBX3QXQHKSP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-20T05:57:25.104" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:15.484" grpc.time_ms=7.252 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2137gitlab # [ 244.487765] gitaly[919]: time="2026-08-20T05:57:15.505Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=655 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVZ8VF12AMGBX3QXQHKSP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-20T05:57:45.495" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:15.495" grpc.time_ms=9.671 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2138gitlab # [ 244.499970] gitaly[919]: time="2026-08-20T05:57:15.521Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=347 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVZ8VF12AMGBX3QXQHKSP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-20T05:57:25.135" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-20T05:57:15.515" grpc.time_ms=5.849 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2139gitlab # [ 244.518585] gitaly[919]: time="2026-08-20T05:57:15.540Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVZ8VF12AMGBX3QXQHKSP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:25.152" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:15.532" grpc.time_ms=7.661 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2140gitlab # [ 244.643814] gitaly[919]: time="2026-08-20T05:57:15.665Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVZ8VF12AMGBX3QXQHKSP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-20T05:57:25.221" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:15.601" grpc.time_ms=63.079 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2141gitlab # [ 244.672720] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:15.694Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","19035372a5ad1e6968ea42004b9f5bb68ce33a49 a6ac1b7991d2bc1bc95c8c78e7358dd194da811f refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"d8055ff38bc5bfb261ac820a","created_at":"2026-08-20T05:56:25.886Z","trace_propagation_headers":{"sentry-trace":"7d8dfbc99890482e81e840140f445e84-0ed502363fdb4b83","baggage":"sentry-trace_id=7d8dfbc99890482e81e840140f445e84,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVVZ8VF12AMGBX3QXQHKSP","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:25.888Z","job_size_bytes":185,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-d8055ff38bc5bfb261ac820a: done: 0.272461 sec","job_status":"done","queue_duration_s":49.53289,"scheduling_latency_s":49.532928,"gitaly_calls":7,"gitaly_duration_s":0.138179,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.021216,"redis_read_bytes":500,"redis_write_bytes":11942,"redis_cache_calls":9,"redis_cache_duration_s":0.001959,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.000946,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5719,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003611,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.006821,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.007879,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.015,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.015,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.170167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000457041,"exclusive_lock_hold_duration_s":0.015627685,"duration_s":0.272461,"completed_at":"2026-08-20T05:57:15.694Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022487,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2142gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'2143gitlab # [ 244.681759] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:15.696Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"a3cd9d032fd75d1078867941","created_at":"2026-08-20T05:56:26.789Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-258f516337184d6e","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:26.796Z","job_size_bytes":65,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-a3cd9d032fd75d1078867941: start","job_status":"start","queue_duration_s":48.899943,"scheduling_latency_s":48.899976}2144gitlab # [ 244.762529] nixbot[2586]: INFO: ::ffff:127.0.0.1:38106 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK2145gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.03 seconds)2146gitlab # [ 244.768033] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:15.788Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"a3cd9d032fd75d1078867941","created_at":"2026-08-20T05:56:26.789Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-258f516337184d6e","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:26.796Z","job_size_bytes":65,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-a3cd9d032fd75d1078867941: done: 0.092789 sec","job_status":"done","queue_duration_s":48.899943,"scheduling_latency_s":48.899976,"redis_calls":16,"redis_duration_s":0.006,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001415,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003556,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001029,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.064866,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00058555,"duration_s":0.092789,"completed_at":"2026-08-20T05:57:15.788Z","load_balancing_strategy":"primary","db_duration_s":0.015129,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2147gitlab # [ 244.770270] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:15.792Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"b3893f28e42bc5ccc60f94fa","created_at":"2026-08-20T05:56:26.796Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-258f516337184d6e","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:26.801Z","job_size_bytes":65,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-b3893f28e42bc5ccc60f94fa: start","job_status":"start","queue_duration_s":48.990545,"scheduling_latency_s":48.990585}2148gitlab # [ 244.874412] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:15.895Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"b3893f28e42bc5ccc60f94fa","created_at":"2026-08-20T05:56:26.796Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-258f516337184d6e","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:26.801Z","job_size_bytes":65,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-b3893f28e42bc5ccc60f94fa: done: 0.103889 sec","job_status":"done","queue_duration_s":48.990545,"scheduling_latency_s":48.990585,"redis_calls":21,"redis_duration_s":0.005331,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.002592,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001532,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001207,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.064521,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000276013,"duration_s":0.103889,"completed_at":"2026-08-20T05:57:15.895Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026679,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2149gitlab # [ 244.921688] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:15.943Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"c4bb94c637f1458e93086bf1","created_at":"2026-08-20T05:56:26.893Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-258f516337184d6e","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:26.902Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-c4bb94c637f1458e93086bf1: start","job_status":"start","queue_duration_s":49.04082,"scheduling_latency_s":49.040844}2150gitlab # [ 245.130614] gitaly[919]: time="2026-08-20T05:57:16.152Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVW049GGJ3FRADN66SJBTT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:16.152" grpc.time_ms=0.538 pid=919 span.kind=server system=grpc2151gitlab # [ 245.182159] gitaly[919]: time="2026-08-20T05:57:16.204Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVW049GGJ3FRADN66SJBTT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:16.203" grpc.time_ms=0.528 pid=919 span.kind=server system=grpc2152gitlab # [ 245.238772] gitaly[919]: time="2026-08-20T05:57:16.260Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVW049GGJ3FRADN66SJBTT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:16.260" grpc.time_ms=0.601 pid=919 span.kind=server system=grpc2153gitlab # [ 245.266542] gitaly[919]: time="2026-08-20T05:57:16.288Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVW049GGJ3FRADN66SJBTT diskcache=ce97f6aa-fb47-4d82-acea-72d3137e71a8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:57:46.109" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:16.109" pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2154gitlab # [ 245.282357] gitaly[919]: time="2026-08-20T05:57:16.304Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=155 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7344 command.oublock=0 command.real_time_ms=171 command.spawn_token_fork_ms=0 command.system_time_ms=96 command.user_time_ms=59 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVW049GGJ3FRADN66SJBTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:57:46.109" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:16.109" grpc.time_ms=178.968 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2155gitlab # [ 245.416655] gitaly[919]: time="2026-08-20T05:57:16.438Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVW049GGJ3FRADN66SJBTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T05:57:46.436" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:16.437" grpc.time_ms=1.197 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2156gitlab # [ 245.459522] gitaly[919]: time="2026-08-20T05:57:16.481Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVW049GGJ3FRADN66SJBTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:46.479" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:16.480" grpc.time_ms=0.878 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2157gitlab # [ 245.472755] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:16.494Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"c4bb94c637f1458e93086bf1","created_at":"2026-08-20T05:56:26.893Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-258f516337184d6e","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:26.902Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2540,"job_status":"rescheduled","message":"PipelineProcessWorker JID-c4bb94c637f1458e93086bf1: rescheduled"}2158gitlab # [ 245.478538] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:16.500Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"c4bb94c637f1458e93086bf1","created_at":"2026-08-20T05:56:26.893Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-258f516337184d6e","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:26.902Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-c4bb94c637f1458e93086bf1: done: 0.557156 sec","job_status":"done","queue_duration_s":49.04082,"scheduling_latency_s":49.040844,"gitaly_calls":3,"gitaly_duration_s":0.205388,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.031047,"redis_read_bytes":462,"redis_write_bytes":29292,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001682,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001493,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.011036,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.004479,"redis_queues_read_bytes":39,"redis_queues_write_bytes":15579,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.006671,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.0007,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00072,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002584,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.063,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.027,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.031,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.032,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.257579,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.490925523,"duration_s":0.557156,"completed_at":"2026-08-20T05:57:16.500Z","load_balancing_strategy":"primary","db_duration_s":0.075422,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2159gitlab # [ 245.516734] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:16.501Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"41bb1df502fea2d42e42c355","created_at":"2026-08-20T05:57:14.677Z","trace_propagation_headers":{"sentry-trace":"11b4dd4cfb2148618199bd8ba8ee8fae-3f7aefa584cf4c66","baggage":"sentry-trace_id=11b4dd4cfb2148618199bd8ba8ee8fae,sentry-release=Unknown"},"correlation_id":"01M0EVVVT0SER04XCE19PA5A7M","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:14.702Z","job_size_bytes":46,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-41bb1df502fea2d42e42c355: start","job_status":"start","queue_duration_s":1.799539,"scheduling_latency_s":1.799554}2160gitlab # [ 245.529604] gitaly[919]: time="2026-08-20T05:57:16.536Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-20T11:57:16.531" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:57:16.531" grpc.time_ms=4.737 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2161gitlab # [ 245.579939] gitaly[919]: time="2026-08-20T05:57:16.602Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=649 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-20T05:57:46.591" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:16.592" grpc.time_ms=9.649 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2162gitlab # [ 245.626428] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:16.647Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"41bb1df502fea2d42e42c355","created_at":"2026-08-20T05:57:14.677Z","trace_propagation_headers":{"sentry-trace":"11b4dd4cfb2148618199bd8ba8ee8fae-3f7aefa584cf4c66","baggage":"sentry-trace_id=11b4dd4cfb2148618199bd8ba8ee8fae,sentry-release=Unknown"},"correlation_id":"01M0EVVVT0SER04XCE19PA5A7M","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:14.702Z","job_size_bytes":46,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-41bb1df502fea2d42e42c355: done: 0.146206 sec","job_status":"done","queue_duration_s":1.799539,"scheduling_latency_s":1.799554,"gitaly_calls":2,"gitaly_duration_s":0.075414,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.007631,"redis_read_bytes":69,"redis_write_bytes":4883,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001593,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.0007,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001945,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.002681,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":748,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000712,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04967,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000432737,"duration_s":0.146206,"completed_at":"2026-08-20T05:57:16.647Z","load_balancing_strategy":"primary","db_duration_s":0.012767,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2163gitlab # [ 245.629923] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:16.650Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"c8e383d0eaa46f9522c55dc4","created_at":"2026-08-20T05:57:14.719Z","trace_propagation_headers":{"sentry-trace":"11b4dd4cfb2148618199bd8ba8ee8fae-3f7aefa584cf4c66","baggage":"sentry-trace_id=11b4dd4cfb2148618199bd8ba8ee8fae,sentry-release=Unknown"},"correlation_id":"01M0EVVVT0SER04XCE19PA5A7M","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:14.725Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-c8e383d0eaa46f9522c55dc4: start","job_status":"start","queue_duration_s":1.924971,"scheduling_latency_s":1.925002}2164gitlab # [ 245.684582] gitaly[919]: time="2026-08-20T05:57:16.706Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M diskcache=356ab0c2-5fe7-47e6-ac62-2a9af77188ea grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T11:57:16.677" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:16.677" pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2165gitlab # [ 245.685317] gitaly[919]: time="2026-08-20T05:57:16.706Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1284 command.oublock=0 command.real_time_ms=30 command.spawn_token_fork_ms=0 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T11:57:16.677" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:16.677" grpc.time_ms=28.543 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2166gitlab # [ 245.712433] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:16.734Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"c8e383d0eaa46f9522c55dc4","created_at":"2026-08-20T05:57:14.719Z","trace_propagation_headers":{"sentry-trace":"11b4dd4cfb2148618199bd8ba8ee8fae-3f7aefa584cf4c66","baggage":"sentry-trace_id=11b4dd4cfb2148618199bd8ba8ee8fae,sentry-release=Unknown"},"correlation_id":"01M0EVVVT0SER04XCE19PA5A7M","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:14.725Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-c8e383d0eaa46f9522c55dc4: done: 0.084162 sec","job_status":"done","queue_duration_s":1.924971,"scheduling_latency_s":1.925002,"gitaly_calls":1,"gitaly_duration_s":0.031484,"redis_calls":15,"redis_duration_s":0.00398,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000546,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001327,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000822,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001285,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.008,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.015,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031426,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.060323867999999996,"duration_s":0.084162,"completed_at":"2026-08-20T05:57:16.734Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015482,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2167gitlab # [ 245.752137] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:16.773Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"8a178e345887ca4e4e8b0abe","created_at":"2026-08-20T05:57:14.834Z","trace_propagation_headers":{"sentry-trace":"11b4dd4cfb2148618199bd8ba8ee8fae-3f7aefa584cf4c66","baggage":"sentry-trace_id=11b4dd4cfb2148618199bd8ba8ee8fae,sentry-release=Unknown"},"correlation_id":"01M0EVVVT0SER04XCE19PA5A7M","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:14.836Z","job_size_bytes":23,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-8a178e345887ca4e4e8b0abe: start","job_status":"start","queue_duration_s":1.93675,"scheduling_latency_s":1.936798}2168gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'2169gitlab # [ 245.804166] nixbot[2586]: INFO: ::ffff:127.0.0.1:38108 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK2170gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.04 seconds)2171gitlab # [ 245.804898] gitaly[919]: time="2026-08-20T05:57:16.826Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=651 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-20T05:57:46.014" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:16.815" grpc.time_ms=11.224 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2172gitlab # [ 245.818788] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:16.840Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"8a178e345887ca4e4e8b0abe","created_at":"2026-08-20T05:57:14.834Z","trace_propagation_headers":{"sentry-trace":"11b4dd4cfb2148618199bd8ba8ee8fae-3f7aefa584cf4c66","baggage":"sentry-trace_id=11b4dd4cfb2148618199bd8ba8ee8fae,sentry-release=Unknown"},"correlation_id":"01M0EVVVT0SER04XCE19PA5A7M","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:14.836Z","job_size_bytes":23,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-8a178e345887ca4e4e8b0abe: done: 0.066641 sec","job_status":"done","queue_duration_s":1.93675,"scheduling_latency_s":1.936798,"gitaly_calls":1,"gitaly_duration_s":0.015062,"redis_calls":16,"redis_duration_s":0.005664,"redis_read_bytes":52,"redis_write_bytes":2048,"redis_queues_calls":1,"redis_queues_duration_s":0.000484,"redis_queues_read_bytes":1,"redis_queues_write_bytes":979,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001721,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.002395,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001064,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038607,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.066641,"completed_at":"2026-08-20T05:57:16.840Z","load_balancing_strategy":"primary","db_duration_s":0.004265,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2173gitlab # [ 245.855116] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:16.876Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"676b9a50507de63431502e8c","created_at":"2026-08-20T05:57:15.261Z","trace_propagation_headers":{"sentry-trace":"11b4dd4cfb2148618199bd8ba8ee8fae-3f7aefa584cf4c66","baggage":"sentry-trace_id=11b4dd4cfb2148618199bd8ba8ee8fae,sentry-release=Unknown"},"correlation_id":"01M0EVVVT0SER04XCE19PA5A7M","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2c4fd889c0a2dd99022f6d8b1a145e0f806d6566510768b294198059299bf051","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:15.266Z","job_size_bytes":467,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-676b9a50507de63431502e8c: start","job_status":"start","queue_duration_s":1.610455,"scheduling_latency_s":1.610489}2174gitlab # [ 245.910255] gitaly[919]: time="2026-08-20T05:57:16.932Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:46.131" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:16.931" grpc.time_ms=0.686 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2175gitlab # [ 245.933620] gitaly[919]: time="2026-08-20T05:57:16.955Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T05:57:26.015" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:16.945" grpc.time_ms=9.505 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2176gitlab # [ 246.027090] gitaly[919]: time="2026-08-20T05:57:17.049Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T05:57:47.047" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:17.048" grpc.time_ms=1.047 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2177gitlab # [ 246.057753] gitaly[919]: time="2026-08-20T05:57:17.079Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=86 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-20T05:57:47.075" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:17.076" grpc.time_ms=3.236 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2178gitlab # [ 246.181283] gitaly[919]: time="2026-08-20T05:57:17.203Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:27.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:17.193" grpc.time_ms=9.438 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2179gitlab # [ 246.541448] gitaly[919]: time="2026-08-20T05:57:17.563Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=966 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T05:57:47.545" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:17.545" grpc.time_ms=17.821 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2180gitlab # [ 246.558289] gitaly[919]: time="2026-08-20T05:57:17.580Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVVT0SER04XCE19PA5A7M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-20T05:57:47.567" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:17.567" grpc.time_ms=12.337 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2181gitlab # [ 246.629638] sidekiq-cluster[2540]: {"severity":"WARN","time":"2026-08-20T05:57:17.651Z","class":"CreatePipelineWorker","correlation_id":"01M0EVVVT0SER04XCE19PA5A7M","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"19035372a5ad1e6968ea42004b9f5bb68ce33a49","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"19035372a5ad1e6968ea42004b9f5bb68ce33a49","ref":"refs/heads/master"},"retry":0}2182gitlab # [ 246.639556] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:17.661Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"676b9a50507de63431502e8c","created_at":"2026-08-20T05:57:15.261Z","trace_propagation_headers":{"sentry-trace":"11b4dd4cfb2148618199bd8ba8ee8fae-3f7aefa584cf4c66","baggage":"sentry-trace_id=11b4dd4cfb2148618199bd8ba8ee8fae,sentry-release=Unknown"},"correlation_id":"01M0EVVVT0SER04XCE19PA5A7M","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2c4fd889c0a2dd99022f6d8b1a145e0f806d6566510768b294198059299bf051","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:15.266Z","job_size_bytes":467,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-676b9a50507de63431502e8c: done: 0.784212 sec","job_status":"done","queue_duration_s":1.610455,"scheduling_latency_s":1.610489,"gitaly_calls":7,"gitaly_duration_s":0.145436,"redis_calls":51,"redis_duration_s":0.011928,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.000785,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.004769,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002007,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003058,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001309,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.595373,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000525486,"duration_s":0.784212,"completed_at":"2026-08-20T05:57:17.660Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.048815,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2183gitlab # [ 246.652563] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:17.663Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"6782b41f-d730-4b09-b7c3-8ecdf3c032a7\"}"],"class":"WebHookWorker","jid":"97ad2b303d38231bb862e732","created_at":"2026-08-20T05:57:15.354Z","trace_propagation_headers":{"sentry-trace":"11b4dd4cfb2148618199bd8ba8ee8fae-3f7aefa584cf4c66","baggage":"sentry-trace_id=11b4dd4cfb2148618199bd8ba8ee8fae,sentry-release=Unknown"},"correlation_id":"01M0EVVVT0SER04XCE19PA5A7M","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d307b0a8165dd3b6d9b9b1f5826cd07d4a0f03808692eec9cf92773a7f032d80","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:15.359Z","job_size_bytes":1751,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-97ad2b303d38231bb862e732: start","job_status":"start","queue_duration_s":2.304319,"scheduling_latency_s":2.30435}2184gitlab # [ 246.747825] nixbot[2586]: INFO: ::ffff:127.0.0.1:38120 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2185gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'2186gitlab # [ 246.769088] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:17.790Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"6782b41f-d730-4b09-b7c3-8ecdf3c032a7\"}"],"class":"WebHookWorker","jid":"97ad2b303d38231bb862e732","created_at":"2026-08-20T05:57:15.354Z","trace_propagation_headers":{"sentry-trace":"11b4dd4cfb2148618199bd8ba8ee8fae-3f7aefa584cf4c66","baggage":"sentry-trace_id=11b4dd4cfb2148618199bd8ba8ee8fae,sentry-release=Unknown"},"correlation_id":"01M0EVVVT0SER04XCE19PA5A7M","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d307b0a8165dd3b6d9b9b1f5826cd07d4a0f03808692eec9cf92773a7f032d80","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:15.359Z","job_size_bytes":1751,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-97ad2b303d38231bb862e732: done: 0.12712 sec","job_status":"done","queue_duration_s":2.304319,"scheduling_latency_s":2.30435,"redis_calls":19,"redis_duration_s":0.004164,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001172,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000347,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001674,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000971,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.04708726900000215,"cpu_s":0.065277,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000320991,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.12712,"completed_at":"2026-08-20T05:57:17.790Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003011,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2187gitlab # [ 246.811139] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:17.792Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"9285d253aacfcd66f6668403","created_at":"2026-08-20T05:57:15.477Z","trace_propagation_headers":{"sentry-trace":"7d8dfbc99890482e81e840140f445e84-5762740324154427","baggage":"sentry-trace_id=7d8dfbc99890482e81e840140f445e84,sentry-release=Unknown"},"correlation_id":"01M0EVVZ8VF12AMGBX3QXQHKSP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"c8e383d0eaa46f9522c55dc4","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:15.479Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-9285d253aacfcd66f6668403: start","job_status":"start","queue_duration_s":2.312563,"scheduling_latency_s":2.312588}2188gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.02 seconds)2189gitlab # [ 246.831144] nixbot[2586]: INFO: ::ffff:127.0.0.1:38126 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK2190gitlab # [ 246.838059] gitaly[919]: time="2026-08-20T05:57:17.859Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=5 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVXJB6RNGHQ1HM1GEP0DY8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:17.851" grpc.time_ms=8.675 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc2191gitlab # [ 246.838583] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:17 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 612192gitlab # [ 246.852442] gitaly[919]: time="2026-08-20T05:57:17.874Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVZ8VF12AMGBX3QXQHKSP diskcache=10c19a11-e787-4d7f-9ead-050ffdf3f22c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T11:57:17.851" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:17.851" pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2193gitlab # [ 246.860486] gitaly[919]: time="2026-08-20T05:57:17.882Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=315 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=4 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVZ8VF12AMGBX3QXQHKSP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T11:57:17.851" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:17.851" grpc.time_ms=22.748 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2194gitlab # [ 246.885924] gitaly[919]: time="2026-08-20T05:57:17.908Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXJD6BHAJMBA4D5W7YG61 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:17.902" pid=919 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2195gitlab # [ 246.886290] gitaly[919]: time="2026-08-20T05:57:17.908Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXJD6BHAJMBA4D5W7YG61 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:17.902" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc2196gitlab # [ 246.886917] gitaly[919]: time="2026-08-20T05:57:17.908Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXJD6BHAJMBA4D5W7YG61 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:17.902" grpc.time_ms=6.196 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc2197gitlab # [ 246.887479] gitlab-workhorse[824]: time="2026-08-20T05:57:17Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672198gitlab # [ 246.887859] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:17 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 462199gitlab # [ 246.888995] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:17.910Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"9285d253aacfcd66f6668403","created_at":"2026-08-20T05:57:15.477Z","trace_propagation_headers":{"sentry-trace":"7d8dfbc99890482e81e840140f445e84-5762740324154427","baggage":"sentry-trace_id=7d8dfbc99890482e81e840140f445e84,sentry-release=Unknown"},"correlation_id":"01M0EVVZ8VF12AMGBX3QXQHKSP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"c8e383d0eaa46f9522c55dc4","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:15.479Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-9285d253aacfcd66f6668403: done: 0.117964 sec","job_status":"done","queue_duration_s":2.312563,"scheduling_latency_s":2.312588,"gitaly_calls":1,"gitaly_duration_s":0.081574,"redis_calls":12,"redis_duration_s":0.003869,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00253,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00036,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025291,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.093933726,"duration_s":0.117964,"completed_at":"2026-08-20T05:57:17.910Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005542,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2200gitlab # [ 246.936708] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:17.914Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"49f26f701602fef21b55fe4e","created_at":"2026-08-20T05:57:15.579Z","trace_propagation_headers":{"sentry-trace":"7d8dfbc99890482e81e840140f445e84-5762740324154427","baggage":"sentry-trace_id=7d8dfbc99890482e81e840140f445e84,sentry-release=Unknown"},"correlation_id":"01M0EVVZ8VF12AMGBX3QXQHKSP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c6b98685dcc3234d419dfb95e427b57eb6c30924309cf4ce13f15f4fde279e7b","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:15.581Z","job_size_bytes":467,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-49f26f701602fef21b55fe4e: start","job_status":"start","queue_duration_s":2.33248,"scheduling_latency_s":2.332506}2201gitlab # [ 246.972949] nixbot[2586]: {"ts": "2026-08-20T05:57:17.995Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2202gitlab # [ 246.979784] gitaly[919]: time="2026-08-20T05:57:18.001Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVZ8VF12AMGBX3QXQHKSP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:48.000" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:18.001" grpc.time_ms=0.671 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2203gitlab # [ 246.986985] gitaly[919]: time="2026-08-20T05:57:18.009Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVZ8VF12AMGBX3QXQHKSP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T05:57:28.004" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:18.004" grpc.time_ms=4.609 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2204gitlab # [ 247.009863] gitaly[919]: time="2026-08-20T05:57:18.032Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVZ8VF12AMGBX3QXQHKSP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T05:57:48.031" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:18.031" grpc.time_ms=0.566 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2205gitlab # [ 247.023828] gitaly[919]: time="2026-08-20T05:57:18.045Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=229 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVZ8VF12AMGBX3QXQHKSP error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-20T05:57:48.043" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:18.043" grpc.time_ms=2.397 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2206gitlab # [ 247.044048] gitaly[919]: time="2026-08-20T05:57:18.066Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXJJAVJCWSHY01NCXP6N4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:48.065" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:18.065" grpc.time_ms=0.392 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2207gitlab # [ 247.054659] gitaly[919]: time="2026-08-20T05:57:18.076Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVZ8VF12AMGBX3QXQHKSP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:28.061" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:18.062" grpc.time_ms=14.53 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2208gitlab # [ 247.093262] gitaly[919]: time="2026-08-20T05:57:18.115Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVXJJAVJCWSHY01NCXP6N4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:28.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:18.109" grpc.time_ms=5.895 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2209gitlab # [ 247.129258] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:18 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/19035372a5ad1e6968ea42004b9f5bb68ce33a49 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 1242210gitlab # [ 247.130206] nixbot[2586]: {"ts": "2026-08-20T05:57:18.152Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/19035372a5ad1e6968ea42004b9f5bb68ce33a49 \"HTTP/1.1 201 Created\""}2211gitlab # [ 247.167629] gitaly[919]: time="2026-08-20T05:57:18.189Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXJPCBX8P6QRWH43DQ6E0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:48.188" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:18.188" grpc.time_ms=0.848 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2212gitlab # [ 247.204944] gitaly[919]: time="2026-08-20T05:57:18.226Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVXJPCBX8P6QRWH43DQ6E0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:28.120" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:18.221" grpc.time_ms=5.752 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2213gitlab # [ 247.255613] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:18 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/19035372a5ad1e6968ea42004b9f5bb68ce33a49 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1212214gitlab # [ 247.261722] nixbot[2586]: {"ts": "2026-08-20T05:57:18.283Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/19035372a5ad1e6968ea42004b9f5bb68ce33a49 \"HTTP/1.1 201 Created\""}2215gitlab # [ 247.312345] gitaly[919]: time="2026-08-20T05:57:18.334Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXJTJ54XF68X52P4STSX1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:48.132" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:18.333" grpc.time_ms=0.797 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2216gitlab # [ 247.420402] gitaly[919]: time="2026-08-20T05:57:18.442Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVXJTJ54XF68X52P4STSX1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:28.201" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:18.431" grpc.time_ms=10.68 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2217gitlab # [ 247.463463] gitaly[919]: time="2026-08-20T05:57:18.485Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=967 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVZ8VF12AMGBX3QXQHKSP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T05:57:48.476" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:18.476" grpc.time_ms=8.893 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2218gitlab # [ 247.482954] gitaly[919]: time="2026-08-20T05:57:18.496Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVZ8VF12AMGBX3QXQHKSP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-20T05:57:48.487" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:18.488" grpc.time_ms=8.137 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2219gitlab # [ 247.483428] sidekiq-cluster[2540]: {"severity":"WARN","time":"2026-08-20T05:57:18.504Z","class":"CreatePipelineWorker","correlation_id":"01M0EVVZ8VF12AMGBX3QXQHKSP","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"19035372a5ad1e6968ea42004b9f5bb68ce33a49","after":"a6ac1b7991d2bc1bc95c8c78e7358dd194da811f","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"a6ac1b7991d2bc1bc95c8c78e7358dd194da811f","ref":"refs/heads/master"},"retry":0}2220gitlab # [ 247.487172] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:18.509Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"49f26f701602fef21b55fe4e","created_at":"2026-08-20T05:57:15.579Z","trace_propagation_headers":{"sentry-trace":"7d8dfbc99890482e81e840140f445e84-5762740324154427","baggage":"sentry-trace_id=7d8dfbc99890482e81e840140f445e84,sentry-release=Unknown"},"correlation_id":"01M0EVVZ8VF12AMGBX3QXQHKSP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c6b98685dcc3234d419dfb95e427b57eb6c30924309cf4ce13f15f4fde279e7b","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:15.581Z","job_size_bytes":467,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-49f26f701602fef21b55fe4e: done: 0.594955 sec","job_status":"done","queue_duration_s":2.33248,"scheduling_latency_s":2.332506,"gitaly_calls":7,"gitaly_duration_s":0.072271,"redis_calls":33,"redis_duration_s":0.0038469999999999997,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000361,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001228,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.001627,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000631,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.083,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.081,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.410994,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.594955,"completed_at":"2026-08-20T05:57:18.509Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.082279,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2221gitlab # [ 247.501726] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:18.510Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"ba137b11-f701-46a6-8d86-24fb9c86a22b\"}"],"class":"WebHookWorker","jid":"3555a9c66d6d60b400e35bc3","created_at":"2026-08-20T05:57:15.592Z","trace_propagation_headers":{"sentry-trace":"7d8dfbc99890482e81e840140f445e84-5762740324154427","baggage":"sentry-trace_id=7d8dfbc99890482e81e840140f445e84,sentry-release=Unknown"},"correlation_id":"01M0EVVZ8VF12AMGBX3QXQHKSP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23a8088b9c1e2ea35589f25a04d9b63be7596b9088b29e1101fe66c204da915b","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:15.593Z","job_size_bytes":1749,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-3555a9c66d6d60b400e35bc3: start","job_status":"start","queue_duration_s":2.916723,"scheduling_latency_s":2.91674}2222gitlab # [ 247.516029] nixbot[2586]: INFO: ::ffff:127.0.0.1:38138 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2223gitlab # [ 247.517413] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:18.539Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"ba137b11-f701-46a6-8d86-24fb9c86a22b\"}"],"class":"WebHookWorker","jid":"3555a9c66d6d60b400e35bc3","created_at":"2026-08-20T05:57:15.592Z","trace_propagation_headers":{"sentry-trace":"7d8dfbc99890482e81e840140f445e84-5762740324154427","baggage":"sentry-trace_id=7d8dfbc99890482e81e840140f445e84,sentry-release=Unknown"},"correlation_id":"01M0EVVZ8VF12AMGBX3QXQHKSP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23a8088b9c1e2ea35589f25a04d9b63be7596b9088b29e1101fe66c204da915b","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:15.593Z","job_size_bytes":1749,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-3555a9c66d6d60b400e35bc3: done: 0.029101 sec","job_status":"done","queue_duration_s":2.916723,"scheduling_latency_s":2.91674,"redis_calls":14,"redis_duration_s":0.0026739999999999997,"redis_read_bytes":26,"redis_write_bytes":4685,"redis_queues_calls":2,"redis_queues_duration_s":0.000235,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001972,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000467,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.008647746999997707,"cpu_s":0.014843,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.029101,"completed_at":"2026-08-20T05:57:18.539Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001184,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2224gitlab # [ 247.577596] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:18.542Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"728d92cedb1e06f692ff1713","created_at":"2026-08-20T05:57:16.094Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-bda3639f975b4724","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.099Z","job_size_bytes":23,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-728d92cedb1e06f692ff1713: start","job_status":"start","queue_duration_s":2.442579,"scheduling_latency_s":2.442611}2225gitlab # [ 247.578173] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:18.595Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"728d92cedb1e06f692ff1713","created_at":"2026-08-20T05:57:16.094Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-bda3639f975b4724","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.099Z","job_size_bytes":23,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-728d92cedb1e06f692ff1713: done: 0.053738 sec","job_status":"done","queue_duration_s":2.442579,"scheduling_latency_s":2.442611,"redis_calls":10,"redis_duration_s":0.001404,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000254,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000854,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000296,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03921,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000225169,"duration_s":0.053738,"completed_at":"2026-08-20T05:57:18.595Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009634,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2226gitlab # [ 247.623331] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:18.596Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"6274ba3a6a6dc919fef221ed","created_at":"2026-08-20T05:57:16.311Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-bda3639f975b4724","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.318Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-6274ba3a6a6dc919fef221ed: start","job_status":"start","queue_duration_s":2.277945,"scheduling_latency_s":2.27796}2227gitlab # [ 247.623882] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:18.621Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"6274ba3a6a6dc919fef221ed","created_at":"2026-08-20T05:57:16.311Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-bda3639f975b4724","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.318Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-6274ba3a6a6dc919fef221ed: done: 0.024394 sec","job_status":"done","queue_duration_s":2.277945,"scheduling_latency_s":2.27796,"redis_calls":10,"redis_duration_s":0.0022,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000353,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001172,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000675,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013361,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000210642,"duration_s":0.024394,"completed_at":"2026-08-20T05:57:18.621Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005893,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2228gitlab # [ 247.686904] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:18 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/19035372a5ad1e6968ea42004b9f5bb68ce33a49 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 3672229gitlab # [ 247.687196] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:18 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 792230gitlab # [ 247.687614] gitaly[919]: time="2026-08-20T05:57:18.677Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVXK45WMJHDQ3BT3A80V3A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:18.671" grpc.time_ms=5.966 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc2231gitlab # [ 247.688291] nixbot[2586]: {"ts": "2026-08-20T05:57:18.659Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/19035372a5ad1e6968ea42004b9f5bb68ce33a49 \"HTTP/1.1 201 Created\""}2232gitlab # [ 247.688945] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:18.622Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"9406b6d04f6a4401e9336c6c","created_at":"2026-08-20T05:57:16.335Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-bda3639f975b4724","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.341Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-9406b6d04f6a4401e9336c6c: start","job_status":"start","queue_duration_s":2.28026,"scheduling_latency_s":2.280272}2233gitlab # [ 247.689799] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:18.643Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"9406b6d04f6a4401e9336c6c","created_at":"2026-08-20T05:57:16.335Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-bda3639f975b4724","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.341Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-9406b6d04f6a4401e9336c6c: done: 0.021742 sec","job_status":"done","queue_duration_s":2.28026,"scheduling_latency_s":2.280272,"redis_calls":10,"redis_duration_s":0.001521,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000267,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001002,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000252,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01337,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000244724,"duration_s":0.021742,"completed_at":"2026-08-20T05:57:18.643Z","load_balancing_strategy":"primary","db_duration_s":0.004058,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2234gitlab # [ 247.724150] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:18.644Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"9ab6b28ecf21295053c4e323","created_at":"2026-08-20T05:57:16.359Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-bda3639f975b4724","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.364Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-9ab6b28ecf21295053c4e323: start","job_status":"start","queue_duration_s":2.280377,"scheduling_latency_s":2.280391}2235gitlab # [ 247.726903] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:18.680Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"9ab6b28ecf21295053c4e323","created_at":"2026-08-20T05:57:16.359Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-bda3639f975b4724","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.364Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-9ab6b28ecf21295053c4e323: done: 0.035341 sec","job_status":"done","queue_duration_s":2.280377,"scheduling_latency_s":2.280391,"redis_calls":13,"redis_duration_s":0.0029309999999999996,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00026,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001416,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001004,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000251,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015263,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000234946,"duration_s":0.035341,"completed_at":"2026-08-20T05:57:18.680Z","load_balancing_strategy":"primary","db_duration_s":0.008179,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2236gitlab # [ 247.764531] gitlab-workhorse[824]: time="2026-08-20T05:57:18Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672237gitlab # [ 247.765135] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:18 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 412238gitlab # [ 247.765553] gitaly[919]: time="2026-08-20T05:57:18.719Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXK6PE1N43JG8ZZCBZER9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:18.713" pid=919 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2239gitlab # [ 247.773584] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:18.682Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"a91abbdabcb544fed90934a3","created_at":"2026-08-20T05:57:16.365Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-bda3639f975b4724","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.369Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-a91abbdabcb544fed90934a3: start","job_status":"start","queue_duration_s":2.312629,"scheduling_latency_s":2.312651}2240gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'2241gitlab # [ 247.808925] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:18.708Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"a91abbdabcb544fed90934a3","created_at":"2026-08-20T05:57:16.365Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-bda3639f975b4724","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.369Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-a91abbdabcb544fed90934a3: done: 0.026047 sec","job_status":"done","queue_duration_s":2.312629,"scheduling_latency_s":2.312651,"redis_calls":10,"redis_duration_s":0.001472,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000251,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000905,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000316,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017511,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000219022,"duration_s":0.026047,"completed_at":"2026-08-20T05:57:18.708Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003727,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2242gitlab # [ 247.822163] nix-daemon[2795]: accepted connection from pid 3280, user nixbot2243gitlab # [ 247.822796] gitaly[919]: time="2026-08-20T05:57:18.719Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXK6PE1N43JG8ZZCBZER9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:18.713" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc2244gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.04 seconds)2245gitlab # [ 247.862934] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:18.712Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"b6a5592974b23384b6e38685","created_at":"2026-08-20T05:57:16.370Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-bda3639f975b4724","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.378Z","job_size_bytes":19,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-b6a5592974b23384b6e38685: start","job_status":"start","queue_duration_s":2.334222,"scheduling_latency_s":2.334237}2246gitlab # [ 247.863513] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:18.734Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"b6a5592974b23384b6e38685","created_at":"2026-08-20T05:57:16.370Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-bda3639f975b4724","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.378Z","job_size_bytes":19,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-b6a5592974b23384b6e38685: done: 0.022071 sec","job_status":"done","queue_duration_s":2.334222,"scheduling_latency_s":2.334237,"redis_calls":11,"redis_duration_s":0.001888,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000267,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001173,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000448,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013131,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000259251,"duration_s":0.022071,"completed_at":"2026-08-20T05:57:18.734Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002916,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2247gitlab # [ 247.880569] gitaly[919]: time="2026-08-20T05:57:18.719Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXK6PE1N43JG8ZZCBZER9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:18.713" grpc.time_ms=6.318 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc2248gitlab # [ 247.891874] nixbot[2586]: INFO: ::ffff:127.0.0.1:38142 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK2249gitlab # [ 247.893400] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:18.735Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"2651dd940ce3bc44cf66707c","created_at":"2026-08-20T05:57:16.381Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-bda3639f975b4724","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.384Z","job_size_bytes":66,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-2651dd940ce3bc44cf66707c: start","job_status":"start","queue_duration_s":2.350999,"scheduling_latency_s":2.351015}2250gitlab # [ 247.930426] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:18.760Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"2651dd940ce3bc44cf66707c","created_at":"2026-08-20T05:57:16.381Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-bda3639f975b4724","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.384Z","job_size_bytes":66,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-2651dd940ce3bc44cf66707c: done: 0.024856 sec","job_status":"done","queue_duration_s":2.350999,"scheduling_latency_s":2.351015,"redis_calls":10,"redis_duration_s":0.001418,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000273,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000878,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000267,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013254,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000233549,"duration_s":0.024856,"completed_at":"2026-08-20T05:57:18.760Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006891,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2251gitlab # [ 247.942324] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:18.761Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"1e390d948de77e9f24f691cf","created_at":"2026-08-20T05:57:16.385Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-bda3639f975b4724","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.387Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-1e390d948de77e9f24f691cf: start","job_status":"start","queue_duration_s":2.373414,"scheduling_latency_s":2.373426}2252gitlab # [ 247.983602] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:18.790Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"1e390d948de77e9f24f691cf","created_at":"2026-08-20T05:57:16.385Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-bda3639f975b4724","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.387Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-1e390d948de77e9f24f691cf: done: 0.029528 sec","job_status":"done","queue_duration_s":2.373414,"scheduling_latency_s":2.373426,"redis_calls":10,"redis_duration_s":0.002568,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000265,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001885,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000418,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017385,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001206019,"duration_s":0.029528,"completed_at":"2026-08-20T05:57:18.790Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006112,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2253gitlab # [ 247.990298] gitaly[919]: time="2026-08-20T05:57:18.955Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVW049GGJ3FRADN66SJBTT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:18.954" grpc.time_ms=0.498 pid=919 span.kind=server system=grpc2254gitlab # [ 247.998196] gitaly[919]: time="2026-08-20T05:57:18.976Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVW049GGJ3FRADN66SJBTT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:18.976" grpc.time_ms=0.336 pid=919 span.kind=server system=grpc2255gitlab # [ 248.005894] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:18.792Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"d3b1f40e673d1b51ccb88f0c","created_at":"2026-08-20T05:57:16.393Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-bda3639f975b4724","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.398Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-d3b1f40e673d1b51ccb88f0c: start","job_status":"start","queue_duration_s":2.393215,"scheduling_latency_s":2.393228}2256gitlab # [ 248.043985] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:18.814Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"d3b1f40e673d1b51ccb88f0c","created_at":"2026-08-20T05:57:16.393Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-bda3639f975b4724","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.398Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-d3b1f40e673d1b51ccb88f0c: done: 0.022308 sec","job_status":"done","queue_duration_s":2.393215,"scheduling_latency_s":2.393228,"redis_calls":10,"redis_duration_s":0.001409,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000265,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000887,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000257,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012419,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000205892,"duration_s":0.022308,"completed_at":"2026-08-20T05:57:18.814Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00571,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2257gitlab # [ 248.080133] gitaly[919]: time="2026-08-20T05:57:18.995Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVW049GGJ3FRADN66SJBTT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:18.994" grpc.time_ms=0.198 pid=919 span.kind=server system=grpc2258gitlab # [ 248.080797] gitaly[919]: time="2026-08-20T05:57:19.004Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVW049GGJ3FRADN66SJBTT diskcache=2610bcc6-145c-41b5-ab49-b644962836ab grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:57:48.035" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:18.935" pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2259gitlab # [ 248.081268] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:18.815Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"391d2d412d7b7627afc7fa64","created_at":"2026-08-20T05:57:16.399Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-bda3639f975b4724","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.404Z","job_size_bytes":6,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-391d2d412d7b7627afc7fa64: start","job_status":"start","queue_duration_s":2.411169,"scheduling_latency_s":2.411182}2260gitlab # [ 248.081796] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:18.828Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"391d2d412d7b7627afc7fa64","created_at":"2026-08-20T05:57:16.399Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-bda3639f975b4724","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.404Z","job_size_bytes":6,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-391d2d412d7b7627afc7fa64: done: 0.013107 sec","job_status":"done","queue_duration_s":2.411169,"scheduling_latency_s":2.411182,"redis_calls":10,"redis_duration_s":0.0012129999999999999,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000223,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000753,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000237,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007947,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000194718,"duration_s":0.013107,"completed_at":"2026-08-20T05:57:18.828Z","load_balancing_strategy":"primary","db_duration_s":0.001224,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2261gitlab # [ 248.116580] gitaly[919]: time="2026-08-20T05:57:19.004Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=64 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7204 command.oublock=0 command.real_time_ms=61 command.spawn_token_fork_ms=0 command.system_time_ms=40 command.user_time_ms=24 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVW049GGJ3FRADN66SJBTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:57:48.035" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:18.935" grpc.time_ms=68.447 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2262gitlab # [ 248.152528] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:18.829Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"93ffcfa7ce3f256dd60de4d1","created_at":"2026-08-20T05:57:16.404Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-bda3639f975b4724","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.409Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-93ffcfa7ce3f256dd60de4d1: start","job_status":"start","queue_duration_s":2.41952,"scheduling_latency_s":2.419533}2263gitlab # [ 248.153111] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:18.849Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"93ffcfa7ce3f256dd60de4d1","created_at":"2026-08-20T05:57:16.404Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-bda3639f975b4724","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.409Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-93ffcfa7ce3f256dd60de4d1: done: 0.020298 sec","job_status":"done","queue_duration_s":2.41952,"scheduling_latency_s":2.419533,"redis_calls":10,"redis_duration_s":0.001206,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000231,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000745,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00023,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012945,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000191365,"duration_s":0.020298,"completed_at":"2026-08-20T05:57:18.849Z","load_balancing_strategy":"primary","db_duration_s":0.003799,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2264gitlab # [ 248.172934] gitaly[919]: time="2026-08-20T05:57:19.037Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVW049GGJ3FRADN66SJBTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T05:57:49.036" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:19.036" grpc.time_ms=0.487 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2265gitlab # [ 248.183150] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:18.850Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"1119e6507b2a7594b5bb1bc3","created_at":"2026-08-20T05:57:16.416Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-bda3639f975b4724","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.422Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-1119e6507b2a7594b5bb1bc3: start","job_status":"start","queue_duration_s":2.427605,"scheduling_latency_s":2.427619}2266gitlab # [ 248.220607] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:18.890Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"1119e6507b2a7594b5bb1bc3","created_at":"2026-08-20T05:57:16.416Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-bda3639f975b4724","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.422Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-1119e6507b2a7594b5bb1bc3: done: 0.039621 sec","job_status":"done","queue_duration_s":2.427605,"scheduling_latency_s":2.427619,"redis_calls":14,"redis_duration_s":0.003745,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000229,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002549,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000967,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024825,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000631924,"duration_s":0.039621,"completed_at":"2026-08-20T05:57:18.890Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007563,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2267gitlab # [ 248.258657] gitaly[919]: time="2026-08-20T05:57:19.055Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVW049GGJ3FRADN66SJBTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:49.054" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:19.054" grpc.time_ms=0.409 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2268gitlab # [ 248.259285] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:18.893Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"a79f403e65c39f39cfedbf5c","created_at":"2026-08-20T05:57:16.494Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-bda3639f975b4724","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.495Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a79f403e65c39f39cfedbf5c: start","job_status":"start","queue_duration_s":2.397956,"scheduling_latency_s":2.397971}2269gitlab # [ 248.259763] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.059Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"a79f403e65c39f39cfedbf5c","created_at":"2026-08-20T05:57:16.494Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-bda3639f975b4724","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.495Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2540,"job_status":"rescheduled","message":"PipelineProcessWorker JID-a79f403e65c39f39cfedbf5c: rescheduled"}2270gitlab # [ 248.295258] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.063Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"a79f403e65c39f39cfedbf5c","created_at":"2026-08-20T05:57:16.494Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-bda3639f975b4724","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.495Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a79f403e65c39f39cfedbf5c: done: 0.170189 sec","job_status":"done","queue_duration_s":2.397956,"scheduling_latency_s":2.397971,"gitaly_calls":3,"gitaly_duration_s":0.0737,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.008988000000000001,"redis_read_bytes":149,"redis_write_bytes":18014,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000319,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000553,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.001742,"redis_queues_read_bytes":27,"redis_queues_write_bytes":12313,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.003917,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000143,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000706,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001289,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.071999,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.147116184,"duration_s":0.170189,"completed_at":"2026-08-20T05:57:19.063Z","load_balancing_strategy":"primary","db_duration_s":0.018774,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2271gitlab # [ 248.337117] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.064Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"e67e4b365013f74810edc7a0","created_at":"2026-08-20T05:57:16.625Z","trace_propagation_headers":{"sentry-trace":"11b4dd4cfb2148618199bd8ba8ee8fae-087c6fc1f59f4b9f","baggage":"sentry-trace_id=11b4dd4cfb2148618199bd8ba8ee8fae,sentry-release=Unknown"},"correlation_id":"01M0EVVVT0SER04XCE19PA5A7M","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.632Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-e67e4b365013f74810edc7a0: start","job_status":"start","queue_duration_s":2.432519,"scheduling_latency_s":2.432533}2272gitlab # [ 248.337682] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.092Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"e67e4b365013f74810edc7a0","created_at":"2026-08-20T05:57:16.625Z","trace_propagation_headers":{"sentry-trace":"11b4dd4cfb2148618199bd8ba8ee8fae-087c6fc1f59f4b9f","baggage":"sentry-trace_id=11b4dd4cfb2148618199bd8ba8ee8fae,sentry-release=Unknown"},"correlation_id":"01M0EVVVT0SER04XCE19PA5A7M","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.632Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-e67e4b365013f74810edc7a0: done: 0.027708 sec","job_status":"done","queue_duration_s":2.432519,"scheduling_latency_s":2.432533,"redis_calls":19,"redis_duration_s":0.002365,"redis_read_bytes":22,"redis_write_bytes":4291,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000484,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000303,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2262,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001172,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000406,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018962,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0042944,"duration_s":0.027708,"completed_at":"2026-08-20T05:57:19.092Z","load_balancing_strategy":"primary","db_duration_s":0.004517,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2273gitlab # [ 248.378916] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.093Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","97ad2b303d38231bb862e732"],"class":"WebHooks::LogExecutionWorker","jid":"6045efdbd6ceddcf1e92f79c","created_at":"2026-08-20T05:57:17.773Z","trace_propagation_headers":{"sentry-trace":"11b4dd4cfb2148618199bd8ba8ee8fae-d999e0f71a0e49f5","baggage":"sentry-trace_id=11b4dd4cfb2148618199bd8ba8ee8fae,sentry-release=Unknown"},"correlation_id":"01M0EVVVT0SER04XCE19PA5A7M","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0cfa6834126fc07c99c407e8437b8b86f855f55207248b7f836967e308679c70","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:17.781Z","job_size_bytes":2593,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-6045efdbd6ceddcf1e92f79c: start","job_status":"start","queue_duration_s":1.311803,"scheduling_latency_s":1.311816}2274gitlab # [ 248.379558] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.125Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","97ad2b303d38231bb862e732"],"class":"WebHooks::LogExecutionWorker","jid":"6045efdbd6ceddcf1e92f79c","created_at":"2026-08-20T05:57:17.773Z","trace_propagation_headers":{"sentry-trace":"11b4dd4cfb2148618199bd8ba8ee8fae-d999e0f71a0e49f5","baggage":"sentry-trace_id=11b4dd4cfb2148618199bd8ba8ee8fae,sentry-release=Unknown"},"correlation_id":"01M0EVVVT0SER04XCE19PA5A7M","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0cfa6834126fc07c99c407e8437b8b86f855f55207248b7f836967e308679c70","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:17.781Z","job_size_bytes":2593,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-6045efdbd6ceddcf1e92f79c: done: 0.032284 sec","job_status":"done","queue_duration_s":1.311803,"scheduling_latency_s":1.311816,"redis_calls":10,"redis_duration_s":0.001286,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000236,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000778,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000272,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0189,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000206171,"duration_s":0.032284,"completed_at":"2026-08-20T05:57:19.125Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010321,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2275gitlab # [ 248.400637] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.126Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","3555a9c66d6d60b400e35bc3"],"class":"WebHooks::LogExecutionWorker","jid":"6c2702d6f021233b8593926e","created_at":"2026-08-20T05:57:18.533Z","trace_propagation_headers":{"sentry-trace":"7d8dfbc99890482e81e840140f445e84-a2a3b8f482ca4cda","baggage":"sentry-trace_id=7d8dfbc99890482e81e840140f445e84,sentry-release=Unknown"},"correlation_id":"01M0EVVZ8VF12AMGBX3QXQHKSP","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e9611876e82f3378695bcf3aad1f57047c965e51d791fbd21efd1c4987f34350","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:18.535Z","job_size_bytes":2592,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-6c2702d6f021233b8593926e: start","job_status":"start","queue_duration_s":0.591617,"scheduling_latency_s":0.59163}2276gitlab # [ 248.438500] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.141Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","3555a9c66d6d60b400e35bc3"],"class":"WebHooks::LogExecutionWorker","jid":"6c2702d6f021233b8593926e","created_at":"2026-08-20T05:57:18.533Z","trace_propagation_headers":{"sentry-trace":"7d8dfbc99890482e81e840140f445e84-a2a3b8f482ca4cda","baggage":"sentry-trace_id=7d8dfbc99890482e81e840140f445e84,sentry-release=Unknown"},"correlation_id":"01M0EVVZ8VF12AMGBX3QXQHKSP","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e9611876e82f3378695bcf3aad1f57047c965e51d791fbd21efd1c4987f34350","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:18.535Z","job_size_bytes":2592,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-6c2702d6f021233b8593926e: done: 0.015035 sec","job_status":"done","queue_duration_s":0.591617,"scheduling_latency_s":0.59163,"redis_calls":7,"redis_duration_s":0.000883,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000651,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000232,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009858,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015035,"completed_at":"2026-08-20T05:57:19.141Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002821,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2277gitlab # [ 248.479661] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.142Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"63a757d10d0b5bd8f71a6ebf","created_at":"2026-08-20T05:57:18.931Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-e6f64bd8e1594059","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:18.932Z","job_size_bytes":23,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-63a757d10d0b5bd8f71a6ebf: start","job_status":"start","queue_duration_s":0.210361,"scheduling_latency_s":0.210374}2278gitlab # [ 248.480767] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:19 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 3752279gitlab # [ 248.481188] gitlab-workhorse[824]: time="2026-08-20T05:57:19Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672280gitlab # [ 248.481579] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:19 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 392281gitlab # [ 248.482039] gitaly[919]: time="2026-08-20T05:57:19.453Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=340 command.spawn_token_fork_ms=335 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVXKK6KZC15JGB9R3VE5NH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:19.112" grpc.time_ms=341.116 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc2282gitlab # [ 248.482620] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.166Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"63a757d10d0b5bd8f71a6ebf","created_at":"2026-08-20T05:57:18.931Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-e6f64bd8e1594059","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:18.932Z","job_size_bytes":23,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-63a757d10d0b5bd8f71a6ebf: done: 0.024007 sec","job_status":"done","queue_duration_s":0.210361,"scheduling_latency_s":0.210374,"redis_calls":7,"redis_duration_s":0.0009,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000665,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000235,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017574,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024007,"completed_at":"2026-08-20T05:57:19.166Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004343,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2283gitlab # [ 248.539836] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.167Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"f7d405b346a6058d09ac662d","created_at":"2026-08-20T05:57:19.008Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-e6f64bd8e1594059","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:19.010Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-f7d405b346a6058d09ac662d: start","job_status":"start","queue_duration_s":0.156985,"scheduling_latency_s":0.157}2284gitlab # [ 248.540706] gitaly[919]: time="2026-08-20T05:57:19.494Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXKYYWKXFH2XC5RWWDT7P grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:19.488" pid=919 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2285gitlab # [ 248.541541] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:19 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 342286gitlab # [ 248.541955] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.182Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"f7d405b346a6058d09ac662d","created_at":"2026-08-20T05:57:19.008Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-e6f64bd8e1594059","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:19.010Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-f7d405b346a6058d09ac662d: done: 0.015129 sec","job_status":"done","queue_duration_s":0.156985,"scheduling_latency_s":0.157,"redis_calls":7,"redis_duration_s":0.0009109999999999999,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000676,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000235,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010383,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015129,"completed_at":"2026-08-20T05:57:19.182Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002329,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2287gitlab # [ 248.580545] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.183Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"ecf579cf9ee9d151d5c2d2a4","created_at":"2026-08-20T05:57:19.015Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-e6f64bd8e1594059","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:19.016Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-ecf579cf9ee9d151d5c2d2a4: start","job_status":"start","queue_duration_s":0.166686,"scheduling_latency_s":0.1667}2288gitlab # [ 248.581185] gitaly[919]: time="2026-08-20T05:57:19.494Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXKYYWKXFH2XC5RWWDT7P grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:19.488" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc2289gitlab # [ 248.618123] gitlab-workhorse[824]: time="2026-08-20T05:57:19Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162290gitlab # [ 248.618615] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:19 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 402291gitlab # [ 248.619077] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.199Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"ecf579cf9ee9d151d5c2d2a4","created_at":"2026-08-20T05:57:19.015Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-e6f64bd8e1594059","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:19.016Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-ecf579cf9ee9d151d5c2d2a4: done: 0.015627 sec","job_status":"done","queue_duration_s":0.166686,"scheduling_latency_s":0.1667,"redis_calls":7,"redis_duration_s":0.0009069999999999999,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000672,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000235,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015627,"completed_at":"2026-08-20T05:57:19.199Z","load_balancing_strategy":"primary","db_duration_s":0.002511,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2292gitlab # [ 248.653942] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.200Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"8dfb311bb1bb0e65bf255d79","created_at":"2026-08-20T05:57:19.021Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-e6f64bd8e1594059","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:19.022Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-8dfb311bb1bb0e65bf255d79: start","job_status":"start","queue_duration_s":0.177407,"scheduling_latency_s":0.177421}2293gitlab # [ 248.654550] gitaly[919]: time="2026-08-20T05:57:19.494Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXKYYWKXFH2XC5RWWDT7P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:19.488" grpc.time_ms=6.157 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc2294gitlab # [ 248.655125] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.220Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"8dfb311bb1bb0e65bf255d79","created_at":"2026-08-20T05:57:19.021Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-e6f64bd8e1594059","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:19.022Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-8dfb311bb1bb0e65bf255d79: done: 0.020899 sec","job_status":"done","queue_duration_s":0.177407,"scheduling_latency_s":0.177421,"redis_calls":10,"redis_duration_s":0.001436,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000742,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000456,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000238,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015305,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020899,"completed_at":"2026-08-20T05:57:19.220Z","load_balancing_strategy":"primary","db_duration_s":0.002822,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2295gitlab # [ 248.704433] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.222Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"15dd2a7c614b2fc54de1ffaf","created_at":"2026-08-20T05:57:19.022Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-e6f64bd8e1594059","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:19.023Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-15dd2a7c614b2fc54de1ffaf: start","job_status":"start","queue_duration_s":0.198181,"scheduling_latency_s":0.198201}2296gitlab # [ 248.705076] gitaly[919]: time="2026-08-20T05:57:19.552Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVXM0Z85VAMDKC9KAW03BS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:19.547" grpc.time_ms=5.704 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc2297gitlab # [ 248.706879] gitaly[919]: time="2026-08-20T05:57:19.594Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXM224TV16FZQW745M2K1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:19.583" pid=919 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2298gitlab # [ 248.715192] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.238Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"15dd2a7c614b2fc54de1ffaf","created_at":"2026-08-20T05:57:19.022Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-e6f64bd8e1594059","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:19.023Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-15dd2a7c614b2fc54de1ffaf: done: 0.016502 sec","job_status":"done","queue_duration_s":0.198181,"scheduling_latency_s":0.198201,"redis_calls":7,"redis_duration_s":0.000928,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000694,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000234,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011422,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016502,"completed_at":"2026-08-20T05:57:19.238Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002368,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2299gitlab # [ 248.752669] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.239Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"d5f4c07d9a5eab7315eaf99d","created_at":"2026-08-20T05:57:19.024Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-e6f64bd8e1594059","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:19.025Z","job_size_bytes":19,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-d5f4c07d9a5eab7315eaf99d: start","job_status":"start","queue_duration_s":0.214004,"scheduling_latency_s":0.21402}2300gitlab # [ 248.762545] gitaly[919]: time="2026-08-20T05:57:19.594Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1171 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXM224TV16FZQW745M2K1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:19.583" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc2301gitlab # [ 248.799220] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.253Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"d5f4c07d9a5eab7315eaf99d","created_at":"2026-08-20T05:57:19.024Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-e6f64bd8e1594059","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:19.025Z","job_size_bytes":19,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-d5f4c07d9a5eab7315eaf99d: done: 0.01451 sec","job_status":"done","queue_duration_s":0.214004,"scheduling_latency_s":0.21402,"redis_calls":8,"redis_duration_s":0.001,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000776,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000224,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009329,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01451,"completed_at":"2026-08-20T05:57:19.253Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002091,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2302gitlab # [ 248.807245] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.254Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"d23d5b98f7742b9417b2ab0d","created_at":"2026-08-20T05:57:19.026Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-e6f64bd8e1594059","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:19.026Z","job_size_bytes":66,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-d23d5b98f7742b9417b2ab0d: start","job_status":"start","queue_duration_s":0.22784,"scheduling_latency_s":0.227853}2303gitlab # [ 248.846469] nixbot[2586]: {"ts": "2026-08-20T05:57:19.807Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a6ac1b7991d2bc1bc95c8c78e7358dd194da811f \"HTTP/1.1 201 Created\""}2304gitlab # [ 248.847053] nixbot[2586]: {"ts": "2026-08-20T05:57:19.812Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-a6ac1b7991d2-4"}2305gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f'2306gitlab # [ 248.847497] gitaly[919]: time="2026-08-20T05:57:19.594Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1171 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXM224TV16FZQW745M2K1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:19.583" grpc.time_ms=10.739 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc2307gitlab # [ 248.850344] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:19 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 1842308gitlab # [ 248.851153] nix-daemon[2795]: accepted connection from pid 3372, user nixbot2309gitlab # [ 248.851905] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.267Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"d23d5b98f7742b9417b2ab0d","created_at":"2026-08-20T05:57:19.026Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-e6f64bd8e1594059","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:19.026Z","job_size_bytes":66,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-d23d5b98f7742b9417b2ab0d: done: 0.012554 sec","job_status":"done","queue_duration_s":0.22784,"scheduling_latency_s":0.227853,"redis_calls":7,"redis_duration_s":0.0008960000000000001,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000639,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000257,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008688,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012554,"completed_at":"2026-08-20T05:57:19.267Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001401,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2310gitlab # [ 248.901322] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.268Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"742bd95a9227ffd4d81bcff5","created_at":"2026-08-20T05:57:19.027Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-e6f64bd8e1594059","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:19.028Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-742bd95a9227ffd4d81bcff5: start","job_status":"start","queue_duration_s":0.240118,"scheduling_latency_s":0.240132}2311gitlab # [ 248.902141] gitaly[919]: time="2026-08-20T05:57:19.655Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXM45Z42E9HRDXV8N9D1R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:49.054" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:19.654" grpc.time_ms=0.45 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2312gitlab # [ 248.902942] nix-daemon[2795]: accepted connection from pid 3380, user nixbot2313gitlab # [ 248.904020] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.283Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"742bd95a9227ffd4d81bcff5","created_at":"2026-08-20T05:57:19.027Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-e6f64bd8e1594059","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:19.028Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-742bd95a9227ffd4d81bcff5: done: 0.01519 sec","job_status":"done","queue_duration_s":0.240118,"scheduling_latency_s":0.240132,"redis_calls":7,"redis_duration_s":0.000898,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000652,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000246,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009478,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01519,"completed_at":"2026-08-20T05:57:19.283Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003362,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2314gitlab # [ 248.941097] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.284Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"86a5217b48112cf8affea603","created_at":"2026-08-20T05:57:19.028Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-e6f64bd8e1594059","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:19.029Z","job_size_bytes":6,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-86a5217b48112cf8affea603: start","job_status":"start","queue_duration_s":0.255018,"scheduling_latency_s":0.255032}2315gitlab # [ 248.941699] gitaly[919]: time="2026-08-20T05:57:19.665Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=648 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVXM45Z42E9HRDXV8N9D1R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-20T05:57:49.059" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:19.660" grpc.time_ms=5.381 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2316gitlab # [ 248.979951] nixbot[2586]: {"ts": "2026-08-20T05:57:19.928Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-a6ac1b7991d2-4", "argv0": "bwrap"}2317gitlab # [ 248.980631] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.292Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"86a5217b48112cf8affea603","created_at":"2026-08-20T05:57:19.028Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-e6f64bd8e1594059","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:19.029Z","job_size_bytes":6,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-86a5217b48112cf8affea603: done: 0.008028 sec","job_status":"done","queue_duration_s":0.255018,"scheduling_latency_s":0.255032,"redis_calls":7,"redis_duration_s":0.0008320000000000001,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000602,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00023,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005211,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008028,"completed_at":"2026-08-20T05:57:19.292Z","load_balancing_strategy":"primary","db_duration_s":0.000228,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2318gitlab # [ 249.016731] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.293Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"a36e3e876e40ab3bca78213f","created_at":"2026-08-20T05:57:19.029Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-e6f64bd8e1594059","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:19.030Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-a36e3e876e40ab3bca78213f: start","job_status":"start","queue_duration_s":0.262752,"scheduling_latency_s":0.262765}2319gitlab # [ 249.017518] gitaly[919]: time="2026-08-20T05:57:19.674Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVXM45Z42E9HRDXV8N9D1R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:29.158" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:19.669" grpc.time_ms=5.154 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2320gitlab # [ 249.018055] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.305Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"a36e3e876e40ab3bca78213f","created_at":"2026-08-20T05:57:19.029Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-e6f64bd8e1594059","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:19.030Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-a36e3e876e40ab3bca78213f: done: 0.012873 sec","job_status":"done","queue_duration_s":0.262752,"scheduling_latency_s":0.262765,"redis_calls":7,"redis_duration_s":0.0008730000000000001,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000625,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000248,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008801,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012873,"completed_at":"2026-08-20T05:57:19.305Z","load_balancing_strategy":"primary","db_duration_s":0.001783,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2321gitlab # [ 249.060047] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.306Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"0822e2afea1c5d60adec76c3","created_at":"2026-08-20T05:57:19.059Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-e6f64bd8e1594059","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:19.060Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0822e2afea1c5d60adec76c3: start","job_status":"start","queue_duration_s":0.246009,"scheduling_latency_s":0.246022}2322gitlab # [ 249.060725] gitaly[919]: time="2026-08-20T05:57:19.688Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXM45Z42E9HRDXV8N9D1R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T05:57:29.178" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:57:19.688" grpc.time_ms=0.154 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2323gitlab # [ 249.061937] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.325Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"0822e2afea1c5d60adec76c3","created_at":"2026-08-20T05:57:19.059Z","trace_propagation_headers":{"sentry-trace":"36ce3a885e4843a3b353035dee1ba068-e6f64bd8e1594059","baggage":"sentry-trace_id=36ce3a885e4843a3b353035dee1ba068,sentry-release=Unknown"},"correlation_id":"01M0EVW049GGJ3FRADN66SJBTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:19.060Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0822e2afea1c5d60adec76c3: done: 0.018325 sec","job_status":"done","queue_duration_s":0.246009,"scheduling_latency_s":0.246022,"redis_calls":8,"redis_duration_s":0.0012829999999999999,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000927,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000356,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013614,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018325,"completed_at":"2026-08-20T05:57:19.325Z","load_balancing_strategy":"primary","db_duration_s":0.002096,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2324gitlab # [ 249.095443] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.326Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"15b3e1cbe3ff2edc3be3db47","created_at":"2026-08-20T05:57:19.084Z","trace_propagation_headers":{"sentry-trace":"11b4dd4cfb2148618199bd8ba8ee8fae-97c284487df04fb7","baggage":"sentry-trace_id=11b4dd4cfb2148618199bd8ba8ee8fae,sentry-release=Unknown"},"correlation_id":"01M0EVVVT0SER04XCE19PA5A7M","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:19.087Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-15b3e1cbe3ff2edc3be3db47: start","job_status":"start","queue_duration_s":0.238489,"scheduling_latency_s":0.238509}2325gitlab # [ 249.109081] gitaly[919]: time="2026-08-20T05:57:19.695Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXM45Z42E9HRDXV8N9D1R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T05:57:29.180" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:19.690" grpc.time_ms=4.687 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2326gitlab # [ 249.119772] gitaly[919]: time="2026-08-20T05:57:19.720Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVXM45Z42E9HRDXV8N9D1R grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:19.720" grpc.time_ms=0.28 pid=919 span.kind=server system=grpc2327gitlab # [ 249.155507] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.381Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"15b3e1cbe3ff2edc3be3db47","created_at":"2026-08-20T05:57:19.084Z","trace_propagation_headers":{"sentry-trace":"11b4dd4cfb2148618199bd8ba8ee8fae-97c284487df04fb7","baggage":"sentry-trace_id=11b4dd4cfb2148618199bd8ba8ee8fae,sentry-release=Unknown"},"correlation_id":"01M0EVVVT0SER04XCE19PA5A7M","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:19.087Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-15b3e1cbe3ff2edc3be3db47: done: 0.054907 sec","job_status":"done","queue_duration_s":0.238489,"scheduling_latency_s":0.238509,"redis_calls":11,"redis_duration_s":0.00165,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000275,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001073,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000302,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039458,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000220419,"duration_s":0.054907,"completed_at":"2026-08-20T05:57:19.380Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012255,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2328gitlab # [ 249.162922] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.756Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"577b1c20ffcf3d93bada5279","created_at":"2026-08-20T05:57:19.752Z","trace_propagation_headers":{"sentry-trace":"5a31d9a4e6fd4af6bf2c784a479a0578-83a08a5e67944ea3","baggage":"sentry-trace_id=5a31d9a4e6fd4af6bf2c784a479a0578,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVXM45Z42E9HRDXV8N9D1R","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:19.755Z","job_size_bytes":65,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-577b1c20ffcf3d93bada5279: start","job_status":"start","queue_duration_s":0.001245,"scheduling_latency_s":0.001275}2329gitlab # [ 249.176483] gitaly[919]: time="2026-08-20T05:57:19.740Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVXM45Z42E9HRDXV8N9D1R grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:19.739" grpc.time_ms=0.276 pid=919 span.kind=server system=grpc2330gitlab # [ 249.215656] gitaly[919]: time="2026-08-20T05:57:19.748Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXM45Z42E9HRDXV8N9D1R diskcache=d37a3126-9ab9-4171-a619-c3838dcea03a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:57:29.186" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:57:19.697" pid=919 ref=refs/keep-around/a6ac1b7991d2bc1bc95c8c78e7358dd194da811f remote_ip="2001:db8:1::1" revision=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f span.kind=server system=grpc username=root2331gitlab # [ 249.216473] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.782Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"577b1c20ffcf3d93bada5279","created_at":"2026-08-20T05:57:19.752Z","trace_propagation_headers":{"sentry-trace":"5a31d9a4e6fd4af6bf2c784a479a0578-83a08a5e67944ea3","baggage":"sentry-trace_id=5a31d9a4e6fd4af6bf2c784a479a0578,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVXM45Z42E9HRDXV8N9D1R","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:19.755Z","job_size_bytes":65,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-577b1c20ffcf3d93bada5279: done: 0.026138 sec","job_status":"done","queue_duration_s":0.001245,"scheduling_latency_s":0.001275,"redis_calls":7,"redis_duration_s":0.001454,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000898,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000556,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017312,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026138,"completed_at":"2026-08-20T05:57:19.782Z","load_balancing_strategy":"primary","db_duration_s":0.00458,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2332gitlab # [ 249.226659] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.783Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"f0f2d50cbbe98f32f748eef8","created_at":"2026-08-20T05:57:19.756Z","trace_propagation_headers":{"sentry-trace":"5a31d9a4e6fd4af6bf2c784a479a0578-83a08a5e67944ea3","baggage":"sentry-trace_id=5a31d9a4e6fd4af6bf2c784a479a0578,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVXM45Z42E9HRDXV8N9D1R","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:19.758Z","job_size_bytes":65,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-f0f2d50cbbe98f32f748eef8: start","job_status":"start","queue_duration_s":0.024907,"scheduling_latency_s":0.024927}2333gitlab # [ 249.240638] gitaly[919]: time="2026-08-20T05:57:19.748Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=46 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5396 command.oublock=8 command.real_time_ms=44 command.spawn_token_fork_ms=0 command.system_time_ms=23 command.user_time_ms=23 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXM45Z42E9HRDXV8N9D1R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:57:29.186" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:57:19.697" grpc.time_ms=51.551 pid=919 ref=refs/keep-around/a6ac1b7991d2bc1bc95c8c78e7358dd194da811f remote_ip="2001:db8:1::1" revision=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f span.kind=server system=grpc username=root2334gitlab # [ 249.252634] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.820Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"f0f2d50cbbe98f32f748eef8","created_at":"2026-08-20T05:57:19.756Z","trace_propagation_headers":{"sentry-trace":"5a31d9a4e6fd4af6bf2c784a479a0578-83a08a5e67944ea3","baggage":"sentry-trace_id=5a31d9a4e6fd4af6bf2c784a479a0578,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVXM45Z42E9HRDXV8N9D1R","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:19.758Z","job_size_bytes":65,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-f0f2d50cbbe98f32f748eef8: done: 0.036611 sec","job_status":"done","queue_duration_s":0.024907,"scheduling_latency_s":0.024927,"redis_calls":10,"redis_duration_s":0.002358,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000861,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001497,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023099,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036611,"completed_at":"2026-08-20T05:57:19.820Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008495,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2335gitlab # [ 249.299597] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.823Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"bc579b415a45b320b88b3a66","created_at":"2026-08-20T05:57:19.795Z","trace_propagation_headers":{"sentry-trace":"5a31d9a4e6fd4af6bf2c784a479a0578-83a08a5e67944ea3","baggage":"sentry-trace_id=5a31d9a4e6fd4af6bf2c784a479a0578,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVXM45Z42E9HRDXV8N9D1R","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:19.797Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-bc579b415a45b320b88b3a66: start","job_status":"start","queue_duration_s":0.026192,"scheduling_latency_s":0.026211}2336gitlab # [ 249.300287] gitaly[919]: time="2026-08-20T05:57:19.751Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXM45Z42E9HRDXV8N9D1R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:49.150" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:19.750" grpc.time_ms=0.262 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2337gitlab # [ 249.309040] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.907Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"bc579b415a45b320b88b3a66","created_at":"2026-08-20T05:57:19.795Z","trace_propagation_headers":{"sentry-trace":"5a31d9a4e6fd4af6bf2c784a479a0578-83a08a5e67944ea3","baggage":"sentry-trace_id=5a31d9a4e6fd4af6bf2c784a479a0578,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVXM45Z42E9HRDXV8N9D1R","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:19.797Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-bc579b415a45b320b88b3a66: done: 0.083903 sec","job_status":"done","queue_duration_s":0.026192,"scheduling_latency_s":0.026211,"gitaly_calls":2,"gitaly_duration_s":0.005295,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.004967,"redis_read_bytes":79,"redis_write_bytes":5121,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000593,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000675,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000942,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001153,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000145,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000302,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000564,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056735,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.062468554,"duration_s":0.083903,"completed_at":"2026-08-20T05:57:19.907Z","load_balancing_strategy":"primary","db_duration_s":0.019668,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2338gitlab # [ 249.355587] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.908Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"3613f0637a885789bc4ce0ac","created_at":"2026-08-20T05:57:19.862Z","trace_propagation_headers":{"sentry-trace":"5a31d9a4e6fd4af6bf2c784a479a0578-f8fca6c2d46b4be8","baggage":"sentry-trace_id=5a31d9a4e6fd4af6bf2c784a479a0578,sentry-release=Unknown"},"correlation_id":"01M0EVXM45Z42E9HRDXV8N9D1R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:19.863Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-3613f0637a885789bc4ce0ac: start","job_status":"start","queue_duration_s":0.045184,"scheduling_latency_s":0.045199}2339gitlab # [ 249.363475] gitaly[919]: time="2026-08-20T05:57:19.877Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVXM45Z42E9HRDXV8N9D1R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T05:57:49.875" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:19.876" grpc.time_ms=0.99 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2340gitlab # [ 249.405673] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:19.938Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"3613f0637a885789bc4ce0ac","created_at":"2026-08-20T05:57:19.862Z","trace_propagation_headers":{"sentry-trace":"5a31d9a4e6fd4af6bf2c784a479a0578-f8fca6c2d46b4be8","baggage":"sentry-trace_id=5a31d9a4e6fd4af6bf2c784a479a0578,sentry-release=Unknown"},"correlation_id":"01M0EVXM45Z42E9HRDXV8N9D1R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:19.863Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-3613f0637a885789bc4ce0ac: done: 0.029848 sec","job_status":"done","queue_duration_s":0.045184,"scheduling_latency_s":0.045199,"redis_calls":7,"redis_duration_s":0.0015769999999999998,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000978,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000599,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015546,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029848,"completed_at":"2026-08-20T05:57:19.938Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010819,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2341gitlab # [ 249.406636] gitaly[919]: time="2026-08-20T05:57:19.900Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXM45Z42E9HRDXV8N9D1R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:49.899" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:19.899" grpc.time_ms=0.514 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2342gitlab # [ 249.469438] nixbot[2586]: INFO: ::ffff:127.0.0.1:38156 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 200 OK2343gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', in 0.61 seconds)2344(finished: subtest: push delivers the webhook, in 55.14 seconds)2345subtest: eval and build post commit statuses2346gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a6ac1b7991d2bc1bc95c8c78e7358dd194da811f/statuses2347gitlab # [ 249.510807] nix-daemon[2795]: accepted connection from pid 3393, user nixbot2348gitlab # [ 249.535978] gitaly[919]: time="2026-08-20T05:57:20.558Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXN0BB5NZVGGVPX02E72M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:50.156" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:20.557" grpc.time_ms=0.529 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2349gitlab # [ 249.565405] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:20 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/a6ac1b7991d2bc1bc95c8c78e7358dd194da811f/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 632350gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a6ac1b7991d2bc1bc95c8c78e7358dd194da811f/statuses, in 0.08 seconds)2351gitlab # [ 249.573668] nix-daemon[2795]: accepted connection from pid 3409, user nixbot2352gitlab # [ 249.585775] nix-daemon[2795]: accepted connection from pid 3393, user nixbot2353gitlab # [ 249.641440] gitaly[919]: time="2026-08-20T05:57:20.663Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXN3P4SXN96KMTP1M0749 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:50.062" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:20.662" grpc.time_ms=0.676 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2354gitlab # [ 249.675868] gitaly[919]: time="2026-08-20T05:57:20.697Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVXN3P4SXN96KMTP1M0749 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:30.178" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:20.688" grpc.time_ms=9.167 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2355gitlab # [ 249.702237] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:20.724Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"cea1ef7c8b4b6a22ef14fe4f","created_at":"2026-08-20T05:57:20.719Z","trace_propagation_headers":{"sentry-trace":"e3ff21bab1e642218f0d1a181ca2aaf6-89f75d7bbf9e4fe6","baggage":"sentry-trace_id=e3ff21bab1e642218f0d1a181ca2aaf6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVXN3P4SXN96KMTP1M0749","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:20.722Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-cea1ef7c8b4b6a22ef14fe4f: start","job_status":"start","queue_duration_s":0.001715,"scheduling_latency_s":0.001747}2356gitlab # [ 249.728874] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:20 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 1202357gitlab # [ 249.731908] nixbot[2586]: {"ts": "2026-08-20T05:57:20.753Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a6ac1b7991d2bc1bc95c8c78e7358dd194da811f \"HTTP/1.1 201 Created\""}2358gitlab # [ 249.813099] gitaly[919]: time="2026-08-20T05:57:20.834Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXN7MH18EVR2FRNS0GJSG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:50.632" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:20.833" grpc.time_ms=1.153 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2359gitlab # [ 249.826777] gitaly[919]: time="2026-08-20T05:57:20.848Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVXN3P4SXN96KMTP1M0749 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:20.848" grpc.time_ms=0.378 pid=919 span.kind=server system=grpc2360gitlab # [ 249.854853] gitaly[919]: time="2026-08-20T05:57:20.877Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVXN7MH18EVR2FRNS0GJSG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:30.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:20.871" grpc.time_ms=5.509 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2361gitlab # [ 249.867594] gitaly[919]: time="2026-08-20T05:57:20.889Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVXN3P4SXN96KMTP1M0749 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:20.889" grpc.time_ms=0.339 pid=919 span.kind=server system=grpc2362gitlab # [ 249.893117] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:20 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1582363gitlab # [ 249.893781] gitaly[919]: time="2026-08-20T05:57:20.916Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVXN3P4SXN96KMTP1M0749 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:20.914" grpc.time_ms=1.784 pid=919 span.kind=server system=grpc2364gitlab # [ 249.896972] nixbot[2586]: {"ts": "2026-08-20T05:57:20.919Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a6ac1b7991d2bc1bc95c8c78e7358dd194da811f \"HTTP/1.1 201 Created\""}2365gitlab # [ 249.906685] gitaly[919]: time="2026-08-20T05:57:20.928Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXN3P4SXN96KMTP1M0749 forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:57:50.820" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:20.820" operations="[repack_refs]" pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2366gitlab # [ 249.915150] gitaly[919]: time="2026-08-20T05:57:20.930Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXN3P4SXN96KMTP1M0749 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:57:50.820" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:20.820" pid=919 remote_ip="2001:db8:1::1" repository_info="{false {6 704 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-08-20 05:56:20.420661962 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2367gitlab # [ 249.924901] gitaly[919]: time="2026-08-20T05:57:20.934Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXN3P4SXN96KMTP1M0749 diskcache=b13c96f0-c500-4080-b1c5-58b8dd01c381 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:57:50.820" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:20.820" pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2368gitlab # [ 249.933058] gitaly[919]: time="2026-08-20T05:57:20.934Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=105 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7750 command.oublock=0 command.real_time_ms=107 command.spawn_token_fork_ms=0 command.system_time_ms=81 command.user_time_ms=24 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXN3P4SXN96KMTP1M0749 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:57:50.820" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:20.820" grpc.time_ms=113.643 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2369gitlab # [ 249.943712] gitaly[919]: time="2026-08-20T05:57:20.946Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXN3P4SXN96KMTP1M0749 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:57:50.820" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:20.820" pid=919 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2370gitlab # [ 249.955221] gitaly[919]: time="2026-08-20T05:57:20.946Z" level=info msg="optimized repository" clean_stale_data_time=16.312129ms clean_work_trees_time="71.517µs" commit_graph_time="3.912µs" correlation_id=01M0EVXN3P4SXN96KMTP1M0749 gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="3.911µs" pid=919 prune_time="3.352µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="4.47µs" storage_name=default system=housekeeping total_time=16.493158ms2371gitlab # [ 249.955512] gitaly[919]: time="2026-08-20T05:57:20.947Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXN3P4SXN96KMTP1M0749 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:57:50.820" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:20.820" pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2372gitlab # [ 249.956062] gitaly[919]: time="2026-08-20T05:57:20.964Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXND01MS5K01JTVTSGKFR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:50.764" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:20.964" grpc.time_ms=0.36 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2373gitlab # [ 249.958760] gitaly[919]: time="2026-08-20T05:57:20.976Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVXN3P4SXN96KMTP1M0749 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T05:57:50.074" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:20.974" grpc.time_ms=0.664 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2374gitlab # [ 249.972734] gitaly[919]: time="2026-08-20T05:57:20.994Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXN3P4SXN96KMTP1M0749 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:50.094" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:20.994" grpc.time_ms=0.436 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2375gitlab # [ 249.979426] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:21.001Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"77fdf5da1146ccc6464cd1da","created_at":"2026-08-20T05:57:20.999Z","trace_propagation_headers":{"sentry-trace":"e3ff21bab1e642218f0d1a181ca2aaf6-3bac81bf756c4f17","baggage":"sentry-trace_id=e3ff21bab1e642218f0d1a181ca2aaf6,sentry-release=Unknown"},"correlation_id":"01M0EVXN3P4SXN96KMTP1M0749","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"cea1ef7c8b4b6a22ef14fe4f","job_size_bytes":3,"pid":2540,"job_status":"deduplicated","message":"PipelineProcessWorker JID-77fdf5da1146ccc6464cd1da: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2376gitlab # [ 249.980169] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:21.002Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"cea1ef7c8b4b6a22ef14fe4f","created_at":"2026-08-20T05:57:20.719Z","trace_propagation_headers":{"sentry-trace":"e3ff21bab1e642218f0d1a181ca2aaf6-89f75d7bbf9e4fe6","baggage":"sentry-trace_id=e3ff21bab1e642218f0d1a181ca2aaf6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVXN3P4SXN96KMTP1M0749","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:20.722Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2540,"job_status":"rescheduled","message":"PipelineProcessWorker JID-cea1ef7c8b4b6a22ef14fe4f: rescheduled"}2377gitlab # [ 249.985937] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:21.006Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"cea1ef7c8b4b6a22ef14fe4f","created_at":"2026-08-20T05:57:20.719Z","trace_propagation_headers":{"sentry-trace":"e3ff21bab1e642218f0d1a181ca2aaf6-89f75d7bbf9e4fe6","baggage":"sentry-trace_id=e3ff21bab1e642218f0d1a181ca2aaf6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVXN3P4SXN96KMTP1M0749","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:20.722Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-cea1ef7c8b4b6a22ef14fe4f: done: 0.282253 sec","job_status":"done","queue_duration_s":0.001715,"scheduling_latency_s":0.001747,"gitaly_calls":3,"gitaly_duration_s":0.120672,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.011738,"redis_read_bytes":239,"redis_write_bytes":21781,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000979,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000836,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.002556,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14466,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.0043,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000162,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000714,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001212,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.008,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.01,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.104261,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.224644473,"duration_s":0.282253,"completed_at":"2026-08-20T05:57:21.006Z","load_balancing_strategy":"primary","db_duration_s":0.030799,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2378gitlab # [ 250.027695] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:21.007Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"9e923163a007bb76fa55a8f8","created_at":"2026-08-20T05:57:20.815Z","trace_propagation_headers":{"sentry-trace":"e3ff21bab1e642218f0d1a181ca2aaf6-3bac81bf756c4f17","baggage":"sentry-trace_id=e3ff21bab1e642218f0d1a181ca2aaf6,sentry-release=Unknown"},"correlation_id":"01M0EVXN3P4SXN96KMTP1M0749","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:20.816Z","job_size_bytes":23,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-9e923163a007bb76fa55a8f8: start","job_status":"start","queue_duration_s":0.190406,"scheduling_latency_s":0.190422}2379gitlab # [ 250.061998] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:21.033Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"9e923163a007bb76fa55a8f8","created_at":"2026-08-20T05:57:20.815Z","trace_propagation_headers":{"sentry-trace":"e3ff21bab1e642218f0d1a181ca2aaf6-3bac81bf756c4f17","baggage":"sentry-trace_id=e3ff21bab1e642218f0d1a181ca2aaf6,sentry-release=Unknown"},"correlation_id":"01M0EVXN3P4SXN96KMTP1M0749","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:20.816Z","job_size_bytes":23,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-9e923163a007bb76fa55a8f8: done: 0.025866 sec","job_status":"done","queue_duration_s":0.190406,"scheduling_latency_s":0.190422,"redis_calls":7,"redis_duration_s":0.000984,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000741,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000243,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017789,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025866,"completed_at":"2026-08-20T05:57:21.033Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005521,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2380gitlab # [ 250.074150] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:21.033Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"1868cdadc8730aa1611bb075","created_at":"2026-08-20T05:57:20.940Z","trace_propagation_headers":{"sentry-trace":"e3ff21bab1e642218f0d1a181ca2aaf6-3bac81bf756c4f17","baggage":"sentry-trace_id=e3ff21bab1e642218f0d1a181ca2aaf6,sentry-release=Unknown"},"correlation_id":"01M0EVXN3P4SXN96KMTP1M0749","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:20.942Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-1868cdadc8730aa1611bb075: start","job_status":"start","queue_duration_s":0.091246,"scheduling_latency_s":0.091262}2381gitlab # [ 250.114537] gitaly[919]: time="2026-08-20T05:57:21.065Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0EVXND01MS5K01JTVTSGKFR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:31.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:21.057" grpc.time_ms=7.64 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2382gitlab # [ 250.115373] nixbot[2586]: {"ts": "2026-08-20T05:57:21.100Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a6ac1b7991d2bc1bc95c8c78e7358dd194da811f \"HTTP/1.1 201 Created\""}2383gitlab # [ 250.115834] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:21 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a6ac1b7991d2bc1bc95c8c78e7358dd194da811f HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1712384gitlab # [ 250.116418] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:21.049Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"1868cdadc8730aa1611bb075","created_at":"2026-08-20T05:57:20.940Z","trace_propagation_headers":{"sentry-trace":"e3ff21bab1e642218f0d1a181ca2aaf6-3bac81bf756c4f17","baggage":"sentry-trace_id=e3ff21bab1e642218f0d1a181ca2aaf6,sentry-release=Unknown"},"correlation_id":"01M0EVXN3P4SXN96KMTP1M0749","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:20.942Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-1868cdadc8730aa1611bb075: done: 0.015959 sec","job_status":"done","queue_duration_s":0.091246,"scheduling_latency_s":0.091262,"redis_calls":7,"redis_duration_s":0.000941,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000688,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000253,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010822,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015959,"completed_at":"2026-08-20T05:57:21.049Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002378,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2385gitlab # [ 250.156131] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:21.050Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"cb377f2e5a6c0a666c9c90e9","created_at":"2026-08-20T05:57:20.946Z","trace_propagation_headers":{"sentry-trace":"e3ff21bab1e642218f0d1a181ca2aaf6-3bac81bf756c4f17","baggage":"sentry-trace_id=e3ff21bab1e642218f0d1a181ca2aaf6,sentry-release=Unknown"},"correlation_id":"01M0EVXN3P4SXN96KMTP1M0749","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:20.948Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-cb377f2e5a6c0a666c9c90e9: start","job_status":"start","queue_duration_s":0.102156,"scheduling_latency_s":0.102171}2386gitlab # [ 250.156792] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:21.068Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"cb377f2e5a6c0a666c9c90e9","created_at":"2026-08-20T05:57:20.946Z","trace_propagation_headers":{"sentry-trace":"e3ff21bab1e642218f0d1a181ca2aaf6-3bac81bf756c4f17","baggage":"sentry-trace_id=e3ff21bab1e642218f0d1a181ca2aaf6,sentry-release=Unknown"},"correlation_id":"01M0EVXN3P4SXN96KMTP1M0749","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:20.948Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-cb377f2e5a6c0a666c9c90e9: done: 0.017716 sec","job_status":"done","queue_duration_s":0.102156,"scheduling_latency_s":0.102171,"redis_calls":7,"redis_duration_s":0.001087,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000773,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000314,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011281,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017716,"completed_at":"2026-08-20T05:57:21.068Z","load_balancing_strategy":"primary","db_duration_s":0.003262,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2387gitlab # [ 250.195756] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:21.069Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"5427fb103c0c2a9e07faa24d","created_at":"2026-08-20T05:57:20.953Z","trace_propagation_headers":{"sentry-trace":"e3ff21bab1e642218f0d1a181ca2aaf6-3bac81bf756c4f17","baggage":"sentry-trace_id=e3ff21bab1e642218f0d1a181ca2aaf6,sentry-release=Unknown"},"correlation_id":"01M0EVXN3P4SXN96KMTP1M0749","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:20.954Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-5427fb103c0c2a9e07faa24d: start","job_status":"start","queue_duration_s":0.114721,"scheduling_latency_s":0.114737}2388gitlab # [ 250.196664] nix-daemon[2795]: accepted connection from pid 3461, user nixbot2389gitlab # [ 250.197084] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:21.092Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"5427fb103c0c2a9e07faa24d","created_at":"2026-08-20T05:57:20.953Z","trace_propagation_headers":{"sentry-trace":"e3ff21bab1e642218f0d1a181ca2aaf6-3bac81bf756c4f17","baggage":"sentry-trace_id=e3ff21bab1e642218f0d1a181ca2aaf6,sentry-release=Unknown"},"correlation_id":"01M0EVXN3P4SXN96KMTP1M0749","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:20.954Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-5427fb103c0c2a9e07faa24d: done: 0.023013 sec","job_status":"done","queue_duration_s":0.114721,"scheduling_latency_s":0.114737,"redis_calls":10,"redis_duration_s":0.001512,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000822,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000348,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000342,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014218,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023013,"completed_at":"2026-08-20T05:57:21.092Z","load_balancing_strategy":"primary","db_duration_s":0.005799,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2390gitlab # [ 250.244466] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:21.093Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"b69dfee5e2a77b96cc2db837","created_at":"2026-08-20T05:57:20.955Z","trace_propagation_headers":{"sentry-trace":"e3ff21bab1e642218f0d1a181ca2aaf6-3bac81bf756c4f17","baggage":"sentry-trace_id=e3ff21bab1e642218f0d1a181ca2aaf6,sentry-release=Unknown"},"correlation_id":"01M0EVXN3P4SXN96KMTP1M0749","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:20.956Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-b69dfee5e2a77b96cc2db837: start","job_status":"start","queue_duration_s":0.137493,"scheduling_latency_s":0.137523}2391gitlab # [ 250.247549] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:21.112Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"b69dfee5e2a77b96cc2db837","created_at":"2026-08-20T05:57:20.955Z","trace_propagation_headers":{"sentry-trace":"e3ff21bab1e642218f0d1a181ca2aaf6-3bac81bf756c4f17","baggage":"sentry-trace_id=e3ff21bab1e642218f0d1a181ca2aaf6,sentry-release=Unknown"},"correlation_id":"01M0EVXN3P4SXN96KMTP1M0749","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:20.956Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-b69dfee5e2a77b96cc2db837: done: 0.018389 sec","job_status":"done","queue_duration_s":0.137493,"scheduling_latency_s":0.137523,"redis_calls":7,"redis_duration_s":0.0011580000000000002,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000903,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000255,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012577,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018389,"completed_at":"2026-08-20T05:57:21.111Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002809,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2392gitlab # [ 250.305490] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:21.113Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"06bb5f0983f1ac29e0408b5d","created_at":"2026-08-20T05:57:20.956Z","trace_propagation_headers":{"sentry-trace":"e3ff21bab1e642218f0d1a181ca2aaf6-3bac81bf756c4f17","baggage":"sentry-trace_id=e3ff21bab1e642218f0d1a181ca2aaf6,sentry-release=Unknown"},"correlation_id":"01M0EVXN3P4SXN96KMTP1M0749","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:20.957Z","job_size_bytes":19,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-06bb5f0983f1ac29e0408b5d: start","job_status":"start","queue_duration_s":0.155227,"scheduling_latency_s":0.155253}2393gitlab # [ 250.306181] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:21 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 442394gitlab # [ 250.306534] gitlab-workhorse[824]: time="2026-08-20T05:57:21Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672395gitlab # [ 250.306936] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:21 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 462396gitlab # [ 250.307792] gitaly[919]: time="2026-08-20T05:57:21.240Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVXNND57X5EWE1EN49V446 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:21.235" grpc.time_ms=5.38 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc2397gitlab # [ 250.308620] gitaly[919]: time="2026-08-20T05:57:21.287Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXNPTBH2J9CJ2QJ6TC9W3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:21.282" pid=919 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2398gitlab # [ 250.311972] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:21.131Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"06bb5f0983f1ac29e0408b5d","created_at":"2026-08-20T05:57:20.956Z","trace_propagation_headers":{"sentry-trace":"e3ff21bab1e642218f0d1a181ca2aaf6-3bac81bf756c4f17","baggage":"sentry-trace_id=e3ff21bab1e642218f0d1a181ca2aaf6,sentry-release=Unknown"},"correlation_id":"01M0EVXN3P4SXN96KMTP1M0749","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:20.957Z","job_size_bytes":19,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-06bb5f0983f1ac29e0408b5d: done: 0.017928 sec","job_status":"done","queue_duration_s":0.155227,"scheduling_latency_s":0.155253,"redis_calls":8,"redis_duration_s":0.0011740000000000001,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000884,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00029,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010659,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017928,"completed_at":"2026-08-20T05:57:21.131Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00226,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2399gitlab # [ 250.348141] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:21.132Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"328ffc0440315598a3e08d3d","created_at":"2026-08-20T05:57:20.958Z","trace_propagation_headers":{"sentry-trace":"e3ff21bab1e642218f0d1a181ca2aaf6-3bac81bf756c4f17","baggage":"sentry-trace_id=e3ff21bab1e642218f0d1a181ca2aaf6,sentry-release=Unknown"},"correlation_id":"01M0EVXN3P4SXN96KMTP1M0749","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:20.959Z","job_size_bytes":66,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-328ffc0440315598a3e08d3d: start","job_status":"start","queue_duration_s":0.172499,"scheduling_latency_s":0.172513}2400gitlab # [ 250.360266] gitaly[919]: time="2026-08-20T05:57:21.287Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXNPTBH2J9CJ2QJ6TC9W3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:21.282" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc2401gitlab # [ 250.370817] nix-daemon[2795]: accepted connection from pid 3502, user nixbot2402gitlab # [ 250.371662] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:21.146Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"328ffc0440315598a3e08d3d","created_at":"2026-08-20T05:57:20.958Z","trace_propagation_headers":{"sentry-trace":"e3ff21bab1e642218f0d1a181ca2aaf6-3bac81bf756c4f17","baggage":"sentry-trace_id=e3ff21bab1e642218f0d1a181ca2aaf6,sentry-release=Unknown"},"correlation_id":"01M0EVXN3P4SXN96KMTP1M0749","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:20.959Z","job_size_bytes":66,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-328ffc0440315598a3e08d3d: done: 0.014672 sec","job_status":"done","queue_duration_s":0.172499,"scheduling_latency_s":0.172513,"redis_calls":7,"redis_duration_s":0.000993,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000753,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00024,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009184,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014672,"completed_at":"2026-08-20T05:57:21.146Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0027,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2403gitlab # [ 250.410447] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:21.147Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"a432c5f0f7c6a46e5be9e7a6","created_at":"2026-08-20T05:57:20.960Z","trace_propagation_headers":{"sentry-trace":"e3ff21bab1e642218f0d1a181ca2aaf6-3bac81bf756c4f17","baggage":"sentry-trace_id=e3ff21bab1e642218f0d1a181ca2aaf6,sentry-release=Unknown"},"correlation_id":"01M0EVXN3P4SXN96KMTP1M0749","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:20.960Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-a432c5f0f7c6a46e5be9e7a6: start","job_status":"start","queue_duration_s":0.186605,"scheduling_latency_s":0.186619}2404gitlab # [ 250.418790] gitaly[919]: time="2026-08-20T05:57:21.288Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXNPTBH2J9CJ2QJ6TC9W3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:21.282" grpc.time_ms=5.943 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc2405gitlab # [ 250.455825] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:21.167Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"a432c5f0f7c6a46e5be9e7a6","created_at":"2026-08-20T05:57:20.960Z","trace_propagation_headers":{"sentry-trace":"e3ff21bab1e642218f0d1a181ca2aaf6-3bac81bf756c4f17","baggage":"sentry-trace_id=e3ff21bab1e642218f0d1a181ca2aaf6,sentry-release=Unknown"},"correlation_id":"01M0EVXN3P4SXN96KMTP1M0749","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:20.960Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-a432c5f0f7c6a46e5be9e7a6: done: 0.020018 sec","job_status":"done","queue_duration_s":0.186605,"scheduling_latency_s":0.186619,"redis_calls":7,"redis_duration_s":0.000898,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000662,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000236,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014746,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020018,"completed_at":"2026-08-20T05:57:21.167Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002979,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2406gitlab # [ 250.494185] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:21.169Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"cd87dc6d8631de913e7a3362","created_at":"2026-08-20T05:57:20.963Z","trace_propagation_headers":{"sentry-trace":"e3ff21bab1e642218f0d1a181ca2aaf6-3bac81bf756c4f17","baggage":"sentry-trace_id=e3ff21bab1e642218f0d1a181ca2aaf6,sentry-release=Unknown"},"correlation_id":"01M0EVXN3P4SXN96KMTP1M0749","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:20.964Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-cd87dc6d8631de913e7a3362: start","job_status":"start","queue_duration_s":0.205837,"scheduling_latency_s":0.205853}2407gitlab # [ 250.494813] gitaly[919]: time="2026-08-20T05:57:21.304Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVXN3P4SXN96KMTP1M0749 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:21.304" grpc.time_ms=0.538 pid=919 span.kind=server system=grpc2408gitlab # [ 250.495487] gitaly[919]: time="2026-08-20T05:57:21.321Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVXN3P4SXN96KMTP1M0749 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:21.321" grpc.time_ms=0.312 pid=919 span.kind=server system=grpc2409gitlab # [ 250.496089] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:21.189Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"cd87dc6d8631de913e7a3362","created_at":"2026-08-20T05:57:20.963Z","trace_propagation_headers":{"sentry-trace":"e3ff21bab1e642218f0d1a181ca2aaf6-3bac81bf756c4f17","baggage":"sentry-trace_id=e3ff21bab1e642218f0d1a181ca2aaf6,sentry-release=Unknown"},"correlation_id":"01M0EVXN3P4SXN96KMTP1M0749","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:20.964Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-cd87dc6d8631de913e7a3362: done: 0.019573 sec","job_status":"done","queue_duration_s":0.205837,"scheduling_latency_s":0.205853,"redis_calls":7,"redis_duration_s":0.000982,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000704,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000278,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01018,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019573,"completed_at":"2026-08-20T05:57:21.189Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006129,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2410gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a6ac1b7991d2bc1bc95c8c78e7358dd194da811f/statuses2411gitlab # [ 250.545137] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:21.190Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"ecf4f69726e25364b07a361b","created_at":"2026-08-20T05:57:20.964Z","trace_propagation_headers":{"sentry-trace":"e3ff21bab1e642218f0d1a181ca2aaf6-3bac81bf756c4f17","baggage":"sentry-trace_id=e3ff21bab1e642218f0d1a181ca2aaf6,sentry-release=Unknown"},"correlation_id":"01M0EVXN3P4SXN96KMTP1M0749","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:20.965Z","job_size_bytes":6,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-ecf4f69726e25364b07a361b: start","job_status":"start","queue_duration_s":0.2251,"scheduling_latency_s":0.225114}2412gitlab # [ 250.545730] gitaly[919]: time="2026-08-20T05:57:21.337Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVXN3P4SXN96KMTP1M0749 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:21.337" grpc.time_ms=0.222 pid=919 span.kind=server system=grpc2413gitlab # [ 250.546409] gitaly[919]: time="2026-08-20T05:57:21.346Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXN3P4SXN96KMTP1M0749 diskcache=79eaed50-d962-4aee-b211-aa1e7f1c6859 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:57:51.277" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:21.277" pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2414gitlab # [ 250.552568] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:21.200Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"ecf4f69726e25364b07a361b","created_at":"2026-08-20T05:57:20.964Z","trace_propagation_headers":{"sentry-trace":"e3ff21bab1e642218f0d1a181ca2aaf6-3bac81bf756c4f17","baggage":"sentry-trace_id=e3ff21bab1e642218f0d1a181ca2aaf6,sentry-release=Unknown"},"correlation_id":"01M0EVXN3P4SXN96KMTP1M0749","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:20.965Z","job_size_bytes":6,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-ecf4f69726e25364b07a361b: done: 0.009943 sec","job_status":"done","queue_duration_s":0.2251,"scheduling_latency_s":0.225114,"redis_calls":7,"redis_duration_s":0.001627,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000782,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000845,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005695,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009943,"completed_at":"2026-08-20T05:57:21.200Z","load_balancing_strategy":"primary","db_duration_s":0.000403,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2415gitlab # [ 250.594217] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:21.201Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"bf090bbbb262184c2b4a384b","created_at":"2026-08-20T05:57:20.965Z","trace_propagation_headers":{"sentry-trace":"e3ff21bab1e642218f0d1a181ca2aaf6-3bac81bf756c4f17","baggage":"sentry-trace_id=e3ff21bab1e642218f0d1a181ca2aaf6,sentry-release=Unknown"},"correlation_id":"01M0EVXN3P4SXN96KMTP1M0749","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:20.966Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-bf090bbbb262184c2b4a384b: start","job_status":"start","queue_duration_s":0.235327,"scheduling_latency_s":0.23534}2416gitlab # [ 250.596722] gitaly[919]: time="2026-08-20T05:57:21.346Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=56 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7068 command.oublock=0 command.real_time_ms=62 command.spawn_token_fork_ms=3 command.system_time_ms=35 command.user_time_ms=21 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXN3P4SXN96KMTP1M0749 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:57:51.277" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:21.277" grpc.time_ms=68.456 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2417gitlab # [ 250.634938] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:21.221Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"bf090bbbb262184c2b4a384b","created_at":"2026-08-20T05:57:20.965Z","trace_propagation_headers":{"sentry-trace":"e3ff21bab1e642218f0d1a181ca2aaf6-3bac81bf756c4f17","baggage":"sentry-trace_id=e3ff21bab1e642218f0d1a181ca2aaf6,sentry-release=Unknown"},"correlation_id":"01M0EVXN3P4SXN96KMTP1M0749","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:20.966Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-bf090bbbb262184c2b4a384b: done: 0.019936 sec","job_status":"done","queue_duration_s":0.235327,"scheduling_latency_s":0.23534,"redis_calls":7,"redis_duration_s":0.003258,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001228,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00203,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010864,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019936,"completed_at":"2026-08-20T05:57:21.221Z","load_balancing_strategy":"primary","db_duration_s":0.004197,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2418gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a6ac1b7991d2bc1bc95c8c78e7358dd194da811f/statuses, in 0.11 seconds)2419(finished: subtest: eval and build post commit statuses, in 1.19 seconds)2420(finished: run the VM test script, in 309.66 seconds)2421gitlab # [ 250.639605] sidekiq-cluster[2540]: {"severity":"INFO","time":"2026-08-20T05:57:21.225Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"a7b8bce4d622a82d3768c1c2","created_at":"2026-08-20T05:57:21.002Z","trace_propagation_headers":{"sentry-trace":"e3ff21bab1e642218f0d1a181ca2aaf6-3bac81bf756c4f17","baggage":"sentry-trace_id=e3ff21bab1e642218f0d1a181ca2aaf6,sentry-release=Unknown"},"correlation_id":"01M0EVXN3P4SXN96KMTP1M0749","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:21.003Z","job_size_bytes":3,"pid":2540,"sidekiq_tid":"m7y0","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a7b8bce4d622a82d3768c1c2: start","job_status":"start","queue_duration_s":0.221873,"scheduling_latency_s":0.221887}2422test script finished in 309.69s2423cleanup2424kill QemuMachine (pid 46)2425gitlab # [ 250.675158] gitaly[919]: time="2026-08-20T05:57:21.383Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVXN3P4SXN96KMTP1M0749 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T05:57:51.382" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:21.382" grpc.time_ms=0.511 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc usernqemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2426(finished: cleanup, in 1.56 seconds)2427additionally exposed symbols:2428 gitlab,2429 vlan1,2430 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2431[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-20T05:56:24.907Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2432[]2433[]2434[]2435[]2436[]2437[]2438[]2439[]2440[]2441[]2442[]2443[]2444[]2445[]2446[]2447[]2448[]2449[]2450[]2451[]2452[]2453[]2454[]2455[]2456[]2457[]2458[]2459[]2460[]2461[]2462[]2463[]2464[]2465[]2466[]2467[]2468[]2469[]2470[]2471[]2472[]2473[]2474[]2475[]2476[]2477[]2478[]2479[]2480[]2481[]2482[]2483[]2484[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-20T05:57:19.617102Z', 'started_at': '2026-08-20T05:57:19.808773Z', 'finished_at': None}]2485[{'id': 5, 'sha': 'a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T05:57:19.789Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2486[{'id': 5, 'sha': 'a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded', 'created_at': '2026-08-20T05:57:19.789Z', 'started_at': None, 'finished_at': '2026-08-20T05:57:20.712Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'a6ac1b7991d2bc1bc95c8c78e7358dd194da811f', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-08-20T05:57:20.895Z', 'started_at': None, 'finished_at': '2026-08-20T05:57:21.081Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]