vm-test-run-nixbot-gitlab
checks.x86_64-linux.nixbot-gitlab
· build #344
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.3uOPx6MBIj', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13(finished: start all VMs, in 38.34 seconds)14gitlab # Discarding device blocks: 0/262144 done15gitlab: waiting for unit setup-gitlab.service16gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes17gitlab: waiting for the VM to finish booting18gitlab # Filesystem UUID: a19d6e94-f504-4dc3-8348-36b4f253319e19gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... ok45gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202646gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/zlhf9vakdnp8l0ind4550ja6r333sfz4-nixos-system-gitlab-test/init regInfo=/nix/store/yl2y4a49n2wnbx3l9r4izl0pyqfy92s9-closure-info/registration console=ttyS0,115200n8 console=tty047gitlab # [ 0.000000] BIOS-provided physical RAM map:48gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable49gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved51gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved55gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable56gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved57gitlab # [ 0.000000] NX (Execute Disable) protection: active58gitlab # [ 0.000000] APIC: Static calls initialized59gitlab # [ 0.000000] SMBIOS 2.8 present.60gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201461gitlab # [ 0.000000] DMI: Memory slots populated: 1/162gitlab # [ 0.000000] Hypervisor detected: KVM63gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000064gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0065gitlab # [ 0.000000] kvm-clock: using sched offset of 505177457 cycles66gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns67gitlab # [ 0.000005] tsc: Detected 2400.012 MHz processor68gitlab # [ 0.000805] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000069gitlab # [ 0.000842] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs70gitlab # [ 0.000845] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT71gitlab # [ 0.000896] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000072gitlab # [ 0.002753] found SMP MP-table at [mem 0x000f5470-0x000f547f]73gitlab # [ 0.002765] Using GB pages for direct mapping74gitlab # [ 0.002854] RAMDISK: [mem 0xbe31c000-0xbffcffff]75gitlab # [ 0.002863] ACPI: Early table checksum verification disabled76gitlab # [ 0.002865] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )77gitlab # [ 0.002869] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002874] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002880] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)80gitlab # [ 0.002883] ACPI: FACS 0x00000000BFFE0000 00004081gitlab # [ 0.002884] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002886] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002887] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)84gitlab # [ 0.002888] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]85gitlab # [ 0.002890] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]86gitlab # [ 0.002890] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]87gitlab # [ 0.002891] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]88gitlab # [ 0.002891] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]89gitlab # [ 0.002892] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]90gitlab # [ 0.003397] No NUMA configuration found91gitlab # [ 0.003399] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]92gitlab # [ 0.003402] NODE_DATA(0) allocated [mem 0x1bfffa780-0x1bffffcff]93gitlab # [ 0.005794] Zone ranges:94gitlab # [ 0.005795] DMA [mem 0x0000000000001000-0x0000000000ffffff]95gitlab # [ 0.005796] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]96gitlab # [ 0.005798] Normal [mem 0x0000000100000000-0x00000001bfffffff]97gitlab # [ 0.005799] Device empty98gitlab # [ 0.005799] Movable zone start for each node99gitlab # [ 0.005800] Early memory node ranges100gitlab # [ 0.005800] node 0: [mem 0x0000000000001000-0x000000000009efff]101gitlab # [ 0.005801] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]102gitlab # [ 0.005802] node 0: [mem 0x0000000100000000-0x00000001bfffffff]103gitlab # [ 0.005803] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]104gitlab # [ 0.005833] On node 0, zone DMA: 1 pages in unavailable ranges105gitlab # [ 0.006116] On node 0, zone DMA: 97 pages in unavailable ranges106gitlab # [ 0.117763] On node 0, zone Normal: 40 pages in unavailable ranges107gitlab # [ 0.118813] ACPI: PM-Timer IO Port: 0x608108gitlab # [ 0.118831] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])109gitlab # [ 0.118867] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23110gitlab # [ 0.118870] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)111gitlab # [ 0.118872] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)112gitlab # [ 0.118874] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)113gitlab # [ 0.118875] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)114gitlab # [ 0.118875] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)115gitlab # [ 0.118878] ACPI: Using ACPI (MADT) for SMP configuration information116gitlab # [ 0.118879] ACPI: HPET id: 0x8086a201 base: 0xfed00000117gitlab # [ 0.118886] TSC deadline timer available118gitlab # [ 0.118890] CPU topo: Max. logical packages: 1119gitlab # [ 0.118891] CPU topo: Max. logical dies: 1120gitlab # [ 0.118891] CPU topo: Max. dies per package: 1121gitlab # [ 0.118895] CPU topo: Max. threads per core: 1122gitlab # [ 0.118896] CPU topo: Num. cores per package: 4123gitlab # [ 0.118896] CPU topo: Num. threads per package: 4124gitlab # [ 0.118897] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs125gitlab # [ 0.118923] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()126gitlab # [ 0.118949] kvm-guest: KVM setup pv remote TLB flush127gitlab # [ 0.118952] kvm-guest: setup PV sched yield128gitlab # [ 0.118971] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]129gitlab # [ 0.118973] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]130gitlab # [ 0.118974] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]131gitlab # [ 0.118976] [mem 0xc0000000-0xfeffbfff] available for PCI devices132gitlab # [ 0.118978] Booting paravirtualized kernel on KVM133gitlab # [ 0.118981] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns134gitlab # [ 0.123443] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1135gitlab # [ 0.125760] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288136gitlab # [ 0.125811] kvm-guest: PV spinlocks enabled137gitlab # [ 0.125813] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)138gitlab # [ 0.125816] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/zlhf9vakdnp8l0ind4550ja6r333sfz4-nixos-system-gitlab-test/init regInfo=/nix/store/yl2y4a49n2wnbx3l9r4izl0pyqfy92s9-closure-info/registration console=ttyS0,115200n8 console=tty0139gitlab # [ 0.125913] Unknown kernel command line parameters "regInfo=/nix/store/yl2y4a49n2wnbx3l9r4izl0pyqfy92s9-closure-info/registration", will be passed to user space.140gitlab # [ 0.125931] random: crng init done141gitlab # [ 0.125932] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes142gitlab # [ 0.135093] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)143gitlab # [ 0.139775] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)144gitlab # [ 0.139853] software IO TLB: area num 4.145gitlab # [ 0.216606] Fallback order for Node 0: 0146gitlab # [ 0.216614] Built 1 zonelists, mobility grouping on. Total pages: 1572726147gitlab # [ 0.216616] Policy zone: Normal148gitlab # [ 0.219279] mem auto-init: stack:all(zero), heap alloc:on, heap free:off149gitlab # [ 0.228916] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1150gitlab # [ 0.243084] allocated 12582912 bytes of page_ext151gitlab # [ 0.252991] ftrace: allocating 48717 entries in 192 pages152gitlab # [ 0.252993] ftrace: allocated 192 pages with 2 groups153gitlab # [ 0.253858] Dynamic Preempt: lazy154gitlab # [ 0.254030] rcu: Preemptible hierarchical RCU implementation.155gitlab # [ 0.254031] rcu: RCU event tracing is enabled.156gitlab # [ 0.254032] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.157gitlab # [ 0.254033] Trampoline variant of Tasks RCU enabled.158gitlab # [ 0.254034] Rude variant of Tasks RCU enabled.159gitlab # [ 0.254034] Tracing variant of Tasks RCU enabled.160gitlab # [ 0.254035] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.161gitlab # [ 0.254035] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4162gitlab # [ 0.254064] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.254065] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.254066] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.165gitlab # [ 0.258437] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16166gitlab # [ 0.258732] rcu: srcu_init: Setting srcu_struct sizes based on contention.167gitlab # [ 0.258740] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns168gitlab # [ 0.258845] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)169gitlab # [ 0.266233] Console: colour VGA+ 80x25170gitlab # [ 0.266236] printk: legacy console [tty0] enabled171gitlab # [ 0.311066] printk: legacy console [ttyS0] enabled172gitlab # [ 0.514258] ACPI: Core revision 20250807173gitlab # [ 0.518334] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns174gitlab # [ 0.521476] APIC: Switch to symmetric I/O mode setup175gitlab # [ 0.523230] x2apic enabled176gitlab # [ 0.524484] APIC: Switched APIC routing to: physical x2apic177gitlab # [ 0.526199] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()178gitlab # [ 0.528426] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()179gitlab # [ 0.531192] kvm-guest: setup PV IPIs180gitlab # [ 0.533602] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1181gitlab # [ 0.535438] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns182gitlab # [ 0.538592] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)183gitlab # [ 0.539708] x86/cpu: User Mode Instruction Prevention (UMIP) activated184gitlab # [ 0.541753] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127185gitlab # [ 0.544589] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0186gitlab # [ 0.545596] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto187gitlab # [ 0.547591] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl188gitlab # [ 0.548591] Transient Scheduler Attacks: Mitigation: Clear CPU buffers189gitlab # [ 0.550591] Spectre V2 : Mitigation: Enhanced / Automatic IBRS190gitlab # [ 0.552591] Speculative Return Stack Overflow: Mitigation: Safe RET191gitlab # [ 0.553591] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization192gitlab # [ 0.554601] Spectre V2 : Enabling IBPB for BPF193gitlab # [ 0.555593] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier194gitlab # [ 0.556592] active return thunk: srso_alias_return_thunk195gitlab # [ 0.558620] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'196gitlab # [ 0.560591] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'197gitlab # [ 0.562591] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'198gitlab # [ 0.564591] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'199gitlab # [ 0.566591] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'200gitlab # [ 0.567591] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'201gitlab # [ 0.568591] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'202gitlab # [ 0.569591] x86/fpu: Supporting XSAVE feature 0x800: 'Control-flow User registers'203gitlab # [ 0.571591] x86/fpu: Supporting XSAVE feature 0x1000: 'Control-flow Kernel registers (KVM only)'204gitlab # [ 0.572591] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256205gitlab # [ 0.574591] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64206gitlab # [ 0.575591] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512207gitlab # [ 0.576591] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024208gitlab # [ 0.577591] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8209gitlab # [ 0.578591] x86/fpu: xstate_offset[11]: 2440, xstate_sizes[11]: 16210gitlab # [ 0.580591] x86/fpu: xstate_offset[12]: 2456, xstate_sizes[12]: 24211gitlab # [ 0.582591] x86/fpu: Enabled xstate features 0x1ae7, context size is 2480 bytes, using 'compacted' format.212gitlab # [ 0.613388] Freeing SMP alternatives memory: 44K213gitlab # [ 0.614593] pid_max: default: 32768 minimum: 301214gitlab # [ 0.615710] LSM: initializing lsm=capability,landlock,yama,bpf,ima215gitlab # [ 0.617693] landlock: Up and running.216gitlab # [ 0.619477] Yama: becoming mindful.217gitlab # [ 0.620800] LSM support for eBPF active218gitlab # [ 0.621837] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)219gitlab # [ 0.623748] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)220gitlab # [ 0.626536] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)221gitlab # [ 0.627241] Performance Events: Fam17h+ core perfctr, AMD PMU driver.222gitlab # [ 0.628596] ... version: 2223gitlab # [ 0.629599] ... bit width: 48224gitlab # [ 0.630593] ... generic counters: 6225gitlab # [ 0.631593] ... generic bitmap: 000000000000003f226gitlab # [ 0.632594] ... fixed-purpose counters: 0227gitlab # [ 0.633592] ... fixed-purpose bitmap: 0000000000000000228gitlab # [ 0.634593] ... value mask: 0000ffffffffffff229gitlab # [ 0.635593] ... max period: 00007fffffffffff230gitlab # [ 0.636593] ... global_ctrl mask: 000000000000003f231gitlab # [ 0.637702] signal: max sigframe size: 3376232gitlab # [ 0.638697] rcu: Hierarchical SRCU implementation.233gitlab # [ 0.639613] rcu: Max phase no-delay instances is 400.234gitlab # [ 0.640833] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level235gitlab # [ 0.646144] smp: Bringing up secondary CPUs ...236gitlab # [ 0.647036] smpboot: x86: Booting SMP configuration:237gitlab # [ 0.647596] .... node #0, CPUs: #1 #2 #3238gitlab # [ 0.651687] smp: Brought up 1 node, 4 CPUs239gitlab # [ 0.653593] smpboot: Total of 4 processors activated (19200.09 BogoMIPS)240gitlab # [ 0.655119] Memory: 6011372K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260100K reserved, 0K cma-reserved)241gitlab # [ 0.657591] devtmpfs: initialized242gitlab # [ 0.658854] x86/mm: Memory block size: 128MB243gitlab # [ 0.661750] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)244gitlab # [ 0.663680] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).245gitlab # [ 0.664710] pinctrl core: initialized pinctrl subsystem246gitlab # [ 0.666140] PM: RTC time: 06:45:56, date: 2026-09-06247gitlab # [ 0.669821] NET: Registered PF_NETLINK/PF_ROUTE protocol family248gitlab # [ 0.672057] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations249gitlab # [ 0.672664] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations250gitlab # [ 0.675069] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations251gitlab # [ 0.675606] audit: initializing netlink subsys (disabled)252gitlab # [ 0.676781] audit: type=2000 audit(1788677156.215:1): state=initialized audit_enabled=0 res=1253gitlab # [ 0.676917] thermal_sys: Registered thermal governor 'fair_share'254gitlab # [ 0.678593] thermal_sys: Registered thermal governor 'bang_bang'255gitlab # [ 0.679593] thermal_sys: Registered thermal governor 'step_wise'256gitlab # [ 0.680593] thermal_sys: Registered thermal governor 'user_space'257gitlab # [ 0.681593] thermal_sys: Registered thermal governor 'power_allocator'258gitlab # [ 0.682631] cpuidle: using governor menu259gitlab # [ 0.685847] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5260gitlab # [ 0.686951] PCI: Using configuration type 1 for base access261gitlab # [ 0.687593] PCI: Using configuration type 1 for extended access262gitlab # [ 0.688803] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.263gitlab # [ 0.691633] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages264gitlab # [ 0.692593] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page265gitlab # [ 0.693593] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages266gitlab # [ 0.694593] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page267gitlab # [ 0.699867] ACPI: Added _OSI(Module Device)268gitlab # [ 0.703604] ACPI: Added _OSI(Processor Device)269gitlab # [ 0.706604] ACPI: Added _OSI(Processor Aggregator Device)270gitlab # [ 0.715824] ACPI: 1 ACPI AML tables successfully acquired and loaded271gitlab # [ 0.725108] ACPI: Interpreter enabled272gitlab # [ 0.727741] ACPI: PM: (supports S0 S3 S4 S5)273gitlab # [ 0.731604] ACPI: Using IOAPIC for interrupt routing274gitlab # [ 0.735923] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug275gitlab # [ 0.742601] PCI: Using E820 reservations for host bridge windows276gitlab # [ 0.747157] ACPI: Enabled 2 GPEs in block 00 to 0F277gitlab # [ 0.762509] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])278gitlab # [ 0.766607] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]279gitlab # [ 0.772755] acpiphp: Slot [3] registered280gitlab # [ 0.775729] acpiphp: Slot [4] registered281gitlab # [ 0.778721] acpiphp: Slot [5] registered282gitlab # [ 0.780675] acpiphp: Slot [6] registered283gitlab # [ 0.781658] acpiphp: Slot [7] registered284gitlab # [ 0.782658] acpiphp: Slot [8] registered285gitlab # [ 0.784650] acpiphp: Slot [9] registered286gitlab # [ 0.785663] acpiphp: Slot [10] registered287gitlab # [ 0.786659] acpiphp: Slot [11] registered288gitlab # [ 0.788671] acpiphp: Slot [12] registered289gitlab # [ 0.789665] acpiphp: Slot [13] registered290gitlab # [ 0.790628] acpiphp: Slot [14] registered291gitlab # [ 0.792958] acpiphp: Slot [15] registered292gitlab # [ 0.795719] acpiphp: Slot [16] registered293gitlab # [ 0.799685] acpiphp: Slot [17] registered294gitlab # [ 0.802700] acpiphp: Slot [18] registered295gitlab # [ 0.805685] acpiphp: Slot [19] registered296gitlab # [ 0.809725] acpiphp: Slot [20] registered297gitlab # [ 0.812685] acpiphp: Slot [21] registered298gitlab # [ 0.815741] acpiphp: Slot [22] registered299gitlab # [ 0.819739] acpiphp: Slot [23] registered300gitlab # [ 0.822685] acpiphp: Slot [24] registered301gitlab # [ 0.826686] acpiphp: Slot [25] registered302gitlab # [ 0.829685] acpiphp: Slot [26] registered303gitlab # [ 0.832737] acpiphp: Slot [27] registered304gitlab # [ 0.836687] acpiphp: Slot [28] registered305gitlab # [ 0.839749] acpiphp: Slot [29] registered306gitlab # [ 0.842671] acpiphp: Slot [30] registered307gitlab # [ 0.845703] acpiphp: Slot [31] registered308gitlab # [ 0.847786] PCI host bridge to bus 0000:00309gitlab # [ 0.850612] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]310gitlab # [ 0.854607] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]311gitlab # [ 0.858618] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]312gitlab # [ 0.861595] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]313gitlab # [ 0.865603] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]314gitlab # [ 0.871638] pci_bus 0000:00: root bus resource [bus 00-ff]315gitlab # [ 0.877102] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint316gitlab # [ 0.886346] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint317gitlab # [ 0.895033] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint318gitlab # [ 0.905749] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]319gitlab # [ 0.908731] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk320gitlab # [ 0.913599] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk321gitlab # [ 0.916620] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk322gitlab # [ 0.920626] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk323gitlab # [ 0.926346] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint324gitlab # [ 0.936766] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]325gitlab # [ 0.943939] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint326gitlab # [ 0.952252] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI327gitlab # [ 0.957638] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB328gitlab # [ 0.962766] pci 0000:00:01.3: quirk_piix4_acpi+0x0/0x180 took 10742 usecs329gitlab # [ 0.968506] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint330gitlab # [ 0.987758] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]331gitlab # [ 0.991660] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]332gitlab # [ 0.994720] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]333gitlab # [ 1.024079] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]334gitlab # [ 1.030867] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint335gitlab # [ 1.043642] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]336gitlab # [ 1.046632] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]337gitlab # [ 1.049648] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]338gitlab # [ 1.051608] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]339gitlab # [ 1.056155] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint340gitlab # [ 1.063631] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]341gitlab # [ 1.065608] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]342gitlab # [ 1.066647] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]343gitlab # [ 1.072167] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint344gitlab # [ 1.085568] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]345gitlab # [ 1.088627] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]346gitlab # [ 1.092705] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]347gitlab # [ 1.100728] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint348gitlab # [ 1.107609] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]349gitlab # [ 1.108608] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]350gitlab # [ 1.110647] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]351gitlab # [ 1.117419] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint352gitlab # [ 1.132645] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]353gitlab # [ 1.136644] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]354gitlab # [ 1.140736] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]355gitlab # [ 1.152234] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint356gitlab # [ 1.166611] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]357gitlab # [ 1.167608] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]358gitlab # [ 1.169647] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]359gitlab # [ 1.174671] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint360gitlab # [ 1.179625] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]361gitlab # [ 1.182610] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]362gitlab # [ 1.185736] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]363gitlab # [ 1.191639] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]364gitlab # [ 1.201918] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint365gitlab # [ 1.213684] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]366gitlab # [ 1.216707] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]367gitlab # [ 1.225853] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint368gitlab # [ 1.233634] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]369gitlab # [ 1.235608] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]370gitlab # [ 1.237654] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]371gitlab # [ 1.243059] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint372gitlab # [ 1.255635] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]373gitlab # [ 1.259637] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]374gitlab # [ 1.264735] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]375gitlab # [ 1.286559] ACPI: PCI: Interrupt link LNKA configured for IRQ 10376gitlab # [ 1.290052] ACPI: PCI: Interrupt link LNKB configured for IRQ 10377gitlab # [ 1.294992] ACPI: PCI: Interrupt link LNKC configured for IRQ 11378gitlab # [ 1.297980] ACPI: PCI: Interrupt link LNKD configured for IRQ 11379gitlab # [ 1.300701] ACPI: PCI: Interrupt link LNKS configured for IRQ 9380gitlab # [ 1.304637] iommu: Default domain type: Translated381gitlab # [ 1.305599] iommu: DMA domain TLB invalidation policy: lazy mode382gitlab # [ 1.307946] ACPI: bus type USB registered383gitlab # [ 1.309670] usbcore: registered new interface driver usbfs384gitlab # [ 1.312650] usbcore: registered new interface driver hub385gitlab # [ 1.317679] usbcore: registered new device driver usb386gitlab # [ 1.324707] NetLabel: Initializing387gitlab # [ 1.327601] NetLabel: domain hash size = 128388gitlab # [ 1.330600] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO389gitlab # [ 1.334754] NetLabel: unlabeled traffic allowed by default390gitlab # [ 1.338624] PCI: Using ACPI for IRQ routing391gitlab # [ 1.342741] pci 0000:00:02.0: vgaarb: setting as boot VGA device392gitlab # [ 1.343588] pci 0000:00:02.0: vgaarb: bridge control possible393gitlab # [ 1.343588] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none394gitlab # [ 1.354597] vgaarb: loaded395gitlab # [ 1.355779] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0396gitlab # [ 1.357593] hpet0: 3 comparators, 64-bit 100.000000 MHz counter397gitlab # [ 1.363755] clocksource: Switched to clocksource kvm-clock398gitlab # [ 1.366091] VFS: Disk quotas dquot_6.6.0399gitlab # [ 1.367365] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)400gitlab # [ 1.369891] pnp: PnP ACPI init401gitlab # [ 1.372676] pnp: PnP ACPI: found 6 devices402gitlab # [ 1.388343] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns403gitlab # [ 1.394947] clocksource: Switched to clocksource acpi_pm404gitlab # [ 1.399393] NET: Registered PF_INET protocol family405gitlab # [ 1.406779] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)406gitlab # [ 1.441370] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)407gitlab # [ 1.443978] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)408gitlab # [ 1.446401] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)409gitlab # [ 1.451430] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)410gitlab # [ 1.453761] TCP: Hash tables configured (established 65536 bind 65536)411gitlab # [ 1.455970] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)412gitlab # [ 1.458585] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)413gitlab # [ 1.461043] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)414gitlab # [ 1.463380] NET: Registered PF_UNIX/PF_LOCAL protocol family415gitlab # [ 1.465189] NET: Registered PF_XDP protocol family416gitlab # [ 1.466729] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]417gitlab # [ 1.468645] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]418gitlab # [ 1.470554] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]419gitlab # [ 1.472652] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]420gitlab # [ 1.474745] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]421gitlab # [ 1.477107] pci 0000:00:01.0: PIIX3: Enabling Passive Release422gitlab # [ 1.478921] pci 0000:00:00.0: Limiting direct PCI/PCI transfers423gitlab # [ 1.482338] ACPI: \_SB_.LNKD: Enabled at IRQ 11424gitlab # [ 1.486048] PCI: CLS 0 bytes, default 64425gitlab # [ 1.487445] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)426gitlab # [ 1.488058] Trying to unpack rootfs image as initramfs...427gitlab # [ 1.489417] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)428gitlab # [ 1.489544] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns429gitlab # [ 1.524706] Initialise system trusted keyrings430gitlab # [ 1.528970] workingset: timestamp_bits=40 max_order=21 bucket_order=0431gitlab # [ 1.560682] Key type asymmetric registered432gitlab # [ 1.563439] Asymmetric key parser 'x509' registered433gitlab # [ 1.566712] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)434gitlab # [ 1.571671] io scheduler mq-deadline registered435gitlab # [ 1.574655] io scheduler kyber registered436gitlab # [ 1.579671] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled437gitlab # [ 1.582025] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A438gitlab # [ 1.586117] Linux agpgart interface v0.103439gitlab # [ 1.587514] ACPI: bus type drm_connector registered440gitlab # [ 1.595143] usbcore: registered new interface driver usbserial_generic441gitlab # [ 1.600085] usbserial: USB Serial support registered for generic442gitlab # [ 1.604698] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.443gitlab # [ 1.604698] Please enable it if your BIOS has the CPPC option.444gitlab # [ 1.614044] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled445gitlab # [ 1.618814] drop_monitor: Initializing network drop monitor service446gitlab # [ 1.622294] NET: Registered PF_INET6 protocol family447gitlab # [ 1.625119] Segment Routing with IPv6448gitlab # [ 1.626378] In-situ OAM (IOAM) with IPv6449gitlab # [ 1.629144] IPI shorthand broadcast: enabled450gitlab # [ 1.634453] sched_clock: Marking stable (1366025346, 267848651)->(1708157369, -74283372)451gitlab # [ 1.637502] registered taskstats version 1452gitlab # [ 1.639260] Loading compiled-in X.509 certificates453gitlab # [ 1.649814] Demotion targets for Node 0: null454gitlab # [ 1.651659] Key type .fscrypt registered455gitlab # [ 1.652943] Key type fscrypt-provisioning registered456gitlab # [ 1.654625] ima: No TPM chip found, activating TPM-bypass!457gitlab # [ 1.656341] ima: Allocated hash algorithm: sha1458gitlab # [ 1.657821] ima: No architecture policies found459gitlab # [ 1.659687] PM: Magic number: 10:339:771460gitlab # [ 1.662010] RAS: Correctable Errors collector initialized.461gitlab # [ 1.667522] clk: Disabling unused clocks462gitlab # [ 1.668797] PM: genpd: Disabling unused power domains463gitlab # [ 1.815409] Freeing initrd memory: 29392K464gitlab # [ 1.823277] Freeing unused decrypted memory: 2028K465gitlab # [ 1.831809] Freeing unused kernel image (initmem) memory: 3640K466gitlab # [ 1.836675] Write protecting the kernel read-only data: 32768k467gitlab # [ 1.844046] Freeing unused kernel image (text/rodata gap) memory: 1220K468gitlab # [ 1.850432] Freeing unused kernel image (rodata/data gap) memory: 760K469gitlab # [ 1.917939] x86/mm: Checked W+X mappings: passed, no W+X pages found.470gitlab # [ 1.920009] Run /init as init process471gitlab # [ 1.933912] systemd[1]: Inserted module 'autofs4'472gitlab # [ 1.963203] fuse: init (API version 7.45)473gitlab # [ 1.973499] ACPI: \_SB_.LNKC: Enabled at IRQ 10474gitlab # [ 1.987080] ACPI: \_SB_.LNKA: Enabled at IRQ 10475gitlab # [ 2.005378] ACPI: \_SB_.LNKB: Enabled at IRQ 11476gitlab # [ 2.059414] systemd[1]: Successfully made /usr/ read-only.477gitlab # [ 2.396731] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)478gitlab # [ 2.405791] systemd[1]: Detected virtualization kvm.479gitlab # [ 2.407462] systemd[1]: Detected architecture x86-64.480gitlab # [ 2.409092] systemd[1]: Running in initrd.481gitlab # [ 2.410833] systemd[1]: Initializing machine ID from random generator.482gitlab # [ 2.413055] systemd[1]: Hostname set to <gitlab>.483gitlab # [ 2.522650] systemd[1]: bpf-restrict-fs: LSM BPF program attached484gitlab # [ 2.569004] systemd[1]: Queued start job for default target Initrd Default Target.485gitlab # [ 2.582989] systemd[1]: Created slice Slice /system/modprobe.486gitlab # [ 2.585091] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.487gitlab # [ 2.587569] systemd[1]: Expecting device /dev/disk/by-label/nix-store...488gitlab # [ 2.589704] systemd[1]: Expecting device /dev/disk/by-label/nixos...489gitlab # [ 2.591800] systemd[1]: Reached target Path Units.490gitlab # [ 2.593487] systemd[1]: Reached target Slice Units.491gitlab # [ 2.595120] systemd[1]: Reached target Swaps.492gitlab # [ 2.596654] systemd[1]: Reached target Timer Units.493gitlab # [ 2.598471] systemd[1]: Listening on D-Bus System Message Bus Socket.494gitlab # [ 2.600664] systemd[1]: Listening on Journal Socket (/dev/log).495gitlab # [ 2.602776] systemd[1]: Listening on Journal Sockets.496gitlab # [ 2.604654] systemd[1]: Listening on udev Control Socket.497gitlab # [ 2.606586] systemd[1]: Listening on udev Kernel Socket.498gitlab # [ 2.608406] systemd[1]: Reached target Socket Units.499gitlab # [ 2.611355] systemd[1]: Starting Create List of Static Device Nodes...500gitlab # [ 2.614541] systemd[1]: Starting Load Kernel Module 9pnet_virtio...501gitlab # [ 2.617683] systemd[1]: Starting Load Kernel Module configfs...502gitlab # [ 2.636147] systemd[1]: Starting Journal Service...503gitlab # [ 2.642517] systemd[1]: Starting Load Kernel Modules...504gitlab # [ 2.644707] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os505gitlab # [ 2.650975] systemd[1]: Starting Coldplug All udev Devices...506gitlab # [ 2.660544] systemd[1]: Finished Create List of Static Device Nodes.507gitlab # [ 2.665725] systemd[1]: modprobe@configfs.service: Deactivated successfully.508gitlab # [ 2.673570] systemd[1]: Finished Load Kernel Module configfs.509gitlab # [ 2.680239] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config510gitlab # [ 2.680396] systemd-journald[92]: Collecting audit messages is disabled.511gitlab # [ 2.688170] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...512gitlab # [ 2.703882] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.513gitlab # [ 2.708782] netfs: FS-Cache loaded514gitlab # [ 2.709144] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev515gitlab # [ 2.718252] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.516gitlab # [ 2.721700] 9pnet: Installing 9P2000 support517gitlab # [ 2.722195] systemd[1]: Starting Create Static Device Nodes in /dev...518gitlab # [ 2.734998] systemd[1]: Finished Load Kernel Modules.519gitlab # [ 2.740010] systemd[1]: Starting Apply Kernel Variables...520gitlab # [ 2.742492] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.521gitlab # [ 2.749563] systemd[1]: Finished Load Kernel Module 9pnet_virtio.522gitlab # [ 2.752811] systemd[1]: Finished Create Static Device Nodes in /dev.523gitlab # [ 2.755993] systemd[1]: Finished Apply Kernel Variables.524gitlab # [ 2.758186] systemd[1]: Reached target Preparation for Local File Systems.525gitlab # [ 2.760342] systemd[1]: Reached target Local File Systems.526gitlab # [ 2.763263] systemd[1]: Starting Rule-based Manager for Device Events and Files...527gitlab # [ 2.766962] systemd[1]: Started Journal Service.528gitlab # [ 2.499253] systemd-modules-load[93]: Using 4 probe threads529gitlab # [ 2.502735] systemd-modules-load[93]: Inserted module 'virtio_balloon'530gitlab # [ 2.504556] systemd-modules-load[93]: Inserted module 'dm_mod'531gitlab # [ 2.506323] systemd-modules-load[93]: Inserted module 'virtio_gpu'532gitlab # [ 2.508099] systemd[1]: Starting Create System Files and Directories...533gitlab # [ 2.519783] systemd[1]: Finished Create System Files and Directories.534gitlab # [ 2.524680] systemd-udevd[104]: Using default interface naming scheme 'v261'.535gitlab # [ 2.539923] systemd[1]: Started Rule-based Manager for Device Events and Files.536gitlab # [ 2.573681] systemd[1]: Finished Coldplug All udev Devices.537gitlab # [ 2.575261] systemd[1]: Reached target System Initialization.538gitlab # [ 2.576781] systemd[1]: Reached target Basic System.539gitlab # [ 2.958535] virtio_blk virtio4: 4/0/0 default/read/poll queues540gitlab # [ 2.970341] SCSI subsystem initialized541gitlab # [ 2.972231] uhci_hcd 0000:00:01.2: UHCI Host Controller542gitlab # [ 2.973603] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1543gitlab # [ 2.975475] uhci_hcd 0000:00:01.2: detected 2 ports544gitlab # [ 2.981884] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140545gitlab # [ 2.983521] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18546gitlab # [ 2.986121] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1547gitlab # [ 2.987936] usb usb1: Product: UHCI Host Controller548gitlab # [ 2.989173] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd549gitlab # [ 2.990508] usb usb1: SerialNumber: 0000:00:01.2550gitlab # [ 2.992508] hub 1-0:1.0: USB hub found551gitlab # [ 2.993703] hub 1-0:1.0: 2 ports detected552gitlab # [ 3.004387] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)553gitlab # [ 3.008606] virtio_blk virtio5: 4/0/0 default/read/poll queues554gitlab # [ 3.015498] virtio_blk virtio5: [vdb] 11843232 512-byte logical blocks (6.06 GB/5.65 GiB)555gitlab # [ 3.024790] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12556gitlab # [ 3.026071] scsi host0: ata_piix557gitlab # [ 3.028492] serio: i8042 KBD port at 0x60,0x64 irq 1558gitlab # [ 3.029777] serio: i8042 AUX port at 0x60,0x64 irq 12559gitlab # [ 3.030256] scsi host1: ata_piix560gitlab # [ 3.032081] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0561gitlab # [ 3.033907] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0562gitlab # [ 2.802119] (udev-worker)[123]: Network interface NamePolicy= disabled on kernel command line.563gitlab # [ 2.806235] systemd[1]: Starting Virtual Console Setup...564gitlab # [ 2.811071] (udev-worker)[135]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.565gitlab # [ 2.816047] (udev-worker)[135]: Network interface NamePolicy= disabled on kernel command line.566gitlab # [ 2.821256] systemd[1]: Found device /dev/disk/by-label/nixos.567gitlab # [ 2.824274] systemd[1]: Reached target Initrd Root Device.568gitlab # [ 2.825612] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...569gitlab # [ 2.830776] systemd-vconsole-setup[150]: Configuration of first virtual console was skipped, ignoring remaining ones.570gitlab # [ 2.833952] systemd[1]: Found device /dev/disk/by-label/nix-store.571gitlab # [ 2.835815] systemd[1]: Finished Virtual Console Setup.572gitlab # [ 2.846861] systemd-fsck[157]: nixos: clean, 12/65536 files, 13019/262144 blocks573gitlab # [ 2.850048] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.574gitlab # [ 3.199246] ata2: found unknown device (class 0)575gitlab # [ 3.203320] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100576gitlab # [ 3.209503] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5577gitlab # [ 3.216064] usb 1-1: new full-speed USB device number 2 using uhci_hcd578gitlab # [ 3.250562] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0579gitlab # [ 3.295396] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray580gitlab # [ 3.332432] cdrom: Uniform CD-ROM driver Revision: 3.20581gitlab # [ 3.388731] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00582gitlab # [ 3.393693] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10583gitlab # [ 3.398586] usb 1-1: Product: QEMU USB Tablet584gitlab # [ 3.401470] usb 1-1: Manufacturer: QEMU585gitlab # [ 3.404137] usb 1-1: SerialNumber: 28754-0000:00:01.2-1586gitlab # [ 3.447987] hid: raw HID events driver (C) Jiri Kosina587gitlab # [ 3.462749] usbcore: registered new interface driver usbhid588gitlab # [ 3.465446] usbhid: USB HID core driver589gitlab # [ 3.478492] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2590gitlab # [ 3.485965] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0591gitlab # [ 3.395668] systemd[1]: Mounting /sysroot...592gitlab # [ 3.856231] EXT4-fs (vda): mounted filesystem a19d6e94-f504-4dc3-8348-36b4f253319e r/w with ordered data mode. Quota mode: none.593gitlab # [ 3.594273] systemd[1]: Mounted /sysroot.594gitlab # [ 3.596335] systemd[1]: Reached target Initrd Root File System.595gitlab # [ 3.600135] systemd[1]: Mounting /sysroot/nix/.ro-store...596gitlab # [ 3.602502] systemd[1]: Mounting /sysroot/nix/.rw-store...597gitlab # [ 3.606205] systemd[1]: Mounting /sysroot/run...598gitlab # [ 3.607701] systemd[1]: Mounting /sysroot/tmp/shared...599gitlab # [ 3.612304] systemd[1]: Mounting /sysroot/tmp/xchg...600gitlab # [ 3.615498] systemd[1]: Starting Mountpoints Configured in the Real Root...601gitlab # [ 3.624177] systemd[1]: Mounted /sysroot/run.602gitlab # [ 3.896706] 9p: Installing v9fs 9p2000 file system support603gitlab # [ 3.633341] systemd-sysroot-fstab-check[177]: /sysroot should be mounted in the initrd, will request daemon-reload.604gitlab # [ 3.637864] systemd[1]: Mounted /sysroot/nix/.rw-store.[ 3.907073] erofs (device vdb): mounted with root inode @ nid 128.605gitlab # 606gitlab # [ 3.641211] systemd[1]: Mounted /sysroot/tmp/xchg.607gitlab # [ 3.642606] systemd[1]: Mounted /sysroot/tmp/shared.608gitlab # [ 3.643960] systemd[1]: Reload requested from client PID 177 ('systemd-sysroot') (unit initrd-parse-etc.service)...609gitlab # [ 3.646592] systemd[1]: Reloading...610gitlab # [ 3.705229] systemd[1]: Reloading finished in 63 ms.611gitlab # [ 3.736236] systemd-sysroot-fstab-check[177]: Requesting initrd-fs.target/start/replace...612gitlab # [ 3.741137] systemd[1]: Mounted /sysroot/nix/.ro-store.613gitlab # [ 3.744462] systemd-sysroot-fstab-check[177]: Requesting swap.target/start/replace...614gitlab # [ 3.748908] systemd[1]: Starting rw-sysroot-nix-store.service...615gitlab # [ 3.753619] systemd[1]: initrd-parse-etc.service: Deactivated successfully.616gitlab # [ 3.761986] systemd[1]: Finished Mountpoints Configured in the Real Root.617gitlab # [ 3.766114] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.618gitlab # [ 3.774757] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.619gitlab # [ 3.779434] systemd[1]: Finished rw-sysroot-nix-store.service.620gitlab # [ 4.396359] systemd[1]: Mounting /sysroot/nix/store...621gitlab # [ 4.450241] systemd[1]: Mounted /sysroot/nix/store.622gitlab # [ 4.454263] systemd[1]: Reached target Initrd File Systems.623gitlab # [ 4.458499] systemd[1]: Starting Find NixOS closure...624gitlab # [ 4.462711] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...625gitlab # [ 4.486605] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.626gitlab # [ 4.492261] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.627gitlab # [ 4.514890] systemd[1]: Finished Find NixOS closure.628gitlab # [ 4.518421] systemd[1]: Reached target Initrd Default Target.629gitlab # [ 4.522946] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...630gitlab # [ 4.563758] systemd[1]: Stopped target Initrd Default Target.631gitlab # [ 4.568185] systemd[1]: Stopped target Basic System.632gitlab # [ 4.571278] systemd[1]: Stopped target Initrd Root Device.633gitlab # [ 4.574602] systemd[1]: Stopped target Path Units.634gitlab # [ 4.577537] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.635gitlab # [ 4.582091] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.636gitlab # [ 4.586975] systemd[1]: Stopped target Slice Units.637gitlab # [ 4.590602] systemd[1]: Stopped target Socket Units.638gitlab # [ 4.593388] systemd[1]: Stopped target System Initialization.639gitlab # [ 4.596921] systemd[1]: Stopped target Swaps.640gitlab # [ 4.599261] systemd[1]: Stopped target Timer Units.641gitlab # [ 4.601839] systemd[1]: dbus.socket: Deactivated successfully.642gitlab # [ 4.604917] systemd[1]: Closed D-Bus System Message Bus Socket.643gitlab # [ 4.608263] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.644gitlab # [ 4.612270] systemd[1]: Stopped Find NixOS closure.645gitlab # [ 4.614707] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio646gitlab # [ 4.619697] systemd[1]: Starting rw-sysroot-nix-store.service...647gitlab # [ 4.622711] systemd[1]: systemd-sysctl.service: Deactivated successfully.648gitlab # [ 4.625370] systemd[1]: Stopped Apply Kernel Variables.649gitlab # [ 4.627414] systemd[1]: systemd-modules-load.service: Deactivated successfully.650gitlab # [ 4.630216] systemd[1]: Stopped Load Kernel Modules.651gitlab # [ 4.631473] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.652gitlab # [ 4.633322] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.653gitlab # [ 4.635180] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.654gitlab # [ 4.637055] systemd[1]: Stopped Create System Files and Directories.655gitlab # [ 4.638587] systemd[1]: Stopped target Local File Systems.656gitlab # [ 4.639957] systemd[1]: Stopped target Preparation for Local File Systems.657gitlab # [ 4.641592] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.658gitlab # [ 4.643305] systemd[1]: Stopped Coldplug All udev Devices.659gitlab # [ 4.644650] systemd[1]: Stopping Rule-based Manager for Device Events and Files...660gitlab # [ 4.646477] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.661gitlab # [ 4.648229] systemd[1]: Stopped Virtual Console Setup.662gitlab # [ 4.649491] systemd[1]: initrd-cleanup.service: Deactivated successfully.663gitlab # [ 4.651137] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.664gitlab # [ 4.652727] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.665gitlab # [ 4.654445] systemd[1]: Finished rw-sysroot-nix-store.service.666gitlab # [ 4.655861] systemd[1]: systemd-udevd.service: Deactivated successfully.667gitlab # [ 4.657441] systemd[1]: Stopped Rule-based Manager for Device Events and Files.668gitlab # [ 4.659217] systemd[1]: systemd-udevd.service: Consumed 1.030s CPU time over 2.139s wall clock time, 26.9M memory peak.669gitlab # [ 4.661897] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.670gitlab # [ 4.663614] systemd[1]: Closed udev Control Socket.671gitlab # [ 4.664858] systemd[1]: Starting Cleanup udev Database...672gitlab # [ 4.666218] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.673gitlab # [ 4.668099] systemd[1]: Stopped Create Static Device Nodes in /dev.674gitlab # [ 4.669575] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.675gitlab # [ 4.671504] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.676gitlab # [ 4.673221] systemd[1]: kmod-static-nodes.service: Deactivated successfully.677gitlab # [ 4.674900] systemd[1]: Stopped Create List of Static Device Nodes.678gitlab # [ 4.676422] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.679gitlab # [ 4.678280] systemd[1]: Finished Cleanup udev Database.680gitlab # [ 4.679575] systemd[1]: Reached target Switch Root.681gitlab # [ 4.681395] systemd[1]: Starting NixOS Activation...682gitlab # [ 4.811931] initrd-nixos-activation-start[225]: booting system configuration /nix/store/zlhf9vakdnp8l0ind4550ja6r333sfz4-nixos-system-gitlab-test683gitlab # [ 4.858903] initrd-nixos-activation-start[225]: running activation script...684gitlab # [ 5.102404] initrd-nixos-activation-start[248]: setting up /etc...685gitlab # [ 5.218621] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.686gitlab # [ 5.221562] systemd[1]: Finished NixOS Activation.687gitlab # [ 5.224971] systemd[1]: Starting Switch Root...688gitlab # [ 5.260551] systemd[1]: Switching root.689gitlab # [ 5.589606] systemd-journald[92]: Received SIGTERM from PID 1 (systemd).690gitlab # [ 5.680794] NET: Registered PF_VSOCK protocol family691gitlab # [ 6.050558] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)692gitlab # [ 6.067314] systemd[1]: Detected virtualization kvm.693gitlab # [ 6.070509] systemd[1]: Detected architecture x86-64.694gitlab # [ 6.073999] systemd[1]: Detected first boot.695gitlab # [ 6.077836] systemd[1]: Initializing machine ID from random generator.696gitlab # [ 6.215932] systemd[1]: bpf-restrict-fs: LSM BPF program attached697gitlab # [ 6.323803] systemd[1]: Applying preset policy.698gitlab # [ 6.485793] systemd[1]: Populated /etc with preset unit settings.699gitlab # [ 6.618217] systemd[1]: initrd-switch-root.service: Deactivated successfully.700gitlab # [ 6.620496] systemd[1]: Stopped initrd-switch-root.service.701gitlab # [ 6.623774] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.702gitlab # [ 6.626973] systemd[1]: Created slice Slice /system/getty.703gitlab # [ 6.629111] systemd[1]: Created slice GitLab DevOps Platform Slice.704gitlab # [ 6.631384] systemd[1]: Created slice User and Session Slice.705gitlab # [ 6.632999] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.706gitlab # [ 6.635044] systemd[1]: Started Forward Password Requests to Wall Directory Watch.707gitlab # [ 6.637010] systemd[1]: Expecting device /dev/hvc0...708gitlab # [ 6.638300] systemd[1]: Expecting device /dev/ttyS0...709gitlab # [ 6.639662] systemd[1]: Reached target Local Encrypted Volumes.710gitlab # [ 6.641195] systemd[1]: Stopped target initrd-fs.target.711gitlab # [ 6.642539] systemd[1]: Stopped target initrd-root-fs.target.712gitlab # [ 6.644364] systemd[1]: Stopped target initrd-switch-root.target.713gitlab # [ 6.645968] systemd[1]: Reached target Virtual Machines and Containers.714gitlab # [ 6.647632] systemd[1]: Reached target Path Units.715gitlab # [ 6.649015] systemd[1]: Reached target Remote File Systems.716gitlab # [ 6.650434] systemd[1]: Reached target Slice Units.717gitlab # [ 6.651757] systemd[1]: Reached target Swaps.718gitlab # [ 6.653910] systemd[1]: Listening on Query the User Interactively for a Password.719gitlab # [ 6.656785] systemd[1]: Listening on Process Core Dump Socket.720gitlab # [ 6.658921] systemd[1]: Listening on Credential Encryption/Decryption.721gitlab # [ 6.661295] systemd[1]: Listening on Factory Reset Management.722gitlab # [ 6.663009] systemd[1]: Listening on Hostname Service Socket.723gitlab # [ 6.666340] systemd[1]: Starting Journal Log Access Socket...724gitlab # [ 6.668594] systemd[1]: Listening on Journal Audit Socket.725gitlab # [ 6.671284] systemd[1]: Listening on Console Output Muting Service Socket.726gitlab # [ 6.673221] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.727gitlab # [ 6.675188] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os728gitlab # [ 6.677438] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki729gitlab # [ 6.681267] systemd[1]: Listening on Disk Repartitioning Service Socket.730gitlab # [ 6.683065] systemd[1]: Listening on udev Control Socket.731gitlab # [ 6.684607] systemd[1]: Listening on udev Varlink Socket.732gitlab # [ 6.688383] systemd[1]: Mounting Huge Pages File System...733gitlab # [ 6.708335] systemd[1]: Mounting POSIX Message Queue File System...734gitlab # [ 6.711561] systemd[1]: Mounting Kernel Debug File System...735gitlab # [ 6.714452] systemd[1]: Mounting Kernel Trace File System...736gitlab # [ 6.724972] systemd[1]: Starting Create List of Static Device Nodes...737gitlab # [ 6.726655] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio738gitlab # [ 6.733682] systemd[1]: Starting Load Kernel Module configfs...739gitlab # [ 6.738652] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm740gitlab # [ 6.741073] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore741gitlab # [ 6.743689] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse742gitlab # [ 6.747455] systemd[1]: Mounting FUSE Control File System...743gitlab # [ 6.748975] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67744gitlab # [ 6.754961] systemd[1]: Starting Journal Service...745gitlab # [ 6.757996] systemd[1]: Starting Load Kernel Modules...746gitlab # [ 6.762541] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...747gitlab # [ 6.772004] systemd[1]: Starting Remount Root and Kernel File Systems...748gitlab # [ 6.773686] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os749gitlab # [ 6.779192] systemd-journald[320]: Collecting audit messages is enabled.750gitlab # [ 6.782577] systemd[1]: Starting Coldplug All udev Devices...751gitlab # [ 6.792379] systemd[1]: Listening on Journal Log Access Socket.752gitlab # [ 6.794442] loop: module loaded753gitlab # [ 6.795655] systemd[1]: Mounted Huge Pages File System.754gitlab # [ 6.797445] systemd[1]: Mounted POSIX Message Queue File System.755gitlab # [ 6.799137] systemd[1]: Mounted Kernel Debug File System.756gitlab # [ 6.800714] systemd[1]: Mounted Kernel Trace File System.757gitlab # [ 6.535525] systemd[1]: Queued start job for default target Multi-User System.758gitlab # [ 6.803706] systemd[1]: Finished Create List of Static Device Nodes.759gitlab # [ 6.538122] s[ 6.803723] EXT4-fs (vda): re-mounted a19d6e94-f504-4dc3-8348-36b4f253319e.760gitlab # ystemd[1]: Unnec[ 6.804713] systemd[1]: Started Journal Service.761gitlab # essary job was removed for /dev/vdb.762gitlab # [ 6.542915] systemd[1]: systemd-journald.service: Deactivated successfully.763gitlab # [ 6.545399] systemd-modules-load[321]: Using 3 probe threads764gitlab # [ 6.547266] systemd-modules-load[321]: Inserted module 'loop'765gitlab # [ 6.549133] systemd-modules-load[321]: Inserted module 'tls'766gitlab # [ 6.550886] systemd[1]: modprobe@configfs.service: Deactivated successfully.767gitlab # [ 6.553296] systemd[1]: Finished Load Kernel Module configfs.768gitlab # [ 6.555442] systemd[1]: Mounted FUSE Control File System.769gitlab # [ 6.557392] systemd[1]: Finished Load Kernel Modules.770gitlab # [ 6.558981] systemd[1]: Finished Remount Root and Kernel File Systems.771gitlab # [ 6.560921] systemd[1]: Listening on Disk Image Download Service Socket.772gitlab # [ 6.562832] systemd[1]: Mounting Kernel Configuration File System...773gitlab # [ 6.564985] systemd-oomd[322]: No swap; memory pressure usage will be degraded774gitlab # [ 6.568391] systemd[1]: Starting Firewall...775gitlab # [ 6.571290] systemd[1]: Starting Flush Journal to Persistent Storage...776gitlab # [ 6.573488] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore777gitlab # [ 6.576658] systemd[1]: Starting Load/Save OS Random Seed...778gitlab # [ 6.579808] systemd[1]: Starting Apply Kernel Variables...779gitlab # [ 6.852569] systemd-journald[320]: Received client request to flush runtime journal.780gitlab # [ 6.657421] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...781gitlab # [ 6.660318] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os782gitlab # [ 6.662759] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.783gitlab # [ 6.665365] systemd[1]: Mounted Kernel Configuration File System.784gitlab # [ 6.667870] systemd[1]: Finished Load/Save OS Random Seed.785gitlab # [ 6.669594] systemd[1]: Reached target First Boot Complete.786gitlab # [ 6.671522] systemd[1]: Finished Apply Kernel Variables.787gitlab # [ 6.672918] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.788gitlab # [ 6.674774] systemd[1]: Starting Create Static Device Nodes in /dev...789gitlab # [ 6.676544] systemd[1]: Finished Create Static Device Nodes in /dev.790gitlab # [ 6.678188] systemd[1]: Reached target Preparation for Local File Systems.791gitlab # [ 6.680072] systemd[1]: Starting Rule-based Manager for Device Events and Files...792gitlab # [ 6.681972] systemd[1]: Finished Flush Journal to Persistent Storage.793gitlab # [ 6.684077] systemd-udevd[363]: Using default interface naming scheme 'v261'.794gitlab # [ 6.694426] systemd[1]: Finished Coldplug All udev Devices.795gitlab # [ 6.712691] systemd[1]: Started Rule-based Manager for Device Events and Files.796gitlab # [ 6.835242] systemd[1]: Finished Firewall.797gitlab # [ 6.837109] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse798gitlab # [ 6.858675] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.799gitlab # [ 6.883156] (udev-worker)[447]: Network interface NamePolicy= disabled on kernel command line.800gitlab # [ 6.887290] (udev-worker)[449]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.801gitlab # [ 6.890913] (udev-worker)[449]: Network interface NamePolicy= disabled on kernel command line.802gitlab # [ 6.897676] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.803gitlab # [ 6.900525] systemd[1]: Condition check resulted in Virtio network device being skipped.804gitlab # [ 6.903167] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore805gitlab # [ 6.906126] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67806gitlab # [ 6.910070] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore807gitlab # [ 6.913114] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os808gitlab # [ 6.915905] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os809gitlab # [ 7.203241] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3810gitlab # [ 7.219344] mousedev: PS/2 mouse device common for all mice811gitlab # [ 7.223490] ACPI: button: Power Button [PWRF]812gitlab # [ 7.234127] rtc_cmos 00:05: RTC can wake from S4813gitlab # [ 7.241167] Floppy drive(s): fd0 is 2.88M AMI BIOS814gitlab # [ 7.249333] rtc_cmos 00:05: registered as rtc0815gitlab # [ 7.250648] rtc_cmos 00:05: setting system clock to 2026-09-06T06:46:02 UTC (1788677162)816gitlab # [ 7.251743] parport_pc 00:03: reported by Plug and Play ACPI817gitlab # [ 7.254454] FDC 0 is a S82078B818gitlab # [ 7.256443] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs819gitlab # [ 7.256459] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]820gitlab # [ 7.262710] systemd-journald[320]: Time jumped backwards, rotating.821gitlab # [ 7.292163] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5822gitlab # [ 7.296509] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4823gitlab # [ 7.301039] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console824gitlab # [ 7.301687] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input6825gitlab # [ 7.308539] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0826gitlab # [ 7.308610] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD827gitlab # [ 7.317091] Console: switching to colour dummy device 80x25828gitlab # [ 7.321253] [drm] Found bochs VGA, ID 0xb0c5.829gitlab # [ 7.321256] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.830gitlab # [ 7.327936] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic831gitlab # [ 7.330134] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0832gitlab # [ 7.367419] Console: switching to colour frame buffer device 160x50833gitlab # [ 7.376091] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device834gitlab # [ 7.128662] systemd[1]: Starting Virtual Console Setup...835gitlab # [ 7.442362] kvm_amd: TSC scaling supported836gitlab # [ 7.443497] kvm_amd: Nested Virtualization enabled837gitlab # [ 7.445044] kvm_amd: Nested Paging enabled838gitlab # [ 7.446226] kvm_amd: LBR virtualization supported839gitlab # [ 7.447304] kvm_amd: Virtual VMLOAD VMSAVE supported840gitlab # [ 7.448458] kvm_amd: Virtual GIF supported841gitlab # [ 7.449428] kvm_amd: Virtual NMI enabled842gitlab # [ 7.192369] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.843gitlab # [ 7.205608] s[ 7.473477] ppdev: user-space parallel port driver844gitlab # ystemd[1]: Stopped Virtual Console Setup.845gitlab # [ 7.218056] systemd[1]: Starting Virtual Console Setup...846gitlab # [ 7.223699] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.847gitlab # [ 7.226144] systemd[1]: Stopped Virtual Console Setup.848gitlab # [ 7.495599] EDAC MC: Ver: 3.0.0849gitlab # [ 7.228756] systemd[1]: Starting Virtual Console Setup...850gitlab # [ 7.288355] systemd-vconsole-setup[495]: Configuration of first virtual console was skipped, ignoring remaining ones.851gitlab # [ 7.291304] systemd[1]: Finished Virtual Console Setup.852gitlab # [ 7.352331] systemd[1]: Mounting /run/wrappers...853gitlab # [ 7.374523] systemd[1]: Mounted /run/wrappers.854gitlab # [ 7.377617] systemd[1]: Reached target Local File Systems.855gitlab # [ 7.381249] systemd[1]: Listening on Boot Loader Control Service Socket.856gitlab # [ 7.385596] systemd[1]: Starting register-nix-paths.service...857gitlab # [ 7.389342] systemd[1]: Starting Create SUID/SGID Wrappers...858gitlab # [ 7.393260] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.859gitlab # [ 7.398549] systemd[1]: Starting Save Transient machine-id to Disk...860gitlab # [ 7.402235] systemd[1]: Starting Create System Files and Directories...861gitlab # [ 7.425659] systemd[1]: Finished Create System Files and Directories.862gitlab # [ 7.430441] systemd[1]: Starting Rebuild Journal Catalog...863gitlab # [ 7.433395] systemd[1]: Starting Record System Boot/Shutdown in UTMP...864gitlab # [ 7.452423] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.865gitlab # [ 7.454545] systemd[1]: Finished Save Transient machine-id to Disk.866gitlab # [ 7.458734] systemd[1]: Finished Record System Boot/Shutdown in UTMP.867gitlab # [ 7.473202] systemd[1]: Finished Rebuild Journal Catalog.868gitlab # [ 7.475484] systemd[1]: Starting Update is Completed...869gitlab # [ 7.493315] systemd[1]: Finished Update is Completed.870gitlab # [ 7.526350] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.871gitlab # [ 7.528476] systemd[1]: Finished Create SUID/SGID Wrappers.872gitlab # [ 7.807682] systemd[1]: Finished register-nix-paths.service.873gitlab # [ 7.811853] systemd[1]: Reached target System Initialization.874gitlab # [ 7.815976] systemd[1]: Started Discard unused filesystem blocks once a week.875gitlab # [ 7.820660] systemd[1]: Started logrotate.timer.876gitlab # [ 7.824168] systemd[1]: Started Daily Cleanup of Temporary Directories.877gitlab # [ 7.828549] systemd[1]: Reached target Timer Units.878gitlab # [ 7.832184] systemd[1]: Listening on D-Bus System Message Bus Socket.879gitlab # [ 7.836642] systemd[1]: Listening on Nix Daemon Socket.880gitlab # [ 7.840490] systemd[1]: Starting nixbot CI service socket...881gitlab # [ 7.844536] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.882gitlab # [ 7.850329] systemd[1]: Listening on nixbot CI service socket.883gitlab # [ 7.855110] systemd[1]: Reached target Socket Units.884gitlab # [ 7.858923] systemd[1]: Starting D-Bus System Message Bus...885gitlab # [ 7.896257] dbus-broker-launch[577]: Looking up NSS user entry for 'systemd-timesync'...886gitlab # [ 7.900928] dbus-broker-launch[577]: NSS returned no entry for 'systemd-timesync'887gitlab # [ 7.904679] dbus-broker-launch[577]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"888gitlab # [ 7.913252] systemd[1]: Started D-Bus System Message Bus.889gitlab # [ 7.927731] dbus-broker-launch[577]: Ready890gitlab # [ 7.931896] systemd[1]: Reached target Basic System.891gitlab # [ 7.934850] systemd[1]: Started backdoor.service.892gitlab # [ 7.937962] systemd[1]: Starting gitlab-config.service...893gitlab # [ 7.952159] systemd[1]: Starting Import lastlog data into lastlog2 database...894gitlab # [ 7.956918] systemd[1]: Starting Logrotate configuration check...895gitlab # [ 7.962412] systemd[1]: Starting Name Service Cache Daemon (nsncd)...896gitlab # [ 7.968947] systemd[1]: Starting Post-Boot Actions...897gitlab # [ 7.971670] logrotate[582]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.898gitlab # [ 7.978594] logrotate[582]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf899gitlab # [ 7.982409] logrotate[582]: note: 'monthly' overrides previously specified 'weekly'900gitlab # [ 7.985323] logrotate[582]: Reading state from file: /var/lib/logrotate.status901gitlab # [ 7.988117] logrotate[582]: state file /var/lib/logrotate.status does not exist902gitlab # [ 7.991113] logrotate[582]: Allocating hash table for state file, size 64 entries903gitlab # connecting to host...904gitlab # [ 7.993201] logrotate[582]: Handling 4 logs905gitlab # [ 7.995465] logrotate[582]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed906gitlab # [ 7.996697] logrotate[582]: considering log /var/log/btmp907gitlab # [ 7.999091] logrotate[582]: Creating new state908gitlab # [ 7.999899] logrotate[582]: Now: 2026-09-06 06:46909gitlab # [ 8.002049] logrotate[582]: Last rotated at 2026-09-06 06:00910gitlab # [ 8.003085] logrotate[582]: log does not need rotating (log has already been rotated)911gitlab # [ 8.003925] logrotate[582]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed912gitlab # [ 8.007572] logrotate[582]: considering log /var/log/wtmp913gitlab # [ 8.008349] logrotate[582]: Creating new state914gitlab # [ 8.012410] logrotate[582]: Now: 2026-09-06 06:46915gitlab # [ 8.013373] logrotate[582]: Last rotated at 2026-09-06 06:00916gitlab # [ 8.014360] logrotate[582]: log does not need rotating (log has already been rotated)917gitlab # [ 8.016712] logrotate[582]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed918gitlab # [ 8.017814] logrotate[582]: switching euid from 0 to 165 and egid from 0 to 165 (pid 582)919gitlab # [ 8.018951] logrotate[582]: considering log /var/gitlab/state/log/*.log920gitlab # [ 8.019859] logrotate[582]: log /var/gitlab/state/log/*.log does not exist -- skipping921gitlab # [ 8.020475] logrotate[582]: Creating new state922gitlab # [ 8.021669] logrotate[582]: switching euid from 165 to 0 and egid from 165 to 0 (pid 582)923gitlab # [ 8.022878] logrotate[582]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed924gitlab # [ 8.023768] logrotate[582]: switching euid from 0 to 60 and egid from 0 to 60 (pid 582)925gitlab # [ 8.024672] logrotate[582]: considering log /var/log/nginx/*.log926gitlab # [ 8.025945] logrotate[582]: log /var/log/nginx/*.log does not exist -- skipping927gitlab # [ 8.027170] logrotate[582]: Creating new state928gitlab # [ 8.027988] logrotate[582]: not running postrotate script, since no logs were rotated929gitlab # [ 8.028933] logrotate[582]: switching euid from 60 to 0 and egid from 60 to 0 (pid 582)930gitlab # [ 8.031668] systemd[1]: Started Reset console on configuration changes.931gitlab # [ 8.032990] systemd[1]: Starting resolvconf update...932gitlab # [ 8.036211] nsncd[583]: Sep 06 06:46:03.546 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"933gitlab # [ 8.037225] systemd[1]: Started Name Service Cache Daemon (nsncd).934gitlab # [ 8.040476] systemd[1]: Finished Logrotate configuration check.935gitlab # [ 8.043871] systemd[1]: Finished Import lastlog data into lastlog2 database.936gitlab # [ 8.053507] systemd[1]: Reached target Host and Network Name Lookups.937gitlab # [ 8.054924] systemd[1]: Reached target User and Group Name Lookups.938gitlab # [ 8.060130] systemd[1]: Starting User Login Management...939gitlab # [ 8.062411] systemd[1]: Finished Post-Boot Actions.940gitlab: Guest shell says: b'Spawning backdoor root shell...\n'941gitlab: connected to guest root shell942gitlab: (connecting took 8.92 seconds)943gitlab: (finished: waiting for the VM to finish booting, in 8.92 seconds)944gitlab # [ 8.095456] systemd[1]: Stopped target Host and Network Name Lookups.945gitlab # [ 8.096919] systemd[1]: Stopping Host and Network Name Lookups...946gitlab # [ 8.097996] systemd[1]: Stopped target User and Group Name Lookups.947gitlab # [ 8.099952] systemd[1]: Stopping User and Group Name Lookups...948gitlab # [ 8.101534] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...949gitlab # [ 8.102905] systemd-logind[627]: New seat seat0.950gitlab # [ 8.104911] systemd[1]: nscd.service: Deactivated successfully.951gitlab # [ 8.107198] systemd[1]: Stopped Name Service Cache Daemon (nsncd).952gitlab # [ 8.108249] systemd[1]: nscd.service: Consumed 17ms CPU time over 142ms wall clock time, 7.3M memory peak, 5.5M read from disk.953gitlab # [ 8.109915] systemd-logind[627]: Watching system buttons on /dev/input/event2 (Power Button)954gitlab # [ 8.112845] systemd-logind[627]: Watching system buttons on /dev/input/event5 (QEMU Virtio Keyboard)955gitlab # [ 8.114311] systemd-logind[627]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)956gitlab # [ 8.114820] systemd[1]: Starting Name Service Cache Daemon (nsncd)...957gitlab # [ 8.116860] systemd[1]: Started User Login Management.958gitlab # [ 8.121539] systemd[1]: Starting linger-users.service...959gitlab # [ 8.132945] systemd[1]: linger-users.service: Deactivated successfully.960gitlab # [ 8.135417] systemd[1]: Finished linger-users.service.961gitlab # [ 8.137542] systemd[1]: Started Name Service Cache Daemon (nsncd).962gitlab # [ 8.139209] nsncd[673]: Sep 06 06:46:03.652 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"963gitlab # [ 8.140645] systemd[1]: Reached target Host and Network Name Lookups.964gitlab # [ 8.141524] systemd[1]: Reached target User and Group Name Lookups.965gitlab # [ 8.149320] systemd[1]: Finished resolvconf update.966gitlab # [ 8.150559] systemd[1]: Reached target Preparation for Network.967gitlab # [ 8.153362] systemd[1]: Starting DHCP Client...968gitlab # [ 8.155111] systemd[1]: Starting Address configuration of eth1...969gitlab # [ 8.158300] systemd[1]: Starting Extra networking commands....970gitlab # [ 8.185416] network-addresses-eth1-start[700]: adding address 192.168.1.1/24... done971gitlab # [ 8.189677] network-addresses-eth1-start[700]: adding address 2001:db8:1::1/64... done972gitlab # [ 8.199153] systemd[1]: Finished Address configuration of eth1.973gitlab # [ 8.225267] systemd[1]: Finished Extra networking commands..974gitlab # [ 8.228941] systemd[1]: Reached target Network.975gitlab # [ 8.230638] systemd[1]: Starting gitlab-workhorse.service...976gitlab # [ 8.233232] dhcpcd[709]: dhcpcd-10.3.2 starting977gitlab # [ 8.234530] systemd[1]: Starting Nginx Web Server...978gitlab # [ 8.237115] systemd[1]: Starting PostgreSQL Server...979gitlab # [ 8.239616] dhcpcd[767]: dev: loaded udev980gitlab # [ 8.512700] 8021q: 802.1Q VLAN Support v1.8981gitlab # [ 8.245527] systemd[1]: Starting Redis Server - redis-gitlab...982gitlab # [ 8.514968] 8021q: adding VLAN 0 to HW filter on device eth1983gitlab # [ 8.249250] systemd[1]: Starting Permit User Sessions...984gitlab # [ 8.263853] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.985gitlab # [ 8.278045] systemd[1]: Finished Permit User Sessions.986gitlab # [ 8.280736] systemd[1]: Started Getty on tty1.987gitlab # [ 8.284209] systemd[1]: Reached target Login Prompts.988gitlab # [ 8.611531] cfg80211: Loading compiled-in X.509 certificates for regulatory database989gitlab # [ 8.621138] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'990gitlab # [ 8.622530] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'991gitlab # [ 8.624783] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2992gitlab # [ 8.626967] cfg80211: failed to load regulatory.db993gitlab # [ 8.654795] 8021q: adding VLAN 0 to HW filter on device eth0994gitlab # [ 8.391248] dhcpcd[767]: eth0: waiting for carrier995gitlab # [ 8.392668] dhcpcd[767]: eth0: carrier acquired996gitlab # [ 8.394838] dhcpcd[767]: DUID 00:01:00:01:32:2f:c8:ab:52:54:00:12:34:56997gitlab # [ 8.395872] dhcpcd[767]: eth0: IAID 00:12:34:56998gitlab # [ 8.397491] dhcpcd[767]: eth0: adding address fe80::5054:ff:fe12:3456999gitlab # [ 8.401525] nginx-pre-start[790]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok1000gitlab # [ 8.403044] nginx-pre-start[790]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful1001gitlab # [ 8.409178] systemd[1]: Started Nginx Web Server.1002gitlab # [ 8.425435] redis-server[789]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.1003gitlab # [ 8.426969] redis-server[789]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo1004gitlab # [ 8.428344] redis-server[789]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=789, just started1005gitlab # [ 8.429369] redis-server[789]: Configuration loaded1006gitlab # [ 8.430223] redis[789]: monotonic clock: POSIX clock_gettime1007gitlab # [ 8.431095] redis[789]: Running mode=standalone, port=0.1008gitlab # [ 8.435203] redis[789]: Server initialized1009gitlab # [ 8.436073] systemd[1]: Started Redis Server - redis-gitlab.1010gitlab # [ 8.436859] redis[789]: Ready to accept connections unix1011gitlab # [ 8.437953] redis[789]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1012gitlab # [ 8.443545] postgresql-pre-start[794]: The files belonging to this database system will be owned by user "postgres".1013gitlab # [ 8.444984] postgresql-pre-start[794]: This user must also own the server process.1014gitlab # [ 8.446286] postgresql-pre-start[794]: The database cluster will be initialized with locale "en_US.UTF-8".1015gitlab # [ 8.447228] postgresql-pre-start[794]: The default database encoding has accordingly been set to "UTF8".1016gitlab # [ 8.448107] postgresql-pre-start[794]: The default text search configuration will be set to "english".1017gitlab # [ 8.448920] postgresql-pre-start[794]: Data page checksums are enabled.1018gitlab # [ 8.450173] postgresql-pre-start[794]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1019gitlab # [ 8.450931] postgresql-pre-start[794]: creating subdirectories ... ok1020gitlab # [ 8.451986] postgresql-pre-start[794]: selecting dynamic shared memory implementation ... posix1021gitlab # [ 8.476864] postgresql-pre-start[794]: selecting default "max_connections" ... 1001022gitlab # [ 8.514976] postgresql-pre-start[794]: selecting default "shared_buffers" ... 128MB1023gitlab # [ 8.758382] systemd[1]: Started gitlab-workhorse.service.1024gitlab # [ 8.922787] postgresql-pre-start[794]: selecting default time zone ... UTC1025gitlab # [ 8.925041] postgresql-pre-start[794]: creating configuration files ... ok1026gitlab # [ 8.991427] gitlab-workhorse[825]: time="2026-09-06T06:46:04Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41027gitlab # [ 8.992904] gitlab-workhorse[825]: time="2026-09-06T06:46:04Z" level=info msg="Using redis/go-redis"1028gitlab # [ 9.006493] gitlab-workhorse[825]: time="2026-09-06T06:46:04Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1029gitlab # [ 9.115709] postgresql-pre-start[794]: running bootstrap script ... ok1030gitlab # [ 9.617437] postgresql-pre-start[794]: performing post-bootstrap initialization ... ok1031gitlab # [ 10.047169] postgresql-pre-start[794]: syncing data to disk ... ok1032gitlab # [ 10.048942] postgresql-pre-start[794]: initdb: warning: enabling "trust" authentication for local connections1033gitlab # [ 10.051097] postgresql-pre-start[794]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1034gitlab # [ 10.052524] postgresql-pre-start[794]: Success. You can now start the database server using:1035gitlab # [ 10.054121] postgresql-pre-start[794]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1036gitlab # [ 10.138130] dhcpcd[767]: eth0: soliciting an IPv6 router1037gitlab # [ 10.140738] dhcpcd[767]: eth0: Router Advertisement from fe80::21038gitlab # [ 10.142550] dhcpcd[767]: eth0: adding address fec0::5054:ff:fe12:3456/641039gitlab # [ 10.144739] dhcpcd[767]: eth0: adding route to fec0::/641040gitlab # [ 10.146674] dhcpcd[767]: eth0: adding default route via fe80::21041gitlab # [ 10.196304] postgres[850]: [850] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1042gitlab # [ 10.200397] postgres[850]: [850] LOG: listening on IPv6 address "::1", port 54321043gitlab # [ 10.202421] postgres[850]: [850] LOG: listening on IPv4 address "127.0.0.1", port 54321044gitlab # [ 10.205281] postgres[850]: [850] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1045gitlab # [ 10.220879] postgres[868]: [868] LOG: database system was shut down at 2026-09-06 06:46:05 GMT1046gitlab # [ 10.231369] postgres[850]: [850] LOG: database system is ready to accept connections1047gitlab # [ 10.236546] systemd[1]: Started PostgreSQL Server.1048gitlab # [ 10.240206] systemd[1]: Starting PostgreSQL Setup Scripts...1049gitlab # [ 10.386688] dhcpcd[767]: eth0: soliciting a DHCP lease1050gitlab # [ 10.660578] NET: Registered PF_PACKET protocol family1051gitlab # [ 10.398721] dhcpcd[767]: eth0: offered 10.0.2.15 from 10.0.2.21052gitlab # [ 10.405117] dhcpcd[767]: eth0: probing address 10.0.2.15/241053gitlab # [ 10.471695] postgresql-setup-start[879]: CREATE DATABASE1054gitlab # [ 10.495327] postgresql-setup-start[891]: CREATE ROLE1055gitlab # [ 10.504955] postgresql-setup-start[893]: ALTER DATABASE1056gitlab # [ 10.517751] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[885]: mkdir -p /var/gitlab/state/home/.ssh: OK1057gitlab # [ 10.519492] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[885]: chmod 700 /var/gitlab/state/home/.ssh: OK1058gitlab # [ 10.529465] postgresql-setup-start[899]: CREATE ROLE1059gitlab # [ 10.532473] systemd[1]: Finished PostgreSQL Setup Scripts.1060gitlab # [ 10.534136] systemd[1]: Reached target PostgreSQL.1061gitlab # [ 10.537676] systemd[1]: Starting gitlab-postgresql.service...1062gitlab # [ 10.556558] systemd[1]: Finished gitlab-config.service.1063gitlab # [ 10.561148] systemd[1]: Started gitaly.service.1064gitlab # [ 10.562740] systemd[1]: Starting gitlab-db-config.service...1065gitlab # [ 10.645209] gitlab-postgresql-start[922]: CREATE DATABASE1066gitlab # [ 10.692426] gitlab-postgresql-start[927]: CREATE EXTENSION1067gitlab # [ 10.860572] gitlab-postgresql-start[929]: CREATE EXTENSION1068gitlab # [ 10.869620] systemd[1]: Finished gitlab-postgresql.service.1069gitlab # [ 11.136957] gitaly[914]: time="2026-09-06T06:46:06.652Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=9141070gitlab # [ 11.140710] gitaly[914]: time="2026-09-06T06:46:06.653Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=9141071gitlab # [ 11.144332] gitaly[914]: time="2026-09-06T06:46:06.653Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=9141072gitlab # [ 11.147828] gitaly[914]: time="2026-09-06T06:46:06.653Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=9141073gitlab # [ 11.153243] gitaly[914]: time="2026-09-06T06:46:06.654Z" level=info msg="Starting Gitaly" pid=914 version=1074gitlab # [ 11.353354] gitaly[914]: time="2026-09-06T06:46:06.870Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=164 pid=9141075gitlab # [ 11.354725] gitaly[914]: time="2026-09-06T06:46:06.870Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=9141076gitlab # [ 11.355254] gitaly[914]: time="2026-09-06T06:46:06.870Z" level=info msg="finished initializing command factory" duration_ms=0 pid=9141077gitlab # [ 11.356302] gitaly[914]: time="2026-09-06T06:46:06.870Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-914/git-exec-1936670402.d/git pid=9141078gitlab # [ 11.366089] gitaly[914]: time="2026-09-06T06:46:06.883Z" level=info msg="finished detecting git version" duration_ms=12 pid=9141079gitlab # [ 11.367335] gitaly[914]: time="2026-09-06T06:46:06.883Z" level=info msg="using Git version" pid=914 version=2.53.g1080gitlab # [ 11.368097] gitaly[914]: time="2026-09-06T06:46:06.883Z" level=info msg="clearing disk cache object folder" pid=914 storage=default1081gitlab # [ 11.369049] gitaly[914]: time="2026-09-06T06:46:06.884Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache814592503 pid=914 storage=default1082gitlab # [ 11.370131] gitaly[914]: time="2026-09-06T06:46:06.884Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache814592503 pid=914 storage=default1083gitlab # [ 11.370911] gitaly[914]: time="2026-09-06T06:46:06.884Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=9141084gitlab # [ 11.372257] gitaly[914]: time="2026-09-06T06:46:06.884Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=9141085gitlab # [ 11.373301] gitaly[914]: time="2026-09-06T06:46:06.885Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache814592503 clear_duration_ms=0 pid=914 storage=default1086gitlab # [ 11.469204] gitaly[914]: time="2026-09-06T06:46:06.985Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9141087gitlab # [ 11.473428] gitaly[914]: time="2026-09-06T06:46:06.986Z" level=info msg="finished tempdir cleaner walk" pid=914 storage=default time_ms=01088gitlab # [ 11.476670] gitaly[914]: time="2026-09-06T06:46:06.986Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=914 schema=unix1089gitlab # [ 11.480651] gitaly[914]: time="2026-09-06T06:46:06.986Z" level=info msg="listening at address" address=/run/gitaly/gitaly-914/sock.d/intern pid=914 schema=unix1090gitlab # [ 11.484668] gitaly[914]: time="2026-09-06T06:46:06.986Z" level=info msg="counting repositories" pid=9141091gitlab # [ 11.485857] gitaly[914]: time="2026-09-06T06:46:06.987Z" level=info msg="starting to count repositories" pid=914 storage_path=/var/gitlab/state/repositories1092gitlab # [ 11.487212] gitaly[914]: time="2026-09-06T06:46:06.987Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9141093gitlab # [ 11.488201] gitaly[914]: time="2026-09-06T06:46:06.987Z" level=info msg="Started Gitaly" duration_ms=333 pid=9141094gitlab # [ 11.489227] gitaly[914]: time="2026-09-06T06:46:06.987Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9141095gitlab # [ 11.490216] gitaly[914]: time="2026-09-06T06:46:06.988Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=914 storage_path=/var/gitlab/state/repositories1096gitlab # [ 11.491212] gitaly[914]: time="2026-09-06T06:46:06.988Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9141097gitlab # [ 11.492269] gitaly[914]: time="2026-09-06T06:46:06.988Z" level=info msg="maintenance: daily scheduled" pid=914 scheduled="2026-09-06 12:00:00 +0000 UTC"1098gitlab # [ 11.911857] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[921]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1099gitlab # [ 11.915984] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[921]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1100gitlab # [ 11.934741] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[921]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1101gitlab # [ 13.416173] gitaly[914]: time="2026-09-06T06:46:08.932Z" level=info msg="License database preloaded" duration_ms=2278 pid=9141102gitlab # [ 15.308540] dhcpcd[767]: eth0: leased 10.0.2.15 for 86400 seconds1103gitlab # [ 15.310672] dhcpcd[767]: eth0: adding route to 10.0.2.0/241104gitlab # [ 15.312473] dhcpcd[767]: eth0: adding default route via 10.0.2.21105gitlab # [ 15.444306] systemd[1]: Started DHCP Client.1106gitlab # [ 15.447534] systemd[1]: Reached target Network is Online.1107gitlab # [ 42.923894] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[921]: W, [2026-09-06T06:46:38.440069 #921] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1108gitlab # [ 45.210054] postgres[1321]: [1321] ERROR: relation "feature_gates" does not exist at character 5231109gitlab # [ 45.211993] postgres[1321]: [1321] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1110gitlab # [ 45.214680] postgres[1321]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1111gitlab # [ 45.218098] postgres[1321]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1112gitlab # [ 45.220149] postgres[1321]: attidentity AS identity,1113gitlab # [ 45.223603] postgres[1321]: attgenerated as attgenerated1114gitlab # [ 45.227094] postgres[1321]: FROM pg_attribute a1115gitlab # [ 45.229787] postgres[1321]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1116gitlab # [ 45.233888] postgres[1321]: LEFT JOIN pg_type t ON a.atttypid = t.oid1117gitlab # [ 45.237934] postgres[1321]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1118gitlab # [ 45.242080] postgres[1321]: WHERE a.attrelid = '"feature_gates"'::regclass1119gitlab # [ 45.244798] postgres[1321]: AND a.attnum > 0 AND NOT a.attisdropped1120gitlab # [ 45.248914] postgres[1321]: ORDER BY a.attnum1121gitlab # [ 45.252972] postgres[1321]:1122gitlab # [ 48.844910] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1359]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1123gitlab # [ 48.849142] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1359]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1124gitlab # [ 49.072995] gitlab-workhorse[825]: time="2026-09-06T06:46:44Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1125gitlab # [ 59.082250] gitlab-workhorse[825]: time="2026-09-06T06:46:54Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1126gitlab # [ 67.025537] postgres[1443]: [1443] ERROR: relation "table_without_models" does not exist1127gitlab # [ 67.030508] postgres[1443]: [1443] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1128gitlab # [ 69.083869] gitlab-workhorse[825]: time="2026-09-06T06:47:04Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1129gitlab # [ 79.095137] gitlab-workhorse[825]: time="2026-09-06T06:47:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1130gitlab # [ 82.765674] systemd[1]: Finished gitlab-db-config.service.1131gitlab # [ 82.772118] systemd[1]: Started gitlab-sidekiq.service.1132gitlab # [ 82.777770] systemd[1]: Starting gitlab.service...1133gitlab # [ 83.211938] bundle[1655]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1134gitlab # [ 83.214480] bundle[1655]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1135gitlab # [ 83.216480] bundle[1655]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1136gitlab # [ 86.030546] sidekiq-cluster[1654]: {"severity":"INFO","time":"2026-09-06T06:47:21.528Z","message":"Starting cluster with 1 processes"}1137gitlab # [ 86.149967] bundle[1655]: {"timestamp":"2026-09-06T06:47:21.646Z","pid":1655,"message":"* Enabling systemd notification integration"}1138gitlab # [ 86.151199] bundle[1655]: {"timestamp":"2026-09-06T06:47:21.666Z","pid":1655,"message":"Puma starting in cluster mode..."}1139gitlab # [ 86.151937] bundle[1655]: {"timestamp":"2026-09-06T06:47:21.666Z","pid":1655,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1140gitlab # [ 86.153626] bundle[1655]: {"timestamp":"2026-09-06T06:47:21.667Z","pid":1655,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1141gitlab # [ 86.155684] bundle[1655]: {"timestamp":"2026-09-06T06:47:21.667Z","pid":1655,"message":"* Min threads: 0"}1142gitlab # [ 86.158634] bundle[1655]: {"timestamp":"2026-09-06T06:47:21.667Z","pid":1655,"message":"* Max threads: 4"}1143gitlab # [ 86.160613] bundle[1655]: {"timestamp":"2026-09-06T06:47:21.667Z","pid":1655,"message":"* Environment: production"}1144gitlab # [ 86.162261] bundle[1655]: {"timestamp":"2026-09-06T06:47:21.667Z","pid":1655,"message":"* Master PID: 1655"}1145gitlab # [ 86.163906] bundle[1655]: {"timestamp":"2026-09-06T06:47:21.667Z","pid":1655,"message":"* Workers: 2"}1146gitlab # [ 86.164719] bundle[1655]: {"timestamp":"2026-09-06T06:47:21.667Z","pid":1655,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1147gitlab # [ 86.165859] bundle[1655]: {"timestamp":"2026-09-06T06:47:21.667Z","pid":1655,"message":"* Preloading application"}1148gitlab # [ 89.105452] gitlab-workhorse[825]: time="2026-09-06T06:47:24Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1149gitlab # [ 99.118830] gitlab-workhorse[825]: time="2026-09-06T06:47:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1150gitlab # [ 109.128721] gitlab-workhorse[825]: time="2026-09-06T06:47:44Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1151gitlab # [ 110.473488] bundle[1655]: W, [2026-09-06T06:47:45.990180 #1655] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1152gitlab # [ 113.012601] sidekiq-cluster[1685]: 2026-09-06T06:47:48.528Z pid=1685 tid=wfx INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1685, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>434032640}1153gitlab # [ 113.195581] sidekiq-cluster[1685]: W, [2026-09-06T06:47:48.712443 #1685] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1154gitlab # [ 113.235523] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:48.752Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1155gitlab # [ 115.394786] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:50.910Z","message":"GitLab reliable fetch activated!"}1156gitlab # [ 115.402324] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:50.910Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1157gitlab # [ 115.420325] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:50.937Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1158gitlab # [ 115.430411] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:50.940Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1159gitlab # [ 115.433181] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:50.946Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1160gitlab # [ 115.436404] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:50.953Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1161gitlab # [ 115.442956] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:50.959Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1162gitlab # [ 115.450046] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:50.967Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1163gitlab # [ 115.454986] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:50.971Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1164gitlab # [ 115.461227] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:50.978Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1165gitlab # [ 115.465879] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:50.982Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1166gitlab # [ 115.470656] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:50.987Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1167gitlab # [ 115.475195] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:50.992Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1168gitlab # [ 115.478045] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:50.995Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1169gitlab # [ 115.480378] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:50.997Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1170gitlab # [ 115.482872] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:50.999Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1171gitlab # [ 115.485432] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.002Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1172gitlab # [ 115.487958] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.005Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1173gitlab # [ 115.490912] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.008Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1174gitlab # [ 115.494211] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.011Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1175gitlab # [ 115.498579] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.015Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1176gitlab # [ 115.502745] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.019Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1177gitlab # [ 115.506658] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.023Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1178gitlab # [ 115.510630] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.027Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1179gitlab # [ 115.514552] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.031Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1180gitlab # [ 115.517983] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.035Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1181gitlab # [ 115.521856] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.038Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1182gitlab # [ 115.525943] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.043Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1183gitlab # [ 115.529402] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.046Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1184gitlab # [ 115.533080] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.050Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1185gitlab # [ 115.536907] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.054Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1186gitlab # [ 115.541081] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.058Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1187gitlab # [ 115.544396] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.061Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1188gitlab # [ 115.548207] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.065Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1189gitlab # [ 115.552074] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.069Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1190gitlab # [ 115.555967] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.073Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1191gitlab # [ 115.559937] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.077Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1192gitlab # [ 115.563253] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.080Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1193gitlab # [ 115.566520] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.083Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1194gitlab # [ 115.570261] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.087Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1195gitlab # [ 115.573643] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.090Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1196gitlab # [ 115.577367] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.094Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1197gitlab # [ 115.580806] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.097Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1198gitlab # [ 115.584409] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.101Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1199gitlab # [ 115.588076] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.105Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1200gitlab # [ 115.591645] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.108Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1201gitlab # [ 115.595846] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.112Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1202gitlab # [ 115.599720] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.116Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1203gitlab # [ 115.603250] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.120Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1204gitlab # [ 115.606806] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.123Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1205gitlab # [ 115.610674] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.127Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1206gitlab # [ 115.614588] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.131Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1207gitlab # [ 115.618742] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.135Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1208gitlab # [ 115.622782] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.139Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1209gitlab # [ 115.633578] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.150Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1210gitlab # [ 115.638105] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.155Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1211gitlab # [ 115.642410] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.159Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1212gitlab # [ 115.646213] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.163Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1213gitlab # [ 115.649852] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.166Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1214gitlab # [ 115.653905] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.171Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1215gitlab # [ 115.657278] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.174Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1216gitlab # [ 115.661592] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.178Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1217gitlab # [ 115.665700] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.182Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1218gitlab # [ 115.669085] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.186Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1219gitlab # [ 115.673133] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.190Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1220gitlab # [ 115.677494] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.194Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1221gitlab # [ 115.681240] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.198Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1222gitlab # [ 115.685327] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.202Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1223gitlab # [ 115.688622] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.205Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1224gitlab # [ 115.692434] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.209Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1225gitlab # [ 115.696125] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.213Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1226gitlab # [ 115.732340] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.249Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1227gitlab # [ 115.739354] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.256Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1228gitlab # [ 115.747738] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.264Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1229gitlab # [ 115.753866] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.270Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1230gitlab # [ 115.760171] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.277Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1231gitlab # [ 115.767616] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.284Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1232gitlab # [ 115.771198] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.288Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1233gitlab # [ 115.774837] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.291Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1234gitlab # [ 115.778297] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.295Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1235gitlab # [ 115.781884] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.298Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1236gitlab # [ 115.785500] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.302Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1237gitlab # [ 115.788925] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.306Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1238gitlab # [ 115.792099] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.309Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1239gitlab # [ 115.796104] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.313Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1240gitlab # [ 115.799091] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.316Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1241gitlab # [ 115.802672] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.319Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1242gitlab # [ 115.806057] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.323Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1243gitlab # [ 115.809797] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.326Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1244gitlab # [ 115.813195] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.330Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1245gitlab # [ 115.816317] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.333Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1246gitlab # [ 115.819275] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.336Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1247gitlab # [ 115.822260] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.339Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1248gitlab # [ 115.825730] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.342Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1249gitlab # [ 115.828625] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.345Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1250gitlab # [ 115.832349] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.349Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1251gitlab # [ 115.835722] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.352Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1252gitlab # [ 115.839907] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.357Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1253gitlab # [ 115.843609] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.360Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1254gitlab # [ 115.847129] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.364Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1255gitlab # [ 115.858289] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.375Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1256gitlab # [ 115.861610] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.378Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1257gitlab # [ 115.864592] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.381Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1258gitlab # [ 115.868773] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.385Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1259gitlab # [ 115.872486] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.389Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1260gitlab # [ 115.876286] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.393Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1261gitlab # [ 115.880202] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.397Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1262gitlab # [ 115.883455] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.400Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1263gitlab # [ 115.886517] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.403Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1264gitlab # [ 115.890713] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.407Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1265gitlab # [ 115.893886] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:47:51.410Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1266gitlab # [ 119.138329] gitlab-workhorse[825]: time="2026-09-06T06:47:54Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1267gitlab # [ 129.142179] gitlab-workhorse[825]: time="2026-09-06T06:48:04Z" level=error correlation_id= duration_ms=2 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1268gitlab # [ 136.892203] postgres[2161]: [2161] ERROR: relation "table_without_models" does not exist1269gitlab # [ 136.893677] postgres[2161]: [2161] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1270gitlab # [ 137.755759] postgres[2172]: [2172] ERROR: relation "table_without_models" does not exist1271gitlab # [ 137.760685] postgres[2172]: [2172] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1272gitlab # [ 139.143224] gitlab-workhorse[825]: time="2026-09-06T06:48:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1273gitlab # [ 139.582867] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:15.098Z","message":"Booted Rails 7.2.3.1 application in production environment"}1274gitlab # [ 139.591899] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:15.108Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1275gitlab # [ 139.600123] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:15.108Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1276gitlab # [ 139.607678] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:15.108Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1277gitlab # [ 139.616423] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:15.111Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1278gitlab # [ 140.710988] bundle[1655]: {"timestamp":"2026-09-06T06:48:16.227Z","pid":1655,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1279gitlab # [ 140.718926] bundle[1655]: {"timestamp":"2026-09-06T06:48:16.227Z","pid":1655,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1280gitlab # [ 140.726421] bundle[1655]: {"timestamp":"2026-09-06T06:48:16.227Z","pid":1655,"message":"! #\u003cThread:0x0000715f73530bd0 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1281gitlab # [ 140.747343] bundle[1655]: {"timestamp":"2026-09-06T06:48:16.227Z","pid":1655,"message":"! #\u003cThread:0x0000715f737cf3c8 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1282gitlab # [ 140.763806] bundle[1655]: {"timestamp":"2026-09-06T06:48:16.227Z","pid":1655,"message":"Use Ctrl-C to stop"}1283gitlab # [ 140.766144] bundle[1655]: {"timestamp":"2026-09-06T06:48:16.227Z","pid":1655,"message":"Sending status to systemd every 1.0 sec"}1284gitlab # [ 140.972042] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:16.488Z","message":"Cleaning working queues"}1285gitlab # [ 140.980960] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:16.497Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"16d82e3c1bca198fc21b427c","created_at":"2026-09-06T06:47:17.935Z","trace_propagation_headers":{"sentry-trace":"26dcc5c10b3a430d91df6f8b8d14ecad-07b1adc2baea4410","baggage":"sentry-trace_id=26dcc5c10b3a430d91df6f8b8d14ecad,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"d29f777ea5b53529256bc32387f6a89c","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-06T06:47:17.945Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-16d82e3c1bca198fc21b427c: start","job_status":"start","queue_duration_s":58.552333,"scheduling_latency_s":58.552415}1286gitlab # [ 141.057359] bundle[1655]: {"timestamp":"2026-09-06T06:48:16.574Z","pid":1655,"message":"- Worker 0 (PID: 2219) booted in 0.31s, phase: 0"}1287gitlab # [ 141.071528] bundle[1655]: {"timestamp":"2026-09-06T06:48:16.588Z","pid":1655,"message":"- Worker 1 (PID: 2223) booted in 0.31s, phase: 0"}1288gitlab # [ 141.076682] systemd[1]: Started gitlab.service.1289gitlab # [ 141.079749] systemd[1]: Reached target Common target for all GitLab services..1290gitlab # [ 141.082244] systemd[1]: Starting setup-gitlab.service...1291gitlab # [ 141.095460] setup-gitlab-start[2253]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1292gitlab # [ 141.170257] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:16.686Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"16d82e3c1bca198fc21b427c","created_at":"2026-09-06T06:47:17.935Z","trace_propagation_headers":{"sentry-trace":"26dcc5c10b3a430d91df6f8b8d14ecad-07b1adc2baea4410","baggage":"sentry-trace_id=26dcc5c10b3a430d91df6f8b8d14ecad,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"d29f777ea5b53529256bc32387f6a89c","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-06T06:47:17.945Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-16d82e3c1bca198fc21b427c: done: 0.189677 sec","job_status":"done","queue_duration_s":58.552333,"scheduling_latency_s":58.552415,"redis_calls":26,"redis_duration_s":0.009536,"redis_read_bytes":914,"redis_write_bytes":2887,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.006496,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001894,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001146,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.06355,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.08116646100000001,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.189677,"completed_at":"2026-09-06T06:48:16.686Z","load_balancing_strategy":"primary","db_duration_s":0.046479,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1293gitlab # [ 143.526736] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:48:19 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 24071294gitlab # [ 143.536266] setup-gitlab-start[2253]: + TOKEN=nixbot-test-token-of-20-chars1295gitlab # [ 143.539133] setup-gitlab-start[2253]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1296gitlab # [ 143.575883] runuser[2276]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1297gitlab # [ 143.982179] setup-gitlab-start[2277]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1298gitlab # [ 143.984962] setup-gitlab-start[2277]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1299gitlab # [ 143.988502] setup-gitlab-start[2277]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1300gitlab # [ 144.616473] setup-gitlab-start[2277]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1301gitlab # [ 144.620591] setup-gitlab-start[2277]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1302gitlab # [ 144.623189] setup-gitlab-start[2277]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1303gitlab # [ 151.437988] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:26.953Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"7098d5e7b09305fddfad652c","created_at":"2026-09-06T06:48:26.913Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"64ef2b7306b03ad53e970aa9731bcffd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:26.949Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-7098d5e7b09305fddfad652c: start","job_status":"start","queue_duration_s":0.003897,"scheduling_latency_s":0.003929}1304gitlab # [ 151.513548] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:27.030Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1305gitlab # [ 151.541806] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:27.058Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"7098d5e7b09305fddfad652c","created_at":"2026-09-06T06:48:26.913Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"64ef2b7306b03ad53e970aa9731bcffd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:26.949Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-7098d5e7b09305fddfad652c: done: 0.10455 sec","job_status":"done","queue_duration_s":0.003897,"scheduling_latency_s":0.003929,"redis_calls":10,"redis_duration_s":0.024771,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.015677,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007269,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001825,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.046,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019801,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002246933,"duration_s":0.10455,"completed_at":"2026-09-06T06:48:27.058Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.046225,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1306gitlab # [ 151.588079] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:27.063Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"dda742429487f40f87edefcc","created_at":"2026-09-06T06:48:27.031Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7b3d3c0e97d36c6a06e675d7df162c0f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.048Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-dda742429487f40f87edefcc: start","job_status":"start","queue_duration_s":0.01451,"scheduling_latency_s":0.014639}1307gitlab # [ 151.589291] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:27.092Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"dda742429487f40f87edefcc","created_at":"2026-09-06T06:48:27.031Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7b3d3c0e97d36c6a06e675d7df162c0f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.048Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-dda742429487f40f87edefcc: done: 0.029234 sec","job_status":"done","queue_duration_s":0.01451,"scheduling_latency_s":0.014639,"redis_calls":12,"redis_duration_s":0.003334,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000964,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001654,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000716,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014361,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000379378,"duration_s":0.029234,"completed_at":"2026-09-06T06:48:27.092Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000676,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1308gitlab # [ 151.721930] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:27.238Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"a92d01d47ff0edf89ca79ee3","created_at":"2026-09-06T06:48:27.062Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e37921de8f98f593f8f06c07a65da4e6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-06T06:48:27.235Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-a92d01d47ff0edf89ca79ee3: start","job_status":"start","queue_duration_s":0.002787,"scheduling_latency_s":0.002823}1309gitlab # [ 151.781466] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:27.298Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1310gitlab # [ 151.798372] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:27.314Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"a92d01d47ff0edf89ca79ee3","created_at":"2026-09-06T06:48:27.062Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e37921de8f98f593f8f06c07a65da4e6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-06T06:48:27.235Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-a92d01d47ff0edf89ca79ee3: done: 0.07643 sec","job_status":"done","queue_duration_s":0.002787,"scheduling_latency_s":0.002823,"redis_calls":10,"redis_duration_s":0.010756,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001756,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005735,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003265,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021283,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000875251,"duration_s":0.07643,"completed_at":"2026-09-06T06:48:27.314Z","load_balancing_strategy":"primary","db_duration_s":0.000662,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1311gitlab # [ 151.836200] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:27.325Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"0f79f620a174748d143d5a2c","created_at":"2026-09-06T06:48:27.277Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cb4fa08bcfca3ae8a6e635b6305905e3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.291Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-0f79f620a174748d143d5a2c: start","job_status":"start","queue_duration_s":0.033694,"scheduling_latency_s":0.033761}1312gitlab # [ 152.042313] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:27.558Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"0f79f620a174748d143d5a2c","created_at":"2026-09-06T06:48:27.277Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cb4fa08bcfca3ae8a6e635b6305905e3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.291Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-0f79f620a174748d143d5a2c: done: 0.234108 sec","job_status":"done","queue_duration_s":0.033694,"scheduling_latency_s":0.033761,"redis_calls":14,"redis_duration_s":0.016515000000000002,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.004172,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008422,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003921,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.025,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.102548,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001229766,"exclusive_lock_hold_duration_s":0.123704828,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.234108,"completed_at":"2026-09-06T06:48:27.558Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.041456,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1313gitlab # [ 152.144290] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:27.660Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"d4d6f458f8b1b237960ae25c","created_at":"2026-09-06T06:48:27.316Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"88693b2a362ec216f23d8bb50fb97dfc","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.330Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-d4d6f458f8b1b237960ae25c: start","job_status":"start","queue_duration_s":0.330052,"scheduling_latency_s":0.330088}1314gitlab # [ 152.236983] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:27.753Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"d4d6f458f8b1b237960ae25c","created_at":"2026-09-06T06:48:27.316Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"88693b2a362ec216f23d8bb50fb97dfc","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.330Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-d4d6f458f8b1b237960ae25c: done: 0.092556 sec","job_status":"done","queue_duration_s":0.330052,"scheduling_latency_s":0.330088,"redis_calls":10,"redis_duration_s":0.035845999999999996,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003763,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.022267,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.009816,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027674,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002532724,"duration_s":0.092556,"completed_at":"2026-09-06T06:48:27.753Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009901,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1315gitlab # [ 152.285264] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:27.763Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"35bd0f576b3989daee36e6be","created_at":"2026-09-06T06:48:27.407Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8786021330b509eececc74b15bb9542f","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.421Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-35bd0f576b3989daee36e6be: start","job_status":"start","queue_duration_s":0.342196,"scheduling_latency_s":0.34224}1316gitlab # [ 153.059228] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:28.575Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"35bd0f576b3989daee36e6be","created_at":"2026-09-06T06:48:27.407Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8786021330b509eececc74b15bb9542f","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.421Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-35bd0f576b3989daee36e6be: done: 0.811693 sec","job_status":"done","queue_duration_s":0.342196,"scheduling_latency_s":0.34224,"redis_calls":565,"redis_duration_s":0.378407,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003278,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008061,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.367068,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.062,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.062,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.406402,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000673549,"duration_s":0.811693,"completed_at":"2026-09-06T06:48:28.575Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.062094,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1317gitlab # [ 153.144577] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:28.661Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"b3d30fa217063f2d13911bbf","created_at":"2026-09-06T06:48:27.455Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.466Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-b3d30fa217063f2d13911bbf: start","job_status":"start","queue_duration_s":1.194319,"scheduling_latency_s":1.194415}1318gitlab # [ 153.315297] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:28.831Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"b3d30fa217063f2d13911bbf","created_at":"2026-09-06T06:48:27.455Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.466Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-b3d30fa217063f2d13911bbf: done: 0.170809 sec","job_status":"done","queue_duration_s":1.194319,"scheduling_latency_s":1.194415,"redis_calls":71,"redis_duration_s":0.036199,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.006072,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001842,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.026657,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001628,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.110084,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000530794,"duration_s":0.170809,"completed_at":"2026-09-06T06:48:28.831Z","load_balancing_strategy":"primary","db_duration_s":0.00298,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1319gitlab # [ 153.420473] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:28.833Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"72d499e8e3fe1162dee7d297","created_at":"2026-09-06T06:48:27.492Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"88dafd15795c6bcf0083383f58970338","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.499Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-72d499e8e3fe1162dee7d297: start","job_status":"start","queue_duration_s":1.333655,"scheduling_latency_s":1.333677}1320gitlab # [ 153.442740] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:28.885Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"72d499e8e3fe1162dee7d297","created_at":"2026-09-06T06:48:27.492Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"88dafd15795c6bcf0083383f58970338","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.499Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-72d499e8e3fe1162dee7d297: done: 0.051573 sec","job_status":"done","queue_duration_s":1.333655,"scheduling_latency_s":1.333677,"redis_calls":19,"redis_duration_s":0.006554,"redis_read_bytes":22,"redis_write_bytes":4781,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001691,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000393,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3011,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.00336,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00111,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037833,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000579124,"duration_s":0.051573,"completed_at":"2026-09-06T06:48:28.885Z","load_balancing_strategy":"primary","db_duration_s":0.00281,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1321gitlab # [ 153.446828] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:28.886Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"d02c13d29b8a643e9669f7fb","created_at":"2026-09-06T06:48:27.509Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"39d70befaa2139aa8ebd11177e36a5f2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.519Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-d02c13d29b8a643e9669f7fb: start","job_status":"start","queue_duration_s":1.366868,"scheduling_latency_s":1.366891}1322gitlab # [ 153.515977] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:28.906Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"d02c13d29b8a643e9669f7fb","created_at":"2026-09-06T06:48:27.509Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"39d70befaa2139aa8ebd11177e36a5f2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.519Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-d02c13d29b8a643e9669f7fb: done: 0.01974 sec","job_status":"done","queue_duration_s":1.366868,"scheduling_latency_s":1.366891,"redis_calls":12,"redis_duration_s":0.00397,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000724,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001945,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001301,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010739,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000520737,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.01974,"completed_at":"2026-09-06T06:48:28.906Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000567,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1323gitlab # [ 153.534107] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:28.908Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"9d9502626a0a2705b0cc87cd","created_at":"2026-09-06T06:48:27.531Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"26813c0b254120d48c7334658e86b7ba","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.544Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-9d9502626a0a2705b0cc87cd: start","job_status":"start","queue_duration_s":1.363994,"scheduling_latency_s":1.364015}1324gitlab # [ 153.603517] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:28.920Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1325gitlab # [ 153.605306] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:28.927Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"9d9502626a0a2705b0cc87cd","created_at":"2026-09-06T06:48:27.531Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"26813c0b254120d48c7334658e86b7ba","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.544Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-9d9502626a0a2705b0cc87cd: done: 0.018851 sec","job_status":"done","queue_duration_s":1.363994,"scheduling_latency_s":1.364015,"redis_calls":10,"redis_duration_s":0.003561,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000731,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002011,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000819,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009972,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00046235,"duration_s":0.018851,"completed_at":"2026-09-06T06:48:28.927Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000575,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1326gitlab # [ 153.631840] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:28.928Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"23f0f5c0bd3348d0a9f1f4c8","created_at":"2026-09-06T06:48:27.553Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2af22db8a9079c7e09d7498c4c11bce8","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.663Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-23f0f5c0bd3348d0a9f1f4c8: start","job_status":"start","queue_duration_s":1.265094,"scheduling_latency_s":1.265114}1327gitlab # [ 153.714998] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.210Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"23f0f5c0bd3348d0a9f1f4c8","created_at":"2026-09-06T06:48:27.553Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2af22db8a9079c7e09d7498c4c11bce8","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.663Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-23f0f5c0bd3348d0a9f1f4c8: done: 0.28197 sec","job_status":"done","queue_duration_s":1.265094,"scheduling_latency_s":1.265114,"redis_calls":16,"redis_duration_s":0.006919,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003472,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002634,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000813,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020854,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000656508,"duration_s":0.28197,"completed_at":"2026-09-06T06:48:29.210Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.251345,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328gitlab # [ 153.719947] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.213Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"8aff8230ee90b27d09bc000f","created_at":"2026-09-06T06:48:27.702Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b632070438d56dfc1388a0ad7a47492d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-06T06:48:27.722Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-8aff8230ee90b27d09bc000f: start","job_status":"start","queue_duration_s":1.490681,"scheduling_latency_s":1.490704}1329gitlab # [ 153.743403] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.225Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1330gitlab # [ 153.749254] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.233Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"8aff8230ee90b27d09bc000f","created_at":"2026-09-06T06:48:27.702Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b632070438d56dfc1388a0ad7a47492d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-06T06:48:27.722Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-8aff8230ee90b27d09bc000f: done: 0.020019 sec","job_status":"done","queue_duration_s":1.490681,"scheduling_latency_s":1.490704,"redis_calls":10,"redis_duration_s":0.0042710000000000005,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000796,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002719,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000756,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010441,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000586108,"duration_s":0.020019,"completed_at":"2026-09-06T06:48:29.233Z","load_balancing_strategy":"primary","db_duration_s":0.000358,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1331gitlab # [ 153.822265] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.234Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"dc1859cad5e17e472b3da4d3","created_at":"2026-09-06T06:48:27.740Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d538b6f26ddd447df2fdf9b144051067","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.760Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-dc1859cad5e17e472b3da4d3: start","job_status":"start","queue_duration_s":1.474021,"scheduling_latency_s":1.474042}1332gitlab # [ 153.835177] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.245Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1333gitlab # [ 153.840915] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.251Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"dc1859cad5e17e472b3da4d3","created_at":"2026-09-06T06:48:27.740Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d538b6f26ddd447df2fdf9b144051067","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.760Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-dc1859cad5e17e472b3da4d3: done: 0.016698 sec","job_status":"done","queue_duration_s":1.474021,"scheduling_latency_s":1.474042,"redis_calls":10,"redis_duration_s":0.0021420000000000002,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000403,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001252,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000487,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009911,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000344178,"duration_s":0.016698,"completed_at":"2026-09-06T06:48:29.251Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000399,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1334gitlab # [ 153.956589] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.253Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"a994a8a1eb9923aad37c6b71","created_at":"2026-09-06T06:48:27.783Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"28c88110b72a4ba2d667ea3eeddbb24e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.859Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-a994a8a1eb9923aad37c6b71: start","job_status":"start","queue_duration_s":1.393966,"scheduling_latency_s":1.393986}1335gitlab # [ 153.958251] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.416Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"a994a8a1eb9923aad37c6b71","created_at":"2026-09-06T06:48:27.783Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"28c88110b72a4ba2d667ea3eeddbb24e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.859Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-a994a8a1eb9923aad37c6b71: done: 0.163136 sec","job_status":"done","queue_duration_s":1.393966,"scheduling_latency_s":1.393986,"redis_calls":14,"redis_duration_s":0.003405,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000801,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001519,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001085,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.125126,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000447264,"exclusive_lock_hold_duration_s":0.142984093,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.163136,"completed_at":"2026-09-06T06:48:29.416Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.045053,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1336gitlab # [ 154.029224] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.417Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"6a3b864e361e366c24e92e42","created_at":"2026-09-06T06:48:27.881Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1a63de30e713f260985dae107f3d29e8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.893Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-6a3b864e361e366c24e92e42: start","job_status":"start","queue_duration_s":1.524213,"scheduling_latency_s":1.524235}1337gitlab # [ 154.030573] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.450Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"6a3b864e361e366c24e92e42","created_at":"2026-09-06T06:48:27.881Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1a63de30e713f260985dae107f3d29e8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.893Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-6a3b864e361e366c24e92e42: done: 0.032295 sec","job_status":"done","queue_duration_s":1.524213,"scheduling_latency_s":1.524235,"redis_calls":12,"redis_duration_s":0.002987,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000658,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001391,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000938,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018871,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000540293,"exclusive_lock_hold_duration_s":0.008264179,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.032295,"completed_at":"2026-09-06T06:48:29.450Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006951,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1338gitlab # [ 154.100692] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.451Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"93b85931727d9a2ecf8760d4","created_at":"2026-09-06T06:48:27.905Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6226330cf69829ec40a458a2643c8014","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.915Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-93b85931727d9a2ecf8760d4: start","job_status":"start","queue_duration_s":1.535995,"scheduling_latency_s":1.536017}1339gitlab # [ 154.114074] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.462Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1340gitlab # [ 154.182835] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.469Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"93b85931727d9a2ecf8760d4","created_at":"2026-09-06T06:48:27.905Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6226330cf69829ec40a458a2643c8014","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.915Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-93b85931727d9a2ecf8760d4: done: 0.017343 sec","job_status":"done","queue_duration_s":1.535995,"scheduling_latency_s":1.536017,"redis_calls":10,"redis_duration_s":0.002186,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000412,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001318,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000456,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010052,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000407594,"duration_s":0.017343,"completed_at":"2026-09-06T06:48:29.469Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000351,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1341gitlab # [ 154.185399] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.470Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"37b6c2862c98ec921ff4bb25","created_at":"2026-09-06T06:48:27.932Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3707f3f9f0facb150b52dbfce5f628e2","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.938Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-37b6c2862c98ec921ff4bb25: start","job_status":"start","queue_duration_s":1.531871,"scheduling_latency_s":1.531891}1342gitlab # [ 154.273671] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.498Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"37b6c2862c98ec921ff4bb25","created_at":"2026-09-06T06:48:27.932Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3707f3f9f0facb150b52dbfce5f628e2","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.938Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-37b6c2862c98ec921ff4bb25: done: 0.02803 sec","job_status":"done","queue_duration_s":1.531871,"scheduling_latency_s":1.531891,"redis_calls":10,"redis_duration_s":0.002168,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000413,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001326,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000429,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012836,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000556496,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.02803,"completed_at":"2026-09-06T06:48:29.498Z","load_balancing_strategy":"primary","db_duration_s":0.008901,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1343gitlab # [ 154.275881] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.500Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"d61ccbd5480e86ac5b792796","created_at":"2026-09-06T06:48:27.947Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a17ac031832e63637f6f869ecf15849a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.953Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-d61ccbd5480e86ac5b792796: start","job_status":"start","queue_duration_s":1.546107,"scheduling_latency_s":1.546128}1344gitlab # [ 154.362478] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.517Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"d61ccbd5480e86ac5b792796","created_at":"2026-09-06T06:48:27.947Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a17ac031832e63637f6f869ecf15849a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.953Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-d61ccbd5480e86ac5b792796: done: 0.017164 sec","job_status":"done","queue_duration_s":1.546107,"scheduling_latency_s":1.546128,"redis_calls":10,"redis_duration_s":0.002143,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0004,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001334,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000409,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010417,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000372952,"duration_s":0.017164,"completed_at":"2026-09-06T06:48:29.517Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000362,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1345gitlab # [ 154.364871] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.518Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"791deaf5dbc5b2446f8f50bf","created_at":"2026-09-06T06:48:27.963Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2b07a439efa409d78bf777a7076404c8","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.971Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-791deaf5dbc5b2446f8f50bf: start","job_status":"start","queue_duration_s":1.547341,"scheduling_latency_s":1.547362}1346gitlab # [ 154.441481] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.540Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"791deaf5dbc5b2446f8f50bf","created_at":"2026-09-06T06:48:27.963Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2b07a439efa409d78bf777a7076404c8","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.971Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-791deaf5dbc5b2446f8f50bf: done: 0.021352 sec","job_status":"done","queue_duration_s":1.547341,"scheduling_latency_s":1.547362,"redis_calls":10,"redis_duration_s":0.002199,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000446,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001323,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00043,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013184,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000371276,"duration_s":0.021352,"completed_at":"2026-09-06T06:48:29.540Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002307,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347gitlab # [ 154.511230] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.541Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"e1e3eab876adbb32bf9ed216","created_at":"2026-09-06T06:48:27.980Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eeb1fab96da41d8d6dc167cd45f6608d","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.992Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-e1e3eab876adbb32bf9ed216: start","job_status":"start","queue_duration_s":1.548794,"scheduling_latency_s":1.548815}1348gitlab # [ 154.512819] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.560Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"e1e3eab876adbb32bf9ed216","created_at":"2026-09-06T06:48:27.980Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eeb1fab96da41d8d6dc167cd45f6608d","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.992Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-e1e3eab876adbb32bf9ed216: done: 0.018583 sec","job_status":"done","queue_duration_s":1.548794,"scheduling_latency_s":1.548815,"redis_calls":12,"redis_duration_s":0.002691,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000477,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000446,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001331,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000437,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011291,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000407593,"duration_s":0.018583,"completed_at":"2026-09-06T06:48:29.560Z","load_balancing_strategy":"primary","db_duration_s":0.000393,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 154.597004] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.561Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleDeleteObjectsCronWorker","jid":"9d3e0373779ca1c18260ca61","created_at":"2026-09-06T06:48:28.010Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8251d4193fad694e50c4958d17fdca56b6fb205fa6961a4b1ccb7cd497bc09c1","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.020Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleDeleteObjectsCronWorker JID-9d3e0373779ca1c18260ca61: start","job_status":"start","queue_duration_s":1.541598,"scheduling_latency_s":1.541618}1350gitlab # [ 154.598435] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.645Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleDeleteObjectsCronWorker","jid":"9d3e0373779ca1c18260ca61","created_at":"2026-09-06T06:48:28.010Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8251d4193fad694e50c4958d17fdca56b6fb205fa6961a4b1ccb7cd497bc09c1","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.020Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleDeleteObjectsCronWorker JID-9d3e0373779ca1c18260ca61: done: 0.084224 sec","job_status":"done","queue_duration_s":1.541598,"scheduling_latency_s":1.541618,"redis_calls":65,"redis_duration_s":0.014693999999999999,"redis_read_bytes":115,"redis_write_bytes":41332,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000895,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":656,"redis_queues_calls":2,"redis_queues_duration_s":0.000667,"redis_queues_read_bytes":4,"redis_queues_write_bytes":37035,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.012473,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3374,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000659,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":267,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.068987,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000368483,"duration_s":0.084224,"completed_at":"2026-09-06T06:48:29.645Z","load_balancing_strategy":"primary","db_duration_s":0.000753,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1351gitlab # [ 154.625246] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.647Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"910745040dbdab6cf886b67e","created_at":"2026-09-06T06:48:28.029Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bb714d37c7c4053c7946481c8709ac72","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.040Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-910745040dbdab6cf886b67e: start","job_status":"start","queue_duration_s":1.606989,"scheduling_latency_s":1.607012}1352gitlab # [ 154.700295] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.673Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"910745040dbdab6cf886b67e","created_at":"2026-09-06T06:48:28.029Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bb714d37c7c4053c7946481c8709ac72","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.040Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-910745040dbdab6cf886b67e: done: 0.026192 sec","job_status":"done","queue_duration_s":1.606989,"scheduling_latency_s":1.607012,"redis_calls":13,"redis_duration_s":0.0029430000000000003,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000454,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001525,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000964,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016755,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00690423,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.026192,"completed_at":"2026-09-06T06:48:29.673Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002527,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1353gitlab # [ 154.717254] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.675Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"7339973cf9c1c560e40c1ff9","created_at":"2026-09-06T06:48:28.052Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fac59e8a74ab22b87895eff6baad9ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-06T06:48:28.063Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-7339973cf9c1c560e40c1ff9: start","job_status":"start","queue_duration_s":1.61136,"scheduling_latency_s":1.61138}1354gitlab # [ 154.784245] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.700Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"7339973cf9c1c560e40c1ff9","created_at":"2026-09-06T06:48:28.052Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fac59e8a74ab22b87895eff6baad9ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-06T06:48:28.063Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-7339973cf9c1c560e40c1ff9: done: 0.025006 sec","job_status":"done","queue_duration_s":1.61136,"scheduling_latency_s":1.61138,"redis_calls":10,"redis_duration_s":0.002185,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000399,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001376,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00041,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016289,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000402286,"duration_s":0.025006,"completed_at":"2026-09-06T06:48:29.700Z","load_balancing_strategy":"primary","db_duration_s":0.002346,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1355gitlab # [ 154.801308] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.701Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"849c0d79f012888cb3b909c3","created_at":"2026-09-06T06:48:28.078Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4cd6805f97dc16045023f230c5eccd77","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.088Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-849c0d79f012888cb3b909c3: start","job_status":"start","queue_duration_s":1.612995,"scheduling_latency_s":1.613016}1356gitlab # [ 154.824244] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.722Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"849c0d79f012888cb3b909c3","created_at":"2026-09-06T06:48:28.078Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4cd6805f97dc16045023f230c5eccd77","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.088Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-849c0d79f012888cb3b909c3: done: 0.020688 sec","job_status":"done","queue_duration_s":1.612995,"scheduling_latency_s":1.613016,"redis_calls":12,"redis_duration_s":0.002672,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000439,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001282,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000951,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012456,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000461232,"exclusive_lock_hold_duration_s":0.00357336,"duration_s":0.020688,"completed_at":"2026-09-06T06:48:29.722Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001828,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357gitlab # [ 154.897298] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.723Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"ad3b95cc1559470640ddbfe3","created_at":"2026-09-06T06:48:28.099Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"5f220e913693103bcc9bb670f5ae8279","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.105Z","job_size_bytes":3,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-ad3b95cc1559470640ddbfe3: start","job_status":"start","queue_duration_s":1.617743,"scheduling_latency_s":1.617763}1358gitlab # [ 154.912363] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.743Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"ad3b95cc1559470640ddbfe3","created_at":"2026-09-06T06:48:28.099Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"5f220e913693103bcc9bb670f5ae8279","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.105Z","job_size_bytes":3,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-ad3b95cc1559470640ddbfe3: done: 0.020181 sec","job_status":"done","queue_duration_s":1.617743,"scheduling_latency_s":1.617763,"redis_calls":10,"redis_duration_s":0.002515,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000423,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001507,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000585,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012585,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000402285,"duration_s":0.020181,"completed_at":"2026-09-06T06:48:29.743Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000436,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1359gitlab # [ 155.015387] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.745Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"4a142e9622289070debf9fde","created_at":"2026-09-06T06:48:28.119Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f9e4b21937870ec255dec5bb4cd925c5","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.126Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-4a142e9622289070debf9fde: start","job_status":"start","queue_duration_s":1.619043,"scheduling_latency_s":1.619066}1360gitlab # [ 155.016979] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.764Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"4a142e9622289070debf9fde","created_at":"2026-09-06T06:48:28.119Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f9e4b21937870ec255dec5bb4cd925c5","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.126Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-4a142e9622289070debf9fde: done: 0.019406 sec","job_status":"done","queue_duration_s":1.619043,"scheduling_latency_s":1.619066,"redis_calls":12,"redis_duration_s":0.002679,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0004,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001323,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000956,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011406,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000433575,"exclusive_lock_hold_duration_s":0.002515683,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.019406,"completed_at":"2026-09-06T06:48:29.764Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001203,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1361gitlab # [ 155.102886] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.766Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"c48f380ddef4b0a4a8f4e331","created_at":"2026-09-06T06:48:28.146Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e61397735517c10cfb41b18475483987","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.154Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-c48f380ddef4b0a4a8f4e331: start","job_status":"start","queue_duration_s":1.611831,"scheduling_latency_s":1.611851}1362gitlab # [ 155.104155] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.788Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"c48f380ddef4b0a4a8f4e331","created_at":"2026-09-06T06:48:28.146Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e61397735517c10cfb41b18475483987","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.154Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-c48f380ddef4b0a4a8f4e331: done: 0.021965 sec","job_status":"done","queue_duration_s":1.611831,"scheduling_latency_s":1.611851,"redis_calls":12,"redis_duration_s":0.002702,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000455,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00127,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000977,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000643657,"exclusive_lock_hold_duration_s":0.004999518,"duration_s":0.021965,"completed_at":"2026-09-06T06:48:29.788Z","load_balancing_strategy":"primary","db_duration_s":0.002156,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363gitlab # [ 155.203467] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.789Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6dd79db90c858d65036b9ba8","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6dd79db90c858d65036b9ba8: start","job_status":"start","queue_duration_s":0.968729,"scheduling_latency_s":0.96875}1364gitlab # [ 155.205152] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.811Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6dd79db90c858d65036b9ba8","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6dd79db90c858d65036b9ba8: done: 0.021553 sec","job_status":"done","queue_duration_s":0.968729,"scheduling_latency_s":0.96875,"redis_calls":16,"redis_duration_s":0.003459,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000413,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001025,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002021,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01364,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000353677,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021553,"completed_at":"2026-09-06T06:48:29.811Z","load_balancing_strategy":"primary","db_duration_s":0.000356,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 155.278440] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.812Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f212c3f4eab38ae9f3aada03","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f212c3f4eab38ae9f3aada03: start","job_status":"start","queue_duration_s":0.991653,"scheduling_latency_s":0.991675}1366gitlab # [ 155.279806] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.828Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f212c3f4eab38ae9f3aada03","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f212c3f4eab38ae9f3aada03: done: 0.015683 sec","job_status":"done","queue_duration_s":0.991653,"scheduling_latency_s":0.991675,"redis_calls":13,"redis_duration_s":0.002752,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000897,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001855,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010705,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015683,"completed_at":"2026-09-06T06:48:29.828Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367gitlab # [ 155.363906] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.829Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4dbe8a779a2a88490ce73b7b","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4dbe8a779a2a88490ce73b7b: start","job_status":"start","queue_duration_s":1.008642,"scheduling_latency_s":1.008663}1368gitlab # [ 155.365241] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.844Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4dbe8a779a2a88490ce73b7b","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4dbe8a779a2a88490ce73b7b: done: 0.015353 sec","job_status":"done","queue_duration_s":1.008642,"scheduling_latency_s":1.008663,"redis_calls":13,"redis_duration_s":0.002653,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000859,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001794,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01032,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015353,"completed_at":"2026-09-06T06:48:29.844Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369gitlab # [ 155.449495] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.846Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9b03a4974a6f86d349158bd","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9b03a4974a6f86d349158bd: start","job_status":"start","queue_duration_s":1.025265,"scheduling_latency_s":1.025287}1370gitlab # [ 155.450847] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.861Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9b03a4974a6f86d349158bd","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9b03a4974a6f86d349158bd: done: 0.015605 sec","job_status":"done","queue_duration_s":1.025265,"scheduling_latency_s":1.025287,"redis_calls":13,"redis_duration_s":0.002768,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000826,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001942,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015605,"completed_at":"2026-09-06T06:48:29.861Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 155.540209] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.863Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"674547db56bea0fffbb51013","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-674547db56bea0fffbb51013: start","job_status":"start","queue_duration_s":1.042152,"scheduling_latency_s":1.042174}1372gitlab # [ 155.541845] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.878Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"674547db56bea0fffbb51013","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-674547db56bea0fffbb51013: done: 0.015423 sec","job_status":"done","queue_duration_s":1.042152,"scheduling_latency_s":1.042174,"redis_calls":13,"redis_duration_s":0.0028160000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000854,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001962,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010435,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015423,"completed_at":"2026-09-06T06:48:29.878Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373gitlab # [ 155.558499] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.879Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d0bca79ca0642801371b7ba","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d0bca79ca0642801371b7ba: start","job_status":"start","queue_duration_s":1.058969,"scheduling_latency_s":1.058991}1374gitlab # [ 155.627582] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.895Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d0bca79ca0642801371b7ba","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d0bca79ca0642801371b7ba: done: 0.015815 sec","job_status":"done","queue_duration_s":1.058969,"scheduling_latency_s":1.058991,"redis_calls":13,"redis_duration_s":0.0029980000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000857,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002141,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010517,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015815,"completed_at":"2026-09-06T06:48:29.895Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375gitlab # [ 155.701988] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.897Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"718447657542db2800bd69fc","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-718447657542db2800bd69fc: start","job_status":"start","queue_duration_s":1.076234,"scheduling_latency_s":1.076255}1376gitlab # [ 155.703336] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.912Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"718447657542db2800bd69fc","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-718447657542db2800bd69fc: done: 0.015301 sec","job_status":"done","queue_duration_s":1.076234,"scheduling_latency_s":1.076255,"redis_calls":13,"redis_duration_s":0.002705,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000817,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001888,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010486,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015301,"completed_at":"2026-09-06T06:48:29.912Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 155.778483] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.913Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17fdf2ae20ea33e284c31930","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17fdf2ae20ea33e284c31930: start","job_status":"start","queue_duration_s":1.093053,"scheduling_latency_s":1.093075}1378gitlab # [ 155.779573] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.929Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17fdf2ae20ea33e284c31930","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17fdf2ae20ea33e284c31930: done: 0.015232 sec","job_status":"done","queue_duration_s":1.093053,"scheduling_latency_s":1.093075,"redis_calls":13,"redis_duration_s":0.0028529999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001027,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001826,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010475,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015232,"completed_at":"2026-09-06T06:48:29.929Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 155.800155] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.930Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17e5b49aa2a29eb23934414c","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17e5b49aa2a29eb23934414c: start","job_status":"start","queue_duration_s":1.109741,"scheduling_latency_s":1.109763}1380gitlab # [ 155.876450] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.945Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17e5b49aa2a29eb23934414c","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17e5b49aa2a29eb23934414c: done: 0.015258 sec","job_status":"done","queue_duration_s":1.109741,"scheduling_latency_s":1.109763,"redis_calls":13,"redis_duration_s":0.00267,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000876,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001794,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010503,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015258,"completed_at":"2026-09-06T06:48:29.945Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381gitlab # [ 155.880269] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.947Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea92e023eff44b423961c0ad","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea92e023eff44b423961c0ad: start","job_status":"start","queue_duration_s":1.126456,"scheduling_latency_s":1.126477}1382gitlab # [ 155.961367] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.962Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea92e023eff44b423961c0ad","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea92e023eff44b423961c0ad: done: 0.015371 sec","job_status":"done","queue_duration_s":1.126456,"scheduling_latency_s":1.126477,"redis_calls":13,"redis_duration_s":0.002733,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000867,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001866,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010539,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015371,"completed_at":"2026-09-06T06:48:29.962Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383gitlab # [ 155.963168] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:29.964Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6884b02e01380d9f6d340c04","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6884b02e01380d9f6d340c04: start","job_status":"start","queue_duration_s":1.143236,"scheduling_latency_s":1.143259}1384gitlab # [ 156.037336] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.027Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6884b02e01380d9f6d340c04","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6884b02e01380d9f6d340c04: done: 0.063715 sec","job_status":"done","queue_duration_s":1.143236,"scheduling_latency_s":1.143259,"redis_calls":13,"redis_duration_s":0.002764,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00088,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001884,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056756,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.063715,"completed_at":"2026-09-06T06:48:30.027Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 156.039997] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.029Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c6fd6c8748c56d205f4af86b","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c6fd6c8748c56d205f4af86b: start","job_status":"start","queue_duration_s":1.208421,"scheduling_latency_s":1.208447}1386gitlab # [ 156.060073] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.045Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c6fd6c8748c56d205f4af86b","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c6fd6c8748c56d205f4af86b: done: 0.016564 sec","job_status":"done","queue_duration_s":1.208421,"scheduling_latency_s":1.208447,"redis_calls":13,"redis_duration_s":0.002692,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000843,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001849,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011254,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016564,"completed_at":"2026-09-06T06:48:30.045Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387gitlab # [ 156.169550] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.047Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c1c91585f47e57a9bee1ad64","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c1c91585f47e57a9bee1ad64: start","job_status":"start","queue_duration_s":1.226245,"scheduling_latency_s":1.226267}1388gitlab # [ 156.171096] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.062Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c1c91585f47e57a9bee1ad64","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c1c91585f47e57a9bee1ad64: done: 0.014969 sec","job_status":"done","queue_duration_s":1.226245,"scheduling_latency_s":1.226267,"redis_calls":13,"redis_duration_s":0.002676,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000855,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001821,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010036,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014969,"completed_at":"2026-09-06T06:48:30.062Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389gitlab # [ 156.238968] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.063Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad07dc52df38626b462989d2","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad07dc52df38626b462989d2: start","job_status":"start","queue_duration_s":1.242548,"scheduling_latency_s":1.242569}1390gitlab # [ 156.240383] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.078Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad07dc52df38626b462989d2","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad07dc52df38626b462989d2: done: 0.015013 sec","job_status":"done","queue_duration_s":1.242548,"scheduling_latency_s":1.242569,"redis_calls":13,"redis_duration_s":0.00278,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000855,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001925,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009905,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015013,"completed_at":"2026-09-06T06:48:30.078Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1391gitlab # [ 156.326101] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.080Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17df55b2ab76fc652a0a0c5f","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17df55b2ab76fc652a0a0c5f: start","job_status":"start","queue_duration_s":1.259316,"scheduling_latency_s":1.259337}1392gitlab # [ 156.327239] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.095Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17df55b2ab76fc652a0a0c5f","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17df55b2ab76fc652a0a0c5f: done: 0.014987 sec","job_status":"done","queue_duration_s":1.259316,"scheduling_latency_s":1.259337,"redis_calls":13,"redis_duration_s":0.00268,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000809,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001871,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010273,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014987,"completed_at":"2026-09-06T06:48:30.095Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1393gitlab # [ 156.361970] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.096Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"522df448d242f12baf45ce8d","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-522df448d242f12baf45ce8d: start","job_status":"start","queue_duration_s":1.275616,"scheduling_latency_s":1.275637}1394gitlab # [ 156.381407] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.114Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"522df448d242f12baf45ce8d","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-522df448d242f12baf45ce8d: done: 0.017728 sec","job_status":"done","queue_duration_s":1.275616,"scheduling_latency_s":1.275637,"redis_calls":13,"redis_duration_s":0.003055,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000872,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002183,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012445,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017728,"completed_at":"2026-09-06T06:48:30.114Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1395gitlab # [ 156.456956] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.115Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28186d9f08809fba63fd3603","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28186d9f08809fba63fd3603: start","job_status":"start","queue_duration_s":1.294861,"scheduling_latency_s":1.29489}1396gitlab # [ 156.461239] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.136Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28186d9f08809fba63fd3603","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28186d9f08809fba63fd3603: done: 0.021138 sec","job_status":"done","queue_duration_s":1.294861,"scheduling_latency_s":1.29489,"redis_calls":13,"redis_duration_s":0.006531,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001067,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005464,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012302,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021138,"completed_at":"2026-09-06T06:48:30.136Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397gitlab # [ 156.529876] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.139Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e157925e0350455dbf294670","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e157925e0350455dbf294670: start","job_status":"start","queue_duration_s":1.318495,"scheduling_latency_s":1.318518}1398gitlab # [ 156.541206] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.160Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e157925e0350455dbf294670","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e157925e0350455dbf294670: done: 0.020731 sec","job_status":"done","queue_duration_s":1.318495,"scheduling_latency_s":1.318518,"redis_calls":13,"redis_duration_s":0.002822,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000902,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00192,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011278,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020731,"completed_at":"2026-09-06T06:48:30.160Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1399gitlab # [ 156.634820] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.162Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df68870a6549d474af899d9c","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df68870a6549d474af899d9c: start","job_status":"start","queue_duration_s":1.3412,"scheduling_latency_s":1.341222}1400gitlab # [ 156.636220] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.177Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df68870a6549d474af899d9c","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df68870a6549d474af899d9c: done: 0.01531 sec","job_status":"done","queue_duration_s":1.3412,"scheduling_latency_s":1.341222,"redis_calls":13,"redis_duration_s":0.002696,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00082,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001876,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01531,"completed_at":"2026-09-06T06:48:30.177Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401gitlab # [ 156.720281] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.178Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42ba3d4203ac9967df972199","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42ba3d4203ac9967df972199: start","job_status":"start","queue_duration_s":1.357745,"scheduling_latency_s":1.357766}1402gitlab # [ 156.721910] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.193Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42ba3d4203ac9967df972199","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42ba3d4203ac9967df972199: done: 0.015174 sec","job_status":"done","queue_duration_s":1.357745,"scheduling_latency_s":1.357766,"redis_calls":13,"redis_duration_s":0.002793,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001865,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010305,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015174,"completed_at":"2026-09-06T06:48:30.193Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403gitlab # [ 156.791111] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.195Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8090cf508071276b6c52356","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8090cf508071276b6c52356: start","job_status":"start","queue_duration_s":1.374464,"scheduling_latency_s":1.374485}1404gitlab # [ 156.792494] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.210Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8090cf508071276b6c52356","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8090cf508071276b6c52356: done: 0.015187 sec","job_status":"done","queue_duration_s":1.374464,"scheduling_latency_s":1.374485,"redis_calls":13,"redis_duration_s":0.0028339999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000851,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001983,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010308,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015187,"completed_at":"2026-09-06T06:48:30.210Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1405gitlab # [ 156.867246] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.211Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a2b28dbdf52fc658a652b216","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a2b28dbdf52fc658a652b216: start","job_status":"start","queue_duration_s":1.390929,"scheduling_latency_s":1.390949}1406gitlab # [ 156.868854] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.227Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a2b28dbdf52fc658a652b216","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a2b28dbdf52fc658a652b216: done: 0.015699 sec","job_status":"done","queue_duration_s":1.390929,"scheduling_latency_s":1.390949,"redis_calls":13,"redis_duration_s":0.002726,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00086,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001866,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015699,"completed_at":"2026-09-06T06:48:30.227Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407gitlab # [ 156.940179] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.228Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"795d3365296305d052676030","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-795d3365296305d052676030: start","job_status":"start","queue_duration_s":1.40792,"scheduling_latency_s":1.407941}1408gitlab # [ 156.941288] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.243Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"795d3365296305d052676030","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-795d3365296305d052676030: done: 0.015095 sec","job_status":"done","queue_duration_s":1.40792,"scheduling_latency_s":1.407941,"redis_calls":13,"redis_duration_s":0.002731,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000896,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001835,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010195,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015095,"completed_at":"2026-09-06T06:48:30.243Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409gitlab # [ 157.033052] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.245Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dbeace2f623a465cfadc3ac2","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dbeace2f623a465cfadc3ac2: start","job_status":"start","queue_duration_s":1.424294,"scheduling_latency_s":1.424316}1410gitlab # [ 157.034433] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.260Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dbeace2f623a465cfadc3ac2","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dbeace2f623a465cfadc3ac2: done: 0.015093 sec","job_status":"done","queue_duration_s":1.424294,"scheduling_latency_s":1.424316,"redis_calls":13,"redis_duration_s":0.0028060000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000863,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001943,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010237,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015093,"completed_at":"2026-09-06T06:48:30.260Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 157.123242] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.261Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf8e7f748aa631cdafbdeedf","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf8e7f748aa631cdafbdeedf: start","job_status":"start","queue_duration_s":1.44069,"scheduling_latency_s":1.440711}1412gitlab # [ 157.124347] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.276Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf8e7f748aa631cdafbdeedf","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf8e7f748aa631cdafbdeedf: done: 0.015021 sec","job_status":"done","queue_duration_s":1.44069,"scheduling_latency_s":1.440711,"redis_calls":13,"redis_duration_s":0.002749,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000855,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001894,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009876,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015021,"completed_at":"2026-09-06T06:48:30.276Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 157.200497] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.278Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db18aa2ace63be1b3b3de6c1","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db18aa2ace63be1b3b3de6c1: start","job_status":"start","queue_duration_s":1.457443,"scheduling_latency_s":1.457464}1414gitlab # [ 157.202043] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.293Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db18aa2ace63be1b3b3de6c1","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db18aa2ace63be1b3b3de6c1: done: 0.015239 sec","job_status":"done","queue_duration_s":1.457443,"scheduling_latency_s":1.457464,"redis_calls":13,"redis_duration_s":0.002892,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000857,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002035,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010279,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015239,"completed_at":"2026-09-06T06:48:30.293Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 157.277290] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.294Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"414c0058ea992bb7c2a7cb9e","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-414c0058ea992bb7c2a7cb9e: start","job_status":"start","queue_duration_s":1.473941,"scheduling_latency_s":1.473963}1416gitlab # [ 157.278459] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.310Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"414c0058ea992bb7c2a7cb9e","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-414c0058ea992bb7c2a7cb9e: done: 0.015367 sec","job_status":"done","queue_duration_s":1.473941,"scheduling_latency_s":1.473963,"redis_calls":13,"redis_duration_s":0.002748,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0009,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001848,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010451,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015367,"completed_at":"2026-09-06T06:48:30.310Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417gitlab # [ 157.347078] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.311Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"031c92245d9c8cee6d2b7e75","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-031c92245d9c8cee6d2b7e75: start","job_status":"start","queue_duration_s":1.490667,"scheduling_latency_s":1.490688}1418gitlab # [ 157.348269] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.326Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"031c92245d9c8cee6d2b7e75","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-031c92245d9c8cee6d2b7e75: done: 0.015354 sec","job_status":"done","queue_duration_s":1.490667,"scheduling_latency_s":1.490688,"redis_calls":13,"redis_duration_s":0.002696,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000824,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001872,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010439,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015354,"completed_at":"2026-09-06T06:48:30.326Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 157.421465] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.328Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8e22a811466fbcb52152658","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8e22a811466fbcb52152658: start","job_status":"start","queue_duration_s":1.507316,"scheduling_latency_s":1.507337}1420gitlab # [ 157.422813] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.343Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8e22a811466fbcb52152658","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8e22a811466fbcb52152658: done: 0.015557 sec","job_status":"done","queue_duration_s":1.507316,"scheduling_latency_s":1.507337,"redis_calls":13,"redis_duration_s":0.002752,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000907,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001845,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009868,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015557,"completed_at":"2026-09-06T06:48:30.343Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421gitlab # [ 157.504149] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.345Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"016d1ca313ecc1c5f70ebbf9","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-016d1ca313ecc1c5f70ebbf9: start","job_status":"start","queue_duration_s":1.524129,"scheduling_latency_s":1.524158}1422gitlab # [ 157.505443] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.360Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"016d1ca313ecc1c5f70ebbf9","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-016d1ca313ecc1c5f70ebbf9: done: 0.01502 sec","job_status":"done","queue_duration_s":1.524129,"scheduling_latency_s":1.524158,"redis_calls":13,"redis_duration_s":0.002783,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000904,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001879,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010208,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01502,"completed_at":"2026-09-06T06:48:30.359Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423gitlab # [ 157.580202] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.361Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17edee07da04b69f3db36c76","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17edee07da04b69f3db36c76: start","job_status":"start","queue_duration_s":1.540468,"scheduling_latency_s":1.540488}1424gitlab # [ 157.582108] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.376Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17edee07da04b69f3db36c76","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17edee07da04b69f3db36c76: done: 0.015453 sec","job_status":"done","queue_duration_s":1.540468,"scheduling_latency_s":1.540488,"redis_calls":13,"redis_duration_s":0.0029259999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000972,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001954,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015453,"completed_at":"2026-09-06T06:48:30.376Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 157.669109] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.378Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d97f8465da3f2b3683affc12","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d97f8465da3f2b3683affc12: start","job_status":"start","queue_duration_s":1.557187,"scheduling_latency_s":1.557208}1426gitlab # [ 157.670287] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.393Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d97f8465da3f2b3683affc12","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d97f8465da3f2b3683affc12: done: 0.015331 sec","job_status":"done","queue_duration_s":1.557187,"scheduling_latency_s":1.557208,"redis_calls":13,"redis_duration_s":0.002712,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00086,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001852,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010113,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015331,"completed_at":"2026-09-06T06:48:30.393Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427gitlab # [ 157.771247] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.394Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7eb63caa2b3cf4849f8fc6d8","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7eb63caa2b3cf4849f8fc6d8: start","job_status":"start","queue_duration_s":1.573796,"scheduling_latency_s":1.573817}1428gitlab # [ 157.772542] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.411Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7eb63caa2b3cf4849f8fc6d8","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7eb63caa2b3cf4849f8fc6d8: done: 0.016409 sec","job_status":"done","queue_duration_s":1.573796,"scheduling_latency_s":1.573817,"redis_calls":13,"redis_duration_s":0.002757,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000863,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001894,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016409,"completed_at":"2026-09-06T06:48:30.411Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1429gitlab # [ 157.854188] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.412Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f665a61b432e7705e8196d0","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f665a61b432e7705e8196d0: start","job_status":"start","queue_duration_s":1.591545,"scheduling_latency_s":1.591566}1430gitlab # [ 157.855827] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.427Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f665a61b432e7705e8196d0","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f665a61b432e7705e8196d0: done: 0.015263 sec","job_status":"done","queue_duration_s":1.591545,"scheduling_latency_s":1.591566,"redis_calls":13,"redis_duration_s":0.0027849999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000829,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001956,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010445,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015263,"completed_at":"2026-09-06T06:48:30.427Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1431gitlab # [ 157.939210] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.428Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca741fded655d7f8319e4b9a","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca741fded655d7f8319e4b9a: start","job_status":"start","queue_duration_s":1.608077,"scheduling_latency_s":1.608097}1432gitlab # [ 157.940379] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.445Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca741fded655d7f8319e4b9a","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca741fded655d7f8319e4b9a: done: 0.016082 sec","job_status":"done","queue_duration_s":1.608077,"scheduling_latency_s":1.608097,"redis_calls":13,"redis_duration_s":0.002909,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000895,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002014,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011234,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016082,"completed_at":"2026-09-06T06:48:30.445Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433gitlab # [ 158.015381] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.446Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20202445e2106aebe744153f","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20202445e2106aebe744153f: start","job_status":"start","queue_duration_s":1.625498,"scheduling_latency_s":1.625519}1434gitlab # [ 158.016814] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.461Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20202445e2106aebe744153f","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20202445e2106aebe744153f: done: 0.015282 sec","job_status":"done","queue_duration_s":1.625498,"scheduling_latency_s":1.625519,"redis_calls":13,"redis_duration_s":0.002721,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00085,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001871,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010411,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015282,"completed_at":"2026-09-06T06:48:30.461Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435gitlab # [ 158.088254] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.462Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ed05c8815620aa190131f91","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ed05c8815620aa190131f91: start","job_status":"start","queue_duration_s":1.642049,"scheduling_latency_s":1.64207}1436gitlab # [ 158.089360] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.478Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ed05c8815620aa190131f91","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ed05c8815620aa190131f91: done: 0.015465 sec","job_status":"done","queue_duration_s":1.642049,"scheduling_latency_s":1.64207,"redis_calls":13,"redis_duration_s":0.002707,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000859,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001848,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010008,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015465,"completed_at":"2026-09-06T06:48:30.478Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437gitlab # [ 158.188442] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.480Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c974fb94574205bc398bd66d","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c974fb94574205bc398bd66d: start","job_status":"start","queue_duration_s":1.659131,"scheduling_latency_s":1.659161}1438gitlab # [ 158.189788] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.498Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c974fb94574205bc398bd66d","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c974fb94574205bc398bd66d: done: 0.018826 sec","job_status":"done","queue_duration_s":1.659131,"scheduling_latency_s":1.659161,"redis_calls":13,"redis_duration_s":0.005964,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001875,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01068,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018826,"completed_at":"2026-09-06T06:48:30.498Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439gitlab # [ 158.205467] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.500Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eba6120d774d7f91973e6cc4","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eba6120d774d7f91973e6cc4: start","job_status":"start","queue_duration_s":1.679275,"scheduling_latency_s":1.679296}1440gitlab # [ 158.273586] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.515Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eba6120d774d7f91973e6cc4","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eba6120d774d7f91973e6cc4: done: 0.015161 sec","job_status":"done","queue_duration_s":1.679275,"scheduling_latency_s":1.679296,"redis_calls":13,"redis_duration_s":0.002794,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000845,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001949,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015161,"completed_at":"2026-09-06T06:48:30.515Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441gitlab # [ 158.285483] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.516Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa565f776faea41aace946fa","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa565f776faea41aace946fa: start","job_status":"start","queue_duration_s":1.695695,"scheduling_latency_s":1.695715}1442gitlab # [ 158.354448] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.531Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa565f776faea41aace946fa","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa565f776faea41aace946fa: done: 0.014975 sec","job_status":"done","queue_duration_s":1.695695,"scheduling_latency_s":1.695715,"redis_calls":13,"redis_duration_s":0.002723,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000852,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001871,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009805,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014975,"completed_at":"2026-09-06T06:48:30.531Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1443gitlab # [ 158.427364] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.533Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"78db40abb29d711dbefff4cd","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-78db40abb29d711dbefff4cd: start","job_status":"start","queue_duration_s":1.712315,"scheduling_latency_s":1.712336}1444gitlab # [ 158.428918] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.548Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"78db40abb29d711dbefff4cd","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-78db40abb29d711dbefff4cd: done: 0.015246 sec","job_status":"done","queue_duration_s":1.712315,"scheduling_latency_s":1.712336,"redis_calls":13,"redis_duration_s":0.002686,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000823,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001863,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010295,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015246,"completed_at":"2026-09-06T06:48:30.548Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445gitlab # [ 158.497224] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.549Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb1f2fdbbc78226e25af472c","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb1f2fdbbc78226e25af472c: start","job_status":"start","queue_duration_s":1.728839,"scheduling_latency_s":1.728859}1446gitlab # [ 158.498367] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.565Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb1f2fdbbc78226e25af472c","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb1f2fdbbc78226e25af472c: done: 0.015324 sec","job_status":"done","queue_duration_s":1.728839,"scheduling_latency_s":1.728859,"redis_calls":13,"redis_duration_s":0.002718,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000914,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001804,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010416,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015324,"completed_at":"2026-09-06T06:48:30.565Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1447gitlab # [ 158.526180] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.566Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"837dc951a2884ef884fe1af2","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-837dc951a2884ef884fe1af2: start","job_status":"start","queue_duration_s":1.745598,"scheduling_latency_s":1.745619}1448gitlab # [ 158.546303] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.581Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"837dc951a2884ef884fe1af2","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-837dc951a2884ef884fe1af2: done: 0.015174 sec","job_status":"done","queue_duration_s":1.745598,"scheduling_latency_s":1.745619,"redis_calls":13,"redis_duration_s":0.0027,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000846,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001854,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010309,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015174,"completed_at":"2026-09-06T06:48:30.581Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449gitlab # [ 158.624968] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.582Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5693c5b980a0c7de65238541","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5693c5b980a0c7de65238541: start","job_status":"start","queue_duration_s":1.762059,"scheduling_latency_s":1.76208}1450gitlab # [ 158.626385] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.597Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5693c5b980a0c7de65238541","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5693c5b980a0c7de65238541: done: 0.014989 sec","job_status":"done","queue_duration_s":1.762059,"scheduling_latency_s":1.76208,"redis_calls":13,"redis_duration_s":0.00271,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000847,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001863,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009813,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014989,"completed_at":"2026-09-06T06:48:30.597Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 158.733851] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.599Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"069f0ded474ca9ec26fd5166","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-069f0ded474ca9ec26fd5166: start","job_status":"start","queue_duration_s":1.778884,"scheduling_latency_s":1.778905}1452gitlab # [ 158.735212] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.614Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"069f0ded474ca9ec26fd5166","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-069f0ded474ca9ec26fd5166: done: 0.015122 sec","job_status":"done","queue_duration_s":1.778884,"scheduling_latency_s":1.778905,"redis_calls":13,"redis_duration_s":0.002749,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00086,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001889,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010277,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015122,"completed_at":"2026-09-06T06:48:30.614Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453gitlab # [ 158.821303] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.616Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33a35ac08e44602925b31346","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33a35ac08e44602925b31346: start","job_status":"start","queue_duration_s":1.795283,"scheduling_latency_s":1.795304}1454gitlab # [ 158.822202] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.631Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33a35ac08e44602925b31346","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33a35ac08e44602925b31346: done: 0.01516 sec","job_status":"done","queue_duration_s":1.795283,"scheduling_latency_s":1.795304,"redis_calls":13,"redis_duration_s":0.002741,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000845,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001896,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010274,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01516,"completed_at":"2026-09-06T06:48:30.631Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455gitlab # [ 158.897837] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.632Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c40746f2a898443ec4d36e6b","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c40746f2a898443ec4d36e6b: start","job_status":"start","queue_duration_s":1.811715,"scheduling_latency_s":1.811736}1456gitlab # [ 158.899226] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.647Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c40746f2a898443ec4d36e6b","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c40746f2a898443ec4d36e6b: done: 0.01535 sec","job_status":"done","queue_duration_s":1.811715,"scheduling_latency_s":1.811736,"redis_calls":13,"redis_duration_s":0.002706,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000823,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001883,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010414,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01535,"completed_at":"2026-09-06T06:48:30.647Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457gitlab # [ 158.971374] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.649Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"844d2522e12776556bdb4468","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-844d2522e12776556bdb4468: start","job_status":"start","queue_duration_s":1.828409,"scheduling_latency_s":1.82843}1458gitlab # [ 158.972436] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.664Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"844d2522e12776556bdb4468","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-844d2522e12776556bdb4468: done: 0.01554 sec","job_status":"done","queue_duration_s":1.828409,"scheduling_latency_s":1.82843,"redis_calls":13,"redis_duration_s":0.002744,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000853,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001891,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010287,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01554,"completed_at":"2026-09-06T06:48:30.664Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459gitlab # [ 159.048186] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.666Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"faaaa194cd411d5cf9a16055","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-faaaa194cd411d5cf9a16055: start","job_status":"start","queue_duration_s":1.845193,"scheduling_latency_s":1.845214}1460gitlab # [ 159.049345] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.681Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"faaaa194cd411d5cf9a16055","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-faaaa194cd411d5cf9a16055: done: 0.01592 sec","job_status":"done","queue_duration_s":1.845193,"scheduling_latency_s":1.845214,"redis_calls":13,"redis_duration_s":0.0037849999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000852,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010465,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01592,"completed_at":"2026-09-06T06:48:30.681Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1461gitlab # [ 159.149538] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.684Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc85e0360e7567322bdac29c","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc85e0360e7567322bdac29c: start","job_status":"start","queue_duration_s":1.863157,"scheduling_latency_s":1.863201}1462gitlab # [ 159.150991] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.702Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc85e0360e7567322bdac29c","created_at":"2026-09-06T06:48:28.724Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-a375a73031fb43ed","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c4f7cabdb52f15dec89dff5e358e21a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.820Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc85e0360e7567322bdac29c: done: 0.018868 sec","job_status":"done","queue_duration_s":1.863157,"scheduling_latency_s":1.863201,"redis_calls":13,"redis_duration_s":0.003015,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001163,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001852,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011731,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018868,"completed_at":"2026-09-06T06:48:30.702Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463gitlab # [ 159.171066] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.704Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"af039d2b5929845211d89381","created_at":"2026-09-06T06:48:28.856Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-b2d6d6f076b343b0","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"88dafd15795c6bcf0083383f58970338","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.875Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-af039d2b5929845211d89381: start","job_status":"start","queue_duration_s":1.828666,"scheduling_latency_s":1.828722}1464gitlab # [ 159.255832] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.718Z","message":"No existing merge request to be cleaned up."}1465gitlab # [ 159.257069] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.729Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"af039d2b5929845211d89381","created_at":"2026-09-06T06:48:28.856Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-b2d6d6f076b343b0","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"88dafd15795c6bcf0083383f58970338","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.875Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-af039d2b5929845211d89381: done: 0.024829 sec","job_status":"done","queue_duration_s":1.828666,"scheduling_latency_s":1.828722,"redis_calls":13,"redis_duration_s":0.0029,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000458,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001078,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001364,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015731,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000362058,"duration_s":0.024829,"completed_at":"2026-09-06T06:48:30.729Z","load_balancing_strategy":"primary","db_duration_s":0.003221,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466gitlab # [ 159.258388] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.730Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"fa29afb052b53ec97296c7e8","created_at":"2026-09-06T06:48:28.856Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-b2d6d6f076b343b0","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"88dafd15795c6bcf0083383f58970338","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.875Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-fa29afb052b53ec97296c7e8: start","job_status":"start","queue_duration_s":1.854866,"scheduling_latency_s":1.854887}1467gitlab # [ 159.332091] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.740Z","message":"No existing merge request to be cleaned up."}1468gitlab # [ 159.333214] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.746Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"fa29afb052b53ec97296c7e8","created_at":"2026-09-06T06:48:28.856Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-b2d6d6f076b343b0","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"88dafd15795c6bcf0083383f58970338","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.875Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-fa29afb052b53ec97296c7e8: done: 0.015996 sec","job_status":"done","queue_duration_s":1.854866,"scheduling_latency_s":1.854887,"redis_calls":10,"redis_duration_s":0.0020930000000000002,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000831,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001262,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010671,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015996,"completed_at":"2026-09-06T06:48:30.746Z","load_balancing_strategy":"primary","db_duration_s":0.001509,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1469gitlab # [ 159.337187] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.747Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"92816906ff4cb3adc6e36272","created_at":"2026-09-06T06:48:28.856Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-b2d6d6f076b343b0","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"88dafd15795c6bcf0083383f58970338","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.875Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-92816906ff4cb3adc6e36272: start","job_status":"start","queue_duration_s":1.872153,"scheduling_latency_s":1.872174}1470gitlab # [ 159.409186] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.757Z","message":"No existing merge request to be cleaned up."}1471gitlab # [ 159.410587] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.763Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"92816906ff4cb3adc6e36272","created_at":"2026-09-06T06:48:28.856Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-b2d6d6f076b343b0","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"88dafd15795c6bcf0083383f58970338","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.875Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-92816906ff4cb3adc6e36272: done: 0.015458 sec","job_status":"done","queue_duration_s":1.872153,"scheduling_latency_s":1.872174,"redis_calls":10,"redis_duration_s":0.002128,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000865,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001263,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01031,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015458,"completed_at":"2026-09-06T06:48:30.763Z","load_balancing_strategy":"primary","db_duration_s":0.001489,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 159.479452] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.764Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"030cbeda962465a5b747d96c","created_at":"2026-09-06T06:48:28.856Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-b2d6d6f076b343b0","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"88dafd15795c6bcf0083383f58970338","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.875Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-030cbeda962465a5b747d96c: start","job_status":"start","queue_duration_s":1.888944,"scheduling_latency_s":1.888964}1473gitlab # [ 159.480842] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.774Z","message":"No existing merge request to be cleaned up."}1474gitlab # [ 159.481992] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.780Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"030cbeda962465a5b747d96c","created_at":"2026-09-06T06:48:28.856Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-b2d6d6f076b343b0","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"88dafd15795c6bcf0083383f58970338","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.875Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-030cbeda962465a5b747d96c: done: 0.015563 sec","job_status":"done","queue_duration_s":1.888944,"scheduling_latency_s":1.888964,"redis_calls":10,"redis_duration_s":0.002174,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000893,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001281,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010266,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015563,"completed_at":"2026-09-06T06:48:30.780Z","load_balancing_strategy":"primary","db_duration_s":0.001487,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1475gitlab # [ 159.561825] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.781Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"03110162f507cd039d64557a","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-03110162f507cd039d64557a: start","job_status":"start","queue_duration_s":1.143847,"scheduling_latency_s":1.143867}1476gitlab # [ 159.563230] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.809Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"03110162f507cd039d64557a","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-03110162f507cd039d64557a: done: 0.028472 sec","job_status":"done","queue_duration_s":1.143847,"scheduling_latency_s":1.143867,"redis_calls":13,"redis_duration_s":0.003041,"redis_read_bytes":12,"redis_write_bytes":1300,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000451,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":289,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001169,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":395,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001421,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":616,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.007,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018436,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000373791,"duration_s":0.028472,"completed_at":"2026-09-06T06:48:30.809Z","load_balancing_strategy":"primary","db_duration_s":0.004162,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1477gitlab # [ 159.582165] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.811Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7a1a1023cf3720cfdbbbfbf2","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7a1a1023cf3720cfdbbbfbf2: start","job_status":"start","queue_duration_s":1.173909,"scheduling_latency_s":1.173932}1478gitlab # [ 159.650529] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.828Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7a1a1023cf3720cfdbbbfbf2","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7a1a1023cf3720cfdbbbfbf2: done: 0.017236 sec","job_status":"done","queue_duration_s":1.173909,"scheduling_latency_s":1.173932,"redis_calls":10,"redis_duration_s":0.002351,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000871,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00148,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011191,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017236,"completed_at":"2026-09-06T06:48:30.828Z","load_balancing_strategy":"primary","db_duration_s":0.001539,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1479gitlab # [ 159.724438] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.830Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"602cae135ddd294ce8c440da","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-602cae135ddd294ce8c440da: start","job_status":"start","queue_duration_s":1.192595,"scheduling_latency_s":1.192616}1480gitlab # [ 159.725859] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.846Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"602cae135ddd294ce8c440da","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-602cae135ddd294ce8c440da: done: 0.016065 sec","job_status":"done","queue_duration_s":1.192595,"scheduling_latency_s":1.192616,"redis_calls":10,"redis_duration_s":0.002189,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000843,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001346,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010782,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016065,"completed_at":"2026-09-06T06:48:30.846Z","load_balancing_strategy":"primary","db_duration_s":0.00144,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1481gitlab # [ 159.800083] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.847Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3e2054b6a4a1c529af5eda75","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3e2054b6a4a1c529af5eda75: start","job_status":"start","queue_duration_s":1.209969,"scheduling_latency_s":1.20999}1482gitlab # [ 159.800815] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.863Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3e2054b6a4a1c529af5eda75","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3e2054b6a4a1c529af5eda75: done: 0.016242 sec","job_status":"done","queue_duration_s":1.209969,"scheduling_latency_s":1.20999,"redis_calls":10,"redis_duration_s":0.002107,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000853,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001254,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016242,"completed_at":"2026-09-06T06:48:30.863Z","load_balancing_strategy":"primary","db_duration_s":0.001408,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1483gitlab # [ 159.876273] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.865Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3aa9e5d35c43ae0ec5576b4a","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3aa9e5d35c43ae0ec5576b4a: start","job_status":"start","queue_duration_s":1.227509,"scheduling_latency_s":1.22753}1484gitlab # [ 159.876805] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.881Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3aa9e5d35c43ae0ec5576b4a","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3aa9e5d35c43ae0ec5576b4a: done: 0.016284 sec","job_status":"done","queue_duration_s":1.227509,"scheduling_latency_s":1.22753,"redis_calls":10,"redis_duration_s":0.0021780000000000002,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000894,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001284,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010714,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016284,"completed_at":"2026-09-06T06:48:30.881Z","load_balancing_strategy":"primary","db_duration_s":0.001414,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1485gitlab # [ 159.945265] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.882Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"113abd0301882879408919a6","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-113abd0301882879408919a6: start","job_status":"start","queue_duration_s":1.245134,"scheduling_latency_s":1.245155}1486gitlab # [ 159.946871] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.899Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"113abd0301882879408919a6","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-113abd0301882879408919a6: done: 0.016715 sec","job_status":"done","queue_duration_s":1.245134,"scheduling_latency_s":1.245155,"redis_calls":10,"redis_duration_s":0.002456,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000982,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001474,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010839,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016715,"completed_at":"2026-09-06T06:48:30.899Z","load_balancing_strategy":"primary","db_duration_s":0.001461,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1487gitlab # [ 160.017378] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.901Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"cf54a02b05cf9e1267fd3f3e","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-cf54a02b05cf9e1267fd3f3e: start","job_status":"start","queue_duration_s":1.263442,"scheduling_latency_s":1.263463}1488gitlab # [ 160.018865] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.917Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"cf54a02b05cf9e1267fd3f3e","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-cf54a02b05cf9e1267fd3f3e: done: 0.016367 sec","job_status":"done","queue_duration_s":1.263442,"scheduling_latency_s":1.263463,"redis_calls":10,"redis_duration_s":0.0022760000000000002,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000867,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001409,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010917,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016367,"completed_at":"2026-09-06T06:48:30.917Z","load_balancing_strategy":"primary","db_duration_s":0.001463,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1489gitlab # [ 160.090862] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.918Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"074939888fdf9d86716bba37","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-074939888fdf9d86716bba37: start","job_status":"start","queue_duration_s":1.281103,"scheduling_latency_s":1.281124}1490gitlab # [ 160.092255] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.937Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"074939888fdf9d86716bba37","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-074939888fdf9d86716bba37: done: 0.01929 sec","job_status":"done","queue_duration_s":1.281103,"scheduling_latency_s":1.281124,"redis_calls":10,"redis_duration_s":0.002481,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001115,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001366,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01929,"completed_at":"2026-09-06T06:48:30.937Z","load_balancing_strategy":"primary","db_duration_s":0.001977,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1491gitlab # [ 160.172239] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.939Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"aacc4ae0ff749886d26ddd68","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-aacc4ae0ff749886d26ddd68: start","job_status":"start","queue_duration_s":1.301957,"scheduling_latency_s":1.301987}1492gitlab # [ 160.173367] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.957Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"aacc4ae0ff749886d26ddd68","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-aacc4ae0ff749886d26ddd68: done: 0.01775 sec","job_status":"done","queue_duration_s":1.301957,"scheduling_latency_s":1.301987,"redis_calls":10,"redis_duration_s":0.002209,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000867,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001342,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011906,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01775,"completed_at":"2026-09-06T06:48:30.957Z","load_balancing_strategy":"primary","db_duration_s":0.001574,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1493gitlab # [ 160.248861] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.958Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"2ccc46cec1eb74c5cbedc9f2","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-2ccc46cec1eb74c5cbedc9f2: start","job_status":"start","queue_duration_s":1.321001,"scheduling_latency_s":1.321022}1494gitlab # [ 160.250220] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.979Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"2ccc46cec1eb74c5cbedc9f2","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-2ccc46cec1eb74c5cbedc9f2: done: 0.02057 sec","job_status":"done","queue_duration_s":1.321001,"scheduling_latency_s":1.321022,"redis_calls":10,"redis_duration_s":0.0026,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001551,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014421,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02057,"completed_at":"2026-09-06T06:48:30.979Z","load_balancing_strategy":"primary","db_duration_s":0.001921,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1495gitlab # [ 160.321698] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.980Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"bc7e9c7ad96b70533dd0ca68","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-bc7e9c7ad96b70533dd0ca68: start","job_status":"start","queue_duration_s":1.343117,"scheduling_latency_s":1.343144}1496gitlab # [ 160.323083] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.998Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"bc7e9c7ad96b70533dd0ca68","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-bc7e9c7ad96b70533dd0ca68: done: 0.01778 sec","job_status":"done","queue_duration_s":1.343117,"scheduling_latency_s":1.343144,"redis_calls":10,"redis_duration_s":0.002345,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000866,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001479,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011567,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01778,"completed_at":"2026-09-06T06:48:30.998Z","load_balancing_strategy":"primary","db_duration_s":0.001685,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1497gitlab # [ 160.398231] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:30.999Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"349c9c868ecddfc247ef9dfe","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-349c9c868ecddfc247ef9dfe: start","job_status":"start","queue_duration_s":1.36235,"scheduling_latency_s":1.362371}1498gitlab # [ 160.399340] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.016Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"349c9c868ecddfc247ef9dfe","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-349c9c868ecddfc247ef9dfe: done: 0.016338 sec","job_status":"done","queue_duration_s":1.36235,"scheduling_latency_s":1.362371,"redis_calls":10,"redis_duration_s":0.0022040000000000002,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000897,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001307,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010968,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016338,"completed_at":"2026-09-06T06:48:31.016Z","load_balancing_strategy":"primary","db_duration_s":0.001447,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1499gitlab # [ 160.483983] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.017Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"62aa5bd24f501e29deffa429","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-62aa5bd24f501e29deffa429: start","job_status":"start","queue_duration_s":1.380011,"scheduling_latency_s":1.380031}1500gitlab # [ 160.484837] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.033Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"62aa5bd24f501e29deffa429","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-62aa5bd24f501e29deffa429: done: 0.016072 sec","job_status":"done","queue_duration_s":1.380011,"scheduling_latency_s":1.380031,"redis_calls":10,"redis_duration_s":0.0021720000000000003,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000861,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001311,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016072,"completed_at":"2026-09-06T06:48:31.033Z","load_balancing_strategy":"primary","db_duration_s":0.001446,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1501gitlab # [ 160.574443] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.034Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f646aff9df172e04a5a11cf4","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f646aff9df172e04a5a11cf4: start","job_status":"start","queue_duration_s":1.397377,"scheduling_latency_s":1.397398}1502gitlab # [ 160.575837] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.051Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f646aff9df172e04a5a11cf4","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f646aff9df172e04a5a11cf4: done: 0.016262 sec","job_status":"done","queue_duration_s":1.397377,"scheduling_latency_s":1.397398,"redis_calls":10,"redis_duration_s":0.00215,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000865,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001285,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016262,"completed_at":"2026-09-06T06:48:31.051Z","load_balancing_strategy":"primary","db_duration_s":0.001446,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1503gitlab # [ 160.660452] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.052Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b99654bf10da99bd6a50fed2","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b99654bf10da99bd6a50fed2: start","job_status":"start","queue_duration_s":1.415125,"scheduling_latency_s":1.415147}1504gitlab # [ 160.661831] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.069Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b99654bf10da99bd6a50fed2","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b99654bf10da99bd6a50fed2: done: 0.016504 sec","job_status":"done","queue_duration_s":1.415125,"scheduling_latency_s":1.415147,"redis_calls":10,"redis_duration_s":0.002209,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000888,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001321,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011099,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016504,"completed_at":"2026-09-06T06:48:31.069Z","load_balancing_strategy":"primary","db_duration_s":0.001426,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1505gitlab # [ 160.730933] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.070Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"4cccd0aee06c0a61b739de25","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-4cccd0aee06c0a61b739de25: start","job_status":"start","queue_duration_s":1.432979,"scheduling_latency_s":1.433}1506gitlab # [ 160.732307] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.089Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"4cccd0aee06c0a61b739de25","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-4cccd0aee06c0a61b739de25: done: 0.018999 sec","job_status":"done","queue_duration_s":1.432979,"scheduling_latency_s":1.433,"redis_calls":10,"redis_duration_s":0.002402,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001047,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001355,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013116,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018999,"completed_at":"2026-09-06T06:48:31.089Z","load_balancing_strategy":"primary","db_duration_s":0.001662,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507gitlab # [ 160.805973] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.091Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"348512cc6f09fd3fe51aaba2","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-348512cc6f09fd3fe51aaba2: start","job_status":"start","queue_duration_s":1.453515,"scheduling_latency_s":1.453546}1508gitlab # [ 160.807323] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.109Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"348512cc6f09fd3fe51aaba2","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-348512cc6f09fd3fe51aaba2: done: 0.018308 sec","job_status":"done","queue_duration_s":1.453515,"scheduling_latency_s":1.453546,"redis_calls":10,"redis_duration_s":0.002236,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00088,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001356,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012161,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018308,"completed_at":"2026-09-06T06:48:31.109Z","load_balancing_strategy":"primary","db_duration_s":0.001706,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1509gitlab # [ 160.887895] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.110Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"95e9783a30dc30b1039dad29","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-95e9783a30dc30b1039dad29: start","job_status":"start","queue_duration_s":1.473251,"scheduling_latency_s":1.473272}1510gitlab # [ 160.889319] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.127Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"95e9783a30dc30b1039dad29","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-95e9783a30dc30b1039dad29: done: 0.016438 sec","job_status":"done","queue_duration_s":1.473251,"scheduling_latency_s":1.473272,"redis_calls":10,"redis_duration_s":0.002265,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000894,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001371,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016438,"completed_at":"2026-09-06T06:48:31.127Z","load_balancing_strategy":"primary","db_duration_s":0.001561,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1511gitlab # [ 160.965458] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.128Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"64b15fd36319bf29a94ab6fb","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-64b15fd36319bf29a94ab6fb: start","job_status":"start","queue_duration_s":1.491018,"scheduling_latency_s":1.49104}1512gitlab # [ 160.966930] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.144Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"64b15fd36319bf29a94ab6fb","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-64b15fd36319bf29a94ab6fb: done: 0.016254 sec","job_status":"done","queue_duration_s":1.491018,"scheduling_latency_s":1.49104,"redis_calls":10,"redis_duration_s":0.0021550000000000002,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000872,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001283,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010925,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016254,"completed_at":"2026-09-06T06:48:31.144Z","load_balancing_strategy":"primary","db_duration_s":0.001427,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1513gitlab # [ 161.050878] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"69e56138a8aa731bd8b0f4b5","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-69e56138a8aa731bd8b0f4b5: start","job_status":"start","queue_duration_s":1.50862,"scheduling_latency_s":1.508642}1514gitlab # [ 161.052259] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.163Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"69e56138a8aa731bd8b0f4b5","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-69e56138a8aa731bd8b0f4b5: done: 0.017069 sec","job_status":"done","queue_duration_s":1.50862,"scheduling_latency_s":1.508642,"redis_calls":10,"redis_duration_s":0.002478,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000978,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.0015,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017069,"completed_at":"2026-09-06T06:48:31.163Z","load_balancing_strategy":"primary","db_duration_s":0.001642,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1515gitlab # [ 161.132339] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.164Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"dac2a9e06cf392955fadcc15","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-dac2a9e06cf392955fadcc15: start","job_status":"start","queue_duration_s":1.527231,"scheduling_latency_s":1.527252}1516gitlab # [ 161.133440] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.181Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"dac2a9e06cf392955fadcc15","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-dac2a9e06cf392955fadcc15: done: 0.016243 sec","job_status":"done","queue_duration_s":1.527231,"scheduling_latency_s":1.527252,"redis_calls":10,"redis_duration_s":0.002389,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000971,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001418,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010441,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016243,"completed_at":"2026-09-06T06:48:31.180Z","load_balancing_strategy":"primary","db_duration_s":0.001471,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1517gitlab # [ 161.201325] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.182Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"bf2ad9c1754185c0691a4115","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-bf2ad9c1754185c0691a4115: start","job_status":"start","queue_duration_s":1.544928,"scheduling_latency_s":1.544949}1518gitlab # [ 161.202500] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.198Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"bf2ad9c1754185c0691a4115","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-bf2ad9c1754185c0691a4115: done: 0.016201 sec","job_status":"done","queue_duration_s":1.544928,"scheduling_latency_s":1.544949,"redis_calls":10,"redis_duration_s":0.00229,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001366,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010426,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016201,"completed_at":"2026-09-06T06:48:31.198Z","load_balancing_strategy":"primary","db_duration_s":0.001433,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1519gitlab # [ 161.281469] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.200Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5b6e3f80592bbf882c9cf288","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5b6e3f80592bbf882c9cf288: start","job_status":"start","queue_duration_s":1.56245,"scheduling_latency_s":1.562479}1520gitlab # [ 161.282574] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.216Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5b6e3f80592bbf882c9cf288","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5b6e3f80592bbf882c9cf288: done: 0.0167 sec","job_status":"done","queue_duration_s":1.56245,"scheduling_latency_s":1.562479,"redis_calls":10,"redis_duration_s":0.0023290000000000003,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000894,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001435,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010836,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0167,"completed_at":"2026-09-06T06:48:31.216Z","load_balancing_strategy":"primary","db_duration_s":0.00149,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1521gitlab # [ 161.365826] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.218Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3e6a96029b0be87136562322","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3e6a96029b0be87136562322: start","job_status":"start","queue_duration_s":1.580581,"scheduling_latency_s":1.580602}1522gitlab # [ 161.366812] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.234Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3e6a96029b0be87136562322","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3e6a96029b0be87136562322: done: 0.016742 sec","job_status":"done","queue_duration_s":1.580581,"scheduling_latency_s":1.580602,"redis_calls":10,"redis_duration_s":0.0022960000000000003,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000838,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001458,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016742,"completed_at":"2026-09-06T06:48:31.234Z","load_balancing_strategy":"primary","db_duration_s":0.001868,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1523gitlab # [ 161.442496] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.236Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d06c4df9a1844650f4617bab","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d06c4df9a1844650f4617bab: start","job_status":"start","queue_duration_s":1.59864,"scheduling_latency_s":1.598662}1524gitlab # [ 161.443884] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.252Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d06c4df9a1844650f4617bab","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d06c4df9a1844650f4617bab: done: 0.016178 sec","job_status":"done","queue_duration_s":1.59864,"scheduling_latency_s":1.598662,"redis_calls":10,"redis_duration_s":0.002145,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00083,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001315,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016178,"completed_at":"2026-09-06T06:48:31.252Z","load_balancing_strategy":"primary","db_duration_s":0.001481,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1525gitlab # [ 161.469322] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.253Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"faa1529bb176e14e4d568265","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-faa1529bb176e14e4d568265: start","job_status":"start","queue_duration_s":1.616126,"scheduling_latency_s":1.616148}1526gitlab # [ 161.488887] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.277Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"faa1529bb176e14e4d568265","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-faa1529bb176e14e4d568265: done: 0.023475 sec","job_status":"done","queue_duration_s":1.616126,"scheduling_latency_s":1.616148,"redis_calls":10,"redis_duration_s":0.0027860000000000003,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001341,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001445,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016246,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023475,"completed_at":"2026-09-06T06:48:31.277Z","load_balancing_strategy":"primary","db_duration_s":0.001621,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1527gitlab # [ 161.574158] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.279Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a8bb6cf54afef3794ea01547","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a8bb6cf54afef3794ea01547: start","job_status":"start","queue_duration_s":1.642075,"scheduling_latency_s":1.642118}1528gitlab # [ 161.575468] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.296Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a8bb6cf54afef3794ea01547","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a8bb6cf54afef3794ea01547: done: 0.017321 sec","job_status":"done","queue_duration_s":1.642075,"scheduling_latency_s":1.642118,"redis_calls":10,"redis_duration_s":0.002398,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00092,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001478,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011297,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017321,"completed_at":"2026-09-06T06:48:31.296Z","load_balancing_strategy":"primary","db_duration_s":0.001518,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1529gitlab # [ 161.660940] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.298Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c61cc36c2f958bbab1290f0f","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c61cc36c2f958bbab1290f0f: start","job_status":"start","queue_duration_s":1.660656,"scheduling_latency_s":1.660718}1530gitlab # [ 161.662082] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.317Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c61cc36c2f958bbab1290f0f","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c61cc36c2f958bbab1290f0f: done: 0.018961 sec","job_status":"done","queue_duration_s":1.660656,"scheduling_latency_s":1.660718,"redis_calls":10,"redis_duration_s":0.002456,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000857,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001599,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018961,"completed_at":"2026-09-06T06:48:31.317Z","load_balancing_strategy":"primary","db_duration_s":0.005368,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1531gitlab # [ 161.738393] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.318Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"de017c711d23ff25e2b06b69","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-de017c711d23ff25e2b06b69: start","job_status":"start","queue_duration_s":1.680999,"scheduling_latency_s":1.68102}1532gitlab # [ 161.740151] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.334Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"de017c711d23ff25e2b06b69","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-de017c711d23ff25e2b06b69: done: 0.016255 sec","job_status":"done","queue_duration_s":1.680999,"scheduling_latency_s":1.68102,"redis_calls":10,"redis_duration_s":0.002168,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000874,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001294,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010857,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016255,"completed_at":"2026-09-06T06:48:31.334Z","load_balancing_strategy":"primary","db_duration_s":0.001552,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1533gitlab # [ 161.808235] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.336Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0dd22f315a44df5f6ebf0cfd","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0dd22f315a44df5f6ebf0cfd: start","job_status":"start","queue_duration_s":1.698535,"scheduling_latency_s":1.698556}1534gitlab # [ 161.809322] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.351Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0dd22f315a44df5f6ebf0cfd","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0dd22f315a44df5f6ebf0cfd: done: 0.015804 sec","job_status":"done","queue_duration_s":1.698535,"scheduling_latency_s":1.698556,"redis_calls":10,"redis_duration_s":0.002199,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000867,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001332,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010603,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015804,"completed_at":"2026-09-06T06:48:31.351Z","load_balancing_strategy":"primary","db_duration_s":0.001388,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1535gitlab # [ 161.880103] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.353Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"4f9c16dda4a7920678b1d182","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-4f9c16dda4a7920678b1d182: start","job_status":"start","queue_duration_s":1.715891,"scheduling_latency_s":1.715912}1536gitlab # [ 161.882284] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.369Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"4f9c16dda4a7920678b1d182","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-4f9c16dda4a7920678b1d182: done: 0.016295 sec","job_status":"done","queue_duration_s":1.715891,"scheduling_latency_s":1.715912,"redis_calls":10,"redis_duration_s":0.002187,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000824,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001363,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016295,"completed_at":"2026-09-06T06:48:31.369Z","load_balancing_strategy":"primary","db_duration_s":0.001374,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1537gitlab # [ 161.943106] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.371Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"753209afae3006e6ad20be24","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-753209afae3006e6ad20be24: start","job_status":"start","queue_duration_s":1.733482,"scheduling_latency_s":1.733503}1538gitlab # [ 162.021044] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.387Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"753209afae3006e6ad20be24","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-753209afae3006e6ad20be24: done: 0.016668 sec","job_status":"done","queue_duration_s":1.733482,"scheduling_latency_s":1.733503,"redis_calls":10,"redis_duration_s":0.00215,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000822,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001328,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011219,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016668,"completed_at":"2026-09-06T06:48:31.387Z","load_balancing_strategy":"primary","db_duration_s":0.001477,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1539gitlab # [ 162.023076] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.388Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"92dcada01ffd908cabfa05fc","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-92dcada01ffd908cabfa05fc: start","job_status":"start","queue_duration_s":1.751403,"scheduling_latency_s":1.751425}1540gitlab # [ 162.096389] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.407Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"92dcada01ffd908cabfa05fc","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-92dcada01ffd908cabfa05fc: done: 0.018152 sec","job_status":"done","queue_duration_s":1.751403,"scheduling_latency_s":1.751425,"redis_calls":10,"redis_duration_s":0.0022069999999999998,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000871,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001336,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011328,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018152,"completed_at":"2026-09-06T06:48:31.407Z","load_balancing_strategy":"primary","db_duration_s":0.002738,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1541gitlab # [ 162.100788] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.408Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"00169b95436ecec38b34985a","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-00169b95436ecec38b34985a: start","job_status":"start","queue_duration_s":1.770885,"scheduling_latency_s":1.770906}1542gitlab # [ 162.171348] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.425Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"00169b95436ecec38b34985a","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-00169b95436ecec38b34985a: done: 0.016782 sec","job_status":"done","queue_duration_s":1.770885,"scheduling_latency_s":1.770906,"redis_calls":10,"redis_duration_s":0.002186,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000893,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001293,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011191,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016782,"completed_at":"2026-09-06T06:48:31.425Z","load_balancing_strategy":"primary","db_duration_s":0.001418,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1543gitlab # [ 162.179154] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.426Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6b138f655c5eeaf58adde8a4","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6b138f655c5eeaf58adde8a4: start","job_status":"start","queue_duration_s":1.789324,"scheduling_latency_s":1.789345}1544gitlab # [ 162.249388] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.443Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6b138f655c5eeaf58adde8a4","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6b138f655c5eeaf58adde8a4: done: 0.017035 sec","job_status":"done","queue_duration_s":1.789324,"scheduling_latency_s":1.789345,"redis_calls":10,"redis_duration_s":0.0022240000000000003,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000938,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001286,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011474,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017035,"completed_at":"2026-09-06T06:48:31.443Z","load_balancing_strategy":"primary","db_duration_s":0.0014,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1545gitlab # [ 162.320468] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.445Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7f8603d3a1c7f43423b5187c","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7f8603d3a1c7f43423b5187c: start","job_status":"start","queue_duration_s":1.807995,"scheduling_latency_s":1.808016}1546gitlab # [ 162.321917] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.462Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7f8603d3a1c7f43423b5187c","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7f8603d3a1c7f43423b5187c: done: 0.016928 sec","job_status":"done","queue_duration_s":1.807995,"scheduling_latency_s":1.808016,"redis_calls":10,"redis_duration_s":0.0021609999999999997,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000866,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001295,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011661,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016928,"completed_at":"2026-09-06T06:48:31.462Z","load_balancing_strategy":"primary","db_duration_s":0.001427,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1547gitlab # [ 162.400507] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.464Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d0c9fff85dfece7a03f65aa1","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d0c9fff85dfece7a03f65aa1: start","job_status":"start","queue_duration_s":1.826479,"scheduling_latency_s":1.8265}1548gitlab # [ 162.402472] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.480Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d0c9fff85dfece7a03f65aa1","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d0c9fff85dfece7a03f65aa1: done: 0.016875 sec","job_status":"done","queue_duration_s":1.826479,"scheduling_latency_s":1.8265,"redis_calls":10,"redis_duration_s":0.0022400000000000002,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000867,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001373,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011618,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016875,"completed_at":"2026-09-06T06:48:31.480Z","load_balancing_strategy":"primary","db_duration_s":0.001417,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1549gitlab # [ 162.416407] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.482Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"38ec4e0c670875c9028d21fc","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-38ec4e0c670875c9028d21fc: start","job_status":"start","queue_duration_s":1.844988,"scheduling_latency_s":1.845011}1550gitlab # [ 162.499567] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.501Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"38ec4e0c670875c9028d21fc","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-38ec4e0c670875c9028d21fc: done: 0.01929 sec","job_status":"done","queue_duration_s":1.844988,"scheduling_latency_s":1.845011,"redis_calls":10,"redis_duration_s":0.0042780000000000006,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002785,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001493,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01184,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01929,"completed_at":"2026-09-06T06:48:31.501Z","load_balancing_strategy":"primary","db_duration_s":0.001553,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1551gitlab # [ 162.501389] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.503Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"bbea080019ea2c027484bb5e","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-bbea080019ea2c027484bb5e: start","job_status":"start","queue_duration_s":1.865587,"scheduling_latency_s":1.865608}1552gitlab # [ 162.516316] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.520Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"bbea080019ea2c027484bb5e","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-bbea080019ea2c027484bb5e: done: 0.016868 sec","job_status":"done","queue_duration_s":1.865587,"scheduling_latency_s":1.865608,"redis_calls":10,"redis_duration_s":0.002132,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000884,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001248,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011391,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016868,"completed_at":"2026-09-06T06:48:31.519Z","load_balancing_strategy":"primary","db_duration_s":0.001763,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1553gitlab # [ 162.585476] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.521Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5a052ed354b1824155aa3da0","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5a052ed354b1824155aa3da0: start","job_status":"start","queue_duration_s":1.883813,"scheduling_latency_s":1.883834}1554gitlab # [ 162.595491] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.538Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5a052ed354b1824155aa3da0","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5a052ed354b1824155aa3da0: done: 0.017067 sec","job_status":"done","queue_duration_s":1.883813,"scheduling_latency_s":1.883834,"redis_calls":10,"redis_duration_s":0.002141,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000832,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001309,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011263,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017067,"completed_at":"2026-09-06T06:48:31.538Z","load_balancing_strategy":"primary","db_duration_s":0.001383,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1555gitlab # [ 162.693587] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.539Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d5c5c7f872f8c49e19d93272","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d5c5c7f872f8c49e19d93272: start","job_status":"start","queue_duration_s":1.90219,"scheduling_latency_s":1.902211}1556gitlab # [ 162.694964] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.556Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d5c5c7f872f8c49e19d93272","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d5c5c7f872f8c49e19d93272: done: 0.017085 sec","job_status":"done","queue_duration_s":1.90219,"scheduling_latency_s":1.902211,"redis_calls":10,"redis_duration_s":0.0021089999999999998,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000828,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001281,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011421,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017085,"completed_at":"2026-09-06T06:48:31.556Z","load_balancing_strategy":"primary","db_duration_s":0.001495,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1557gitlab # [ 162.763285] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.558Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"478cdf4e48e54642c8ee8adf","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-478cdf4e48e54642c8ee8adf: start","job_status":"start","queue_duration_s":1.920868,"scheduling_latency_s":1.920891}1558gitlab # [ 162.764192] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.577Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"478cdf4e48e54642c8ee8adf","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-478cdf4e48e54642c8ee8adf: done: 0.018836 sec","job_status":"done","queue_duration_s":1.920868,"scheduling_latency_s":1.920891,"redis_calls":10,"redis_duration_s":0.002213,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001296,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011498,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018836,"completed_at":"2026-09-06T06:48:31.577Z","load_balancing_strategy":"primary","db_duration_s":0.003734,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1559gitlab # [ 162.835275] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.579Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1b1c6f091e6e3803da99f5d1","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1b1c6f091e6e3803da99f5d1: start","job_status":"start","queue_duration_s":1.941454,"scheduling_latency_s":1.941486}1560gitlab # [ 162.836851] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.598Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1b1c6f091e6e3803da99f5d1","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1b1c6f091e6e3803da99f5d1: done: 0.01904 sec","job_status":"done","queue_duration_s":1.941454,"scheduling_latency_s":1.941486,"redis_calls":10,"redis_duration_s":0.002295,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000845,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00145,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.003,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01904,"completed_at":"2026-09-06T06:48:31.598Z","load_balancing_strategy":"primary","db_duration_s":0.0044,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1561gitlab # [ 162.908216] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.599Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"baa51dd6bf0c9b3fed4e31b0","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-baa51dd6bf0c9b3fed4e31b0: start","job_status":"start","queue_duration_s":1.961863,"scheduling_latency_s":1.961884}1562gitlab # [ 162.910424] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.616Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"baa51dd6bf0c9b3fed4e31b0","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-baa51dd6bf0c9b3fed4e31b0: done: 0.017417 sec","job_status":"done","queue_duration_s":1.961863,"scheduling_latency_s":1.961884,"redis_calls":10,"redis_duration_s":0.002393,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001127,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001266,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010555,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017417,"completed_at":"2026-09-06T06:48:31.616Z","load_balancing_strategy":"primary","db_duration_s":0.002954,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1563gitlab # [ 162.986196] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.618Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3ac2ad6c55a2ad6b5c85c903","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3ac2ad6c55a2ad6b5c85c903: start","job_status":"start","queue_duration_s":1.980582,"scheduling_latency_s":1.980603}1564gitlab # [ 162.989263] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.634Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3ac2ad6c55a2ad6b5c85c903","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3ac2ad6c55a2ad6b5c85c903: done: 0.015952 sec","job_status":"done","queue_duration_s":1.980582,"scheduling_latency_s":1.980603,"redis_calls":10,"redis_duration_s":0.002171,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000871,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.0013,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01075,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015952,"completed_at":"2026-09-06T06:48:31.634Z","load_balancing_strategy":"primary","db_duration_s":0.001424,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1565gitlab # [ 163.066150] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.635Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b48a83d6c33d3c17389a8d21","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b48a83d6c33d3c17389a8d21: start","job_status":"start","queue_duration_s":1.998004,"scheduling_latency_s":1.998025}1566gitlab # [ 163.067459] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.651Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b48a83d6c33d3c17389a8d21","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b48a83d6c33d3c17389a8d21: done: 0.016089 sec","job_status":"done","queue_duration_s":1.998004,"scheduling_latency_s":1.998025,"redis_calls":10,"redis_duration_s":0.002208,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001296,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016089,"completed_at":"2026-09-06T06:48:31.651Z","load_balancing_strategy":"primary","db_duration_s":0.001482,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1567gitlab # [ 163.142235] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.653Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f8e080e81e05d5463a136107","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f8e080e81e05d5463a136107: start","job_status":"start","queue_duration_s":2.015515,"scheduling_latency_s":2.015536}1568gitlab # [ 163.146208] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.669Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f8e080e81e05d5463a136107","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f8e080e81e05d5463a136107: done: 0.015986 sec","job_status":"done","queue_duration_s":2.015515,"scheduling_latency_s":2.015536,"redis_calls":10,"redis_duration_s":0.0021809999999999998,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000864,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001317,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010681,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015986,"completed_at":"2026-09-06T06:48:31.669Z","load_balancing_strategy":"primary","db_duration_s":0.001472,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1569gitlab # [ 163.234230] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.670Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ed4a5d2f0d2e5ff3c2606298","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ed4a5d2f0d2e5ff3c2606298: start","job_status":"start","queue_duration_s":2.032844,"scheduling_latency_s":2.032865}1570gitlab # [ 163.235597] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.686Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ed4a5d2f0d2e5ff3c2606298","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ed4a5d2f0d2e5ff3c2606298: done: 0.01569 sec","job_status":"done","queue_duration_s":2.032844,"scheduling_latency_s":2.032865,"redis_calls":10,"redis_duration_s":0.0021999999999999997,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000879,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001321,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010523,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01569,"completed_at":"2026-09-06T06:48:31.686Z","load_balancing_strategy":"primary","db_duration_s":0.001403,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1571gitlab # [ 163.312224] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.687Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"dcc2ead3c5c358631b79b0cc","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-dcc2ead3c5c358631b79b0cc: start","job_status":"start","queue_duration_s":2.049854,"scheduling_latency_s":2.049875}1572gitlab # [ 163.313347] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.703Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"dcc2ead3c5c358631b79b0cc","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-dcc2ead3c5c358631b79b0cc: done: 0.015612 sec","job_status":"done","queue_duration_s":2.049854,"scheduling_latency_s":2.049875,"redis_calls":10,"redis_duration_s":0.002179,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000858,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001321,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010488,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015612,"completed_at":"2026-09-06T06:48:31.702Z","load_balancing_strategy":"primary","db_duration_s":0.001446,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1573gitlab # [ 163.389188] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.704Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ed0b90d45a51e707c59b2d5c","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ed0b90d45a51e707c59b2d5c: start","job_status":"start","queue_duration_s":2.066833,"scheduling_latency_s":2.066853}1574gitlab # [ 163.390771] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:48:31.720Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ed0b90d45a51e707c59b2d5c","created_at":"2026-09-06T06:48:29.572Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-52bee3a63cdd4f9d","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"685f6a750a3951f7b1840324761c9902","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.637Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ed0b90d45a51e707c59b2d5c: done: 0.015965 sec","job_status":"done","queue_duration_s":2.066833,"scheduling_latency_s":2.066853,"redis_calls":10,"redis_duration_s":0.002125,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000828,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001297,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010723,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015965,"completed_at":"2026-09-06T06:48:31.720Z","load_balancing_strategy":"primary","db_duration_s":0.001476,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1575gitlab # [ 163.780034] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 9238558474 wd_nsec: 92385579751576gitlab # [ 174.270072] setup-gitlab-start[2277]: W, [2026-09-06T06:48:49.786718 #2277] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1577gitlab # [ 187.608388] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:03.123Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"3a40f3cb6cbf37d7be81c29e","created_at":"2026-09-06T06:49:03.056Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"49b3031406a39359efb3b4aca14ee826","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:03.120Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-3a40f3cb6cbf37d7be81c29e: start","job_status":"start","queue_duration_s":0.00301,"scheduling_latency_s":0.00308}1578gitlab # [ 187.686857] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:03.203Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1579gitlab # [ 187.717961] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:03.234Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"3a40f3cb6cbf37d7be81c29e","created_at":"2026-09-06T06:49:03.056Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"49b3031406a39359efb3b4aca14ee826","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:03.120Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-3a40f3cb6cbf37d7be81c29e: done: 0.110993 sec","job_status":"done","queue_duration_s":0.00301,"scheduling_latency_s":0.00308,"redis_calls":7,"redis_duration_s":0.010963,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.008664,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002299,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020011,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.110993,"completed_at":"2026-09-06T06:49:03.234Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1580gitlab # [ 187.799470] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:03.315Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"9d8394c9065285350617b899","created_at":"2026-09-06T06:49:03.182Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1bd188a765ec2e21f578949d63e2b93d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:03.187Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-9d8394c9065285350617b899: start","job_status":"start","queue_duration_s":0.128635,"scheduling_latency_s":0.128706}1581gitlab # [ 187.851262] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:03.367Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"9d8394c9065285350617b899","created_at":"2026-09-06T06:49:03.182Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1bd188a765ec2e21f578949d63e2b93d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:03.187Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-9d8394c9065285350617b899: done: 0.051823 sec","job_status":"done","queue_duration_s":0.128635,"scheduling_latency_s":0.128706,"redis_calls":7,"redis_duration_s":0.011236,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004979,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006257,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.051823,"completed_at":"2026-09-06T06:49:03.367Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1582gitlab # [ 187.922390] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:03.438Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"eab69dda2a3777e06cf6eb24","created_at":"2026-09-06T06:49:03.218Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5c0950c94f9bb226575e4c4977812f87","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-06T06:49:03.223Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-eab69dda2a3777e06cf6eb24: start","job_status":"start","queue_duration_s":0.215034,"scheduling_latency_s":0.215104}1583gitlab # [ 187.964085] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:03.480Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1584gitlab # [ 188.021111] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:03.537Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"eab69dda2a3777e06cf6eb24","created_at":"2026-09-06T06:49:03.218Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5c0950c94f9bb226575e4c4977812f87","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-06T06:49:03.223Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-eab69dda2a3777e06cf6eb24: done: 0.098791 sec","job_status":"done","queue_duration_s":0.215034,"scheduling_latency_s":0.215104,"redis_calls":7,"redis_duration_s":0.018106,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.013981,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004125,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020327,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.098791,"completed_at":"2026-09-06T06:49:03.537Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1585gitlab # [ 188.100292] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:03.616Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"923cd08c4b3acebd27b22452","created_at":"2026-09-06T06:49:03.308Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e3fafe40dde37c05a3ecf30aabc9377c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:03.314Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-923cd08c4b3acebd27b22452: start","job_status":"start","queue_duration_s":0.302112,"scheduling_latency_s":0.302154}1586gitlab # [ 188.307295] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:03.823Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"923cd08c4b3acebd27b22452","created_at":"2026-09-06T06:49:03.308Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e3fafe40dde37c05a3ecf30aabc9377c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:03.314Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-923cd08c4b3acebd27b22452: done: 0.206558 sec","job_status":"done","queue_duration_s":0.302112,"scheduling_latency_s":0.302154,"redis_calls":9,"redis_duration_s":0.023706,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.016383,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.007323,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.021,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045887,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.003367467,"exclusive_lock_hold_duration_s":0.092258932,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.206558,"completed_at":"2026-09-06T06:49:03.823Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.079719,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1587gitlab # [ 188.400299] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:03.917Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"7ebefb717451e1b8d1325b87","created_at":"2026-09-06T06:49:03.354Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d676d2bfb7445c27827d2ea77893b007","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:03.363Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-7ebefb717451e1b8d1325b87: start","job_status":"start","queue_duration_s":0.553567,"scheduling_latency_s":0.553609}1588gitlab # [ 188.608838] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:04.123Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"7ebefb717451e1b8d1325b87","created_at":"2026-09-06T06:49:03.354Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d676d2bfb7445c27827d2ea77893b007","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:03.363Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-7ebefb717451e1b8d1325b87: done: 0.206922 sec","job_status":"done","queue_duration_s":0.553567,"scheduling_latency_s":0.553609,"redis_calls":7,"redis_duration_s":0.061259,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.059155,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002104,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.073,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.073,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028854,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.206922,"completed_at":"2026-09-06T06:49:04.123Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.098525,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1589gitlab # [ 188.696417] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:04.212Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"9718dba376dd20c194739a82","created_at":"2026-09-06T06:49:03.442Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"85c4fc6c643185ae6fb98d3f3cd421ce","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:03.470Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-9718dba376dd20c194739a82: start","job_status":"start","queue_duration_s":0.741779,"scheduling_latency_s":0.741852}1590gitlab # [ 189.184293] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:04.700Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"9718dba376dd20c194739a82","created_at":"2026-09-06T06:49:03.442Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"85c4fc6c643185ae6fb98d3f3cd421ce","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:03.470Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-9718dba376dd20c194739a82: done: 0.487989 sec","job_status":"done","queue_duration_s":0.741779,"scheduling_latency_s":0.741852,"redis_calls":562,"redis_duration_s":0.173452,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002806,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.170646,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.350481,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.487989,"completed_at":"2026-09-06T06:49:04.700Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1591gitlab # [ 189.249345] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:04.766Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"b7559525d63b2adef7520c59","created_at":"2026-09-06T06:49:03.495Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:03.500Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-b7559525d63b2adef7520c59: start","job_status":"start","queue_duration_s":1.265272,"scheduling_latency_s":1.26531}1592gitlab # [ 189.404330] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:04.920Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"b7559525d63b2adef7520c59","created_at":"2026-09-06T06:49:03.495Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:03.500Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-b7559525d63b2adef7520c59: done: 0.154916 sec","job_status":"done","queue_duration_s":1.265272,"scheduling_latency_s":1.26531,"redis_calls":60,"redis_duration_s":0.032747,"redis_read_bytes":108,"redis_write_bytes":41059,"redis_queues_calls":2,"redis_queues_duration_s":0.00142,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.029684,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001643,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.099013,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.154916,"completed_at":"2026-09-06T06:49:04.920Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1593gitlab # [ 189.407469] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:04.922Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"a4f0b486a7793dc05386dcbb","created_at":"2026-09-06T06:49:03.534Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8beccda37b4796851f42b59efaed0b00","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:03.614Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-a4f0b486a7793dc05386dcbb: start","job_status":"start","queue_duration_s":1.307636,"scheduling_latency_s":1.307663}1594gitlab # [ 189.517497] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:05.033Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"a4f0b486a7793dc05386dcbb","created_at":"2026-09-06T06:49:03.534Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8beccda37b4796851f42b59efaed0b00","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:03.614Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-a4f0b486a7793dc05386dcbb: done: 0.11135 sec","job_status":"done","queue_duration_s":1.307636,"scheduling_latency_s":1.307663,"redis_calls":14,"redis_duration_s":0.007134,"redis_read_bytes":16,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.00082,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.004756,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001558,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.078,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.078,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022372,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.11135,"completed_at":"2026-09-06T06:49:05.033Z","load_balancing_strategy":"primary","db_duration_s":0.078168,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1595gitlab # [ 189.588296] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:05.102Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"4b150677791e98224d09ac67","created_at":"2026-09-06T06:49:03.658Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a771d79f62e3fc4586a875bbfc464d8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:03.662Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-4b150677791e98224d09ac67: start","job_status":"start","queue_duration_s":1.439965,"scheduling_latency_s":1.440038}1596gitlab # [ 189.613241] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:05.128Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1597gitlab # [ 189.629704] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:05.146Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"4b150677791e98224d09ac67","created_at":"2026-09-06T06:49:03.658Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a771d79f62e3fc4586a875bbfc464d8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:03.662Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-4b150677791e98224d09ac67: done: 0.043306 sec","job_status":"done","queue_duration_s":1.439965,"scheduling_latency_s":1.440038,"redis_calls":7,"redis_duration_s":0.004468,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002907,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001561,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021232,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.043306,"completed_at":"2026-09-06T06:49:05.145Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1598gitlab # [ 189.638254] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:05.152Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"3c1174103bd992f396d0c9b5","created_at":"2026-09-06T06:49:03.670Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"acfc48406f57ecf1220c69b1a4e2fc69","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:03.674Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-3c1174103bd992f396d0c9b5: start","job_status":"start","queue_duration_s":1.477958,"scheduling_latency_s":1.478016}1599gitlab # [ 189.683722] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:05.200Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"3c1174103bd992f396d0c9b5","created_at":"2026-09-06T06:49:03.670Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"acfc48406f57ecf1220c69b1a4e2fc69","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:03.674Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-3c1174103bd992f396d0c9b5: done: 0.047603 sec","job_status":"done","queue_duration_s":1.477958,"scheduling_latency_s":1.478016,"redis_calls":7,"redis_duration_s":0.003728,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002747,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000981,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019919,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.047603,"completed_at":"2026-09-06T06:49:05.200Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010118,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1600gitlab # [ 189.710317] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:05.207Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"74cfba58b97233c86962daa8","created_at":"2026-09-06T06:49:03.707Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"974e32a54df09a3f5d6ffc2feec36ea4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-06T06:49:03.712Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-74cfba58b97233c86962daa8: start","job_status":"start","queue_duration_s":1.495401,"scheduling_latency_s":1.495468}1601gitlab # [ 189.731909] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:05.228Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1602gitlab # [ 189.737146] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:05.237Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"74cfba58b97233c86962daa8","created_at":"2026-09-06T06:49:03.707Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"974e32a54df09a3f5d6ffc2feec36ea4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-06T06:49:03.712Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-74cfba58b97233c86962daa8: done: 0.029745 sec","job_status":"done","queue_duration_s":1.495401,"scheduling_latency_s":1.495468,"redis_calls":7,"redis_duration_s":0.004005,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002484,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001521,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01584,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029745,"completed_at":"2026-09-06T06:49:05.237Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1603gitlab # [ 189.827384] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:05.238Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"179f0287a6a7331561869bd4","created_at":"2026-09-06T06:49:03.728Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20d5120ac2c3225630864a56211c457d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:03.733Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-179f0287a6a7331561869bd4: start","job_status":"start","queue_duration_s":1.505591,"scheduling_latency_s":1.505613}1604gitlab # [ 189.828817] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:05.246Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1605gitlab # [ 189.830448] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:05.250Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"179f0287a6a7331561869bd4","created_at":"2026-09-06T06:49:03.728Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20d5120ac2c3225630864a56211c457d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:03.733Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-179f0287a6a7331561869bd4: done: 0.011854 sec","job_status":"done","queue_duration_s":1.505591,"scheduling_latency_s":1.505613,"redis_calls":7,"redis_duration_s":0.001722,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00113,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000592,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007039,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011854,"completed_at":"2026-09-06T06:49:05.250Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1606gitlab # [ 189.906575] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:05.252Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"66b6c35732b0e70164d7595c","created_at":"2026-09-06T06:49:03.745Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"15f784513778bab647fb4936576e4898","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:03.749Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-66b6c35732b0e70164d7595c: start","job_status":"start","queue_duration_s":1.502776,"scheduling_latency_s":1.502797}1607gitlab # [ 189.913486] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:05.426Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"66b6c35732b0e70164d7595c","created_at":"2026-09-06T06:49:03.745Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"15f784513778bab647fb4936576e4898","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:03.749Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-66b6c35732b0e70164d7595c: done: 0.174153 sec","job_status":"done","queue_duration_s":1.502776,"scheduling_latency_s":1.502797,"redis_calls":9,"redis_duration_s":0.002274,"redis_read_bytes":7,"redis_write_bytes":987,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001162,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001112,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.032,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.122236,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000506489,"exclusive_lock_hold_duration_s":0.159724211,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.174153,"completed_at":"2026-09-06T06:49:05.426Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.059809,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1608gitlab # [ 189.985657] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:05.427Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"936d48f6e6e7bb45fb3e009b","created_at":"2026-09-06T06:49:03.760Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b0aefb848e68dc5aa8dabe02d0469e44","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:03.763Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-936d48f6e6e7bb45fb3e009b: start","job_status":"start","queue_duration_s":1.66418,"scheduling_latency_s":1.664202}1609gitlab # [ 190.004402] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:05.453Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"936d48f6e6e7bb45fb3e009b","created_at":"2026-09-06T06:49:03.760Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b0aefb848e68dc5aa8dabe02d0469e44","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:03.763Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-936d48f6e6e7bb45fb3e009b: done: 0.025934 sec","job_status":"done","queue_duration_s":1.66418,"scheduling_latency_s":1.664202,"redis_calls":9,"redis_duration_s":0.002282,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001152,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00113,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013344,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000573537,"exclusive_lock_hold_duration_s":0.008665068,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.025934,"completed_at":"2026-09-06T06:49:05.453Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007689,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1610gitlab # [ 190.084509] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:05.455Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"8fdd67cb5eb8ec7dc75a6856","created_at":"2026-09-06T06:49:03.774Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"43a1664d5c26922f5aa86134df5e711b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:03.781Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-8fdd67cb5eb8ec7dc75a6856: start","job_status":"start","queue_duration_s":1.673892,"scheduling_latency_s":1.673913}1611gitlab # [ 190.095167] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:05.463Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1612gitlab # [ 190.101383] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:05.467Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"8fdd67cb5eb8ec7dc75a6856","created_at":"2026-09-06T06:49:03.774Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"43a1664d5c26922f5aa86134df5e711b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:03.781Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-8fdd67cb5eb8ec7dc75a6856: done: 0.012318 sec","job_status":"done","queue_duration_s":1.673892,"scheduling_latency_s":1.673913,"redis_calls":7,"redis_duration_s":0.0017439999999999999,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001227,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000517,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007585,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012318,"completed_at":"2026-09-06T06:49:05.467Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1613gitlab # [ 190.192496] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:05.469Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"116446f511a27c6338c815fd","created_at":"2026-09-06T06:49:03.806Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8bfc393696e86fbcd9a84c3bff2ac2a0","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:03.814Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-116446f511a27c6338c815fd: start","job_status":"start","queue_duration_s":1.654897,"scheduling_latency_s":1.654918}1614gitlab # [ 190.194454] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:05.485Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"116446f511a27c6338c815fd","created_at":"2026-09-06T06:49:03.806Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8bfc393696e86fbcd9a84c3bff2ac2a0","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:03.814Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-116446f511a27c6338c815fd: done: 0.016707 sec","job_status":"done","queue_duration_s":1.654897,"scheduling_latency_s":1.654918,"redis_calls":7,"redis_duration_s":0.001776,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001229,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000547,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00805,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.016707,"completed_at":"2026-09-06T06:49:05.485Z","load_balancing_strategy":"primary","db_duration_s":0.004207,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1615gitlab # [ 190.278349] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:05.487Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"96ef28aae6a0b1a369d3d622","created_at":"2026-09-06T06:49:03.910Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9d6725fa3d3e57e7393b7271f2021bef","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:03.916Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-96ef28aae6a0b1a369d3d622: start","job_status":"start","queue_duration_s":1.571015,"scheduling_latency_s":1.571036}1616gitlab # [ 190.279905] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:05.499Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"96ef28aae6a0b1a369d3d622","created_at":"2026-09-06T06:49:03.910Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9d6725fa3d3e57e7393b7271f2021bef","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:03.916Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-96ef28aae6a0b1a369d3d622: done: 0.012328 sec","job_status":"done","queue_duration_s":1.571015,"scheduling_latency_s":1.571036,"redis_calls":7,"redis_duration_s":0.0016849999999999999,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001174,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000511,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007544,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012328,"completed_at":"2026-09-06T06:49:05.499Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1617gitlab # [ 190.360594] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:05.500Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"10aa5a44e15d5f49a0ff1af3","created_at":"2026-09-06T06:49:04.008Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"912f3b64f4fcd6e9ddced22f8cfe5242","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.023Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-10aa5a44e15d5f49a0ff1af3: start","job_status":"start","queue_duration_s":1.477343,"scheduling_latency_s":1.477494}1618gitlab # [ 190.362715] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:05.517Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"10aa5a44e15d5f49a0ff1af3","created_at":"2026-09-06T06:49:04.008Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"912f3b64f4fcd6e9ddced22f8cfe5242","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.023Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-10aa5a44e15d5f49a0ff1af3: done: 0.017188 sec","job_status":"done","queue_duration_s":1.477343,"scheduling_latency_s":1.477494,"redis_calls":10,"redis_duration_s":0.00238,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001376,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001004,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010515,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.003397638,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.017188,"completed_at":"2026-09-06T06:49:05.517Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001597,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1619gitlab # [ 190.457644] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:05.519Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"41f96069753b6f91c62f1e32","created_at":"2026-09-06T06:49:04.033Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"26d28dc84956524b38769b29cc646d40","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-06T06:49:04.036Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-41f96069753b6f91c62f1e32: start","job_status":"start","queue_duration_s":1.482385,"scheduling_latency_s":1.482406}1620gitlab # [ 190.459622] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:05.536Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"41f96069753b6f91c62f1e32","created_at":"2026-09-06T06:49:04.033Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"26d28dc84956524b38769b29cc646d40","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-06T06:49:04.036Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-41f96069753b6f91c62f1e32: done: 0.017221 sec","job_status":"done","queue_duration_s":1.482385,"scheduling_latency_s":1.482406,"redis_calls":7,"redis_duration_s":0.001585,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001156,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000429,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011212,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017221,"completed_at":"2026-09-06T06:49:05.536Z","load_balancing_strategy":"primary","db_duration_s":0.001117,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1621gitlab # [ 190.575153] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:05.579Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"91a17ab317365af2df257a00","created_at":"2026-09-06T06:49:04.060Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab1b65f1bcc69c2c33ef376323e81bea","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.062Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-91a17ab317365af2df257a00: start","job_status":"start","queue_duration_s":1.516868,"scheduling_latency_s":1.517055}1622gitlab # [ 190.576485] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:05.596Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"91a17ab317365af2df257a00","created_at":"2026-09-06T06:49:04.060Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab1b65f1bcc69c2c33ef376323e81bea","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.062Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-91a17ab317365af2df257a00: done: 0.016899 sec","job_status":"done","queue_duration_s":1.516868,"scheduling_latency_s":1.517055,"redis_calls":9,"redis_duration_s":0.0026880000000000003,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001293,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001395,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000503975,"exclusive_lock_hold_duration_s":0.002424609,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.016899,"completed_at":"2026-09-06T06:49:05.596Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000947,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1623gitlab # [ 190.602369] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:05.597Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"bac80e263eaca2ce9b78d371","created_at":"2026-09-06T06:49:04.087Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2cb860eb01f584ff3710e0e5cfcec1e5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.098Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-bac80e263eaca2ce9b78d371: start","job_status":"start","queue_duration_s":1.498753,"scheduling_latency_s":1.498774}1624gitlab # [ 190.624526] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:05.614Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"bac80e263eaca2ce9b78d371","created_at":"2026-09-06T06:49:04.087Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2cb860eb01f584ff3710e0e5cfcec1e5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.098Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-bac80e263eaca2ce9b78d371: done: 0.01672 sec","job_status":"done","queue_duration_s":1.498753,"scheduling_latency_s":1.498774,"redis_calls":9,"redis_duration_s":0.002268,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001196,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001072,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009216,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000455644,"exclusive_lock_hold_duration_s":0.003945753,"duration_s":0.01672,"completed_at":"2026-09-06T06:49:05.614Z","load_balancing_strategy":"primary","db_duration_s":0.000758,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1625gitlab # [ 190.720248] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:05.615Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"f116f404080bcdca343a9081","created_at":"2026-09-06T06:49:04.115Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3dae2687577b4f97d3aedcea54ee400b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.209Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-f116f404080bcdca343a9081: start","job_status":"start","queue_duration_s":1.40631,"scheduling_latency_s":1.406331}1626gitlab # [ 190.721888] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.032Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"f116f404080bcdca343a9081","created_at":"2026-09-06T06:49:04.115Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-9dfa0616e2124ed4","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3dae2687577b4f97d3aedcea54ee400b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.209Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-f116f404080bcdca343a9081: done: 0.416997 sec","job_status":"done","queue_duration_s":1.40631,"scheduling_latency_s":1.406331,"redis_calls":12,"redis_duration_s":0.003598,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000519,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001752,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001327,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.10566,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000589181,"exclusive_lock_hold_duration_s":0.29365575800000004,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.416997,"completed_at":"2026-09-06T06:49:06.032Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.204334,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null}1627gitlab # [ 190.804056] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.034Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20b4b41cd590a1aae4e90a1f","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20b4b41cd590a1aae4e90a1f: start","job_status":"start","queue_duration_s":1.122616,"scheduling_latency_s":1.122638}1628gitlab # [ 190.805384] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.052Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20b4b41cd590a1aae4e90a1f","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20b4b41cd590a1aae4e90a1f: done: 0.018082 sec","job_status":"done","queue_duration_s":1.122616,"scheduling_latency_s":1.122638,"redis_calls":13,"redis_duration_s":0.003744,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000972,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002772,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010856,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018082,"completed_at":"2026-09-06T06:49:06.052Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1629gitlab # [ 190.919513] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.053Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9440092e451476510e596347","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9440092e451476510e596347: start","job_status":"start","queue_duration_s":1.142036,"scheduling_latency_s":1.142058}1630gitlab # [ 190.920965] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.069Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9440092e451476510e596347","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9440092e451476510e596347: done: 0.015505 sec","job_status":"done","queue_duration_s":1.142036,"scheduling_latency_s":1.142058,"redis_calls":13,"redis_duration_s":0.0030039999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000901,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002103,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00984,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015505,"completed_at":"2026-09-06T06:49:06.069Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1631gitlab # [ 190.940167] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.070Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07a9d189a7d01db19432524e","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07a9d189a7d01db19432524e: start","job_status":"start","queue_duration_s":1.158859,"scheduling_latency_s":1.158881}1632gitlab # [ 191.014470] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.086Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07a9d189a7d01db19432524e","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07a9d189a7d01db19432524e: done: 0.015443 sec","job_status":"done","queue_duration_s":1.158859,"scheduling_latency_s":1.158881,"redis_calls":13,"redis_duration_s":0.003013,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001017,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009624,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015443,"completed_at":"2026-09-06T06:49:06.086Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1633gitlab # [ 191.020340] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.087Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"070a74e4c07282f25579e787","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-070a74e4c07282f25579e787: start","job_status":"start","queue_duration_s":1.175659,"scheduling_latency_s":1.17568}1634gitlab # [ 191.095421] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.103Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"070a74e4c07282f25579e787","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-070a74e4c07282f25579e787: done: 0.015642 sec","job_status":"done","queue_duration_s":1.175659,"scheduling_latency_s":1.17568,"redis_calls":13,"redis_duration_s":0.003081,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001007,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002074,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0101,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015642,"completed_at":"2026-09-06T06:49:06.103Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1635gitlab # [ 191.099750] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.104Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b92bf0c810ef1238a69c4a9","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b92bf0c810ef1238a69c4a9: start","job_status":"start","queue_duration_s":1.192703,"scheduling_latency_s":1.192724}1636gitlab # [ 191.177530] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.119Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b92bf0c810ef1238a69c4a9","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b92bf0c810ef1238a69c4a9: done: 0.015316 sec","job_status":"done","queue_duration_s":1.192703,"scheduling_latency_s":1.192724,"redis_calls":13,"redis_duration_s":0.003071,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000932,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002139,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009657,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015316,"completed_at":"2026-09-06T06:49:06.119Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1637gitlab # [ 191.180324] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.121Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cae0e2f3c24809c6c65e0a45","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cae0e2f3c24809c6c65e0a45: start","job_status":"start","queue_duration_s":1.209362,"scheduling_latency_s":1.209384}1638gitlab # [ 191.200167] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.136Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cae0e2f3c24809c6c65e0a45","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cae0e2f3c24809c6c65e0a45: done: 0.015766 sec","job_status":"done","queue_duration_s":1.209362,"scheduling_latency_s":1.209384,"redis_calls":13,"redis_duration_s":0.002888,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000927,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001961,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009672,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015766,"completed_at":"2026-09-06T06:49:06.136Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1639gitlab # [ 191.269181] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.138Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe19a157b0b8f8e133c04409","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe19a157b0b8f8e133c04409: start","job_status":"start","queue_duration_s":1.226523,"scheduling_latency_s":1.226545}1640gitlab # [ 191.346099] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.153Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe19a157b0b8f8e133c04409","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe19a157b0b8f8e133c04409: done: 0.015501 sec","job_status":"done","queue_duration_s":1.226523,"scheduling_latency_s":1.226545,"redis_calls":13,"redis_duration_s":0.003111,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000948,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002163,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015501,"completed_at":"2026-09-06T06:49:06.153Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1641gitlab # [ 191.348199] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.155Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08f89972829d55c99ded3568","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08f89972829d55c99ded3568: start","job_status":"start","queue_duration_s":1.243346,"scheduling_latency_s":1.243369}1642gitlab # [ 191.360370] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.170Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08f89972829d55c99ded3568","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08f89972829d55c99ded3568: done: 0.015461 sec","job_status":"done","queue_duration_s":1.243346,"scheduling_latency_s":1.243369,"redis_calls":13,"redis_duration_s":0.003054,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000888,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002166,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009598,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015461,"completed_at":"2026-09-06T06:49:06.170Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1643gitlab # [ 191.464084] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.171Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3065080f6cfd77a3eac92056","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3065080f6cfd77a3eac92056: start","job_status":"start","queue_duration_s":1.260123,"scheduling_latency_s":1.260143}1644gitlab # [ 191.465514] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.187Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3065080f6cfd77a3eac92056","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3065080f6cfd77a3eac92056: done: 0.015444 sec","job_status":"done","queue_duration_s":1.260123,"scheduling_latency_s":1.260143,"redis_calls":13,"redis_duration_s":0.003071,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00212,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009908,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015444,"completed_at":"2026-09-06T06:49:06.187Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1645gitlab # [ 191.534823] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.188Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d377f9436b97df6d5bbf03e","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d377f9436b97df6d5bbf03e: start","job_status":"start","queue_duration_s":1.276902,"scheduling_latency_s":1.276923}1646gitlab # [ 191.536110] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.204Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d377f9436b97df6d5bbf03e","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d377f9436b97df6d5bbf03e: done: 0.015394 sec","job_status":"done","queue_duration_s":1.276902,"scheduling_latency_s":1.276923,"redis_calls":13,"redis_duration_s":0.0030029999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001021,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001982,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009877,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015394,"completed_at":"2026-09-06T06:49:06.204Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1647gitlab # [ 191.608247] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.205Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c656bf98ab59fc955e9a9132","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c656bf98ab59fc955e9a9132: start","job_status":"start","queue_duration_s":1.293673,"scheduling_latency_s":1.293695}1648gitlab # [ 191.609390] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.221Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c656bf98ab59fc955e9a9132","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c656bf98ab59fc955e9a9132: done: 0.015537 sec","job_status":"done","queue_duration_s":1.293673,"scheduling_latency_s":1.293695,"redis_calls":13,"redis_duration_s":0.002918,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000967,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001951,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009827,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015537,"completed_at":"2026-09-06T06:49:06.220Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1649gitlab # [ 191.693303] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.222Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3539b0770addb27f46eab8d6","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3539b0770addb27f46eab8d6: start","job_status":"start","queue_duration_s":1.310657,"scheduling_latency_s":1.310679}1650gitlab # [ 191.694765] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.237Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3539b0770addb27f46eab8d6","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3539b0770addb27f46eab8d6: done: 0.015241 sec","job_status":"done","queue_duration_s":1.310657,"scheduling_latency_s":1.310679,"redis_calls":13,"redis_duration_s":0.00305,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000925,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002125,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009692,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015241,"completed_at":"2026-09-06T06:49:06.237Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1651gitlab # [ 191.775260] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.239Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a327ae2b118909cb5354f9a","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a327ae2b118909cb5354f9a: start","job_status":"start","queue_duration_s":1.327213,"scheduling_latency_s":1.327243}1652gitlab # [ 191.776926] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.254Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a327ae2b118909cb5354f9a","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a327ae2b118909cb5354f9a: done: 0.015375 sec","job_status":"done","queue_duration_s":1.327213,"scheduling_latency_s":1.327243,"redis_calls":13,"redis_duration_s":0.003147,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00096,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002187,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009692,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015375,"completed_at":"2026-09-06T06:49:06.254Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1653gitlab # [ 191.877483] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.255Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09cd3c5e24e59588b189a028","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09cd3c5e24e59588b189a028: start","job_status":"start","queue_duration_s":1.3439,"scheduling_latency_s":1.343921}1654gitlab # [ 191.879126] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09cd3c5e24e59588b189a028","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09cd3c5e24e59588b189a028: done: 0.015637 sec","job_status":"done","queue_duration_s":1.3439,"scheduling_latency_s":1.343921,"redis_calls":13,"redis_duration_s":0.0029389999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000888,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002051,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009712,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015637,"completed_at":"2026-09-06T06:49:06.271Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1655gitlab # [ 191.908158] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.272Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"057eaf16857dc9b3b2f0b02e","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-057eaf16857dc9b3b2f0b02e: start","job_status":"start","queue_duration_s":1.360939,"scheduling_latency_s":1.36096}1656gitlab # [ 191.928114] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.288Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"057eaf16857dc9b3b2f0b02e","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-057eaf16857dc9b3b2f0b02e: done: 0.015441 sec","job_status":"done","queue_duration_s":1.360939,"scheduling_latency_s":1.36096,"redis_calls":13,"redis_duration_s":0.0028770000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000923,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001954,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00984,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015441,"completed_at":"2026-09-06T06:49:06.288Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1657gitlab # [ 192.008237] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.289Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37332252cd82dc67be0bf32c","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37332252cd82dc67be0bf32c: start","job_status":"start","queue_duration_s":1.377826,"scheduling_latency_s":1.377848}1658gitlab # [ 192.009854] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.304Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37332252cd82dc67be0bf32c","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37332252cd82dc67be0bf32c: done: 0.015354 sec","job_status":"done","queue_duration_s":1.377826,"scheduling_latency_s":1.377848,"redis_calls":13,"redis_duration_s":0.002972,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000964,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002008,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009621,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015354,"completed_at":"2026-09-06T06:49:06.304Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1659gitlab # [ 192.098249] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.306Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b119756394e7249d462ce782","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b119756394e7249d462ce782: start","job_status":"start","queue_duration_s":1.394762,"scheduling_latency_s":1.394783}1660gitlab # [ 192.099964] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.322Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b119756394e7249d462ce782","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b119756394e7249d462ce782: done: 0.015521 sec","job_status":"done","queue_duration_s":1.394762,"scheduling_latency_s":1.394783,"redis_calls":13,"redis_duration_s":0.003337,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001384,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001953,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009735,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015521,"completed_at":"2026-09-06T06:49:06.322Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1661gitlab # [ 192.205309] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.323Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17cc6501b020234d45f374a4","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17cc6501b020234d45f374a4: start","job_status":"start","queue_duration_s":1.411719,"scheduling_latency_s":1.41174}1662gitlab # [ 192.206917] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.338Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17cc6501b020234d45f374a4","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17cc6501b020234d45f374a4: done: 0.015266 sec","job_status":"done","queue_duration_s":1.411719,"scheduling_latency_s":1.41174,"redis_calls":13,"redis_duration_s":0.0029040000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00093,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001974,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009753,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015266,"completed_at":"2026-09-06T06:49:06.338Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1663gitlab # [ 192.281360] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.340Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b44011ec87274f9909d9fd4","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b44011ec87274f9909d9fd4: start","job_status":"start","queue_duration_s":1.428307,"scheduling_latency_s":1.428328}1664gitlab # [ 192.282466] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.355Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b44011ec87274f9909d9fd4","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b44011ec87274f9909d9fd4: done: 0.015812 sec","job_status":"done","queue_duration_s":1.428307,"scheduling_latency_s":1.428328,"redis_calls":13,"redis_duration_s":0.002996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000942,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002054,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009805,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015812,"completed_at":"2026-09-06T06:49:06.355Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1665gitlab # [ 192.358295] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.357Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d84c20bfbb3a2d37ae8458a6","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d84c20bfbb3a2d37ae8458a6: start","job_status":"start","queue_duration_s":1.445603,"scheduling_latency_s":1.445624}1666gitlab # [ 192.359499] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.372Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d84c20bfbb3a2d37ae8458a6","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d84c20bfbb3a2d37ae8458a6: done: 0.015457 sec","job_status":"done","queue_duration_s":1.445603,"scheduling_latency_s":1.445624,"redis_calls":13,"redis_duration_s":0.00305,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000922,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002128,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009831,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015457,"completed_at":"2026-09-06T06:49:06.372Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1667gitlab # [ 192.428241] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.374Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2cb5ee64c68f659591964849","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2cb5ee64c68f659591964849: start","job_status":"start","queue_duration_s":1.462404,"scheduling_latency_s":1.46247}1668gitlab # [ 192.429882] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.389Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2cb5ee64c68f659591964849","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2cb5ee64c68f659591964849: done: 0.01536 sec","job_status":"done","queue_duration_s":1.462404,"scheduling_latency_s":1.46247,"redis_calls":13,"redis_duration_s":0.003062,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000883,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002179,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009718,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01536,"completed_at":"2026-09-06T06:49:06.389Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1669gitlab # [ 192.502806] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.390Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73d3127f4fb296287ce90d14","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73d3127f4fb296287ce90d14: start","job_status":"start","queue_duration_s":1.479098,"scheduling_latency_s":1.479119}1670gitlab # [ 192.504203] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.406Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73d3127f4fb296287ce90d14","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73d3127f4fb296287ce90d14: done: 0.015337 sec","job_status":"done","queue_duration_s":1.479098,"scheduling_latency_s":1.479119,"redis_calls":13,"redis_duration_s":0.0030250000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000893,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002132,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009828,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015337,"completed_at":"2026-09-06T06:49:06.406Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1671gitlab # [ 192.593251] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.407Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"767529c7ffb1dc736cb445ea","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-767529c7ffb1dc736cb445ea: start","job_status":"start","queue_duration_s":1.495803,"scheduling_latency_s":1.496004}1672gitlab # [ 192.594547] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.423Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"767529c7ffb1dc736cb445ea","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-767529c7ffb1dc736cb445ea: done: 0.015417 sec","job_status":"done","queue_duration_s":1.495803,"scheduling_latency_s":1.496004,"redis_calls":13,"redis_duration_s":0.0030050000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000955,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00205,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009749,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015417,"completed_at":"2026-09-06T06:49:06.422Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1673gitlab # [ 192.689354] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.424Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c093c7172f0f23067255e04","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c093c7172f0f23067255e04: start","job_status":"start","queue_duration_s":1.512585,"scheduling_latency_s":1.512605}1674gitlab # [ 192.690517] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.439Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c093c7172f0f23067255e04","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c093c7172f0f23067255e04: done: 0.015224 sec","job_status":"done","queue_duration_s":1.512585,"scheduling_latency_s":1.512605,"redis_calls":13,"redis_duration_s":0.003053,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00088,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002173,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009729,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015224,"completed_at":"2026-09-06T06:49:06.439Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1675gitlab # [ 192.716396] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.440Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63473b44f15e3e059e9af922","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63473b44f15e3e059e9af922: start","job_status":"start","queue_duration_s":1.529134,"scheduling_latency_s":1.529155}1676gitlab # [ 192.735915] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.456Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63473b44f15e3e059e9af922","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63473b44f15e3e059e9af922: done: 0.01571 sec","job_status":"done","queue_duration_s":1.529134,"scheduling_latency_s":1.529155,"redis_calls":13,"redis_duration_s":0.003276,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000902,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002374,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009853,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01571,"completed_at":"2026-09-06T06:49:06.456Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1677gitlab # [ 192.862842] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.458Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"910c25d6e566830c64521337","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-910c25d6e566830c64521337: start","job_status":"start","queue_duration_s":1.546183,"scheduling_latency_s":1.546204}1678gitlab # [ 192.864236] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.473Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"910c25d6e566830c64521337","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-910c25d6e566830c64521337: done: 0.015611 sec","job_status":"done","queue_duration_s":1.546183,"scheduling_latency_s":1.546204,"redis_calls":13,"redis_duration_s":0.0030289999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000913,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002116,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009759,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015611,"completed_at":"2026-09-06T06:49:06.473Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1679gitlab # [ 192.942331] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.474Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d8920d9d8b6e38db1b2f231","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d8920d9d8b6e38db1b2f231: start","job_status":"start","queue_duration_s":1.563145,"scheduling_latency_s":1.563166}1680gitlab # [ 192.943464] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.491Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d8920d9d8b6e38db1b2f231","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d8920d9d8b6e38db1b2f231: done: 0.016845 sec","job_status":"done","queue_duration_s":1.563145,"scheduling_latency_s":1.563166,"redis_calls":13,"redis_duration_s":0.002946,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000915,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002031,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009667,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016845,"completed_at":"2026-09-06T06:49:06.491Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1681gitlab # [ 193.011409] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.493Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"445e1180bf0a7fc6d834556f","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-445e1180bf0a7fc6d834556f: start","job_status":"start","queue_duration_s":1.581302,"scheduling_latency_s":1.581324}1682gitlab # [ 193.013054] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.508Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"445e1180bf0a7fc6d834556f","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-445e1180bf0a7fc6d834556f: done: 0.014925 sec","job_status":"done","queue_duration_s":1.581302,"scheduling_latency_s":1.581324,"redis_calls":13,"redis_duration_s":0.002868,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000922,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001946,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009499,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014925,"completed_at":"2026-09-06T06:49:06.507Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1683gitlab # [ 193.086290] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.509Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f6587e0113ae59c50f9e7c3","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f6587e0113ae59c50f9e7c3: start","job_status":"start","queue_duration_s":1.597651,"scheduling_latency_s":1.597671}1684gitlab # [ 193.087916] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.524Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f6587e0113ae59c50f9e7c3","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f6587e0113ae59c50f9e7c3: done: 0.015252 sec","job_status":"done","queue_duration_s":1.597651,"scheduling_latency_s":1.597671,"redis_calls":13,"redis_duration_s":0.003044,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000891,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002153,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009703,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015252,"completed_at":"2026-09-06T06:49:06.524Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1685gitlab # [ 193.170300] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.526Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3fa600f7fd9b66f88bf82ee6","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3fa600f7fd9b66f88bf82ee6: start","job_status":"start","queue_duration_s":1.614258,"scheduling_latency_s":1.614279}1686gitlab # [ 193.171457] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.541Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3fa600f7fd9b66f88bf82ee6","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3fa600f7fd9b66f88bf82ee6: done: 0.015466 sec","job_status":"done","queue_duration_s":1.614258,"scheduling_latency_s":1.614279,"redis_calls":13,"redis_duration_s":0.002872,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000875,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001997,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00962,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015466,"completed_at":"2026-09-06T06:49:06.541Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1687gitlab # [ 193.245437] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.542Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"843be993a2a90bf30ce3661b","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-843be993a2a90bf30ce3661b: start","job_status":"start","queue_duration_s":1.631053,"scheduling_latency_s":1.631073}1688gitlab # [ 193.246605] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.558Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"843be993a2a90bf30ce3661b","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-843be993a2a90bf30ce3661b: done: 0.015656 sec","job_status":"done","queue_duration_s":1.631053,"scheduling_latency_s":1.631073,"redis_calls":13,"redis_duration_s":0.002972,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000866,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002106,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009731,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015656,"completed_at":"2026-09-06T06:49:06.558Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1689gitlab # [ 193.280075] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.559Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d7b6e08af7064bf86e7d0fa","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d7b6e08af7064bf86e7d0fa: start","job_status":"start","queue_duration_s":1.648078,"scheduling_latency_s":1.648099}1690gitlab # [ 193.299083] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.575Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d7b6e08af7064bf86e7d0fa","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d7b6e08af7064bf86e7d0fa: done: 0.015227 sec","job_status":"done","queue_duration_s":1.648078,"scheduling_latency_s":1.648099,"redis_calls":13,"redis_duration_s":0.002976,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000885,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009617,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015227,"completed_at":"2026-09-06T06:49:06.575Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1691gitlab # [ 193.367183] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.576Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c78c1dd99a487927b7dc37da","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c78c1dd99a487927b7dc37da: start","job_status":"start","queue_duration_s":1.66463,"scheduling_latency_s":1.664652}1692gitlab # [ 193.378995] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.591Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c78c1dd99a487927b7dc37da","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c78c1dd99a487927b7dc37da: done: 0.015258 sec","job_status":"done","queue_duration_s":1.66463,"scheduling_latency_s":1.664652,"redis_calls":13,"redis_duration_s":0.002929,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00088,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002049,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009612,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015258,"completed_at":"2026-09-06T06:49:06.591Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1693gitlab # [ 193.455959] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.593Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27ca548ad4accc0ededfef5d","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27ca548ad4accc0ededfef5d: start","job_status":"start","queue_duration_s":1.681201,"scheduling_latency_s":1.681229}1694gitlab # [ 193.459397] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.608Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27ca548ad4accc0ededfef5d","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27ca548ad4accc0ededfef5d: done: 0.015138 sec","job_status":"done","queue_duration_s":1.681201,"scheduling_latency_s":1.681229,"redis_calls":13,"redis_duration_s":0.0029130000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00088,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002033,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009622,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015138,"completed_at":"2026-09-06T06:49:06.608Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1695gitlab # [ 193.537200] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.609Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d63cc240968beaaf26b5e4c0","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d63cc240968beaaf26b5e4c0: start","job_status":"start","queue_duration_s":1.697731,"scheduling_latency_s":1.697753}1696gitlab # [ 193.605411] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.624Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d63cc240968beaaf26b5e4c0","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d63cc240968beaaf26b5e4c0: done: 0.015206 sec","job_status":"done","queue_duration_s":1.697731,"scheduling_latency_s":1.697753,"redis_calls":13,"redis_duration_s":0.002916,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000915,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009631,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015206,"completed_at":"2026-09-06T06:49:06.624Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1697gitlab # [ 193.607216] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.626Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f62ff6c7095fd73960505d5","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f62ff6c7095fd73960505d5: start","job_status":"start","queue_duration_s":1.714266,"scheduling_latency_s":1.714288}1698gitlab # [ 193.620226] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.641Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f62ff6c7095fd73960505d5","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f62ff6c7095fd73960505d5: done: 0.015343 sec","job_status":"done","queue_duration_s":1.714266,"scheduling_latency_s":1.714288,"redis_calls":13,"redis_duration_s":0.002998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000933,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002065,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009663,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015343,"completed_at":"2026-09-06T06:49:06.641Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1699gitlab # [ 193.701185] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.642Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0df9498ee0cf0fe6f1bad1e5","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0df9498ee0cf0fe6f1bad1e5: start","job_status":"start","queue_duration_s":1.730948,"scheduling_latency_s":1.73097}1700gitlab # [ 193.702291] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.657Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0df9498ee0cf0fe6f1bad1e5","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0df9498ee0cf0fe6f1bad1e5: done: 0.015203 sec","job_status":"done","queue_duration_s":1.730948,"scheduling_latency_s":1.73097,"redis_calls":13,"redis_duration_s":0.0030600000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000923,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002137,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009553,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015203,"completed_at":"2026-09-06T06:49:06.657Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1701gitlab # [ 193.771749] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.659Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca8c7418b6f5df1651f6d780","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca8c7418b6f5df1651f6d780: start","job_status":"start","queue_duration_s":1.747508,"scheduling_latency_s":1.74753}1702gitlab # [ 193.780368] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.674Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca8c7418b6f5df1651f6d780","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca8c7418b6f5df1651f6d780: done: 0.014932 sec","job_status":"done","queue_duration_s":1.747508,"scheduling_latency_s":1.74753,"redis_calls":13,"redis_duration_s":0.002931,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002014,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009456,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014932,"completed_at":"2026-09-06T06:49:06.674Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1703gitlab # [ 193.858223] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.675Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0cada919b8f74bb31e3a7ea3","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0cada919b8f74bb31e3a7ea3: start","job_status":"start","queue_duration_s":1.763777,"scheduling_latency_s":1.763797}1704gitlab # [ 193.860518] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.690Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0cada919b8f74bb31e3a7ea3","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0cada919b8f74bb31e3a7ea3: done: 0.015323 sec","job_status":"done","queue_duration_s":1.763777,"scheduling_latency_s":1.763797,"redis_calls":13,"redis_duration_s":0.003166,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001059,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002107,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009831,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015323,"completed_at":"2026-09-06T06:49:06.690Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1705gitlab # [ 193.933187] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.692Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d39b6da229ade10fd37a4873","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d39b6da229ade10fd37a4873: start","job_status":"start","queue_duration_s":1.780473,"scheduling_latency_s":1.780502}1706gitlab # [ 193.940464] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.707Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d39b6da229ade10fd37a4873","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d39b6da229ade10fd37a4873: done: 0.01533 sec","job_status":"done","queue_duration_s":1.780473,"scheduling_latency_s":1.780502,"redis_calls":13,"redis_duration_s":0.0030659999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000875,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002191,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009657,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01533,"completed_at":"2026-09-06T06:49:06.707Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1707gitlab # [ 194.019117] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.708Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e46e0498813cbb52f137b46c","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e46e0498813cbb52f137b46c: start","job_status":"start","queue_duration_s":1.7971,"scheduling_latency_s":1.797121}1708gitlab # [ 194.021095] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.724Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e46e0498813cbb52f137b46c","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e46e0498813cbb52f137b46c: done: 0.0152 sec","job_status":"done","queue_duration_s":1.7971,"scheduling_latency_s":1.797121,"redis_calls":13,"redis_duration_s":0.0028850000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000923,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001962,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009689,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0152,"completed_at":"2026-09-06T06:49:06.724Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1709gitlab # [ 194.101252] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.725Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2149e519f9942508ad905f06","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2149e519f9942508ad905f06: start","job_status":"start","queue_duration_s":1.813681,"scheduling_latency_s":1.813702}1710gitlab # [ 194.102863] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.740Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2149e519f9942508ad905f06","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2149e519f9942508ad905f06: done: 0.015008 sec","job_status":"done","queue_duration_s":1.813681,"scheduling_latency_s":1.813702,"redis_calls":13,"redis_duration_s":0.0030099999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000874,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002136,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009542,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015008,"completed_at":"2026-09-06T06:49:06.740Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1711gitlab # [ 194.176115] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.741Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07ed125f553767bfb1cca8eb","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07ed125f553767bfb1cca8eb: start","job_status":"start","queue_duration_s":1.829988,"scheduling_latency_s":1.83001}1712gitlab # [ 194.181247] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.757Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07ed125f553767bfb1cca8eb","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07ed125f553767bfb1cca8eb: done: 0.015295 sec","job_status":"done","queue_duration_s":1.829988,"scheduling_latency_s":1.83001,"redis_calls":13,"redis_duration_s":0.0028840000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000922,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001962,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009588,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015295,"completed_at":"2026-09-06T06:49:06.757Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1713gitlab # [ 194.250226] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.758Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f748b8f42339791c3eaca9ed","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f748b8f42339791c3eaca9ed: start","job_status":"start","queue_duration_s":1.846655,"scheduling_latency_s":1.846676}1714gitlab # [ 194.320344] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.773Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f748b8f42339791c3eaca9ed","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f748b8f42339791c3eaca9ed: done: 0.015083 sec","job_status":"done","queue_duration_s":1.846655,"scheduling_latency_s":1.846676,"redis_calls":13,"redis_duration_s":0.002954,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000881,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002073,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009549,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015083,"completed_at":"2026-09-06T06:49:06.773Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1715gitlab # [ 194.322179] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d06d9465d74b127eef707fd2","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d06d9465d74b127eef707fd2: start","job_status":"start","queue_duration_s":1.864634,"scheduling_latency_s":1.864656}1716gitlab # [ 194.402575] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.796Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d06d9465d74b127eef707fd2","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d06d9465d74b127eef707fd2: done: 0.02046 sec","job_status":"done","queue_duration_s":1.864634,"scheduling_latency_s":1.864656,"redis_calls":13,"redis_duration_s":0.003156,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000893,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002263,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009893,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02046,"completed_at":"2026-09-06T06:49:06.796Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1717gitlab # [ 194.404951] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.798Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6836795d46d492f9286390c1","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6836795d46d492f9286390c1: start","job_status":"start","queue_duration_s":1.886553,"scheduling_latency_s":1.886575}1718gitlab # [ 194.421750] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.813Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6836795d46d492f9286390c1","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6836795d46d492f9286390c1: done: 0.015191 sec","job_status":"done","queue_duration_s":1.886553,"scheduling_latency_s":1.886575,"redis_calls":13,"redis_duration_s":0.002956,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000878,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002078,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009577,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015191,"completed_at":"2026-09-06T06:49:06.813Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1719gitlab # [ 194.526992] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.814Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10f6f01fea2c1abb30061df5","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10f6f01fea2c1abb30061df5: start","job_status":"start","queue_duration_s":1.903066,"scheduling_latency_s":1.903086}1720gitlab # [ 194.528266] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.829Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10f6f01fea2c1abb30061df5","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10f6f01fea2c1abb30061df5: done: 0.015051 sec","job_status":"done","queue_duration_s":1.903066,"scheduling_latency_s":1.903086,"redis_calls":13,"redis_duration_s":0.002988,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000961,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002027,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009534,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015051,"completed_at":"2026-09-06T06:49:06.829Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1721gitlab # [ 194.599159] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.831Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03e315f6345b38cd1b05e4ba","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03e315f6345b38cd1b05e4ba: start","job_status":"start","queue_duration_s":1.91956,"scheduling_latency_s":1.91958}1722gitlab # [ 194.600287] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.846Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03e315f6345b38cd1b05e4ba","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03e315f6345b38cd1b05e4ba: done: 0.015137 sec","job_status":"done","queue_duration_s":1.91956,"scheduling_latency_s":1.91958,"redis_calls":13,"redis_duration_s":0.003113,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000863,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00225,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009636,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015137,"completed_at":"2026-09-06T06:49:06.846Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1723gitlab # [ 194.672215] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.848Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94b53ceedaee846b447ca628","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94b53ceedaee846b447ca628: start","job_status":"start","queue_duration_s":1.936243,"scheduling_latency_s":1.936264}1724gitlab # [ 194.673829] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.863Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94b53ceedaee846b447ca628","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94b53ceedaee846b447ca628: done: 0.015319 sec","job_status":"done","queue_duration_s":1.936243,"scheduling_latency_s":1.936264,"redis_calls":13,"redis_duration_s":0.0030369999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00091,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002127,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009767,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015319,"completed_at":"2026-09-06T06:49:06.863Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1725gitlab # [ 194.766217] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.864Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c1712837550142f76caf24e9","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c1712837550142f76caf24e9: start","job_status":"start","queue_duration_s":1.952889,"scheduling_latency_s":1.952911}1726gitlab # [ 194.767827] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.880Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c1712837550142f76caf24e9","created_at":"2026-09-06T06:49:04.807Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-5a7c5498938343ee","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6453cd0e2499bd5052aba6072370e5f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.911Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c1712837550142f76caf24e9: done: 0.015314 sec","job_status":"done","queue_duration_s":1.952889,"scheduling_latency_s":1.952911,"redis_calls":13,"redis_duration_s":0.003024,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000941,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002083,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009714,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015314,"completed_at":"2026-09-06T06:49:06.879Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1727gitlab # [ 194.839627] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.881Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6f12ab8413c442a6d0a2bba5","created_at":"2026-09-06T06:49:05.011Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-ca99897f2afc48fc","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8beccda37b4796851f42b59efaed0b00","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.021Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6f12ab8413c442a6d0a2bba5: start","job_status":"start","queue_duration_s":1.859694,"scheduling_latency_s":1.859716}1728gitlab # [ 194.843185] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.892Z","message":"No existing merge request to be cleaned up."}1729gitlab # [ 194.847269] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.898Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6f12ab8413c442a6d0a2bba5","created_at":"2026-09-06T06:49:05.011Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-ca99897f2afc48fc","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8beccda37b4796851f42b59efaed0b00","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.021Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6f12ab8413c442a6d0a2bba5: done: 0.017418 sec","job_status":"done","queue_duration_s":1.859694,"scheduling_latency_s":1.859716,"redis_calls":10,"redis_duration_s":0.002467,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001002,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001465,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011185,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017418,"completed_at":"2026-09-06T06:49:06.898Z","load_balancing_strategy":"primary","db_duration_s":0.001982,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1730gitlab # [ 194.929946] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.900Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"930913db2b4901116e854b13","created_at":"2026-09-06T06:49:05.011Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-ca99897f2afc48fc","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8beccda37b4796851f42b59efaed0b00","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.021Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-930913db2b4901116e854b13: start","job_status":"start","queue_duration_s":1.878525,"scheduling_latency_s":1.878591}1731gitlab # [ 194.931228] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.909Z","message":"No existing merge request to be cleaned up."}1732gitlab # [ 194.932209] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.915Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"930913db2b4901116e854b13","created_at":"2026-09-06T06:49:05.011Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-ca99897f2afc48fc","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8beccda37b4796851f42b59efaed0b00","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.021Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-930913db2b4901116e854b13: done: 0.015487 sec","job_status":"done","queue_duration_s":1.878525,"scheduling_latency_s":1.878591,"redis_calls":10,"redis_duration_s":0.002314,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000879,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001435,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009805,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015487,"completed_at":"2026-09-06T06:49:06.915Z","load_balancing_strategy":"primary","db_duration_s":0.00133,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1733gitlab # [ 195.005207] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.917Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"aa12ce90a7651ba7667a3c6a","created_at":"2026-09-06T06:49:05.011Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-ca99897f2afc48fc","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8beccda37b4796851f42b59efaed0b00","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.021Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-aa12ce90a7651ba7667a3c6a: start","job_status":"start","queue_duration_s":1.895308,"scheduling_latency_s":1.895329}1734gitlab # [ 195.006734] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.926Z","message":"No existing merge request to be cleaned up."}1735gitlab # [ 195.007941] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.932Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"aa12ce90a7651ba7667a3c6a","created_at":"2026-09-06T06:49:05.011Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-ca99897f2afc48fc","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8beccda37b4796851f42b59efaed0b00","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.021Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-aa12ce90a7651ba7667a3c6a: done: 0.015649 sec","job_status":"done","queue_duration_s":1.895308,"scheduling_latency_s":1.895329,"redis_calls":10,"redis_duration_s":0.002398,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000884,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001514,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015649,"completed_at":"2026-09-06T06:49:06.932Z","load_balancing_strategy":"primary","db_duration_s":0.001331,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1736gitlab # [ 195.091144] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.933Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"add87565d3207ff354367eb9","created_at":"2026-09-06T06:49:05.011Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-ca99897f2afc48fc","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8beccda37b4796851f42b59efaed0b00","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.021Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-add87565d3207ff354367eb9: start","job_status":"start","queue_duration_s":1.91227,"scheduling_latency_s":1.91229}1737gitlab # [ 195.092430] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.943Z","message":"No existing merge request to be cleaned up."}1738gitlab # [ 195.093311] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:06.950Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"add87565d3207ff354367eb9","created_at":"2026-09-06T06:49:05.011Z","trace_propagation_headers":{"sentry-trace":"e91678497e2d468e9e7a985ea0dc7461-ca99897f2afc48fc","baggage":"sentry-trace_id=e91678497e2d468e9e7a985ea0dc7461,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8beccda37b4796851f42b59efaed0b00","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.021Z","job_size_bytes":2,"pid":1685,"sidekiq_tid":"maip","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-add87565d3207ff354367eb9: done: 0.016106 sec","job_status":"done","queue_duration_s":1.91227,"scheduling_latency_s":1.91229,"redis_calls":10,"redis_duration_s":0.002641,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001104,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001537,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010174,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016106,"completed_at":"2026-09-06T06:49:06.950Z","load_balancing_strategy":"primary","db_duration_s":0.001345,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1739gitlab # [ 196.252391] postgres[2488]: [2488] ERROR: relation "table_without_models" does not exist1740gitlab # [ 196.255855] postgres[2488]: [2488] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1741gitlab # [ 199.349438] runuser[2276]: pam_unix(runuser:session): session closed for user gitlab1742gitlab # [ 199.351835] setup-gitlab-start[2253]: + systemctl restart gitlab-sidekiq.service1743gitlab # [ 199.375524] systemd[1]: Stopping gitlab-sidekiq.service...1744gitlab # [ 199.380863] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:14.897Z","message":"Shutting down"}1745gitlab # [ 199.382630] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:14.897Z","message":"Scheduler exiting..."}1746gitlab # [ 199.384299] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:14.898Z","message":"Terminating quiet threads for default capsule"}1747gitlab # [ 199.388902] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:14.905Z","message":"Scheduler exiting..."}1748gitlab # [ 199.896277] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:15.412Z","message":"Pausing to allow jobs to finish..."}1749gitlab # [ 201.901137] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:17.416Z","message":"Bye!"}1750gitlab # [ 201.935219] sidekiq-cluster[1685]: {"severity":"INFO","time":"2026-09-06T06:49:17.451Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1685,"worker_id":"sidekiq_0","memwd_rss_bytes":939732992,"retry":0}1751gitlab # [ 203.072142] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1752gitlab # [ 203.076286] systemd[1]: Stopped gitlab-sidekiq.service.1753gitlab # [ 203.078980] systemd[1]: gitlab-sidekiq.service: Consumed 1min 2.760s CPU time over 2min 299ms wall clock time, 956.4M memory peak, 4.4M read from disk.1754gitlab # [ 203.082703] systemd[1]: Started gitlab-sidekiq.service.1755gitlab # [ 203.087217] setup-gitlab-start[2253]: + mkdir -p /var/lib/secrets1756gitlab # [ 203.092238] setup-gitlab-start[2253]: + echo nixbot-test-token-of-20-chars1757gitlab # [ 203.094927] setup-gitlab-start[2253]: + chmod 644 /var/lib/secrets/gitlab-token1758gitlab # [ 203.100132] setup-gitlab-start[2253]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1759gitlab # [ 203.798971] gitaly[914]: time="2026-09-06T06:49:19.315Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN11E7CG2J7WGTKXMKCR3 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T06:49:29.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:19.314" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1760gitlab # [ 203.802471] gitaly[914]: time="2026-09-06T06:49:19.316Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN11E7CG2J7WGTKXMKCR3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T06:49:29.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:19.314" grpc.time_ms=0.939 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1761gitlab # [ 203.973267] gitaly[914]: time="2026-09-06T06:49:19.489Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN11E7CG2J7WGTKXMKCR3 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T06:49:29.178" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:19.489" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1762gitlab # [ 204.014307] gitaly[914]: time="2026-09-06T06:49:19.490Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN11E7CG2J7WGTKXMKCR3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T06:49:29.178" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:19.489" grpc.time_ms=0.45 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1763gitlab # [ 204.108100] gitaly[914]: time="2026-09-06T06:49:19.624Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN11E7CG2J7WGTKXMKCR3 diskcache=64e2420a-a70d-46b8-bbe4-dffd4a7d0083 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-06T06:49:29.252" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:19.564" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1764gitlab # [ 204.128274] gitaly[914]: time="2026-09-06T06:49:19.625Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1571 command.oublock=32 command.real_time_ms=26 command.spawn_token_fork_ms=4 command.system_time_ms=17 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN11E7CG2J7WGTKXMKCR3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-06T06:49:29.252" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:19.564" grpc.time_ms=60.525 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1765gitlab # [ 204.149806] gitaly[914]: time="2026-09-06T06:49:19.652Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN11E7CG2J7WGTKXMKCR3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T06:49:29.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:19.652" pid=914 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1766gitlab # [ 204.166601] gitaly[914]: time="2026-09-06T06:49:19.653Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN11E7CG2J7WGTKXMKCR3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T06:49:29.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:19.652" grpc.time_ms=1.011 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1767gitlab # [ 204.184403] gitaly[914]: time="2026-09-06T06:49:19.672Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN11E7CG2J7WGTKXMKCR3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-06T06:49:29.009" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:19.660" grpc.time_ms=11.489 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1768gitlab # [ 204.222644] gitaly[914]: time="2026-09-06T06:49:19.738Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN11E7CG2J7WGTKXMKCR3 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T06:49:29.087" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:19.738" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1769gitlab # [ 204.224649] gitaly[914]: time="2026-09-06T06:49:19.738Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN11E7CG2J7WGTKXMKCR3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T06:49:29.087" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:19.738" grpc.time_ms=0.269 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1770gitlab # [ 204.269502] gitaly[914]: time="2026-09-06T06:49:19.786Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN11E7CG2J7WGTKXMKCR3 diskcache=fa261bf1-880a-41cb-bb97-fb076e8ee647 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-06T06:49:29.093" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:19.744" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1771gitlab # [ 204.271383] gitaly[914]: time="2026-09-06T06:49:19.786Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1579 command.oublock=32 command.real_time_ms=13 command.spawn_token_fork_ms=6 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN11E7CG2J7WGTKXMKCR3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-06T06:49:29.093" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:19.744" grpc.time_ms=42.507 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1772gitlab # [ 204.321983] gitaly[914]: time="2026-09-06T06:49:19.838Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN11E7CG2J7WGTKXMKCR3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T06:49:29.187" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:19.837" pid=914 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1773gitlab # [ 204.324412] gitaly[914]: time="2026-09-06T06:49:19.839Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN11E7CG2J7WGTKXMKCR3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T06:49:29.187" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:19.837" grpc.time_ms=1.08 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1774gitlab # [ 204.377213] gitaly[914]: time="2026-09-06T06:49:19.893Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN11E7CG2J7WGTKXMKCR3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-06T06:49:29.229" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:19.880" grpc.time_ms=13.298 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1775gitlab # [ 204.443390] gitaly[914]: time="2026-09-06T06:49:19.960Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN11E7CG2J7WGTKXMKCR3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T06:49:29.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:19.959" grpc.time_ms=0.167 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1776gitlab # [ 204.470881] gitaly[914]: time="2026-09-06T06:49:19.987Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN11E7CG2J7WGTKXMKCR3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-06T06:49:29.037" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:19.987" grpc.time_ms=0.195 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1777gitlab # [ 205.055738] gitaly[914]: time="2026-09-06T06:49:20.572Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN11E7CG2J7WGTKXMKCR3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-06T06:49:30.250" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:20.561" grpc.time_ms=10.537 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1778gitlab # [ 205.405225] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:20 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 22821779gitlab # [ 205.412888] setup-gitlab-start[2253]: + mkdir -p /tmp/test-flake1780gitlab # [ 205.417400] setup-gitlab-start[2253]: + cd /tmp/test-flake1781gitlab # [ 205.418666] setup-gitlab-start[2253]: + git init -b master1782gitlab # [ 205.436176] setup-gitlab-start[2569]: Initialized empty Git repository in /tmp/test-flake/.git/1783gitlab # [ 205.438311] setup-gitlab-start[2253]: + git config user.name test1784gitlab # [ 205.441444] setup-gitlab-start[2253]: + git config user.email test@example.com1785gitlab # [ 205.442930] setup-gitlab-start[2253]: + cat1786gitlab # [ 205.445701] setup-gitlab-start[2253]: + git add flake.nix1787gitlab # [ 205.449620] setup-gitlab-start[2253]: + git commit -m 'initial commit'1788gitlab # [ 205.471222] setup-gitlab-start[2574]: [master (root-commit) 3a677d9] initial commit1789gitlab # [ 205.473075] setup-gitlab-start[2574]: 1 file changed, 10 insertions(+)1790gitlab # [ 205.474681] setup-gitlab-start[2574]: create mode 100644 flake.nix1791gitlab # [ 205.476262] setup-gitlab-start[2253]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1792gitlab # [ 205.478974] setup-gitlab-start[2253]: + git push -u origin master1793gitlab # [ 205.819437] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:21 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 3201794gitlab # [ 205.966868] gitaly[914]: time="2026-09-06T06:49:21.483Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN3P2HQK4AEWES78CS42Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:21.474" grpc.time_ms=8.689 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1795gitlab # [ 205.968554] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:21 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 1371796gitlab # [ 206.239422] gitaly[914]: time="2026-09-06T06:49:21.755Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-06T06:49:31.098" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:21.749" grpc.time_ms=6.755 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1797gitlab # [ 206.308390] gitaly[914]: time="2026-09-06T06:49:21.825Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=327 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-06T06:49:51.016" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-06T06:49:21.816" grpc.time_ms=8.33 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1798gitlab # [ 206.364930] gitaly[914]: time="2026-09-06T06:49:21.881Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 duration_ms=201ns method=POST pid=914 status=200 url="http://unix/api/v4/internal/allowed"1799gitlab # [ 206.400191] sidekiq-cluster[2522]: {"severity":"INFO","time":"2026-09-06T06:49:21.898Z","message":"Starting cluster with 1 processes"}1800gitlab # [ 206.410311] gitaly[914]: time="2026-09-06T06:49:21.927Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 duration_ms=40ns method=POST pid=914 status=200 url="http://unix/api/v4/internal/pre_receive"1801gitlab # [ 206.419623] gitaly[914]: time="2026-09-06T06:49:21.936Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:49:21.679" grpc.time_ms=257.184 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1802gitlab # [ 206.471420] gitaly[914]: time="2026-09-06T06:49:21.988Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:49:21.987" grpc.time_ms=0.592 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1803gitlab # [ 206.516133] gitaly[914]: time="2026-09-06T06:49:22.033Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:49:22.032" grpc.time_ms=0.405 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1804gitlab # [ 206.554254] gitaly[914]: time="2026-09-06T06:49:22.071Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:49:22.070" grpc.time_ms=0.474 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1805gitlab # [ 206.647188] gitaly[914]: time="2026-09-06T06:49:22.164Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-06T06:49:32.003" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:22.153" grpc.time_ms=10.011 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1806gitlab # [ 206.694981] gitaly[914]: time="2026-09-06T06:49:22.212Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1558 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-06T06:49:32.040" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:49:22.191" grpc.time_ms=20.571 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1807gitlab # [ 206.730718] gitaly[914]: time="2026-09-06T06:49:22.247Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 duration_ms=137ns method=POST pid=914 status=200 url="http://unix/api/v4/internal/post_receive"1808gitlab # [ 206.731826] gitaly[914]: time="2026-09-06T06:49:22.248Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:49:22.109" grpc.time_ms=138.803 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1809gitlab # [ 206.761406] gitaly[914]: time="2026-09-06T06:49:22.278Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 diskcache=30331251-65d3-4b0f-9317-fb59dbacb95c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:21.607" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1810gitlab # [ 206.777443] gitaly[914]: time="2026-09-06T06:49:22.294Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=202 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13647 command.oublock=32 command.real_time_ms=660 command.spawn_token_fork_ms=1 command.system_time_ms=139 command.user_time_ms=63 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=684 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:21.607" grpc.time_ms=671.462 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1811gitlab # [ 206.779532] gitlab-workhorse[825]: time="2026-09-06T06:49:22Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521812gitlab # [ 206.780983] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:22 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 7491813gitlab # [ 206.806377] setup-gitlab-start[2578]: To http://gitlab/root/test-flake.git1814gitlab # [ 206.807883] setup-gitlab-start[2578]: * [new branch] master -> master1815gitlab # [ 206.814349] setup-gitlab-start[2578]: branch 'master' set up to track 'origin/master'.1816gitlab # [ 206.819249] systemd[1]: Finished setup-gitlab.service.1817gitlab # [ 206.828438] systemd[1]: Starting nixbot CI service...1818gitlab: (finished: waiting for unit setup-gitlab.service, in 208.53 seconds)1819gitlab: waiting for unit nixbot.service1820gitlab # [ 208.109976] nixbot[2666]: {"ts": "2026-09-06T06:49:23.626Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1821gitlab # [ 208.146575] nixbot[2666]: {"ts": "2026-09-06T06:49:23.663Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1822gitlab # [ 208.186930] nixbot[2666]: {"ts": "2026-09-06T06:49:23.703Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1823gitlab # [ 208.202192] nixbot[2666]: {"ts": "2026-09-06T06:49:23.718Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1824gitlab # [ 208.215153] nixbot[2666]: {"ts": "2026-09-06T06:49:23.731Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1825gitlab # [ 208.232868] nixbot[2666]: {"ts": "2026-09-06T06:49:23.749Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1826gitlab # [ 208.241838] nixbot[2666]: {"ts": "2026-09-06T06:49:23.758Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1827gitlab # [ 208.249328] nixbot[2666]: {"ts": "2026-09-06T06:49:23.763Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1828gitlab # [ 208.257890] nixbot[2666]: {"ts": "2026-09-06T06:49:23.774Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1829gitlab # [ 208.263324] nixbot[2666]: {"ts": "2026-09-06T06:49:23.778Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1830gitlab # [ 208.270710] nixbot[2666]: {"ts": "2026-09-06T06:49:23.787Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1831gitlab # [ 208.280530] nixbot[2666]: {"ts": "2026-09-06T06:49:23.797Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1832gitlab # [ 208.286973] nixbot[2666]: {"ts": "2026-09-06T06:49:23.803Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1833gitlab # [ 208.291544] nixbot[2666]: {"ts": "2026-09-06T06:49:23.808Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1834gitlab # [ 208.298137] nixbot[2666]: {"ts": "2026-09-06T06:49:23.814Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1835gitlab # [ 208.305617] nixbot[2666]: {"ts": "2026-09-06T06:49:23.822Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1836gitlab # [ 208.312808] nixbot[2666]: {"ts": "2026-09-06T06:49:23.829Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1837gitlab # [ 208.320925] nixbot[2666]: {"ts": "2026-09-06T06:49:23.837Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1838gitlab # [ 208.332667] nixbot[2666]: {"ts": "2026-09-06T06:49:23.849Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1839gitlab # [ 208.339504] nixbot[2666]: {"ts": "2026-09-06T06:49:23.856Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1840gitlab # [ 208.347774] nixbot[2666]: {"ts": "2026-09-06T06:49:23.864Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1841gitlab # [ 208.356491] nixbot[2666]: {"ts": "2026-09-06T06:49:23.873Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1842gitlab # [ 208.363354] nixbot[2666]: {"ts": "2026-09-06T06:49:23.880Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1843gitlab # [ 208.370210] nixbot[2666]: {"ts": "2026-09-06T06:49:23.887Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1844gitlab # [ 208.376603] nixbot[2666]: {"ts": "2026-09-06T06:49:23.893Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1845gitlab # [ 208.386274] nixbot[2666]: {"ts": "2026-09-06T06:49:23.903Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1846gitlab # [ 208.392259] nixbot[2666]: {"ts": "2026-09-06T06:49:23.909Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1847gitlab # [ 208.399588] nixbot[2666]: {"ts": "2026-09-06T06:49:23.916Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1848gitlab # [ 208.406211] nixbot[2666]: {"ts": "2026-09-06T06:49:23.922Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1849gitlab # [ 208.428936] nixbot[2666]: {"ts": "2026-09-06T06:49:23.945Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1850gitlab # [ 208.440199] nixbot[2666]: {"ts": "2026-09-06T06:49:23.957Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"}1851gitlab # [ 208.448291] nixbot[2666]: {"ts": "2026-09-06T06:49:23.965Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1852gitlab # [ 208.452565] nixbot[2666]: {"ts": "2026-09-06T06:49:23.969Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 32, "migration": "upload_queue"}1853gitlab # [ 208.831759] nixbot[2666]: INFO: Started server process [2666]1854gitlab # [ 208.833686] nixbot[2666]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1855gitlab # [ 208.865234] nixbot[2666]: INFO: ::ffff:127.0.0.1:35898 - "GET /health HTTP/1.1" 200 OK1856gitlab # [ 208.873482] systemd[1]: Started nixbot CI service.1857gitlab # [ 208.876822] systemd[1]: Reached target Multi-User System.1858gitlab # [ 208.878366] systemd[1]: Startup finished in 1.656s (kernel) + 3.726s (initrd) + 3min 23.494s (userspace) = 3min 28.878s.1859gitlab: (finished: waiting for unit nixbot.service, in 2.09 seconds)1860gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1861gitlab # [ 209.817680] nixbot[2666]: INFO: ::ffff:127.0.0.1:35900 - "GET /health HTTP/1.1" 200 OK1862gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.04 seconds)1863subtest: project discovered and webhook registered1864gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1865gitlab # [ 209.832245] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:25 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 9661866gitlab # [ 209.836224] nixbot[2666]: {"ts": "2026-09-06T06:49:25.350Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1867gitlab # [ 209.853513] nixbot[2666]: {"ts": "2026-09-06T06:49:25.370Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1868gitlab # [ 209.915299] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:25 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 531869gitlab # [ 209.929859] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:25 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 661870gitlab # [ 209.939929] nixbot[2666]: {"ts": "2026-09-06T06:49:25.432Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1871gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.13 seconds)1872gitlab # [ 209.948709] nixbot[2666]: {"ts": "2026-09-06T06:49:25.433Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1873gitlab # [ 210.073472] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:25 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 918 "" "python-httpx/0.28.1" 1471874gitlab # [ 210.082982] nixbot[2666]: {"ts": "2026-09-06T06:49:25.599Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1875gitlab # [ 210.264443] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:25 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1611876gitlab # [ 210.273880] nixbot[2666]: {"ts": "2026-09-06T06:49:25.781Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1877gitlab # [ 210.376123] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:25 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "python-httpx/0.28.1" 721878gitlab # [ 210.379358] nixbot[2666]: {"ts": "2026-09-06T06:49:25.893Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1879gitlab # [ 210.467132] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:25 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 918 "" "python-httpx/0.28.1" 721880gitlab # [ 210.469952] nixbot[2666]: {"ts": "2026-09-06T06:49:25.984Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1881gitlab # [ 210.562238] gitaly[914]: time="2026-09-06T06:49:26.078Z" level=info msg="finished unary call with code OK" catfile.duration_ms=4 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=4 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN87N48RTKQSHBTKAAYK3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-09-06T06:49:56.058" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:49:26.059" grpc.time_ms=17.843 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1882gitlab # [ 210.627248] gitaly[914]: time="2026-09-06T06:49:26.143Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN87N48RTKQSHBTKAAYK3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:49:56.140" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:49:26.141" grpc.time_ms=1.108 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1883gitlab # [ 210.671447] gitaly[914]: time="2026-09-06T06:49:26.188Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=4 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN87N48RTKQSHBTKAAYK3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-09-06T06:49:36.002" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:49:26.173" grpc.time_ms=13.775 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1884gitlab # [ 210.708320] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:26 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 2181885gitlab # [ 210.710204] nixbot[2666]: {"ts": "2026-09-06T06:49:26.225Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1886gitlab # [ 210.808146] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:26 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 901887gitlab # [ 210.811267] nixbot[2666]: {"ts": "2026-09-06T06:49:26.325Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1888gitlab # [ 210.832403] nixbot[2666]: {"ts": "2026-09-06T06:49:26.348Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1889gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1890gitlab # [ 210.976841] gitaly[914]: time="2026-09-06T06:49:26.493Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN8MFKZXJZE18H7TPF666 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:26.476" grpc.time_ms=16.313 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1891gitlab # [ 210.978518] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:26 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 781892gitlab # [ 211.086554] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:26 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "curl/8.21.0" 551893gitlab # [ 211.091734] gitaly[914]: time="2026-09-06T06:49:26.608Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN8Q3PTDJPCQCG1FGFYTT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:26.595" pid=914 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1894gitlab # [ 211.096087] gitaly[914]: time="2026-09-06T06:49:26.609Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN8Q3PTDJPCQCG1FGFYTT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:26.595" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1895gitlab # [ 211.099092] gitlab-workhorse[825]: time="2026-09-06T06:49:26Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131896gitlab # [ 211.099830] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:26 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1101897gitlab # [ 211.100997] gitaly[914]: time="2026-09-06T06:49:26.609Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN8Q3PTDJPCQCG1FGFYTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:26.595" grpc.time_ms=14.004 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1898gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.21 seconds)1899(finished: subtest: project discovered and webhook registered, in 1.34 seconds)1900subtest: push delivers the webhook1901gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1902gitlab # [ 211.216144] gitaly[914]: time="2026-09-06T06:49:26.732Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN8TRGD4PMNZDKWY2NTKA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:26.718" pid=914 remote_ip="2001:db8:1::1" request_sha=d51e5ccb5d82373c6c1695a9e02e6ec437b5c81b response_bytes=223 span.kind=server system=grpc1903gitlab # [ 211.217410] gitaly[914]: time="2026-09-06T06:49:26.733Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1196 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=3 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN8TRGD4PMNZDKWY2NTKA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:26.718" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1904gitlab # [ 211.218195] gitaly[914]: time="2026-09-06T06:49:26.733Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1196 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=3 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN8TRGD4PMNZDKWY2NTKA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:26.718" grpc.time_ms=14.776 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1905gitlab # [ 211.221080] gitlab-workhorse[825]: time="2026-09-06T06:49:26Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231906gitlab # [ 211.222090] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:26 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 1181907gitlab # [ 211.307678] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:26 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 1131908gitlab # [ 211.366988] gitaly[914]: time="2026-09-06T06:49:26.884Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN91H5QN97JKE5N6MRH64 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:26.875" grpc.time_ms=8.809 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1909gitlab # [ 211.373102] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:26 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 521910gitlab # [ 211.397258] gitaly[914]: time="2026-09-06T06:49:26.914Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=6 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN91APEB4PRRK4PBZZ8AJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:26.902" grpc.time_ms=11.67 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1911gitlab # [ 211.398454] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:26 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 881912gitlab # Enumerating objects: 5, done.1913gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1914gitlab # [ 211.432120] gitaly[914]: time="2026-09-06T06:49:26.949Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN93C20EXYE5AKY9WXGWB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:26.940" pid=914 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1915gitlab # [ 211.433283] gitaly[914]: time="2026-09-06T06:49:26.949Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN93C20EXYE5AKY9WXGWB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:26.940" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1916gitlab # [ 211.434114] gitaly[914]: time="2026-09-06T06:49:26.950Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN93C20EXYE5AKY9WXGWB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:26.940" grpc.time_ms=9.817 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1917gitlab # [ 211.443311] gitlab-workhorse[825]: time="2026-09-06T06:49:26Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671918gitlab # [ 211.444262] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:26 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 571919gitlab # Delta compression using up to 4 threads1920gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1921gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 136.00 KiB/s, done.1922gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1923gitlab # [ 211.573538] gitaly[914]: time="2026-09-06T06:49:27.088Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN98472PB7G4Q5Y5VWTJ7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:27.082" grpc.time_ms=6.754 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1924gitlab # [ 211.574939] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:27 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 441925gitlab # [ 211.672434] gitaly[914]: time="2026-09-06T06:49:27.189Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN9AB6AZBRAWZX1APB094 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:27.174" pid=914 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1926gitlab # [ 211.673559] gitaly[914]: time="2026-09-06T06:49:27.189Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1167 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN9AB6AZBRAWZX1APB094 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:27.174" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1927gitlab # [ 211.706609] gitaly[914]: time="2026-09-06T06:49:27.223Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=327 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN97FDT4YG740JCY6NA38 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-06T06:49:57.215" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-06T06:49:27.215" grpc.time_ms=7.623 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1928gitlab # [ 211.732457] gitaly[914]: time="2026-09-06T06:49:27.249Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1167 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN9AB6AZBRAWZX1APB094 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:27.174" grpc.time_ms=74.896 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1929gitlab # [ 211.736286] gitaly[914]: time="2026-09-06T06:49:27.253Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1TQN97FDT4YG740JCY6NA38 duration_ms=97ns method=POST pid=914 status=200 url="http://unix/api/v4/internal/allowed"1930gitlab # [ 211.759560] gitaly[914]: time="2026-09-06T06:49:27.276Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1TQN97FDT4YG740JCY6NA38 duration_ms=22ns method=POST pid=914 status=200 url="http://unix/api/v4/internal/pre_receive"1931gitlab # [ 211.760321] gitaly[914]: time="2026-09-06T06:49:27.276Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN97FDT4YG740JCY6NA38 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:49:27.155" grpc.time_ms=120.999 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1932gitlab # [ 211.782248] gitlab-workhorse[825]: time="2026-09-06T06:49:27Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091933gitlab # [ 211.785613] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:27 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 1831934gitlab # [ 211.806108] gitaly[914]: time="2026-09-06T06:49:27.322Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN97FDT4YG740JCY6NA38 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:49:27.322" grpc.time_ms=0.411 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1935gitlab # [ 211.861138] gitaly[914]: time="2026-09-06T06:49:27.378Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN97FDT4YG740JCY6NA38 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:49:27.375" grpc.time_ms=0.427 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1936gitlab # [ 211.895081] gitaly[914]: time="2026-09-06T06:49:27.412Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN9HTKD88XDGAPYZTXSNC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:49:57.010" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:49:27.411" grpc.time_ms=0.669 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1937gitlab # [ 211.897963] gitaly[914]: time="2026-09-06T06:49:27.415Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN97FDT4YG740JCY6NA38 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:49:27.414" grpc.time_ms=0.27 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1938gitlab # [ 211.964126] gitaly[914]: time="2026-09-06T06:49:27.479Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=651 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN9HTKD88XDGAPYZTXSNC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-06T06:49:57.068" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:49:27.469" grpc.time_ms=10.517 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1939gitlab # [ 212.008303] gitaly[914]: time="2026-09-06T06:49:27.525Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN9HTKD88XDGAPYZTXSNC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:49:37.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:49:27.518" grpc.time_ms=6.998 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1940gitlab # [ 212.023051] gitaly[914]: time="2026-09-06T06:49:27.540Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1TQN97FDT4YG740JCY6NA38 duration_ms=66ns method=POST pid=914 status=200 url="http://unix/api/v4/internal/post_receive"1941gitlab # [ 212.024450] gitaly[914]: time="2026-09-06T06:49:27.540Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN97FDT4YG740JCY6NA38 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:49:27.472" grpc.time_ms=67.532 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1942gitlab # [ 212.055382] gitaly[914]: time="2026-09-06T06:49:27.572Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=20 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN9HTKD88XDGAPYZTXSNC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:49:37.036" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:49:27.546" grpc.time_ms=25.531 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1943gitlab # [ 212.060604] gitaly[914]: time="2026-09-06T06:49:27.577Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN97FDT4YG740JCY6NA38 diskcache=25af048c-abc4-4186-8cb8-0521fb3da2e7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:27.101" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1944gitlab # [ 212.062488] gitaly[914]: time="2026-09-06T06:49:27.579Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=198 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13541 command.oublock=32 command.real_time_ms=464 command.spawn_token_fork_ms=0 command.system_time_ms=151 command.user_time_ms=47 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN97FDT4YG740JCY6NA38 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:27.101" grpc.time_ms=477.334 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1945gitlab # [ 212.063832] gitlab-workhorse[825]: time="2026-09-06T06:49:27Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521946gitlab # [ 212.065132] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:27 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 5561947gitlab # [ 212.113696] gitaly[914]: time="2026-09-06T06:49:27.630Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN9HTKD88XDGAPYZTXSNC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-06T06:49:37.119" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:27.629" grpc.time_ms=0.234 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1948gitlab # [ 212.130527] gitaly[914]: time="2026-09-06T06:49:27.647Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN9HTKD88XDGAPYZTXSNC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-06T06:49:37.127" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:49:27.637" grpc.time_ms=9.479 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1949gitlab # To http://gitlab/root/test-flake.git1950gitlab # 3a677d9..bfeb273 master -> master1951gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.01 seconds)1952gitlab: must succeed: git -C /tmp/test-flake rev-parse master1953gitlab # [ 212.167935] gitaly[914]: time="2026-09-06T06:49:27.684Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN9HTKD88XDGAPYZTXSNC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:49:27.684" grpc.time_ms=0.372 pid=914 span.kind=server system=grpc1954gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.02 seconds)1955gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'1956gitlab # [ 212.191928] gitaly[914]: time="2026-09-06T06:49:27.708Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN9HTKD88XDGAPYZTXSNC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:49:27.707" grpc.time_ms=0.409 pid=914 span.kind=server system=grpc1957gitlab # [ 212.215965] gitaly[914]: time="2026-09-06T06:49:27.733Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN9HTKD88XDGAPYZTXSNC diskcache=4ed4deb8-0011-40d9-8755-934beca3039d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-06T06:49:37.139" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:27.649" pid=914 ref=refs/keep-around/3a677d9a61d000feb5e6df34bb2f87d261723ea8 remote_ip="2001:db8:1::1" revision=3a677d9a61d000feb5e6df34bb2f87d261723ea8 span.kind=server system=grpc username=root1958gitlab # [ 212.234197] gitaly[914]: time="2026-09-06T06:49:27.733Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=59 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5306 command.oublock=8 command.real_time_ms=74 command.spawn_token_fork_ms=1 command.system_time_ms=45 command.user_time_ms=14 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN9HTKD88XDGAPYZTXSNC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-06T06:49:37.139" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:27.649" grpc.time_ms=83.675 pid=914 ref=refs/keep-around/3a677d9a61d000feb5e6df34bb2f87d261723ea8 remote_ip="2001:db8:1::1" revision=3a677d9a61d000feb5e6df34bb2f87d261723ea8 span.kind=server system=grpc username=root1959gitlab # [ 212.235356] gitaly[914]: time="2026-09-06T06:49:27.738Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN9HTKD88XDGAPYZTXSNC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:49:57.337" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:49:27.737" grpc.time_ms=0.403 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1960gitlab # [ 212.282136] nixbot[2666]: INFO: ::ffff:127.0.0.1:35902 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK1961gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.10 seconds)1962gitlab # [ 212.343503] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:27 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3a677d9a61d000feb5e6df34bb2f87d261723ea8 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 5051963gitlab # [ 212.345265] nixbot[2666]: {"ts": "2026-09-06T06:49:27.861Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/3a677d9a61d000feb5e6df34bb2f87d261723ea8 \"HTTP/1.1 201 Created\""}1964gitlab # [ 212.353874] nixbot[2666]: {"ts": "2026-09-06T06:49:27.870Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-3a677d9a61d0-0"}1965gitlab # [ 212.522829] nixbot[2666]: {"ts": "2026-09-06T06:49:28.039Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-3a677d9a61d0-0", "argv0": "bwrap"}1966gitlab # [ 212.655163] systemd[1]: Started Nix Daemon.1967gitlab # [ 212.718619] nix-daemon[2896]: accepted connection from pid 2891, user nixbot1968gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'1969gitlab # [ 213.331377] nixbot[2666]: INFO: ::ffff:127.0.0.1:51578 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK1970gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.05 seconds)1971gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'1972gitlab # [ 214.381528] nixbot[2666]: INFO: ::ffff:127.0.0.1:51586 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK1973gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.05 seconds)1974gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'1975gitlab # [ 215.430929] nixbot[2666]: INFO: ::ffff:127.0.0.1:51592 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK1976gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.05 seconds)1977gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'1978gitlab # [ 216.480642] nixbot[2666]: INFO: ::ffff:127.0.0.1:51594 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK1979gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.05 seconds)1980gitlab # [ 216.980329] nix-daemon[2896]: accepted connection from pid 2923, user nixbot1981gitlab # [ 217.000611] nix-daemon[2896]: accepted connection from pid 2891, user nixbot1982gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'1983gitlab # [ 217.530245] nixbot[2666]: INFO: ::ffff:127.0.0.1:51602 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK1984gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.05 seconds)1985gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'1986gitlab # [ 218.581285] nixbot[2666]: INFO: ::ffff:127.0.0.1:51610 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK1987gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.05 seconds)1988gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'1989gitlab # [ 219.633743] nixbot[2666]: INFO: ::ffff:127.0.0.1:51626 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK1990gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.05 seconds)1991gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'1992gitlab # [ 220.685372] nixbot[2666]: INFO: ::ffff:127.0.0.1:51642 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK1993gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.05 seconds)1994gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'1995gitlab # [ 221.735677] nixbot[2666]: INFO: ::ffff:127.0.0.1:51646 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK1996gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.05 seconds)1997gitlab # [ 222.018691] nix-daemon[2896]: accepted connection from pid 2891, user nixbot1998gitlab # [ 222.110818] nix-daemon[2896]: accepted connection from pid 2955, user nixbot1999gitlab # [ 222.167250] gitaly[914]: time="2026-09-06T06:49:37.683Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQNKK5CPAP031180HT3C79 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:50:07.682" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:49:37.683" grpc.time_ms=0.57 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2000gitlab # [ 222.343192] gitaly[914]: time="2026-09-06T06:49:37.859Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1TQNKK5CPAP031180HT3C79 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:49:47.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:49:37.847" grpc.time_ms=11.673 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2001gitlab # [ 222.476518] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:37 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3a677d9a61d000feb5e6df34bb2f87d261723ea8 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 3542002gitlab # [ 222.487758] nixbot[2666]: {"ts": "2026-09-06T06:49:37.993Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/3a677d9a61d000feb5e6df34bb2f87d261723ea8 \"HTTP/1.1 201 Created\""}2003gitlab # [ 222.524301] gitaly[914]: time="2026-09-06T06:49:38.041Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQNKYC7Y6K4JQQ52N592YX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:50:08.040" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:49:38.040" grpc.time_ms=0.802 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2004gitlab # [ 222.628758] gitaly[914]: time="2026-09-06T06:49:38.145Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1TQNKYC7Y6K4JQQ52N592YX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:49:48.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:49:38.131" grpc.time_ms=13.638 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2005gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2006gitlab # [ 222.742911] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:38 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3a677d9a61d000feb5e6df34bb2f87d261723ea8 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2622007gitlab # [ 222.745146] nixbot[2666]: {"ts": "2026-09-06T06:49:38.261Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/3a677d9a61d000feb5e6df34bb2f87d261723ea8 \"HTTP/1.1 201 Created\""}2008gitlab # [ 222.802552] nixbot[2666]: INFO: ::ffff:127.0.0.1:51652 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2009gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.07 seconds)2010gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2011gitlab # [ 223.855269] nixbot[2666]: INFO: ::ffff:127.0.0.1:59398 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2012gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.05 seconds)2013gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2014gitlab # [ 224.904316] nixbot[2666]: INFO: ::ffff:127.0.0.1:59408 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2015gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.05 seconds)2016gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2017gitlab # [ 225.955111] nixbot[2666]: INFO: ::ffff:127.0.0.1:59418 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2018gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.05 seconds)2019gitlab # [ 226.462714] nix-daemon[2896]: accepted connection from pid 2995, user nixbot2020gitlab # [ 226.556297] gitaly[914]: time="2026-09-06T06:49:42.072Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQNQVXTHBTFWJTC5063SP7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:50:12.070" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:49:42.071" grpc.time_ms=1.126 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2021gitlab # [ 226.632703] gitaly[914]: time="2026-09-06T06:49:42.149Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQNQVXTHBTFWJTC5063SP7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:49:52.012" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:49:42.143" grpc.time_ms=6.397 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2022gitlab # [ 226.714530] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:42 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3a677d9a61d000feb5e6df34bb2f87d261723ea8 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2162023gitlab # [ 226.724980] nixbot[2666]: {"ts": "2026-09-06T06:49:42.241Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/3a677d9a61d000feb5e6df34bb2f87d261723ea8 \"HTTP/1.1 201 Created\""}2024gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2025gitlab # [ 227.002474] nixbot[2666]: INFO: ::ffff:127.0.0.1:59422 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2026gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.04 seconds)2027gitlab # [ 227.207764] gitaly[914]: time="2026-09-06T06:49:42.724Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1TQNRDW4C04G61E98QG4070 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:42.711" grpc.time_ms=12.95 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2028gitlab # [ 227.256696] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:42 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1842029gitlab # [ 227.326969] gitaly[914]: time="2026-09-06T06:49:42.843Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQNRKYRV6TE4P46D5D5K5B grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:42.834" pid=914 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2030gitlab # [ 227.328935] gitaly[914]: time="2026-09-06T06:49:42.843Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQNRKYRV6TE4P46D5D5K5B grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:42.834" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2031gitlab # [ 227.333184] gitlab-workhorse[825]: time="2026-09-06T06:49:42Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672032gitlab # [ 227.337233] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:42 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 632033gitlab # [ 227.341497] gitaly[914]: time="2026-09-06T06:49:42.844Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQNRKYRV6TE4P46D5D5K5B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:42.834" grpc.time_ms=10.304 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2034gitlab # [ 227.481762] gitaly[914]: time="2026-09-06T06:49:42.998Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQNRP5Y3WQ88G22Q7VK2MP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:42.985" pid=914 remote_ip="2001:db8:1::1" request_sha=c0abcd32423e37dab6ca7dbd390df7660eaa60dc response_bytes=336 span.kind=server system=grpc2035gitlab # [ 227.483597] gitaly[914]: time="2026-09-06T06:49:43.000Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1192 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQNRP5Y3WQ88G22Q7VK2MP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:42.985" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2036gitlab # [ 227.486359] gitaly[914]: time="2026-09-06T06:49:43.000Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1192 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQNRP5Y3WQ88G22Q7VK2MP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:42.985" grpc.time_ms=15.401 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2037gitlab # [ 227.489169] gitlab-workhorse[825]: time="2026-09-06T06:49:43Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3362038gitlab # [ 227.490911] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:43 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 336 "" "git/2.55.0" 1482039gitlab # [ 227.646356] gitaly[914]: time="2026-09-06T06:49:43.162Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQNRY8ESHJN9X46ATEWMH4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:43.155" grpc.time_ms=7.336 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2040gitlab # [ 227.647526] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:43 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 502041gitlab # [ 227.704602] gitaly[914]: time="2026-09-06T06:49:43.220Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQNS004ZE1JZ64KJHTRKRZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:43.213" pid=914 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc2042gitlab # [ 227.709833] gitaly[914]: time="2026-09-06T06:49:43.221Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQNS004ZE1JZ64KJHTRKRZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:43.213" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2043gitlab # [ 227.711237] gitlab-workhorse[825]: time="2026-09-06T06:49:43Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672044gitlab # [ 227.711963] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:43 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 532045gitlab # [ 227.713156] gitaly[914]: time="2026-09-06T06:49:43.221Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQNS004ZE1JZ64KJHTRKRZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:43.213" grpc.time_ms=7.548 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2046gitlab # [ 227.849878] gitaly[914]: time="2026-09-06T06:49:43.366Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1TQNS4HHVP3NPC402TRDV0A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:43.355" grpc.time_ms=11.57 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2047gitlab # [ 227.880612] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:43 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 822048gitlab # [ 227.950824] gitaly[914]: time="2026-09-06T06:49:43.467Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQNS794HGQYZ7S00SRRM6V grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:43.449" pid=914 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2049gitlab # [ 227.954574] gitaly[914]: time="2026-09-06T06:49:43.467Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1163 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQNS794HGQYZ7S00SRRM6V grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:43.449" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2050gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2051gitlab # [ 228.005383] gitaly[914]: time="2026-09-06T06:49:43.522Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1163 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQNS794HGQYZ7S00SRRM6V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:43.449" grpc.time_ms=18.53 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2052gitlab # [ 228.007336] gitlab-workhorse[825]: time="2026-09-06T06:49:43Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162053gitlab # [ 228.009306] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:43 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 1212054gitlab # [ 228.062431] nixbot[2666]: INFO: ::ffff:127.0.0.1:59430 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2055gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.06 seconds)2056gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2057gitlab # [ 229.111400] nixbot[2666]: INFO: ::ffff:127.0.0.1:59432 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2058gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.05 seconds)2059gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2060gitlab # [ 230.161659] nixbot[2666]: INFO: ::ffff:127.0.0.1:59444 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2061gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.05 seconds)2062gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2063gitlab # [ 231.196530] nixbot[2666]: INFO: ::ffff:127.0.0.1:59458 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2064gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.03 seconds)2065gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2066gitlab # [ 232.245424] nixbot[2666]: INFO: ::ffff:127.0.0.1:59468 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2067gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.05 seconds)2068gitlab # [ 233.065125] sidekiq-cluster[2615]: 2026-09-06T06:49:48.580Z pid=2615 tid=xb3 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2615, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>432295936}2069gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2070gitlab # [ 233.256685] sidekiq-cluster[2615]: W, [2026-09-06T06:49:48.773471 #2615] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.2071gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.04 seconds)2072gitlab # [ 233.295170] nixbot[2666]: INFO: ::ffff:127.0.0.1:57878 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2073gitlab # [ 233.303722] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:49:48.814Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}2074gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2075gitlab # [ 234.339974] nixbot[2666]: INFO: ::ffff:127.0.0.1:57892 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2076gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.05 seconds)2077gitlab # [ 235.241551] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:49:50.757Z","message":"GitLab reliable fetch activated!"}2078gitlab # [ 235.248433] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:49:50.757Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2079gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2080gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.03 seconds)2081gitlab # [ 235.378835] nixbot[2666]: INFO: ::ffff:127.0.0.1:57896 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2082gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2083gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.04 seconds)2084gitlab # [ 236.421204] nixbot[2666]: INFO: ::ffff:127.0.0.1:57908 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2085gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2086gitlab # [ 237.465662] nixbot[2666]: INFO: ::ffff:127.0.0.1:57920 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2087gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.05 seconds)2088gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2089gitlab # [ 238.512210] nixbot[2666]: INFO: ::ffff:127.0.0.1:57936 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2090gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.05 seconds)2091gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2092gitlab # [ 239.556941] nixbot[2666]: INFO: ::ffff:127.0.0.1:57950 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2093gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.04 seconds)2094gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2095gitlab # [ 240.601335] nixbot[2666]: INFO: ::ffff:127.0.0.1:57962 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2096gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.04 seconds)2097gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2098gitlab # [ 241.647360] nixbot[2666]: INFO: ::ffff:127.0.0.1:57964 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2099gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.05 seconds)2100gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2101gitlab # [ 242.691472] nixbot[2666]: INFO: ::ffff:127.0.0.1:57974 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2102gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.04 seconds)2103gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2104gitlab # [ 243.735501] nixbot[2666]: INFO: ::ffff:127.0.0.1:46006 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2105gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.04 seconds)2106gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2107gitlab # [ 244.780675] nixbot[2666]: INFO: ::ffff:127.0.0.1:46012 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2108gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.04 seconds)2109gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2110gitlab # [ 245.825992] nixbot[2666]: INFO: ::ffff:127.0.0.1:46018 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2111gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.04 seconds)2112gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2113gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.04 seconds)2114gitlab # [ 246.870309] nixbot[2666]: INFO: ::ffff:127.0.0.1:46034 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2115gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2116gitlab # [ 247.913737] nixbot[2666]: INFO: ::ffff:127.0.0.1:46050 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2117gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.04 seconds)2118gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2119gitlab # [ 248.957337] nixbot[2666]: INFO: ::ffff:127.0.0.1:46058 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2120gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.04 seconds)2121gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2122gitlab # [ 250.002118] nixbot[2666]: INFO: ::ffff:127.0.0.1:46068 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2123gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.04 seconds)2124gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2125gitlab # [ 251.046524] nixbot[2666]: INFO: ::ffff:127.0.0.1:46080 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2126gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.04 seconds)2127gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2128gitlab # [ 252.090572] nixbot[2666]: INFO: ::ffff:127.0.0.1:46088 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2129gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.04 seconds)2130gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2131gitlab # [ 253.134524] nixbot[2666]: INFO: ::ffff:127.0.0.1:59206 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2132gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.04 seconds)2133gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2134gitlab # [ 254.167560] nixbot[2666]: INFO: ::ffff:127.0.0.1:59212 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2135gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.04 seconds)2136gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2137gitlab # [ 255.219256] nixbot[2666]: INFO: ::ffff:127.0.0.1:59224 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2138gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.05 seconds)2139gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2140gitlab # [ 256.268959] nixbot[2666]: INFO: ::ffff:127.0.0.1:59240 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2141gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.05 seconds)2142gitlab # [ 256.683130] postgres[3197]: [3197] ERROR: relation "table_without_models" does not exist2143gitlab # [ 256.685258] postgres[3197]: [3197] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')2144gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2145gitlab # [ 257.316420] nixbot[2666]: INFO: ::ffff:127.0.0.1:59254 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2146gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.05 seconds)2147gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2148gitlab # [ 258.367640] nixbot[2666]: INFO: ::ffff:127.0.0.1:59262 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2149gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.05 seconds)2150gitlab # [ 259.344602] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:14.861Z","message":"Booted Rails 7.2.3.1 application in production environment"}2151gitlab # [ 259.348982] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:14.865Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}2152gitlab # [ 259.352830] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:14.865Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}2153gitlab # [ 259.356211] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:14.866Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}2154gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2155gitlab # [ 259.359129] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:14.868Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2156gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.05 seconds)2157gitlab # [ 259.423466] nixbot[2666]: INFO: ::ffff:127.0.0.1:59264 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2158gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2159gitlab # [ 260.469630] nixbot[2666]: INFO: ::ffff:127.0.0.1:59266 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2160gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.05 seconds)2161gitlab # [ 260.766186] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:16.282Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"abaf423937f2e66f568b3ac9","created_at":"2026-09-06T06:49:19.687Z","trace_propagation_headers":{"sentry-trace":"49eb246475974fcb9f5eab0c2d5cdf87-f00458df617045c9","baggage":"sentry-trace_id=49eb246475974fcb9f5eab0c2d5cdf87,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQN11E7CG2J7WGTKXMKCR3","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:19.719Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-abaf423937f2e66f568b3ac9: start","job_status":"start","queue_duration_s":56.561974,"scheduling_latency_s":56.562082}2162gitlab # [ 261.086297] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:16.602Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"abaf423937f2e66f568b3ac9","created_at":"2026-09-06T06:49:19.687Z","trace_propagation_headers":{"sentry-trace":"49eb246475974fcb9f5eab0c2d5cdf87-f00458df617045c9","baggage":"sentry-trace_id=49eb246475974fcb9f5eab0c2d5cdf87,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQN11E7CG2J7WGTKXMKCR3","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:19.719Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-abaf423937f2e66f568b3ac9: done: 0.320445 sec","job_status":"done","queue_duration_s":56.561974,"scheduling_latency_s":56.562082,"redis_calls":24,"redis_duration_s":0.015243,"redis_read_bytes":1038,"redis_write_bytes":2604,"redis_feature_flag_calls":14,"redis_feature_flag_duration_s":0.008058,"redis_feature_flag_read_bytes":1030,"redis_feature_flag_write_bytes":1439,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004244,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002941,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.116344,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.120771774,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.320445,"completed_at":"2026-09-06T06:50:16.602Z","load_balancing_strategy":"primary","db_duration_s":0.084015,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2163gitlab # [ 261.190323] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:16.706Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"06b397f21c4b522007d55e50","created_at":"2026-09-06T06:49:19.728Z","trace_propagation_headers":{"sentry-trace":"49eb246475974fcb9f5eab0c2d5cdf87-f00458df617045c9","baggage":"sentry-trace_id=49eb246475974fcb9f5eab0c2d5cdf87,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQN11E7CG2J7WGTKXMKCR3","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:19.733Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-06b397f21c4b522007d55e50: start","job_status":"start","queue_duration_s":56.972987,"scheduling_latency_s":56.973058}2164gitlab # [ 261.355256] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:16.871Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"06b397f21c4b522007d55e50","created_at":"2026-09-06T06:49:19.728Z","trace_propagation_headers":{"sentry-trace":"49eb246475974fcb9f5eab0c2d5cdf87-f00458df617045c9","baggage":"sentry-trace_id=49eb246475974fcb9f5eab0c2d5cdf87,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQN11E7CG2J7WGTKXMKCR3","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:19.733Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-06b397f21c4b522007d55e50: done: 0.16513 sec","job_status":"done","queue_duration_s":56.972987,"scheduling_latency_s":56.973058,"redis_calls":14,"redis_duration_s":0.007984,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.002024,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003434,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002526,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.091751,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.09884775900000001,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.16513,"completed_at":"2026-09-06T06:50:16.871Z","load_balancing_strategy":"primary","db_duration_s":0.035446,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2165gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2166gitlab # [ 261.464479] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:16.980Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"2d236d88d18452333e862270","created_at":"2026-09-06T06:49:20.414Z","trace_propagation_headers":{"sentry-trace":"49eb246475974fcb9f5eab0c2d5cdf87-f00458df617045c9","baggage":"sentry-trace_id=49eb246475974fcb9f5eab0c2d5cdf87,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQN11E7CG2J7WGTKXMKCR3","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:20.421Z","job_size_bytes":5,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-2d236d88d18452333e862270: start","job_status":"start","queue_duration_s":56.558932,"scheduling_latency_s":56.559002}2167gitlab # [ 261.530160] nixbot[2666]: INFO: ::ffff:127.0.0.1:59280 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2168gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.06 seconds)2169gitlab # [ 261.670208] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:17.186Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"2d236d88d18452333e862270","created_at":"2026-09-06T06:49:20.414Z","trace_propagation_headers":{"sentry-trace":"49eb246475974fcb9f5eab0c2d5cdf87-f00458df617045c9","baggage":"sentry-trace_id=49eb246475974fcb9f5eab0c2d5cdf87,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQN11E7CG2J7WGTKXMKCR3","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:20.421Z","job_size_bytes":5,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-2d236d88d18452333e862270: done: 0.20598 sec","job_status":"done","queue_duration_s":56.558932,"scheduling_latency_s":56.559002,"redis_calls":12,"redis_duration_s":0.005534,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001369,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003432,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000733,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.129981,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000531353,"duration_s":0.20598,"completed_at":"2026-09-06T06:50:17.186Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.034455,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2170gitlab # [ 261.777943] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:17.293Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"c009e815c3a588330294c3e3","created_at":"2026-09-06T06:49:20.455Z","trace_propagation_headers":{"sentry-trace":"49eb246475974fcb9f5eab0c2d5cdf87-f00458df617045c9","baggage":"sentry-trace_id=49eb246475974fcb9f5eab0c2d5cdf87,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQN11E7CG2J7WGTKXMKCR3","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:20.465Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-c009e815c3a588330294c3e3: start","job_status":"start","queue_duration_s":56.827869,"scheduling_latency_s":56.82791}2171gitlab # [ 262.143341] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:17.659Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"c009e815c3a588330294c3e3","created_at":"2026-09-06T06:49:20.455Z","trace_propagation_headers":{"sentry-trace":"49eb246475974fcb9f5eab0c2d5cdf87-f00458df617045c9","baggage":"sentry-trace_id=49eb246475974fcb9f5eab0c2d5cdf87,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQN11E7CG2J7WGTKXMKCR3","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:20.465Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-c009e815c3a588330294c3e3: done: 0.366036 sec","job_status":"done","queue_duration_s":56.827869,"scheduling_latency_s":56.82791,"redis_calls":11,"redis_duration_s":0.006872,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001966,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003883,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001023,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.298,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.298,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.044,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.234744,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001071086,"duration_s":0.366036,"completed_at":"2026-09-06T06:50:17.659Z","load_balancing_strategy":"primary","db_duration_s":0.125332,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2172gitlab # [ 262.148316] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:17.663Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"a15b8864bc510294d4f5401c","created_at":"2026-09-06T06:49:20.471Z","trace_propagation_headers":{"sentry-trace":"49eb246475974fcb9f5eab0c2d5cdf87-f00458df617045c9","baggage":"sentry-trace_id=49eb246475974fcb9f5eab0c2d5cdf87,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQN11E7CG2J7WGTKXMKCR3","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:20.480Z","job_size_bytes":89,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-a15b8864bc510294d4f5401c: start","job_status":"start","queue_duration_s":57.182066,"scheduling_latency_s":57.182107}2173gitlab # [ 262.336325] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:17.852Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"a15b8864bc510294d4f5401c","created_at":"2026-09-06T06:49:20.471Z","trace_propagation_headers":{"sentry-trace":"49eb246475974fcb9f5eab0c2d5cdf87-f00458df617045c9","baggage":"sentry-trace_id=49eb246475974fcb9f5eab0c2d5cdf87,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQN11E7CG2J7WGTKXMKCR3","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:20.480Z","job_size_bytes":89,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-a15b8864bc510294d4f5401c: done: 0.189697 sec","job_status":"done","queue_duration_s":57.182066,"scheduling_latency_s":57.182107,"redis_calls":11,"redis_duration_s":0.121507,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.002645,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.117636,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001226,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046589,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00104734,"duration_s":0.189697,"completed_at":"2026-09-06T06:50:17.852Z","load_balancing_strategy":"primary","db_duration_s":0.009312,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2174gitlab # [ 262.341458] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:17.856Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 3a677d9a61d000feb5e6df34bb2f87d261723ea8 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"edfba4285d22e0db7e0c5367","created_at":"2026-09-06T06:49:22.139Z","trace_propagation_headers":{"sentry-trace":"281151d1c86a47348c2fecf9f829b4e4-3bfe5872063b49b8","baggage":"sentry-trace_id=281151d1c86a47348c2fecf9f829b4e4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQN3W93Y7PXGKKVXQS5E71","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:22.143Z","job_size_bytes":185,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-edfba4285d22e0db7e0c5367: start","job_status":"start","queue_duration_s":55.712359,"scheduling_latency_s":55.712401}2175gitlab # [ 262.379352] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:17.881Z","message":"changes: \"0000000000000000000000000000000000000000 3a677d9a61d000feb5e6df34bb2f87d261723ea8 refs/heads/master\\n\""}2176gitlab # [ 262.408667] gitaly[914]: time="2026-09-06T06:50:17.924Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:50:27.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:17.912" grpc.time_ms=10.934 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2177gitlab # [ 262.425873] gitaly[914]: time="2026-09-06T06:50:17.942Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-06T06:50:27.019" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:50:17.930" grpc.time_ms=12.283 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2178gitlab # [ 262.478265] gitaly[914]: time="2026-09-06T06:50:17.995Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-06T06:50:27.073" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:17.984" grpc.time_ms=10.706 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2179gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2180gitlab # [ 262.535190] gitaly[914]: time="2026-09-06T06:50:18.052Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:50:18.051" grpc.time_ms=0.39 pid=914 span.kind=server system=grpc2181gitlab # [ 262.571616] nixbot[2666]: INFO: ::ffff:127.0.0.1:59296 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2182gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.04 seconds)2183gitlab # [ 262.579759] gitaly[914]: time="2026-09-06T06:50:18.096Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:50:18.095" grpc.time_ms=0.729 pid=914 span.kind=server system=grpc2184gitlab # [ 262.607087] gitaly[914]: time="2026-09-06T06:50:18.124Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 diskcache=556811e1-94b4-47a8-ae29-9246d12b58f5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-06T06:50:28.008" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:50:18.009" pid=914 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2185gitlab # [ 262.608651] gitaly[914]: time="2026-09-06T06:50:18.124Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=79 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5134 command.oublock=8 command.real_time_ms=105 command.spawn_token_fork_ms=1 command.system_time_ms=53 command.user_time_ms=26 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-06T06:50:28.008" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:50:18.009" grpc.time_ms=115.067 pid=914 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2186gitlab # [ 262.636125] gitaly[914]: time="2026-09-06T06:50:18.153Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T06:50:28.151" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:50:18.152" grpc.time_ms=0.26 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2187gitlab # [ 262.656163] gitaly[914]: time="2026-09-06T06:50:18.172Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=946 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-06T06:50:28.159" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:18.160" grpc.time_ms=12.352 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2188gitlab # [ 262.732399] gitaly[914]: time="2026-09-06T06:50:18.249Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=340 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-09-06T06:50:48.039" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:18.239" grpc.time_ms=9.149 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2189gitlab # [ 262.777500] gitaly[914]: time="2026-09-06T06:50:18.294Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-06T06:50:28.292" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:50:18.293" grpc.time_ms=0.505 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2190gitlab # [ 262.808272] gitaly[914]: time="2026-09-06T06:50:18.325Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=340 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-06T06:50:28.004" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-09-06T06:50:18.315" grpc.time_ms=9.17 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2191gitlab # [ 262.844773] gitaly[914]: time="2026-09-06T06:50:18.361Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:50:28.037" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:18.348" grpc.time_ms=13.424 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2192gitlab # [ 262.871285] gitaly[914]: time="2026-09-06T06:50:18.388Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:50:28.062" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:18.372" grpc.time_ms=14.968 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2193gitlab # [ 262.914567] gitaly[914]: time="2026-09-06T06:50:18.431Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=965 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-06T06:50:48.209" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:18.409" grpc.time_ms=21.372 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2194gitlab # [ 263.329416] gitaly[914]: time="2026-09-06T06:50:18.846Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-06T06:50:28.003" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:18.844" grpc.time_ms=1.485 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2195gitlab # [ 263.437956] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:18.953Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 3a677d9a61d000feb5e6df34bb2f87d261723ea8 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"edfba4285d22e0db7e0c5367","created_at":"2026-09-06T06:49:22.139Z","trace_propagation_headers":{"sentry-trace":"281151d1c86a47348c2fecf9f829b4e4-3bfe5872063b49b8","baggage":"sentry-trace_id=281151d1c86a47348c2fecf9f829b4e4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQN3W93Y7PXGKKVXQS5E71","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:22.143Z","job_size_bytes":185,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-edfba4285d22e0db7e0c5367: done: 1.097344 sec","job_status":"done","queue_duration_s":55.712359,"scheduling_latency_s":55.712401,"gitaly_calls":13,"gitaly_duration_s":0.377885,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.078497,"redis_read_bytes":2103,"redis_write_bytes":21748,"redis_cache_calls":15,"redis_cache_duration_s":0.006632,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.013817,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.00258,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7836,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.007682,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.029783,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.018003,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.066,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.201,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.225,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.066,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.563472,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000658743,"exclusive_lock_hold_duration_s":0.035699509000000004,"duration_s":1.097344,"completed_at":"2026-09-06T06:50:18.953Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.109517,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2196gitlab # [ 263.541738] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:18.957Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","3a677d9a61d000feb5e6df34bb2f87d261723ea8 bfeb273a2da919f0df84a793793005bc3005f6f5 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"c4015afe26648123ab49eed1","created_at":"2026-09-06T06:49:27.504Z","trace_propagation_headers":{"sentry-trace":"15b2282b5ba84a53a00eab8c8b142a9e-387a8ad7888548c9","baggage":"sentry-trace_id=15b2282b5ba84a53a00eab8c8b142a9e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQN97FDT4YG740JCY6NA38","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:27.508Z","job_size_bytes":185,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-c4015afe26648123ab49eed1: start","job_status":"start","queue_duration_s":51.448102,"scheduling_latency_s":51.448155}2197gitlab # [ 263.542808] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:18.984Z","message":"changes: \"3a677d9a61d000feb5e6df34bb2f87d261723ea8 bfeb273a2da919f0df84a793793005bc3005f6f5 refs/heads/master\\n\""}2198gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2199gitlab # [ 263.543877] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:19.057Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"c2882e2072143b987824e1ff","created_at":"2026-09-06T06:50:19.054Z","trace_propagation_headers":{"sentry-trace":"15b2282b5ba84a53a00eab8c8b142a9e-654e32bd5e154fa1","baggage":"sentry-trace_id=15b2282b5ba84a53a00eab8c8b142a9e,sentry-release=Unknown"},"correlation_id":"01M1TQN97FDT4YG740JCY6NA38","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"8cf397d8bcaf52a587b2de70","job_size_bytes":46,"pid":2615,"job_status":"deduplicated","message":"ProjectCacheWorker JID-c2882e2072143b987824e1ff: deduplicated: until executing","deduplication.type":"until executing"}2200gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.03 seconds)2201gitlab # [ 263.545412] gitaly[914]: time="2026-09-06T06:50:19.028Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN97FDT4YG740JCY6NA38 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:50:29.012" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:19.013" grpc.time_ms=14.58 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2202gitlab # [ 263.546212] gitaly[914]: time="2026-09-06T06:50:19.049Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN97FDT4YG740JCY6NA38 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-06T06:50:29.036" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:50:19.037" grpc.time_ms=11.423 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2203gitlab # [ 263.576841] gitaly[914]: time="2026-09-06T06:50:19.093Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN97FDT4YG740JCY6NA38 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-06T06:50:29.079" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:19.080" grpc.time_ms=12.707 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2204gitlab # [ 263.604524] nixbot[2666]: INFO: ::ffff:127.0.0.1:49826 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2205gitlab # [ 263.676465] gitaly[914]: time="2026-09-06T06:50:19.193Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=652 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN97FDT4YG740JCY6NA38 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-09-06T06:50:49.080" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:19.181" grpc.time_ms=12.111 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2206gitlab # [ 263.693673] gitaly[914]: time="2026-09-06T06:50:19.210Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=345 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN97FDT4YG740JCY6NA38 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-06T06:50:29.202" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-09-06T06:50:19.202" grpc.time_ms=7.936 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2207gitlab # [ 263.706576] gitaly[914]: time="2026-09-06T06:50:19.223Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN97FDT4YG740JCY6NA38 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:50:29.217" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:19.217" grpc.time_ms=6.065 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2208gitlab # [ 263.794741] gitaly[914]: time="2026-09-06T06:50:19.311Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN97FDT4YG740JCY6NA38 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-06T06:50:29.009" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:19.309" grpc.time_ms=1.46 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2209gitlab # [ 263.828555] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:19.344Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","3a677d9a61d000feb5e6df34bb2f87d261723ea8 bfeb273a2da919f0df84a793793005bc3005f6f5 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"c4015afe26648123ab49eed1","created_at":"2026-09-06T06:49:27.504Z","trace_propagation_headers":{"sentry-trace":"15b2282b5ba84a53a00eab8c8b142a9e-387a8ad7888548c9","baggage":"sentry-trace_id=15b2282b5ba84a53a00eab8c8b142a9e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQN97FDT4YG740JCY6NA38","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:27.508Z","job_size_bytes":185,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-c4015afe26648123ab49eed1: done: 0.387396 sec","job_status":"done","queue_duration_s":51.448102,"scheduling_latency_s":51.448155,"gitaly_calls":7,"gitaly_duration_s":0.170462,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.046392,"redis_read_bytes":500,"redis_write_bytes":11941,"redis_cache_calls":9,"redis_cache_duration_s":0.003185,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001582,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5718,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.015959,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.014781,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.010885,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.025,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.025,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.152432,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00118339,"exclusive_lock_hold_duration_s":0.03024323,"duration_s":0.387396,"completed_at":"2026-09-06T06:50:19.344Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.030917,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2210gitlab # [ 263.892288] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:19.348Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"05d43f03eb226eb2c4e3adc7","created_at":"2026-09-06T06:49:27.741Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-6fcb60ea6c184555","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:27.747Z","job_size_bytes":65,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-05d43f03eb226eb2c4e3adc7: start","job_status":"start","queue_duration_s":51.600283,"scheduling_latency_s":51.600341}2211gitlab # [ 263.981889] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:19.497Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"05d43f03eb226eb2c4e3adc7","created_at":"2026-09-06T06:49:27.741Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-6fcb60ea6c184555","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:27.747Z","job_size_bytes":65,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-05d43f03eb226eb2c4e3adc7: done: 0.149995 sec","job_status":"done","queue_duration_s":51.600283,"scheduling_latency_s":51.600341,"redis_calls":16,"redis_duration_s":0.008356,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.004248,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003032,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001076,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048454,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001016051,"duration_s":0.149995,"completed_at":"2026-09-06T06:50:19.497Z","load_balancing_strategy":"primary","db_duration_s":0.024276,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2212gitlab # [ 263.984927] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:19.501Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"6fad7e0302827486707990f5","created_at":"2026-09-06T06:49:27.748Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-6fcb60ea6c184555","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:27.755Z","job_size_bytes":65,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-6fad7e0302827486707990f5: start","job_status":"start","queue_duration_s":51.745923,"scheduling_latency_s":51.745982}2213gitlab # [ 264.112988] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:19.629Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"6fad7e0302827486707990f5","created_at":"2026-09-06T06:49:27.748Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-6fcb60ea6c184555","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:27.755Z","job_size_bytes":65,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-6fad7e0302827486707990f5: done: 0.127799 sec","job_status":"done","queue_duration_s":51.745923,"scheduling_latency_s":51.745982,"redis_calls":21,"redis_duration_s":0.009892,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.00406,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003065,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002767,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.067082,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000604546,"duration_s":0.127799,"completed_at":"2026-09-06T06:50:19.628Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.035273,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2214gitlab # [ 264.187613] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:19.703Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"4b8819e143032f3305682cb6","created_at":"2026-09-06T06:49:27.842Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-6fcb60ea6c184555","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:27.846Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-4b8819e143032f3305682cb6: start","job_status":"start","queue_duration_s":51.856626,"scheduling_latency_s":51.856697}2215gitlab # [ 264.419541] gitaly[914]: time="2026-09-06T06:50:19.936Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN9HTKD88XDGAPYZTXSNC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:50:19.935" grpc.time_ms=0.455 pid=914 span.kind=server system=grpc2216gitlab # [ 264.506997] gitaly[914]: time="2026-09-06T06:50:20.023Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN9HTKD88XDGAPYZTXSNC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:50:20.022" grpc.time_ms=0.83 pid=914 span.kind=server system=grpc2217gitlab # [ 264.583732] gitaly[914]: time="2026-09-06T06:50:20.099Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN9HTKD88XDGAPYZTXSNC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:50:20.098" grpc.time_ms=0.835 pid=914 span.kind=server system=grpc2218gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2219gitlab # [ 264.611240] gitaly[914]: time="2026-09-06T06:50:20.128Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN9HTKD88XDGAPYZTXSNC diskcache=07ce1f2e-3831-452b-acdf-019bf70ba672 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-06T06:50:49.778" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:19.879" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2220gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.03 seconds)2221gitlab # [ 264.626880] gitaly[914]: time="2026-09-06T06:50:20.128Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=225 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7534 command.oublock=0 command.real_time_ms=241 command.spawn_token_fork_ms=0 command.system_time_ms=154 command.user_time_ms=71 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN9HTKD88XDGAPYZTXSNC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-06T06:50:49.778" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:19.879" grpc.time_ms=248.822 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2222gitlab # [ 264.639607] nixbot[2666]: INFO: ::ffff:127.0.0.1:49828 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2223gitlab # [ 264.759975] gitaly[914]: time="2026-09-06T06:50:20.276Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN9HTKD88XDGAPYZTXSNC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-06T06:50:50.174" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:20.274" grpc.time_ms=1.842 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2224gitlab # [ 264.840612] gitaly[914]: time="2026-09-06T06:50:20.357Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN9HTKD88XDGAPYZTXSNC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:50:50.255" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:20.355" grpc.time_ms=1.227 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2225gitlab # [ 264.865485] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:20.381Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"4b8819e143032f3305682cb6","created_at":"2026-09-06T06:49:27.842Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-6fcb60ea6c184555","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:27.846Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2615,"job_status":"rescheduled","message":"PipelineProcessWorker JID-4b8819e143032f3305682cb6: rescheduled"}2226gitlab # [ 264.882149] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:20.397Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"4b8819e143032f3305682cb6","created_at":"2026-09-06T06:49:27.842Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-6fcb60ea6c184555","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:27.846Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-4b8819e143032f3305682cb6: done: 0.694449 sec","job_status":"done","queue_duration_s":51.856626,"scheduling_latency_s":51.856697,"gitaly_calls":3,"gitaly_duration_s":0.302316,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.07113,"redis_read_bytes":462,"redis_write_bytes":29289,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002182,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001827,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.019033,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.029372,"redis_queues_read_bytes":39,"redis_queues_write_bytes":15576,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.010426,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.001157,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000637,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004314,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.08,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.022,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.025,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.043,"db_ci_duration_s":0.037,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.231744,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.577133406,"duration_s":0.694449,"completed_at":"2026-09-06T06:50:20.397Z","load_balancing_strategy":"primary","db_duration_s":0.093379,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2227gitlab # [ 264.922892] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:20.401Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"8cf397d8bcaf52a587b2de70","created_at":"2026-09-06T06:50:17.945Z","trace_propagation_headers":{"sentry-trace":"281151d1c86a47348c2fecf9f829b4e4-f201ad47767a428d","baggage":"sentry-trace_id=281151d1c86a47348c2fecf9f829b4e4,sentry-release=Unknown"},"correlation_id":"01M1TQN3W93Y7PXGKKVXQS5E71","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:17.960Z","job_size_bytes":46,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-8cf397d8bcaf52a587b2de70: start","job_status":"start","queue_duration_s":2.441444,"scheduling_latency_s":2.441487}2228gitlab # [ 265.011491] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:20.510Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"8cf397d8bcaf52a587b2de70","created_at":"2026-09-06T06:50:17.945Z","trace_propagation_headers":{"sentry-trace":"281151d1c86a47348c2fecf9f829b4e4-f201ad47767a428d","baggage":"sentry-trace_id=281151d1c86a47348c2fecf9f829b4e4,sentry-release=Unknown"},"correlation_id":"01M1TQN3W93Y7PXGKKVXQS5E71","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:17.960Z","job_size_bytes":46,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-8cf397d8bcaf52a587b2de70: done: 0.108778 sec","job_status":"done","queue_duration_s":2.441444,"scheduling_latency_s":2.441487,"gitaly_calls":2,"gitaly_duration_s":0.020056,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.011249,"redis_read_bytes":69,"redis_write_bytes":4886,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002189,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000619,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2114,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002549,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.004663,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001229,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.062581,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000347531,"duration_s":0.108778,"completed_at":"2026-09-06T06:50:20.510Z","load_balancing_strategy":"primary","db_duration_s":0.015108,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2229gitlab # [ 265.020927] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:20.511Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"7f61aef90aa7237ed6d0d3c6","created_at":"2026-09-06T06:50:17.974Z","trace_propagation_headers":{"sentry-trace":"281151d1c86a47348c2fecf9f829b4e4-f201ad47767a428d","baggage":"sentry-trace_id=281151d1c86a47348c2fecf9f829b4e4,sentry-release=Unknown"},"correlation_id":"01M1TQN3W93Y7PXGKKVXQS5E71","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:17.978Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-7f61aef90aa7237ed6d0d3c6: start","job_status":"start","queue_duration_s":2.532984,"scheduling_latency_s":2.533007}2230gitlab # [ 265.090100] gitaly[914]: time="2026-09-06T06:50:20.460Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-09-06T12:50:20.452" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:50:20.453" grpc.time_ms=6.053 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2231gitlab # [ 265.091322] gitaly[914]: time="2026-09-06T06:50:20.480Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=652 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-06T06:50:50.372" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:20.473" grpc.time_ms=6.977 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2232gitlab # [ 265.154705] gitaly[914]: time="2026-09-06T06:50:20.671Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 diskcache=93ecdfb9-444b-4313-bd6e-b281e71b99b2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-06T12:50:20.534" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:20.534" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2233gitlab # [ 265.155931] gitaly[914]: time="2026-09-06T06:50:20.672Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1282 command.oublock=0 command.real_time_ms=135 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-06T12:50:20.534" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:20.534" grpc.time_ms=136.905 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2234gitlab # [ 265.184605] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:20.701Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"7f61aef90aa7237ed6d0d3c6","created_at":"2026-09-06T06:50:17.974Z","trace_propagation_headers":{"sentry-trace":"281151d1c86a47348c2fecf9f829b4e4-f201ad47767a428d","baggage":"sentry-trace_id=281151d1c86a47348c2fecf9f829b4e4,sentry-release=Unknown"},"correlation_id":"01M1TQN3W93Y7PXGKKVXQS5E71","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:17.978Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-7f61aef90aa7237ed6d0d3c6: done: 0.189697 sec","job_status":"done","queue_duration_s":2.532984,"scheduling_latency_s":2.533007,"gitaly_calls":1,"gitaly_duration_s":0.139464,"redis_calls":15,"redis_duration_s":0.003543,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000505,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001366,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000634,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001038,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.008,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.014,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034332,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.167030446,"duration_s":0.189697,"completed_at":"2026-09-06T06:50:20.701Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011917,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2235gitlab # [ 265.196213] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:20.703Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"008cd93e509999a5a02eb3e1","created_at":"2026-09-06T06:50:18.145Z","trace_propagation_headers":{"sentry-trace":"281151d1c86a47348c2fecf9f829b4e4-f201ad47767a428d","baggage":"sentry-trace_id=281151d1c86a47348c2fecf9f829b4e4,sentry-release=Unknown"},"correlation_id":"01M1TQN3W93Y7PXGKKVXQS5E71","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:18.148Z","job_size_bytes":23,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-008cd93e509999a5a02eb3e1: start","job_status":"start","queue_duration_s":2.554863,"scheduling_latency_s":2.554896}2236gitlab # [ 265.220842] gitaly[914]: time="2026-09-06T06:50:20.732Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=651 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-06T06:50:50.625" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:20.725" grpc.time_ms=6.922 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2237gitlab # [ 265.241280] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:20.741Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"008cd93e509999a5a02eb3e1","created_at":"2026-09-06T06:50:18.145Z","trace_propagation_headers":{"sentry-trace":"281151d1c86a47348c2fecf9f829b4e4-f201ad47767a428d","baggage":"sentry-trace_id=281151d1c86a47348c2fecf9f829b4e4,sentry-release=Unknown"},"correlation_id":"01M1TQN3W93Y7PXGKKVXQS5E71","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:18.148Z","job_size_bytes":23,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-008cd93e509999a5a02eb3e1: done: 0.03809 sec","job_status":"done","queue_duration_s":2.554863,"scheduling_latency_s":2.554896,"gitaly_calls":1,"gitaly_duration_s":0.009248,"redis_calls":16,"redis_duration_s":0.003802,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000307,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001133,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001666,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000696,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021949,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03809,"completed_at":"2026-09-06T06:50:20.741Z","load_balancing_strategy":"primary","db_duration_s":0.00246,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2238gitlab # [ 265.362225] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:20.742Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"5941aaaf138039d853738ebe","created_at":"2026-09-06T06:50:18.706Z","trace_propagation_headers":{"sentry-trace":"281151d1c86a47348c2fecf9f829b4e4-f201ad47767a428d","baggage":"sentry-trace_id=281151d1c86a47348c2fecf9f829b4e4,sentry-release=Unknown"},"correlation_id":"01M1TQN3W93Y7PXGKKVXQS5E71","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a65133b86da2011777c6811c8f8214431b8a3737be72c9de3d2a855d8a5d4b13","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:18.711Z","job_size_bytes":467,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-5941aaaf138039d853738ebe: start","job_status":"start","queue_duration_s":2.030853,"scheduling_latency_s":2.030876}2239gitlab # [ 265.363871] gitaly[914]: time="2026-09-06T06:50:20.764Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:50:50.663" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:20.763" grpc.time_ms=0.588 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2240gitlab # [ 265.365188] gitaly[914]: time="2026-09-06T06:50:20.771Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=620 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-06T06:50:30.005" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:20.766" grpc.time_ms=5.393 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2241gitlab # [ 265.376254] gitaly[914]: time="2026-09-06T06:50:20.852Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-06T06:50:50.750" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:20.851" grpc.time_ms=0.679 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2242gitlab # [ 265.395886] gitaly[914]: time="2026-09-06T06:50:20.860Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=324 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-06T06:50:50.755" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:20.856" grpc.time_ms=4.048 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2243gitlab # [ 265.421132] gitaly[914]: time="2026-09-06T06:50:20.927Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:50:30.161" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:20.921" grpc.time_ms=6.177 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2244gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2245gitlab # [ 265.692589] nixbot[2666]: INFO: ::ffff:127.0.0.1:49840 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2246gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.06 seconds)2247gitlab # [ 265.901233] gitaly[914]: time="2026-09-06T06:50:21.417Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=959 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-06T06:50:51.295" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:21.396" grpc.time_ms=21.016 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2248gitlab # [ 265.975518] gitaly[914]: time="2026-09-06T06:50:21.492Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN3W93Y7PXGKKVXQS5E71 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-06T06:50:51.373" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:21.474" grpc.time_ms=18.078 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2249gitlab # [ 266.029875] sidekiq-cluster[2615]: {"severity":"WARN","time":"2026-09-06T06:50:21.545Z","class":"CreatePipelineWorker","correlation_id":"01M1TQN3W93Y7PXGKKVXQS5E71","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"3a677d9a61d000feb5e6df34bb2f87d261723ea8","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"3a677d9a61d000feb5e6df34bb2f87d261723ea8","ref":"refs/heads/master"},"retry":0}2250gitlab # [ 266.036374] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:21.552Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"5941aaaf138039d853738ebe","created_at":"2026-09-06T06:50:18.706Z","trace_propagation_headers":{"sentry-trace":"281151d1c86a47348c2fecf9f829b4e4-f201ad47767a428d","baggage":"sentry-trace_id=281151d1c86a47348c2fecf9f829b4e4,sentry-release=Unknown"},"correlation_id":"01M1TQN3W93Y7PXGKKVXQS5E71","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a65133b86da2011777c6811c8f8214431b8a3737be72c9de3d2a855d8a5d4b13","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:18.711Z","job_size_bytes":467,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-5941aaaf138039d853738ebe: done: 0.810426 sec","job_status":"done","queue_duration_s":2.030853,"scheduling_latency_s":2.030876,"gitaly_calls":7,"gitaly_duration_s":0.146605,"redis_calls":51,"redis_duration_s":0.012341,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.000921,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.005562,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001944,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002472,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001442,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.616431,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000527442,"duration_s":0.810426,"completed_at":"2026-09-06T06:50:21.552Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.046905,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2251gitlab # [ 266.056816] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:21.555Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"3889f4ca-addf-4cb3-a2bf-e2c9ac3a6556\"}"],"class":"WebHookWorker","jid":"14c65430c8c1d7126962e061","created_at":"2026-09-06T06:50:18.814Z","trace_propagation_headers":{"sentry-trace":"281151d1c86a47348c2fecf9f829b4e4-f201ad47767a428d","baggage":"sentry-trace_id=281151d1c86a47348c2fecf9f829b4e4,sentry-release=Unknown"},"correlation_id":"01M1TQN3W93Y7PXGKKVXQS5E71","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8dcd5c74165a27d8e61dca1a500e203912e37d52f06e9a083dff48ae9950165d","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:18.820Z","job_size_bytes":1751,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-14c65430c8c1d7126962e061: start","job_status":"start","queue_duration_s":2.734773,"scheduling_latency_s":2.734797}2252gitlab # [ 266.142647] nixbot[2666]: INFO: ::ffff:127.0.0.1:49842 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2253gitlab # [ 266.174144] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:21.690Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"3889f4ca-addf-4cb3-a2bf-e2c9ac3a6556\"}"],"class":"WebHookWorker","jid":"14c65430c8c1d7126962e061","created_at":"2026-09-06T06:50:18.814Z","trace_propagation_headers":{"sentry-trace":"281151d1c86a47348c2fecf9f829b4e4-f201ad47767a428d","baggage":"sentry-trace_id=281151d1c86a47348c2fecf9f829b4e4,sentry-release=Unknown"},"correlation_id":"01M1TQN3W93Y7PXGKKVXQS5E71","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8dcd5c74165a27d8e61dca1a500e203912e37d52f06e9a083dff48ae9950165d","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:18.820Z","job_size_bytes":1751,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-14c65430c8c1d7126962e061: done: 0.134839 sec","job_status":"done","queue_duration_s":2.734773,"scheduling_latency_s":2.734797,"redis_calls":19,"redis_duration_s":0.007225,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001732,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000639,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003181,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001673,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.03775479799998038,"cpu_s":0.076247,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000791721,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.134839,"completed_at":"2026-09-06T06:50:21.690Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004332,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2254gitlab # [ 266.181373] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:21.694Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"86db41001efb919ed7469c53","created_at":"2026-09-06T06:50:19.067Z","trace_propagation_headers":{"sentry-trace":"15b2282b5ba84a53a00eab8c8b142a9e-654e32bd5e154fa1","baggage":"sentry-trace_id=15b2282b5ba84a53a00eab8c8b142a9e,sentry-release=Unknown"},"correlation_id":"01M1TQN97FDT4YG740JCY6NA38","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"7f61aef90aa7237ed6d0d3c6","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:19.071Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-86db41001efb919ed7469c53: start","job_status":"start","queue_duration_s":2.622938,"scheduling_latency_s":2.622981}2255gitlab # [ 266.270251] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:21.747Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"86db41001efb919ed7469c53","created_at":"2026-09-06T06:50:19.067Z","trace_propagation_headers":{"sentry-trace":"15b2282b5ba84a53a00eab8c8b142a9e-654e32bd5e154fa1","baggage":"sentry-trace_id=15b2282b5ba84a53a00eab8c8b142a9e,sentry-release=Unknown"},"correlation_id":"01M1TQN97FDT4YG740JCY6NA38","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"7f61aef90aa7237ed6d0d3c6","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:19.071Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-86db41001efb919ed7469c53: done: 0.052976 sec","job_status":"done","queue_duration_s":2.622938,"scheduling_latency_s":2.622981,"gitaly_calls":1,"gitaly_duration_s":0.01134,"redis_calls":12,"redis_duration_s":0.00409,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001869,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000807,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001414,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028816,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.025074416,"duration_s":0.052976,"completed_at":"2026-09-06T06:50:21.747Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005283,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2256gitlab # [ 266.341088] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:21.749Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"618f1ba22850be71c6bbb413","created_at":"2026-09-06T06:50:19.281Z","trace_propagation_headers":{"sentry-trace":"15b2282b5ba84a53a00eab8c8b142a9e-654e32bd5e154fa1","baggage":"sentry-trace_id=15b2282b5ba84a53a00eab8c8b142a9e,sentry-release=Unknown"},"correlation_id":"01M1TQN97FDT4YG740JCY6NA38","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:08d5467ca949f730db7394d9010ca97dc7db290763656c3c005d7b5ed42f2a48","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:19.283Z","job_size_bytes":467,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-618f1ba22850be71c6bbb413: start","job_status":"start","queue_duration_s":2.465354,"scheduling_latency_s":2.46538}2257gitlab # [ 266.341828] gitaly[914]: time="2026-09-06T06:50:21.731Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN97FDT4YG740JCY6NA38 diskcache=9aedb1a6-338b-46b2-af8c-93e262dd6d89 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-06T12:50:21.721" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:21.722" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2258gitlab # [ 266.342910] gitaly[914]: time="2026-09-06T06:50:21.731Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=314 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN97FDT4YG740JCY6NA38 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-06T12:50:21.721" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:21.722" grpc.time_ms=9.132 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2259gitlab # [ 266.344085] gitaly[914]: time="2026-09-06T06:50:21.770Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN97FDT4YG740JCY6NA38 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:50:51.669" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:21.769" grpc.time_ms=0.759 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2260gitlab # [ 266.423164] gitaly[914]: time="2026-09-06T06:50:21.778Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN97FDT4YG740JCY6NA38 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-06T06:50:31.012" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:21.772" grpc.time_ms=5.725 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2261gitlab # [ 266.424724] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:21 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1932262gitlab # [ 266.425766] gitaly[914]: time="2026-09-06T06:50:21.809Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN97FDT4YG740JCY6NA38 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-06T06:50:51.707" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:21.808" grpc.time_ms=1.262 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2263gitlab # [ 266.426916] gitaly[914]: time="2026-09-06T06:50:21.816Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=304 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN97FDT4YG740JCY6NA38 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-06T06:50:51.712" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:21.812" grpc.time_ms=4.006 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2264gitlab # [ 266.428865] gitaly[914]: time="2026-09-06T06:50:21.841Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN97FDT4YG740JCY6NA38 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:50:31.074" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:21.834" grpc.time_ms=6.722 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2265gitlab # [ 266.449340] gitaly[914]: time="2026-09-06T06:50:21.874Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQPYKHD5JM7KCHPVJXGW4N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:50:21.867" grpc.time_ms=6.134 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2266gitlab # [ 266.527292] gitaly[914]: time="2026-09-06T06:50:21.999Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQPYSNXZMEFNKWHXGKKK2B grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:50:21.991" pid=914 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2267gitlab # [ 266.528439] gitlab-workhorse[825]: time="2026-09-06T06:50:22Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672268gitlab # [ 266.529280] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:22 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1232269gitlab # [ 266.530194] gitaly[914]: time="2026-09-06T06:50:21.999Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQPYSNXZMEFNKWHXGKKK2B grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:50:21.991" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2270gitlab # [ 266.531073] gitaly[914]: time="2026-09-06T06:50:22.000Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQPYSNXZMEFNKWHXGKKK2B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:50:21.991" grpc.time_ms=8.317 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2271gitlab # [ 266.624514] nixbot[2666]: {"ts": "2026-09-06T06:50:22.141Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2272gitlab # [ 266.642735] gitaly[914]: time="2026-09-06T06:50:22.159Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=964 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN97FDT4YG740JCY6NA38 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-06T06:50:52.048" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:22.149" grpc.time_ms=10.558 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2273gitlab # [ 266.678144] gitaly[914]: time="2026-09-06T06:50:22.195Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN97FDT4YG740JCY6NA38 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-06T06:50:52.062" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:22.163" grpc.time_ms=31.62 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2274gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2275gitlab # [ 266.688740] sidekiq-cluster[2615]: {"severity":"WARN","time":"2026-09-06T06:50:22.205Z","class":"CreatePipelineWorker","correlation_id":"01M1TQN97FDT4YG740JCY6NA38","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"3a677d9a61d000feb5e6df34bb2f87d261723ea8","after":"bfeb273a2da919f0df84a793793005bc3005f6f5","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"bfeb273a2da919f0df84a793793005bc3005f6f5","ref":"refs/heads/master"},"retry":0}2276gitlab # [ 266.693802] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:22.210Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"618f1ba22850be71c6bbb413","created_at":"2026-09-06T06:50:19.281Z","trace_propagation_headers":{"sentry-trace":"15b2282b5ba84a53a00eab8c8b142a9e-654e32bd5e154fa1","baggage":"sentry-trace_id=15b2282b5ba84a53a00eab8c8b142a9e,sentry-release=Unknown"},"correlation_id":"01M1TQN97FDT4YG740JCY6NA38","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:08d5467ca949f730db7394d9010ca97dc7db290763656c3c005d7b5ed42f2a48","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:19.283Z","job_size_bytes":467,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-618f1ba22850be71c6bbb413: done: 0.46159 sec","job_status":"done","queue_duration_s":2.465354,"scheduling_latency_s":2.46538,"gitaly_calls":7,"gitaly_duration_s":0.075735,"redis_calls":33,"redis_duration_s":0.005041,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000657,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001122,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002369,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000893,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.361123,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.46159,"completed_at":"2026-09-06T06:50:22.210Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014252,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2277gitlab # [ 266.714473] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:22.212Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"d2fef09d-8807-42f5-88ea-997540af930e\"}"],"class":"WebHookWorker","jid":"56984b2852924196cd6eb85f","created_at":"2026-09-06T06:50:19.296Z","trace_propagation_headers":{"sentry-trace":"15b2282b5ba84a53a00eab8c8b142a9e-654e32bd5e154fa1","baggage":"sentry-trace_id=15b2282b5ba84a53a00eab8c8b142a9e,sentry-release=Unknown"},"correlation_id":"01M1TQN97FDT4YG740JCY6NA38","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f358a8d3e3292a4d8c2e0d024d5f4e8ad26ded2268dc7ad2a4ec2ce130d06a36","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:19.298Z","job_size_bytes":1749,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-56984b2852924196cd6eb85f: start","job_status":"start","queue_duration_s":2.91401,"scheduling_latency_s":2.914073}2278gitlab # [ 266.820168] gitaly[914]: time="2026-09-06T06:50:22.337Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQPZ2E3DF56K1H6WEXBSWZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:50:52.035" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:22.336" grpc.time_ms=0.738 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2279gitlab # [ 266.822949] nixbot[2666]: INFO: ::ffff:127.0.0.1:49856 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2280gitlab # [ 266.832675] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:22.349Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"d2fef09d-8807-42f5-88ea-997540af930e\"}"],"class":"WebHookWorker","jid":"56984b2852924196cd6eb85f","created_at":"2026-09-06T06:50:19.296Z","trace_propagation_headers":{"sentry-trace":"15b2282b5ba84a53a00eab8c8b142a9e-654e32bd5e154fa1","baggage":"sentry-trace_id=15b2282b5ba84a53a00eab8c8b142a9e,sentry-release=Unknown"},"correlation_id":"01M1TQN97FDT4YG740JCY6NA38","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f358a8d3e3292a4d8c2e0d024d5f4e8ad26ded2268dc7ad2a4ec2ce130d06a36","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:19.298Z","job_size_bytes":1749,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-56984b2852924196cd6eb85f: done: 0.137212 sec","job_status":"done","queue_duration_s":2.91401,"scheduling_latency_s":2.914073,"redis_calls":14,"redis_duration_s":0.002773,"redis_read_bytes":26,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.000465,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001517,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000791,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.008977398000013181,"cpu_s":0.021128,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.137212,"completed_at":"2026-09-06T06:50:22.349Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009241,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2281gitlab # [ 266.847084] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:22.351Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"56593161d3f83e836650c34a","created_at":"2026-09-06T06:50:19.861Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-a8451cdb5b964ba5","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:19.866Z","job_size_bytes":23,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-56593161d3f83e836650c34a: start","job_status":"start","queue_duration_s":2.484255,"scheduling_latency_s":2.484282}2282gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 0.30 seconds)2283gitlab # [ 266.916416] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:22.410Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"56593161d3f83e836650c34a","created_at":"2026-09-06T06:50:19.861Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-a8451cdb5b964ba5","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:19.866Z","job_size_bytes":23,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-56593161d3f83e836650c34a: done: 0.059808 sec","job_status":"done","queue_duration_s":2.484255,"scheduling_latency_s":2.484282,"redis_calls":10,"redis_duration_s":0.002365,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000451,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001492,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000422,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04365,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000410388,"duration_s":0.059808,"completed_at":"2026-09-06T06:50:22.410Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011011,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2284gitlab # [ 266.987223] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:22.412Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"a797d3f30a00338b0be7867e","created_at":"2026-09-06T06:50:20.135Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-a8451cdb5b964ba5","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.144Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-a797d3f30a00338b0be7867e: start","job_status":"start","queue_duration_s":2.267465,"scheduling_latency_s":2.267487}2285gitlab # [ 266.990428] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:22.439Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"a797d3f30a00338b0be7867e","created_at":"2026-09-06T06:50:20.135Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-a8451cdb5b964ba5","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.144Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-a797d3f30a00338b0be7867e: done: 0.02748 sec","job_status":"done","queue_duration_s":2.267465,"scheduling_latency_s":2.267487,"redis_calls":10,"redis_duration_s":0.002225,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000414,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001396,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000415,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01736,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000392787,"duration_s":0.02748,"completed_at":"2026-09-06T06:50:22.439Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004476,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2286gitlab # [ 267.071646] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:22.441Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"f93dc2fc10ddaf6f13a18cb5","created_at":"2026-09-06T06:50:20.187Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-a8451cdb5b964ba5","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.195Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-f93dc2fc10ddaf6f13a18cb5: start","job_status":"start","queue_duration_s":2.245429,"scheduling_latency_s":2.245449}2287gitlab # [ 267.072655] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:22.468Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"f93dc2fc10ddaf6f13a18cb5","created_at":"2026-09-06T06:50:20.187Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-a8451cdb5b964ba5","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.195Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-f93dc2fc10ddaf6f13a18cb5: done: 0.027127 sec","job_status":"done","queue_duration_s":2.245429,"scheduling_latency_s":2.245449,"redis_calls":10,"redis_duration_s":0.002147,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000387,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001343,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000417,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017558,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000355911,"duration_s":0.027127,"completed_at":"2026-09-06T06:50:22.468Z","load_balancing_strategy":"primary","db_duration_s":0.004176,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2288gitlab # [ 267.151822] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:22.469Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"a349b809a67a60fd396c2efd","created_at":"2026-09-06T06:50:20.206Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-a8451cdb5b964ba5","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.211Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-a349b809a67a60fd396c2efd: start","job_status":"start","queue_duration_s":2.258571,"scheduling_latency_s":2.258591}2289gitlab # [ 267.153893] nixbot[2666]: INFO: ::ffff:127.0.0.1:49870 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2290gitlab # [ 267.155591] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:22 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 982291gitlab # [ 267.159294] gitaly[914]: time="2026-09-06T06:50:22.601Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1TQPZD8E44RZCDQB8W6VB4X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=198 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:50:22.587" grpc.time_ms=14.199 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2292gitlab # [ 267.180277] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:22.580Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"a349b809a67a60fd396c2efd","created_at":"2026-09-06T06:50:20.206Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-a8451cdb5b964ba5","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.211Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-a349b809a67a60fd396c2efd: done: 0.111237 sec","job_status":"done","queue_duration_s":2.258571,"scheduling_latency_s":2.258591,"redis_calls":13,"redis_duration_s":0.006018,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000428,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003207,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001867,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000516,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.082848,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000386641,"duration_s":0.111237,"completed_at":"2026-09-06T06:50:22.580Z","load_balancing_strategy":"primary","db_duration_s":0.014336,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2293gitlab # [ 267.250880] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:22.583Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"f3b7a0043de73fa960fac17a","created_at":"2026-09-06T06:50:20.211Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-a8451cdb5b964ba5","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.215Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-f3b7a0043de73fa960fac17a: start","job_status":"start","queue_duration_s":2.367594,"scheduling_latency_s":2.367617}2294gitlab # [ 267.324595] gitaly[914]: time="2026-09-06T06:50:22.615Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=4 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1TQPZ2E3DF56K1H6WEXBSWZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:50:32.095" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:22.605" grpc.time_ms=9.972 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2295gitlab # [ 267.326326] nixbot[2666]: {"ts": "2026-09-06T06:50:22.694Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/3a677d9a61d000feb5e6df34bb2f87d261723ea8 \"HTTP/1.1 201 Created\""}2296gitlab # [ 267.327406] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:22 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3a677d9a61d000feb5e6df34bb2f87d261723ea8 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 5342297gitlab # [ 267.328257] gitlab-workhorse[825]: time="2026-09-06T06:50:22Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672298gitlab # [ 267.329335] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:22 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 922299gitlab # [ 267.334935] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:22 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 742300gitlab # [ 267.336378] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:22.622Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"f3b7a0043de73fa960fac17a","created_at":"2026-09-06T06:50:20.211Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-a8451cdb5b964ba5","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.215Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-f3b7a0043de73fa960fac17a: done: 0.039508 sec","job_status":"done","queue_duration_s":2.367594,"scheduling_latency_s":2.367617,"redis_calls":10,"redis_duration_s":0.003934,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000986,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002268,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00068,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022858,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003872,"duration_s":0.039508,"completed_at":"2026-09-06T06:50:22.622Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006764,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2301gitlab # [ 267.419244] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:22.624Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"3f9ca83f5b87cf7475f5194c","created_at":"2026-09-06T06:50:20.216Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-a8451cdb5b964ba5","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.221Z","job_size_bytes":19,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-3f9ca83f5b87cf7475f5194c: start","job_status":"start","queue_duration_s":2.402628,"scheduling_latency_s":2.402649}2302gitlab # [ 267.420865] gitaly[914]: time="2026-09-06T06:50:22.696Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQPZGDTAG4SY2QBVP3EYJJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:50:22.684" pid=914 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2303gitlab # [ 267.426172] nixbot[2666]: {"ts": "2026-09-06T06:50:22.886Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/3a677d9a61d000feb5e6df34bb2f87d261723ea8 \"HTTP/1.1 201 Created\""}2304gitlab # [ 267.494697] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:22.656Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"3f9ca83f5b87cf7475f5194c","created_at":"2026-09-06T06:50:20.216Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-a8451cdb5b964ba5","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.221Z","job_size_bytes":19,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-3f9ca83f5b87cf7475f5194c: done: 0.032621 sec","job_status":"done","queue_duration_s":2.402628,"scheduling_latency_s":2.402649,"redis_calls":11,"redis_duration_s":0.003299,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000973,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001648,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000678,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018443,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000362895,"duration_s":0.032621,"completed_at":"2026-09-06T06:50:22.656Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006454,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2305gitlab # [ 267.563421] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:22.658Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f3373e2a134f64e67f3c4e2c","created_at":"2026-09-06T06:50:20.223Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-a8451cdb5b964ba5","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.228Z","job_size_bytes":66,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f3373e2a134f64e67f3c4e2c: start","job_status":"start","queue_duration_s":2.430207,"scheduling_latency_s":2.430229}2306gitlab # [ 267.565171] gitlab-workhorse[825]: time="2026-09-06T06:50:22Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672307gitlab # [ 267.566200] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:22 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 622308gitlab # [ 267.567070] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:22 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3a677d9a61d000feb5e6df34bb2f87d261723ea8 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1802309gitlab # [ 267.568134] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:23 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3a677d9a61d000feb5e6df34bb2f87d261723ea8 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1722310gitlab # [ 267.569478] gitaly[914]: time="2026-09-06T06:50:22.697Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQPZGDTAG4SY2QBVP3EYJJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:50:22.684" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2311gitlab # [ 267.570374] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:22.701Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f3373e2a134f64e67f3c4e2c","created_at":"2026-09-06T06:50:20.223Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-a8451cdb5b964ba5","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.228Z","job_size_bytes":66,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f3373e2a134f64e67f3c4e2c: done: 0.043394 sec","job_status":"done","queue_duration_s":2.430207,"scheduling_latency_s":2.430229,"redis_calls":10,"redis_duration_s":0.009316999999999999,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00362,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002296,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003401,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018795,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000573537,"duration_s":0.043394,"completed_at":"2026-09-06T06:50:22.701Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006012,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2312gitlab # [ 267.649252] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:22.703Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"3aac4669e0e91072a444940a","created_at":"2026-09-06T06:50:20.229Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-a8451cdb5b964ba5","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.233Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-3aac4669e0e91072a444940a: start","job_status":"start","queue_duration_s":2.470356,"scheduling_latency_s":2.470384}2313gitlab # [ 267.718561] nixbot[2666]: {"ts": "2026-09-06T06:50:23.064Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/3a677d9a61d000feb5e6df34bb2f87d261723ea8 \"HTTP/1.1 201 Created\""}2314gitlab # [ 267.719965] nixbot[2666]: {"ts": "2026-09-06T06:50:23.191Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/bfeb273a2da919f0df84a793793005bc3005f6f5 \"HTTP/1.1 201 Created\""}2315gitlab # [ 267.721115] nixbot[2666]: {"ts": "2026-09-06T06:50:23.202Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-bfeb273a2da9-5"}2316gitlab # [ 267.722050] gitaly[914]: time="2026-09-06T06:50:22.697Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQPZGDTAG4SY2QBVP3EYJJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:50:22.684" grpc.time_ms=12.893 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2317gitlab # [ 267.722891] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:22.750Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"3aac4669e0e91072a444940a","created_at":"2026-09-06T06:50:20.229Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-a8451cdb5b964ba5","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.233Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-3aac4669e0e91072a444940a: done: 0.045633 sec","job_status":"done","queue_duration_s":2.470356,"scheduling_latency_s":2.470384,"redis_calls":10,"redis_duration_s":0.00329,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000531,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001973,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000786,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023147,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000526883,"duration_s":0.045633,"completed_at":"2026-09-06T06:50:22.749Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01104,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2318gitlab # [ 267.813494] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:22.753Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"6cefa5ebd4f47d015447d152","created_at":"2026-09-06T06:50:20.239Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-a8451cdb5b964ba5","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.243Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-6cefa5ebd4f47d015447d152: start","job_status":"start","queue_duration_s":2.509966,"scheduling_latency_s":2.509989}2319gitlab # [ 267.815125] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:23 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 2742320gitlab # [ 267.816193] gitaly[914]: time="2026-09-06T06:50:22.762Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQPZKG2FQYSM0MBVPWM4NQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:50:52.360" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:22.761" grpc.time_ms=0.649 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2321gitlab # [ 267.817084] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:22.811Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"6cefa5ebd4f47d015447d152","created_at":"2026-09-06T06:50:20.239Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-a8451cdb5b964ba5","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.243Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-6cefa5ebd4f47d015447d152: done: 0.058084 sec","job_status":"done","queue_duration_s":2.509966,"scheduling_latency_s":2.509989,"redis_calls":10,"redis_duration_s":0.016642,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.007335,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006892,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002415,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002062552,"duration_s":0.058084,"completed_at":"2026-09-06T06:50:22.811Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013773,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2322gitlab # [ 267.879140] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:22.813Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"25cae704f433862f7990ada7","created_at":"2026-09-06T06:50:20.244Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-a8451cdb5b964ba5","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.248Z","job_size_bytes":6,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-25cae704f433862f7990ada7: start","job_status":"start","queue_duration_s":2.564766,"scheduling_latency_s":2.564788}2323gitlab # [ 267.949501] nixbot[2666]: {"ts": "2026-09-06T06:50:23.302Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-bfeb273a2da9-5", "argv0": "bwrap"}2324gitlab # [ 267.950410] gitaly[914]: time="2026-09-06T06:50:22.808Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1TQPZME7CZA2K0V5XV7BD73 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:50:22.794" grpc.time_ms=13.968 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2325gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5'2326gitlab # [ 267.951336] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:22.842Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"25cae704f433862f7990ada7","created_at":"2026-09-06T06:50:20.244Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-a8451cdb5b964ba5","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.248Z","job_size_bytes":6,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-25cae704f433862f7990ada7: done: 0.028808 sec","job_status":"done","queue_duration_s":2.564766,"scheduling_latency_s":2.564788,"redis_calls":10,"redis_duration_s":0.0074,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000401,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006149,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00085,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012794,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039614,"duration_s":0.028808,"completed_at":"2026-09-06T06:50:22.842Z","load_balancing_strategy":"primary","db_duration_s":0.004127,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2327gitlab # [ 268.026332] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:22.847Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"06221f7aa79cfe5b09e5ae26","created_at":"2026-09-06T06:50:20.249Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-a8451cdb5b964ba5","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.253Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-06221f7aa79cfe5b09e5ae26: start","job_status":"start","queue_duration_s":2.593579,"scheduling_latency_s":2.593601}2328gitlab # [ 268.027456] gitaly[914]: time="2026-09-06T06:50:22.834Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=8 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQPZKG2FQYSM0MBVPWM4NQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:50:32.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:22.814" grpc.time_ms=20.351 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2329gitlab # [ 268.104643] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:22.898Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"06221f7aa79cfe5b09e5ae26","created_at":"2026-09-06T06:50:20.249Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-a8451cdb5b964ba5","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.253Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-06221f7aa79cfe5b09e5ae26: done: 0.051544 sec","job_status":"done","queue_duration_s":2.593579,"scheduling_latency_s":2.593601,"redis_calls":10,"redis_duration_s":0.008657,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000605,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006518,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001534,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026649,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000490286,"duration_s":0.051544,"completed_at":"2026-09-06T06:50:22.898Z","load_balancing_strategy":"primary","db_duration_s":0.009774,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2330gitlab # [ 268.107199] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:22.901Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"efdd05856042e6d1938e271c","created_at":"2026-09-06T06:50:20.258Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-a8451cdb5b964ba5","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.263Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-efdd05856042e6d1938e271c: start","job_status":"start","queue_duration_s":2.637796,"scheduling_latency_s":2.63782}2331gitlab # [ 268.133071] gitaly[914]: time="2026-09-06T06:50:22.872Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQPZPV27T1J5VXCHCA7AB6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:50:22.860" pid=914 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2332gitlab # [ 268.204916] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:22.974Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"efdd05856042e6d1938e271c","created_at":"2026-09-06T06:50:20.258Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-a8451cdb5b964ba5","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.263Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-efdd05856042e6d1938e271c: done: 0.072994 sec","job_status":"done","queue_duration_s":2.637796,"scheduling_latency_s":2.63782,"redis_calls":14,"redis_duration_s":0.0060999999999999995,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000619,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003362,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002119,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037945,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000669079,"duration_s":0.072994,"completed_at":"2026-09-06T06:50:22.974Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01777,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2333gitlab # [ 268.273245] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:22.975Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"66ccfa4877f2c3ae0462d28c","created_at":"2026-09-06T06:50:20.381Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-a8451cdb5b964ba5","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.385Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-66ccfa4877f2c3ae0462d28c: start","job_status":"start","queue_duration_s":2.590671,"scheduling_latency_s":2.590693}2334gitlab # [ 268.275226] gitaly[914]: time="2026-09-06T06:50:22.872Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQPZPV27T1J5VXCHCA7AB6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:50:22.860" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2335gitlab # [ 268.276237] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.111Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"17f0d3fd4e0b0453199424cb","created_at":"2026-09-06T06:50:23.109Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-22c26caa6f08470f","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"66ccfa4877f2c3ae0462d28c","job_size_bytes":3,"pid":2615,"job_status":"deduplicated","message":"PipelineProcessWorker JID-17f0d3fd4e0b0453199424cb: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2336gitlab # [ 268.343084] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.113Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"66ccfa4877f2c3ae0462d28c","created_at":"2026-09-06T06:50:20.381Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-a8451cdb5b964ba5","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.385Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2615,"job_status":"rescheduled","message":"PipelineProcessWorker JID-66ccfa4877f2c3ae0462d28c: rescheduled"}2337gitlab # [ 268.344306] gitaly[914]: time="2026-09-06T06:50:22.873Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQPZPV27T1J5VXCHCA7AB6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:50:22.860" grpc.time_ms=12.712 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2338gitlab # [ 268.345360] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.119Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"66ccfa4877f2c3ae0462d28c","created_at":"2026-09-06T06:50:20.381Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-a8451cdb5b964ba5","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.385Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-66ccfa4877f2c3ae0462d28c: done: 0.14407 sec","job_status":"done","queue_duration_s":2.590671,"scheduling_latency_s":2.590693,"gitaly_calls":2,"gitaly_duration_s":0.008123,"redis_calls":37,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.015603,"redis_read_bytes":139,"redis_write_bytes":6670,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.0037,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":8,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000607,"redis_cache_read_bytes":16,"redis_cache_write_bytes":735,"redis_queues_calls":4,"redis_queues_duration_s":0.001325,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2220,"redis_queues_metadata_calls":11,"redis_queues_metadata_duration_s":0.002589,"redis_queues_metadata_read_bytes":89,"redis_queues_metadata_write_bytes":1432,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000355,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000256,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003071,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":29,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":29,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":14,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.006,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.009,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.08793,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.106744013,"duration_s":0.14407,"completed_at":"2026-09-06T06:50:23.119Z","load_balancing_strategy":"primary","db_duration_s":0.029997,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2339gitlab # [ 268.414890] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.121Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"2b42b96735bf583b9fc66890","created_at":"2026-09-06T06:50:20.492Z","trace_propagation_headers":{"sentry-trace":"281151d1c86a47348c2fecf9f829b4e4-4428f1aba66147dd","baggage":"sentry-trace_id=281151d1c86a47348c2fecf9f829b4e4,sentry-release=Unknown"},"correlation_id":"01M1TQN3W93Y7PXGKKVXQS5E71","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.499Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-2b42b96735bf583b9fc66890: start","job_status":"start","queue_duration_s":2.621825,"scheduling_latency_s":2.621849}2340gitlab # [ 268.434853] gitaly[914]: time="2026-09-06T06:50:22.944Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQPZSDEN29Z1SD7VB8N166 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:50:52.042" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:22.943" grpc.time_ms=1.187 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2341gitlab # [ 268.510393] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.164Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"2b42b96735bf583b9fc66890","created_at":"2026-09-06T06:50:20.492Z","trace_propagation_headers":{"sentry-trace":"281151d1c86a47348c2fecf9f829b4e4-4428f1aba66147dd","baggage":"sentry-trace_id=281151d1c86a47348c2fecf9f829b4e4,sentry-release=Unknown"},"correlation_id":"01M1TQN3W93Y7PXGKKVXQS5E71","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.499Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-2b42b96735bf583b9fc66890: done: 0.04306 sec","job_status":"done","queue_duration_s":2.621825,"scheduling_latency_s":2.621849,"redis_calls":19,"redis_duration_s":0.004705,"redis_read_bytes":21,"redis_write_bytes":4291,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000943,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000564,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2262,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002219,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029052,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.007096712,"duration_s":0.04306,"completed_at":"2026-09-06T06:50:23.164Z","load_balancing_strategy":"primary","db_duration_s":0.006068,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2342gitlab # [ 268.525452] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.167Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","14c65430c8c1d7126962e061"],"class":"WebHooks::LogExecutionWorker","jid":"ade229047054f8e9e5f107ba","created_at":"2026-09-06T06:50:21.664Z","trace_propagation_headers":{"sentry-trace":"281151d1c86a47348c2fecf9f829b4e4-0069937f6a974d46","baggage":"sentry-trace_id=281151d1c86a47348c2fecf9f829b4e4,sentry-release=Unknown"},"correlation_id":"01M1TQN3W93Y7PXGKKVXQS5E71","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5df399d13ae888da338f9800434931cbe34ab7a50840bb352cc8466c4f48454c","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:21.674Z","job_size_bytes":2593,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-ade229047054f8e9e5f107ba: start","job_status":"start","queue_duration_s":1.492771,"scheduling_latency_s":1.492801}2343gitlab # [ 268.619420] gitaly[914]: time="2026-09-06T06:50:22.969Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQPZT65MV3A6199VPE1A2N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:50:52.568" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:22.968" grpc.time_ms=0.628 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2344gitlab # [ 268.620781] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.206Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","14c65430c8c1d7126962e061"],"class":"WebHooks::LogExecutionWorker","jid":"ade229047054f8e9e5f107ba","created_at":"2026-09-06T06:50:21.664Z","trace_propagation_headers":{"sentry-trace":"281151d1c86a47348c2fecf9f829b4e4-0069937f6a974d46","baggage":"sentry-trace_id=281151d1c86a47348c2fecf9f829b4e4,sentry-release=Unknown"},"correlation_id":"01M1TQN3W93Y7PXGKKVXQS5E71","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5df399d13ae888da338f9800434931cbe34ab7a50840bb352cc8466c4f48454c","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:21.674Z","job_size_bytes":2593,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-ade229047054f8e9e5f107ba: done: 0.038805 sec","job_status":"done","queue_duration_s":1.492771,"scheduling_latency_s":1.492801,"redis_calls":10,"redis_duration_s":0.002453,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000435,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001555,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000463,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026173,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00045313,"duration_s":0.038805,"completed_at":"2026-09-06T06:50:23.206Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006348,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2345gitlab # [ 268.694275] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.208Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","56984b2852924196cd6eb85f"],"class":"WebHooks::LogExecutionWorker","jid":"b89dbd467de1dc6633d99da3","created_at":"2026-09-06T06:50:22.341Z","trace_propagation_headers":{"sentry-trace":"15b2282b5ba84a53a00eab8c8b142a9e-0d7a027d3e35470f","baggage":"sentry-trace_id=15b2282b5ba84a53a00eab8c8b142a9e,sentry-release=Unknown"},"correlation_id":"01M1TQN97FDT4YG740JCY6NA38","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:13e57f260de8296a81dabb76523b48417d69a08bd90212a0242d95a8d43b0bf5","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:22.343Z","job_size_bytes":2591,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-b89dbd467de1dc6633d99da3: start","job_status":"start","queue_duration_s":0.863997,"scheduling_latency_s":0.864021}2346gitlab # [ 268.695526] gitaly[914]: time="2026-09-06T06:50:22.986Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=648 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=4 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1TQPZT65MV3A6199VPE1A2N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-06T06:50:52.576" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:22.977" grpc.time_ms=9.16 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2347gitlab # [ 268.696386] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.232Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","56984b2852924196cd6eb85f"],"class":"WebHooks::LogExecutionWorker","jid":"b89dbd467de1dc6633d99da3","created_at":"2026-09-06T06:50:22.341Z","trace_propagation_headers":{"sentry-trace":"15b2282b5ba84a53a00eab8c8b142a9e-0d7a027d3e35470f","baggage":"sentry-trace_id=15b2282b5ba84a53a00eab8c8b142a9e,sentry-release=Unknown"},"correlation_id":"01M1TQN97FDT4YG740JCY6NA38","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:13e57f260de8296a81dabb76523b48417d69a08bd90212a0242d95a8d43b0bf5","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:22.343Z","job_size_bytes":2591,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-b89dbd467de1dc6633d99da3: done: 0.024781 sec","job_status":"done","queue_duration_s":0.863997,"scheduling_latency_s":0.864021,"redis_calls":7,"redis_duration_s":0.001671,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001251,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00042,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024781,"completed_at":"2026-09-06T06:50:23.232Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004506,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2348gitlab # [ 268.795267] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.234Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"0e69e837b3cf1ad126b5b7c7","created_at":"2026-09-06T06:50:23.047Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-22c26caa6f08470f","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.051Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-0e69e837b3cf1ad126b5b7c7: start","job_status":"start","queue_duration_s":0.183007,"scheduling_latency_s":0.183029}2349gitlab # [ 268.796865] gitaly[914]: time="2026-09-06T06:50:23.001Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1TQPZT65MV3A6199VPE1A2N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:50:32.181" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:22.991" grpc.time_ms=10.14 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2350gitlab # [ 268.867199] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.263Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"0e69e837b3cf1ad126b5b7c7","created_at":"2026-09-06T06:50:23.047Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-22c26caa6f08470f","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.051Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-0e69e837b3cf1ad126b5b7c7: done: 0.029329 sec","job_status":"done","queue_duration_s":0.183007,"scheduling_latency_s":0.183029,"redis_calls":7,"redis_duration_s":0.001749,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0013,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000449,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019259,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029329,"completed_at":"2026-09-06T06:50:23.263Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004137,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2351gitlab # [ 268.868987] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.264Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"24885858d02214bb2fdc14d2","created_at":"2026-09-06T06:50:23.113Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-22c26caa6f08470f","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.114Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-24885858d02214bb2fdc14d2: start","job_status":"start","queue_duration_s":0.150203,"scheduling_latency_s":0.150225}2352gitlab # [ 268.951455] gitaly[914]: time="2026-09-06T06:50:23.010Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQPZSDEN29Z1SD7VB8N166 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:50:32.159" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:22.999" grpc.time_ms=10.768 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2353gitlab # [ 268.952964] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.526Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"24885858d02214bb2fdc14d2","created_at":"2026-09-06T06:50:23.113Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-22c26caa6f08470f","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.114Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-24885858d02214bb2fdc14d2: done: 0.26183 sec","job_status":"done","queue_duration_s":0.150203,"scheduling_latency_s":0.150225,"gitaly_calls":3,"gitaly_duration_s":0.124138,"redis_calls":71,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.014319,"redis_read_bytes":155,"redis_write_bytes":19879,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001125,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000851,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":23,"redis_queues_duration_s":0.003785,"redis_queues_read_bytes":29,"redis_queues_write_bytes":13381,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.004597,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3094,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000293,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000587,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001956,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.006,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.008,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.104878,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.234574226,"duration_s":0.26183,"completed_at":"2026-09-06T06:50:23.526Z","load_balancing_strategy":"primary","db_duration_s":0.028002,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2354gitlab # [ 269.030089] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.528Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"14c63885cd113c8a55b1d840","created_at":"2026-09-06T06:50:23.132Z","trace_propagation_headers":{"sentry-trace":"5db2283c599842368dbdb4590ab2f19b-ad154aff714f4206","baggage":"sentry-trace_id=5db2283c599842368dbdb4590ab2f19b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQPZT65MV3A6199VPE1A2N","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.136Z","job_size_bytes":65,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-14c63885cd113c8a55b1d840: start","job_status":"start","queue_duration_s":0.391992,"scheduling_latency_s":0.392014}2355gitlab # [ 269.031373] gitaly[914]: time="2026-09-06T06:50:23.027Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQPZT65MV3A6199VPE1A2N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-06T06:50:33.006" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:50:23.027" grpc.time_ms=0.451 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2356gitlab # [ 269.035924] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.557Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"14c63885cd113c8a55b1d840","created_at":"2026-09-06T06:50:23.132Z","trace_propagation_headers":{"sentry-trace":"5db2283c599842368dbdb4590ab2f19b-ad154aff714f4206","baggage":"sentry-trace_id=5db2283c599842368dbdb4590ab2f19b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQPZT65MV3A6199VPE1A2N","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.136Z","job_size_bytes":65,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-14c63885cd113c8a55b1d840: done: 0.029178 sec","job_status":"done","queue_duration_s":0.391992,"scheduling_latency_s":0.392014,"redis_calls":7,"redis_duration_s":0.002026,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001541,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000485,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019377,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029178,"completed_at":"2026-09-06T06:50:23.557Z","load_balancing_strategy":"primary","db_duration_s":0.00468,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2357gitlab # [ 269.111426] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.559Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"34e3298b38de48e28641e36f","created_at":"2026-09-06T06:50:23.137Z","trace_propagation_headers":{"sentry-trace":"5db2283c599842368dbdb4590ab2f19b-ad154aff714f4206","baggage":"sentry-trace_id=5db2283c599842368dbdb4590ab2f19b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQPZT65MV3A6199VPE1A2N","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.138Z","job_size_bytes":65,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-34e3298b38de48e28641e36f: start","job_status":"start","queue_duration_s":0.420341,"scheduling_latency_s":0.420373}2358gitlab # [ 269.129900] gitaly[914]: time="2026-09-06T06:50:23.046Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=5 command.system_time_ms=1 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQPZT65MV3A6199VPE1A2N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-06T06:50:33.010" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:23.031" grpc.time_ms=14.878 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2359gitlab # [ 269.151089] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.601Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"34e3298b38de48e28641e36f","created_at":"2026-09-06T06:50:23.137Z","trace_propagation_headers":{"sentry-trace":"5db2283c599842368dbdb4590ab2f19b-ad154aff714f4206","baggage":"sentry-trace_id=5db2283c599842368dbdb4590ab2f19b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQPZT65MV3A6199VPE1A2N","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.138Z","job_size_bytes":65,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-34e3298b38de48e28641e36f: done: 0.042602 sec","job_status":"done","queue_duration_s":0.420341,"scheduling_latency_s":0.420373,"redis_calls":10,"redis_duration_s":0.002306,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001196,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.00111,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02901,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042602,"completed_at":"2026-09-06T06:50:23.601Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009277,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2360gitlab # [ 269.222923] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.603Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"156bfce9bfd241a5c09aa1ee","created_at":"2026-09-06T06:50:23.152Z","trace_propagation_headers":{"sentry-trace":"281151d1c86a47348c2fecf9f829b4e4-c131b107e9f54ca7","baggage":"sentry-trace_id=281151d1c86a47348c2fecf9f829b4e4,sentry-release=Unknown"},"correlation_id":"01M1TQN3W93Y7PXGKKVXQS5E71","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.157Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-156bfce9bfd241a5c09aa1ee: start","job_status":"start","queue_duration_s":0.446065,"scheduling_latency_s":0.44609}2361gitlab # [ 269.297688] gitaly[914]: time="2026-09-06T06:50:23.071Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN9HTKD88XDGAPYZTXSNC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-06T06:50:53.068" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:23.068" grpc.time_ms=2.834 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2362gitlab # [ 269.298939] gitaly[914]: time="2026-09-06T06:50:23.086Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQPZT65MV3A6199VPE1A2N grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:50:23.084" grpc.time_ms=1.848 pid=914 span.kind=server system=grpc2363gitlab # [ 269.300159] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.669Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"156bfce9bfd241a5c09aa1ee","created_at":"2026-09-06T06:50:23.152Z","trace_propagation_headers":{"sentry-trace":"281151d1c86a47348c2fecf9f829b4e4-c131b107e9f54ca7","baggage":"sentry-trace_id=281151d1c86a47348c2fecf9f829b4e4,sentry-release=Unknown"},"correlation_id":"01M1TQN3W93Y7PXGKKVXQS5E71","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.157Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-156bfce9bfd241a5c09aa1ee: done: 0.066023 sec","job_status":"done","queue_duration_s":0.446065,"scheduling_latency_s":0.44609,"redis_calls":11,"redis_duration_s":0.002454,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000431,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001589,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000434,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045676,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000370159,"duration_s":0.066023,"completed_at":"2026-09-06T06:50:23.669Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015618,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2364gitlab # [ 269.370473] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.670Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"dc73ae51b04eb33aae8c786c","created_at":"2026-09-06T06:50:23.174Z","trace_propagation_headers":{"sentry-trace":"5db2283c599842368dbdb4590ab2f19b-ad154aff714f4206","baggage":"sentry-trace_id=5db2283c599842368dbdb4590ab2f19b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQPZT65MV3A6199VPE1A2N","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.177Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-dc73ae51b04eb33aae8c786c: start","job_status":"start","queue_duration_s":0.493565,"scheduling_latency_s":0.493587}2365gitlab # [ 269.373213] gitaly[914]: time="2026-09-06T06:50:23.104Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN9HTKD88XDGAPYZTXSNC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:50:53.003" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:23.103" grpc.time_ms=0.855 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2366gitlab # [ 269.449107] gitaly[914]: time="2026-09-06T06:50:23.118Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQPZT65MV3A6199VPE1A2N grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:50:23.116" grpc.time_ms=1.28 pid=914 span.kind=server system=grpc2367gitlab # [ 269.450225] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.763Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"dc73ae51b04eb33aae8c786c","created_at":"2026-09-06T06:50:23.174Z","trace_propagation_headers":{"sentry-trace":"5db2283c599842368dbdb4590ab2f19b-ad154aff714f4206","baggage":"sentry-trace_id=5db2283c599842368dbdb4590ab2f19b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQPZT65MV3A6199VPE1A2N","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.177Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-dc73ae51b04eb33aae8c786c: done: 0.093159 sec","job_status":"done","queue_duration_s":0.493565,"scheduling_latency_s":0.493587,"gitaly_calls":2,"gitaly_duration_s":0.005594,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.006304,"redis_read_bytes":80,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.0009,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001123,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000272,"redis_queues_read_bytes":3,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001498,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000229,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.00045,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000932,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.004,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065152,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.066735018,"duration_s":0.093159,"completed_at":"2026-09-06T06:50:23.763Z","load_balancing_strategy":"primary","db_duration_s":0.019799,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2368gitlab # [ 269.527106] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.765Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"d967a2bc15187f735d44a125","created_at":"2026-09-06T06:50:23.319Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-fda641756a4043bc","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.321Z","job_size_bytes":23,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-d967a2bc15187f735d44a125: start","job_status":"start","queue_duration_s":0.443347,"scheduling_latency_s":0.443402}2369gitlab # [ 269.528430] gitaly[914]: time="2026-09-06T06:50:23.126Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQPZT65MV3A6199VPE1A2N diskcache=41697054-4a06-4b89-8a8c-af57248814e3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-06T06:50:33.028" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:50:23.048" pid=914 ref=refs/keep-around/bfeb273a2da919f0df84a793793005bc3005f6f5 remote_ip="2001:db8:1::1" revision=bfeb273a2da919f0df84a793793005bc3005f6f5 span.kind=server system=grpc username=root2370gitlab # [ 269.530129] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.803Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"d967a2bc15187f735d44a125","created_at":"2026-09-06T06:50:23.319Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-fda641756a4043bc","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.321Z","job_size_bytes":23,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-d967a2bc15187f735d44a125: done: 0.037995 sec","job_status":"done","queue_duration_s":0.443347,"scheduling_latency_s":0.443402,"redis_calls":7,"redis_duration_s":0.001784,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001299,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000485,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027752,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037995,"completed_at":"2026-09-06T06:50:23.803Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006132,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2371gitlab # [ 269.624980] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.805Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"192d4ec958c87355bf40ad51","created_at":"2026-09-06T06:50:23.447Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-fda641756a4043bc","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.450Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-192d4ec958c87355bf40ad51: start","job_status":"start","queue_duration_s":0.354963,"scheduling_latency_s":0.35499}2372gitlab # [ 269.626399] gitaly[914]: time="2026-09-06T06:50:23.126Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=52 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4979 command.oublock=8 command.real_time_ms=70 command.spawn_token_fork_ms=1 command.system_time_ms=32 command.user_time_ms=20 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQPZT65MV3A6199VPE1A2N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-06T06:50:33.028" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:50:23.048" grpc.time_ms=77.824 pid=914 ref=refs/keep-around/bfeb273a2da919f0df84a793793005bc3005f6f5 remote_ip="2001:db8:1::1" revision=bfeb273a2da919f0df84a793793005bc3005f6f5 span.kind=server system=grpc username=root2373gitlab # [ 269.707958] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.828Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"192d4ec958c87355bf40ad51","created_at":"2026-09-06T06:50:23.447Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-fda641756a4043bc","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.450Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-192d4ec958c87355bf40ad51: done: 0.023778 sec","job_status":"done","queue_duration_s":0.354963,"scheduling_latency_s":0.35499,"redis_calls":7,"redis_duration_s":0.0016150000000000001,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001162,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000453,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015872,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023778,"completed_at":"2026-09-06T06:50:23.828Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003103,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2374gitlab # [ 269.712055] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.830Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"bd4cf70d1b8187df9becc293","created_at":"2026-09-06T06:50:23.457Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-fda641756a4043bc","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.459Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-bd4cf70d1b8187df9becc293: start","job_status":"start","queue_duration_s":0.37149,"scheduling_latency_s":0.371512}2375gitlab # [ 269.789402] gitaly[914]: time="2026-09-06T06:50:23.131Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQPZT65MV3A6199VPE1A2N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:50:53.029" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:23.130" grpc.time_ms=0.348 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2376gitlab # [ 269.790849] gitaly[914]: time="2026-09-06T06:50:23.354Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN9HTKD88XDGAPYZTXSNC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:50:23.353" grpc.time_ms=1.08 pid=914 span.kind=server system=grpc2377gitlab # [ 269.792054] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.854Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"bd4cf70d1b8187df9becc293","created_at":"2026-09-06T06:50:23.457Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-fda641756a4043bc","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.459Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-bd4cf70d1b8187df9becc293: done: 0.023461 sec","job_status":"done","queue_duration_s":0.37149,"scheduling_latency_s":0.371512,"redis_calls":7,"redis_duration_s":0.0015010000000000002,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001097,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000404,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01555,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023461,"completed_at":"2026-09-06T06:50:23.854Z","load_balancing_strategy":"primary","db_duration_s":0.003642,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2378gitlab # [ 269.875900] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.855Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"0aa32a556ef85bd7f0f70f22","created_at":"2026-09-06T06:50:23.465Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-fda641756a4043bc","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.466Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-0aa32a556ef85bd7f0f70f22: start","job_status":"start","queue_duration_s":0.38864,"scheduling_latency_s":0.388662}2379gitlab # [ 269.877333] gitaly[914]: time="2026-09-06T06:50:23.408Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN9HTKD88XDGAPYZTXSNC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:50:23.406" grpc.time_ms=0.441 pid=914 span.kind=server system=grpc2380gitlab # [ 269.878321] gitaly[914]: time="2026-09-06T06:50:23.431Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN9HTKD88XDGAPYZTXSNC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:50:23.430" grpc.time_ms=0.712 pid=914 span.kind=server system=grpc2381gitlab # [ 269.891092] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.881Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"0aa32a556ef85bd7f0f70f22","created_at":"2026-09-06T06:50:23.465Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-fda641756a4043bc","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.466Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-0aa32a556ef85bd7f0f70f22: done: 0.026143 sec","job_status":"done","queue_duration_s":0.38864,"scheduling_latency_s":0.388662,"redis_calls":10,"redis_duration_s":0.002572,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001155,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000938,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000479,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018163,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026143,"completed_at":"2026-09-06T06:50:23.881Z","load_balancing_strategy":"primary","db_duration_s":0.003513,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2382gitlab # [ 269.971244] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.883Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"4a3484a1f157ec01fe8af2e2","created_at":"2026-09-06T06:50:23.467Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-fda641756a4043bc","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.468Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-4a3484a1f157ec01fe8af2e2: start","job_status":"start","queue_duration_s":0.414717,"scheduling_latency_s":0.41474}2383gitlab # [ 270.050371] gitaly[914]: time="2026-09-06T06:50:23.442Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN9HTKD88XDGAPYZTXSNC diskcache=6497cbee-36f5-4751-b7a6-0a452dc8b7c0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-06T06:50:53.226" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:23.327" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2384gitlab # [ 270.051855] gitaly[914]: time="2026-09-06T06:50:23.443Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=76 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=6752 command.oublock=0 command.real_time_ms=107 command.spawn_token_fork_ms=1 command.system_time_ms=47 command.user_time_ms=29 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN9HTKD88XDGAPYZTXSNC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-06T06:50:53.226" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:23.327" grpc.time_ms=115.685 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2385gitlab # [ 270.053070] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.905Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"4a3484a1f157ec01fe8af2e2","created_at":"2026-09-06T06:50:23.467Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-fda641756a4043bc","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.468Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-4a3484a1f157ec01fe8af2e2: done: 0.022519 sec","job_status":"done","queue_duration_s":0.414717,"scheduling_latency_s":0.41474,"redis_calls":7,"redis_duration_s":0.001729,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001288,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000441,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015407,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022519,"completed_at":"2026-09-06T06:50:23.905Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003207,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2386gitlab # [ 270.087225] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.907Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"ab00538f475c365087d52bd7","created_at":"2026-09-06T06:50:23.469Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-fda641756a4043bc","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.471Z","job_size_bytes":19,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-ab00538f475c365087d52bd7: start","job_status":"start","queue_duration_s":0.436514,"scheduling_latency_s":0.436536}2387gitlab # [ 270.113165] gitaly[914]: time="2026-09-06T06:50:23.491Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN9HTKD88XDGAPYZTXSNC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-06T06:50:53.390" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:23.490" grpc.time_ms=0.904 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2388gitlab # [ 270.181734] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.928Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"ab00538f475c365087d52bd7","created_at":"2026-09-06T06:50:23.469Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-fda641756a4043bc","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.471Z","job_size_bytes":19,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-ab00538f475c365087d52bd7: done: 0.020482 sec","job_status":"done","queue_duration_s":0.436514,"scheduling_latency_s":0.436536,"redis_calls":8,"redis_duration_s":0.0016979999999999999,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001287,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000411,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013492,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020482,"completed_at":"2026-09-06T06:50:23.928Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002574,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2389gitlab # [ 270.253451] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.929Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"3ee521e80ff54d216b3d2d8d","created_at":"2026-09-06T06:50:23.471Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-fda641756a4043bc","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.473Z","job_size_bytes":66,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-3ee521e80ff54d216b3d2d8d: start","job_status":"start","queue_duration_s":0.45622,"scheduling_latency_s":0.456241}2390gitlab # [ 270.254866] gitaly[914]: time="2026-09-06T06:50:23.516Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN9HTKD88XDGAPYZTXSNC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:50:53.415" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:23.515" grpc.time_ms=0.629 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2391gitlab # [ 270.255943] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.951Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"3ee521e80ff54d216b3d2d8d","created_at":"2026-09-06T06:50:23.471Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-fda641756a4043bc","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.473Z","job_size_bytes":66,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-3ee521e80ff54d216b3d2d8d: done: 0.021631 sec","job_status":"done","queue_duration_s":0.45622,"scheduling_latency_s":0.456241,"redis_calls":7,"redis_duration_s":0.0034980000000000002,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00123,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002268,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013349,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021631,"completed_at":"2026-09-06T06:50:23.951Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002148,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2392gitlab # [ 270.332822] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.952Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"4bc3e1f8ec9cde605bf3e05f","created_at":"2026-09-06T06:50:23.473Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-fda641756a4043bc","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.475Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-4bc3e1f8ec9cde605bf3e05f: start","job_status":"start","queue_duration_s":0.477632,"scheduling_latency_s":0.477653}2393gitlab # [ 270.337405] gitaly[914]: time="2026-09-06T06:50:23.727Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQPZT65MV3A6199VPE1A2N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-06T06:50:53.626" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:23.727" grpc.time_ms=0.822 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2394gitlab # [ 270.406320] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.981Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"4bc3e1f8ec9cde605bf3e05f","created_at":"2026-09-06T06:50:23.473Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-fda641756a4043bc","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.475Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-4bc3e1f8ec9cde605bf3e05f: done: 0.028385 sec","job_status":"done","queue_duration_s":0.477632,"scheduling_latency_s":0.477653,"redis_calls":7,"redis_duration_s":0.0021579999999999998,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001499,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000659,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020232,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028385,"completed_at":"2026-09-06T06:50:23.981Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003806,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2395gitlab # [ 270.476283] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:23.983Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"87bdf4d983c5118487ecfc39","created_at":"2026-09-06T06:50:23.478Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-fda641756a4043bc","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.479Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-87bdf4d983c5118487ecfc39: start","job_status":"start","queue_duration_s":0.504059,"scheduling_latency_s":0.504099}2396gitlab # [ 270.477950] gitaly[914]: time="2026-09-06T06:50:23.754Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQPZT65MV3A6199VPE1A2N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:50:53.652" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:23.753" grpc.time_ms=0.626 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2397gitlab # [ 270.478756] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:24.007Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"87bdf4d983c5118487ecfc39","created_at":"2026-09-06T06:50:23.478Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-fda641756a4043bc","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.479Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-87bdf4d983c5118487ecfc39: done: 0.024211 sec","job_status":"done","queue_duration_s":0.504059,"scheduling_latency_s":0.504099,"redis_calls":7,"redis_duration_s":0.001641,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00115,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000491,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014453,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024211,"completed_at":"2026-09-06T06:50:24.007Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004142,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2398gitlab # [ 270.550984] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:24.009Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"425eb25c35767baa1f6118d7","created_at":"2026-09-06T06:50:23.480Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-fda641756a4043bc","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.481Z","job_size_bytes":6,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-425eb25c35767baa1f6118d7: start","job_status":"start","queue_duration_s":0.527998,"scheduling_latency_s":0.528022}2399gitlab # [ 270.557184] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:24.022Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"425eb25c35767baa1f6118d7","created_at":"2026-09-06T06:50:23.480Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-fda641756a4043bc","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.481Z","job_size_bytes":6,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-425eb25c35767baa1f6118d7: done: 0.01323 sec","job_status":"done","queue_duration_s":0.527998,"scheduling_latency_s":0.528022,"redis_calls":7,"redis_duration_s":0.001506,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001088,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000418,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00848,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01323,"completed_at":"2026-09-06T06:50:24.022Z","load_balancing_strategy":"primary","db_duration_s":0.000341,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2400gitlab # [ 270.628180] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:24.023Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"2acc91bbeaa763720b04dbf1","created_at":"2026-09-06T06:50:23.481Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-fda641756a4043bc","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.482Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-2acc91bbeaa763720b04dbf1: start","job_status":"start","queue_duration_s":0.541082,"scheduling_latency_s":0.541103}2401gitlab # [ 270.646154] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:24.045Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"2acc91bbeaa763720b04dbf1","created_at":"2026-09-06T06:50:23.481Z","trace_propagation_headers":{"sentry-trace":"18d90afacdf746b898630e3f9c8f0a4e-fda641756a4043bc","baggage":"sentry-trace_id=18d90afacdf746b898630e3f9c8f0a4e,sentry-release=Unknown"},"correlation_id":"01M1TQN9HTKD88XDGAPYZTXSNC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.482Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-2acc91bbeaa763720b04dbf1: done: 0.022017 sec","job_status":"done","queue_duration_s":0.541082,"scheduling_latency_s":0.541103,"redis_calls":7,"redis_duration_s":0.001668,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001216,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000452,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013034,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022017,"completed_at":"2026-09-06T06:50:24.045Z","load_balancing_strategy":"primary","db_duration_s":0.00505,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2402gitlab # [ 270.714483] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:24.047Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"10797903e1702f29f5a7c8a9","created_at":"2026-09-06T06:50:23.714Z","trace_propagation_headers":{"sentry-trace":"5db2283c599842368dbdb4590ab2f19b-b1d2f5736a5a406f","baggage":"sentry-trace_id=5db2283c599842368dbdb4590ab2f19b,sentry-release=Unknown"},"correlation_id":"01M1TQPZT65MV3A6199VPE1A2N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.716Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-10797903e1702f29f5a7c8a9: start","job_status":"start","queue_duration_s":0.330744,"scheduling_latency_s":0.330766}2403gitlab # [ 270.799525] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:24.074Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"10797903e1702f29f5a7c8a9","created_at":"2026-09-06T06:50:23.714Z","trace_propagation_headers":{"sentry-trace":"5db2283c599842368dbdb4590ab2f19b-b1d2f5736a5a406f","baggage":"sentry-trace_id=5db2283c599842368dbdb4590ab2f19b,sentry-release=Unknown"},"correlation_id":"01M1TQPZT65MV3A6199VPE1A2N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.716Z","job_size_bytes":3,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-10797903e1702f29f5a7c8a9: done: 0.02759 sec","job_status":"done","queue_duration_s":0.330744,"scheduling_latency_s":0.330766,"redis_calls":7,"redis_duration_s":0.0017040000000000002,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001239,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000465,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019374,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02759,"completed_at":"2026-09-06T06:50:24.074Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003882,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2404gitlab # [ 270.886569] nixbot[2666]: INFO: ::ffff:127.0.0.1:49886 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 200 OK2405gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bfeb273a2da919f0df84a793793005bc3005f6f5', in 2.92 seconds)2406(finished: subtest: push delivers the webhook, in 59.76 seconds)2407subtest: eval and build post commit statuses2408gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/bfeb273a2da919f0df84a793793005bc3005f6f5/statuses2409gitlab # [ 270.933245] nix-daemon[2896]: accepted connection from pid 3517, user nixbot2410gitlab # [ 270.994232] gitaly[914]: time="2026-09-06T06:50:26.511Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ395871BSZ0T64BHE92W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:50:56.409" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:26.510" grpc.time_ms=0.658 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2411gitlab # [ 271.016329] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:26 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/bfeb273a2da919f0df84a793793005bc3005f6f5/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 622412gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/bfeb273a2da919f0df84a793793005bc3005f6f5/statuses, in 0.12 seconds)2413gitlab # [ 271.856861] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:27.372Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"7e094929cb60f9eb1846c63a","created_at":"2026-09-06T06:50:27.346Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"23edcf3914cb393cad33ebec83d8df6d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.367Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-7e094929cb60f9eb1846c63a: start","job_status":"start","queue_duration_s":0.004486,"scheduling_latency_s":0.004553}2414gitlab # [ 271.997119] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:27.513Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}2415gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/bfeb273a2da919f0df84a793793005bc3005f6f5/statuses2416gitlab # [ 272.028544] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:27.544Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"7e094929cb60f9eb1846c63a","created_at":"2026-09-06T06:50:27.346Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"23edcf3914cb393cad33ebec83d8df6d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.367Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-7e094929cb60f9eb1846c63a: done: 0.172726 sec","job_status":"done","queue_duration_s":0.004486,"scheduling_latency_s":0.004553,"redis_calls":9,"redis_duration_s":0.025103,"redis_read_bytes":7,"redis_write_bytes":1112,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003424,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.015296,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006383,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.172726,"completed_at":"2026-09-06T06:50:27.544Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003118,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2417gitlab # [ 272.085594] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:27.549Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"9fe939c0aafd49243eb7b09c","created_at":"2026-09-06T06:50:27.461Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3c07da672f585324325fda61cec133f7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.488Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-9fe939c0aafd49243eb7b09c: start","job_status":"start","queue_duration_s":0.061174,"scheduling_latency_s":0.061235}2418gitlab # [ 272.116363] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:27.632Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"9fe939c0aafd49243eb7b09c","created_at":"2026-09-06T06:50:27.461Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3c07da672f585324325fda61cec133f7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.488Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-9fe939c0aafd49243eb7b09c: done: 0.083546 sec","job_status":"done","queue_duration_s":0.061174,"scheduling_latency_s":0.061235,"redis_calls":11,"redis_duration_s":0.023126,"redis_read_bytes":9,"redis_write_bytes":1459,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.003946,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.015094,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004086,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032222,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.083546,"completed_at":"2026-09-06T06:50:27.632Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009018,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2419gitlab # [ 272.133828] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:27.639Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"3a1b271cfc53065836972e70","created_at":"2026-09-06T06:50:27.511Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12548d7596197a8fe7656dc364abfb34","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-06T06:50:27.577Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-3a1b271cfc53065836972e70: start","job_status":"start","queue_duration_s":0.061076,"scheduling_latency_s":0.061131}2420gitlab # [ 272.157302] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:27.674Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}2421gitlab # [ 272.170274] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:27.687Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"3a1b271cfc53065836972e70","created_at":"2026-09-06T06:50:27.511Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12548d7596197a8fe7656dc364abfb34","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-06T06:50:27.577Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-3a1b271cfc53065836972e70: done: 0.048066 sec","job_status":"done","queue_duration_s":0.061076,"scheduling_latency_s":0.061131,"redis_calls":9,"redis_duration_s":0.011948,"redis_read_bytes":7,"redis_write_bytes":1152,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001447,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006796,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003705,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010713,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048066,"completed_at":"2026-09-06T06:50:27.686Z","load_balancing_strategy":"primary","db_duration_s":0.001293,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2422gitlab # [ 272.265986] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:27.689Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"9dc199b13259a1b1326cecf7","created_at":"2026-09-06T06:50:27.596Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d1259d2bc4d8f96a5d1b16c82973dedf","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.619Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-9dc199b13259a1b1326cecf7: start","job_status":"start","queue_duration_s":0.069755,"scheduling_latency_s":0.069777}2423gitlab # [ 272.267680] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:27.732Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"9dc199b13259a1b1326cecf7","created_at":"2026-09-06T06:50:27.596Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d1259d2bc4d8f96a5d1b16c82973dedf","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.619Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-9dc199b13259a1b1326cecf7: done: 0.042925 sec","job_status":"done","queue_duration_s":0.069755,"scheduling_latency_s":0.069777,"redis_calls":11,"redis_duration_s":0.01779,"redis_read_bytes":9,"redis_write_bytes":1174,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001153,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.014615,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.00042,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001602,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012667,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001056279,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.042925,"completed_at":"2026-09-06T06:50:27.732Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000507,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2424gitlab # [ 272.360155] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:27.735Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"18730f143788c82a805798d7","created_at":"2026-09-06T06:50:27.633Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"894ec0b8f453199cb3508e27e86b061d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.645Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-18730f143788c82a805798d7: start","job_status":"start","queue_duration_s":0.090158,"scheduling_latency_s":0.090182}2425gitlab # [ 272.361380] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:27.810Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"18730f143788c82a805798d7","created_at":"2026-09-06T06:50:27.633Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"894ec0b8f453199cb3508e27e86b061d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.645Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-18730f143788c82a805798d7: done: 0.074701 sec","job_status":"done","queue_duration_s":0.090158,"scheduling_latency_s":0.090182,"redis_calls":13,"redis_duration_s":0.009512,"redis_read_bytes":11,"redis_write_bytes":1780,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002993,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00359,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002929,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.015,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030801,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001128356,"exclusive_lock_hold_duration_s":0.038800462,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.074701,"completed_at":"2026-09-06T06:50:27.810Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021067,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2426gitlab # [ 272.433204] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:27.814Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"cae6c652fdebec349d4474b9","created_at":"2026-09-06T06:50:27.652Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba10077f630c2fbf97f07b042226b934","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.664Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-cae6c652fdebec349d4474b9: start","job_status":"start","queue_duration_s":0.149898,"scheduling_latency_s":0.149931}2427gitlab # [ 272.433748] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:27.852Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"cae6c652fdebec349d4474b9","created_at":"2026-09-06T06:50:27.652Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba10077f630c2fbf97f07b042226b934","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.664Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-cae6c652fdebec349d4474b9: done: 0.038168 sec","job_status":"done","queue_duration_s":0.149898,"scheduling_latency_s":0.149931,"redis_calls":9,"redis_duration_s":0.009468,"redis_read_bytes":7,"redis_write_bytes":984,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001862,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006923,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000683,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014178,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038168,"completed_at":"2026-09-06T06:50:27.852Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004369,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2428gitlab # [ 272.522120] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:27.855Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"b67405b79e282761cfde44a8","created_at":"2026-09-06T06:50:27.673Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cd686f9238b45d4cbaf31a00a5f9337f","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.685Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-b67405b79e282761cfde44a8: start","job_status":"start","queue_duration_s":0.169914,"scheduling_latency_s":0.169942}2429gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/bfeb273a2da919f0df84a793793005bc3005f6f5/statuses, in 0.55 seconds)2430gitlab # [ 272.561942] gitaly[914]: time="2026-09-06T06:50:28.078Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ4STB3EA8G2GQ5B1GZAG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:50:58.077" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:28.077" grpc.time_ms=0.628 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2431gitlab # [ 272.587555] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:28 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/bfeb273a2da919f0df84a793793005bc3005f6f5/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 762432gitlab # [ 273.101327] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:28.617Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"b67405b79e282761cfde44a8","created_at":"2026-09-06T06:50:27.673Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cd686f9238b45d4cbaf31a00a5f9337f","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.685Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-b67405b79e282761cfde44a8: done: 0.761334 sec","job_status":"done","queue_duration_s":0.169914,"scheduling_latency_s":0.169942,"redis_calls":564,"redis_duration_s":0.419585,"redis_read_bytes":562,"redis_write_bytes":49063,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000705,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003588,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.415292,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.385489,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.761334,"completed_at":"2026-09-06T06:50:28.616Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000372,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2433gitlab # [ 273.205433] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:28.619Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"54afd0cfc23c2da4cb6f9b05","created_at":"2026-09-06T06:50:27.693Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"55d54a0a82c4e37dc3cfd65510c8351e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.704Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-54afd0cfc23c2da4cb6f9b05: start","job_status":"start","queue_duration_s":0.915074,"scheduling_latency_s":0.915102}2434gitlab # [ 273.254176] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:28.770Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"54afd0cfc23c2da4cb6f9b05","created_at":"2026-09-06T06:50:27.693Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"55d54a0a82c4e37dc3cfd65510c8351e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.704Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-54afd0cfc23c2da4cb6f9b05: done: 0.151702 sec","job_status":"done","queue_duration_s":0.915074,"scheduling_latency_s":0.915102,"redis_calls":70,"redis_duration_s":0.031386,"redis_read_bytes":118,"redis_write_bytes":42580,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.004405,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001236,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.024406,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001339,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.115507,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.151702,"completed_at":"2026-09-06T06:50:28.770Z","load_balancing_strategy":"primary","db_duration_s":0.003855,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2435gitlab # [ 273.290558] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:28.773Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerExpirationPolicyWorker","jid":"9280792442a30db7b95d4ff8","created_at":"2026-09-06T06:50:27.724Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7db3e85f0980fdf0b3910c9063df7cfd","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ba5eeda814b310e5e806d97a55d657076d1f5f4bfe3538607468cb1befa65b3c","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.733Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerExpirationPolicyWorker JID-9280792442a30db7b95d4ff8: start","job_status":"start","queue_duration_s":1.039198,"scheduling_latency_s":1.039225}2436gitlab # [ 273.329255] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:28.845Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerExpirationPolicyWorker","jid":"9280792442a30db7b95d4ff8","created_at":"2026-09-06T06:50:27.724Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7db3e85f0980fdf0b3910c9063df7cfd","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ba5eeda814b310e5e806d97a55d657076d1f5f4bfe3538607468cb1befa65b3c","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.733Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerExpirationPolicyWorker JID-9280792442a30db7b95d4ff8: done: 0.072443 sec","job_status":"done","queue_duration_s":1.039198,"scheduling_latency_s":1.039225,"redis_calls":21,"redis_duration_s":0.011231,"redis_read_bytes":24,"redis_write_bytes":5391,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001917,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":724,"redis_queues_calls":2,"redis_queues_duration_s":0.000729,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3279,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.005866,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":782,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.002719,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":606,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043447,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.019102429,"extra.container_expiration_policy_worker.cleanup_required_count":0,"extra.container_expiration_policy_worker.cleanup_unfinished_count":0,"extra.container_expiration_policy_worker.cleanup_total_count":0,"duration_s":0.072443,"completed_at":"2026-09-06T06:50:28.845Z","load_balancing_strategy":"primary","db_duration_s":0.011117,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2437gitlab # [ 273.341381] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:28.849Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"cd9c7e867d68612fbff32686","created_at":"2026-09-06T06:50:27.737Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d2df358eb10d7c75515757ae0635e1f5","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.747Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-cd9c7e867d68612fbff32686: start","job_status":"start","queue_duration_s":1.101888,"scheduling_latency_s":1.101931}2438gitlab # [ 273.375972] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:28.892Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"cd9c7e867d68612fbff32686","created_at":"2026-09-06T06:50:27.737Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d2df358eb10d7c75515757ae0635e1f5","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.747Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-cd9c7e867d68612fbff32686: done: 0.043325 sec","job_status":"done","queue_duration_s":1.101888,"scheduling_latency_s":1.101931,"redis_calls":10,"redis_duration_s":0.00519,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001136,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00317,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000884,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025655,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000823847,"duration_s":0.043325,"completed_at":"2026-09-06T06:50:28.892Z","load_balancing_strategy":"primary","db_duration_s":0.002807,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2439gitlab # [ 273.474622] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:28.895Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"b0045d2c9eb70b7b98a83f70","created_at":"2026-09-06T06:50:27.754Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"41e277bea5d28b72311c0f06b73e7b5b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.762Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-b0045d2c9eb70b7b98a83f70: start","job_status":"start","queue_duration_s":1.13288,"scheduling_latency_s":1.132931}2440gitlab # [ 273.476339] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:28.948Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"b0045d2c9eb70b7b98a83f70","created_at":"2026-09-06T06:50:27.754Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"41e277bea5d28b72311c0f06b73e7b5b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.762Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-b0045d2c9eb70b7b98a83f70: done: 0.052369 sec","job_status":"done","queue_duration_s":1.13288,"scheduling_latency_s":1.132931,"redis_calls":18,"redis_duration_s":0.0087,"redis_read_bytes":20,"redis_write_bytes":4698,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001966,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000645,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.004401,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001688,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031391,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.052369,"completed_at":"2026-09-06T06:50:28.947Z","load_balancing_strategy":"primary","db_duration_s":0.003736,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2441gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/bfeb273a2da919f0df84a793793005bc3005f6f5/statuses2442gitlab # [ 273.577436] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:28.950Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"b17bb6c8b93cede75d1e60d4","created_at":"2026-09-06T06:50:27.775Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3fa99852cf5649b97bbf146a26e5ff5a","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.782Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-b17bb6c8b93cede75d1e60d4: start","job_status":"start","queue_duration_s":1.167132,"scheduling_latency_s":1.167158}2443gitlab # [ 273.579130] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:28.970Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"b17bb6c8b93cede75d1e60d4","created_at":"2026-09-06T06:50:27.775Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3fa99852cf5649b97bbf146a26e5ff5a","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.782Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-b17bb6c8b93cede75d1e60d4: done: 0.020589 sec","job_status":"done","queue_duration_s":1.167132,"scheduling_latency_s":1.167158,"redis_calls":10,"redis_duration_s":0.004119,"redis_read_bytes":9,"redis_write_bytes":1179,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000854,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002367,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000898,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":238,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011479,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000582755,"duration_s":0.020589,"completed_at":"2026-09-06T06:50:28.970Z","load_balancing_strategy":"primary","db_duration_s":0.000671,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2444gitlab # [ 273.601993] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:28.972Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"2795f4737d9dd703cd45cac7","created_at":"2026-09-06T06:50:27.792Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"60d68bfabd00d5bc5183500d8b327247","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.800Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-2795f4737d9dd703cd45cac7: start","job_status":"start","queue_duration_s":1.172351,"scheduling_latency_s":1.172372}2445gitlab # [ 273.625119] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:28.984Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}2446gitlab # [ 273.695082] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:28.991Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"2795f4737d9dd703cd45cac7","created_at":"2026-09-06T06:50:27.792Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"60d68bfabd00d5bc5183500d8b327247","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.800Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-2795f4737d9dd703cd45cac7: done: 0.018666 sec","job_status":"done","queue_duration_s":1.172351,"scheduling_latency_s":1.172372,"redis_calls":9,"redis_duration_s":0.004076,"redis_read_bytes":7,"redis_write_bytes":1178,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000837,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002387,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000852,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010104,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018666,"completed_at":"2026-09-06T06:50:28.991Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000662,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2447gitlab # [ 273.700776] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:28.993Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"5a82c43604f743ab88f1f7c6","created_at":"2026-09-06T06:50:27.806Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff9ea0674da44ffe265901ac39878230","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.817Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-5a82c43604f743ab88f1f7c6: start","job_status":"start","queue_duration_s":1.175922,"scheduling_latency_s":1.175943}2448gitlab # [ 273.780473] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.019Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"5a82c43604f743ab88f1f7c6","created_at":"2026-09-06T06:50:27.806Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff9ea0674da44ffe265901ac39878230","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.817Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-5a82c43604f743ab88f1f7c6: done: 0.025514 sec","job_status":"done","queue_duration_s":1.175922,"scheduling_latency_s":1.175943,"redis_calls":9,"redis_duration_s":0.004314,"redis_read_bytes":7,"redis_write_bytes":1026,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001046,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00244,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000828,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012318,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025514,"completed_at":"2026-09-06T06:50:29.019Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005417,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2449gitlab # [ 273.849375] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.021Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"fa108b9fdbb51c808e2a213e","created_at":"2026-09-06T06:50:27.830Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"23b549dd5c4dce4bfed194c8cf8d85e0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-06T06:50:27.839Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-fa108b9fdbb51c808e2a213e: start","job_status":"start","queue_duration_s":1.182123,"scheduling_latency_s":1.182145}2450gitlab # [ 273.850898] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.036Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}2451gitlab # [ 273.852430] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:29 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/bfeb273a2da919f0df84a793793005bc3005f6f5/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 632452gitlab # [ 273.853463] gitaly[914]: time="2026-09-06T06:50:29.229Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ5Y2VNYR1D5NCYZ3H6D7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:50:59.125" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:29.226" grpc.time_ms=3.562 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2453gitlab # [ 273.854351] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.043Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"fa108b9fdbb51c808e2a213e","created_at":"2026-09-06T06:50:27.830Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"23b549dd5c4dce4bfed194c8cf8d85e0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-06T06:50:27.839Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-fa108b9fdbb51c808e2a213e: done: 0.022585 sec","job_status":"done","queue_duration_s":1.182123,"scheduling_latency_s":1.182145,"redis_calls":9,"redis_duration_s":0.004808,"redis_read_bytes":7,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001135,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002271,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001402,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012472,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022585,"completed_at":"2026-09-06T06:50:29.043Z","load_balancing_strategy":"primary","db_duration_s":0.000878,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2454gitlab # [ 273.927190] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.045Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"a664917565818caa9c3cbaf7","created_at":"2026-09-06T06:50:27.846Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7c6e1456f82d0cd9c15004944029904d","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.854Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-a664917565818caa9c3cbaf7: start","job_status":"start","queue_duration_s":1.191034,"scheduling_latency_s":1.191061}2455gitlab # [ 273.928789] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.090Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"a664917565818caa9c3cbaf7","created_at":"2026-09-06T06:50:27.846Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7c6e1456f82d0cd9c15004944029904d","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.854Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-a664917565818caa9c3cbaf7: done: 0.044371 sec","job_status":"done","queue_duration_s":1.191034,"scheduling_latency_s":1.191061,"redis_calls":10,"redis_duration_s":0.004215,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00081,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002556,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000849,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018786,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00065567,"extra.pages_deactivate_expired_deployments_cron_worker.deactivate_expired_pages_deployments":{"deactivated_deployments":0,"duration":0.002739733},"duration_s":0.044371,"completed_at":"2026-09-06T06:50:29.090Z","load_balancing_strategy":"primary","db_duration_s":0.017525,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2456gitlab # [ 274.016199] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.092Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"7ea86f5dd673fb51a27e3382","created_at":"2026-09-06T06:50:27.860Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4e2efcdb275314416cd3fda7211a2619","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.869Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-7ea86f5dd673fb51a27e3382: start","job_status":"start","queue_duration_s":1.22326,"scheduling_latency_s":1.223281}2457gitlab # [ 274.017735] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.105Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}2458gitlab # [ 274.018994] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.111Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"7ea86f5dd673fb51a27e3382","created_at":"2026-09-06T06:50:27.860Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4e2efcdb275314416cd3fda7211a2619","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.869Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-7ea86f5dd673fb51a27e3382: done: 0.019427 sec","job_status":"done","queue_duration_s":1.22326,"scheduling_latency_s":1.223281,"redis_calls":9,"redis_duration_s":0.00384,"redis_read_bytes":7,"redis_write_bytes":1185,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000792,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00223,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000818,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01011,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019427,"completed_at":"2026-09-06T06:50:29.111Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000891,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2459gitlab # [ 274.097827] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.113Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"cb2c754d607a0519e003b312","created_at":"2026-09-06T06:50:27.878Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"98620ee17b9ed1d007b1847d828d8bf1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.886Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-cb2c754d607a0519e003b312: start","job_status":"start","queue_duration_s":1.227299,"scheduling_latency_s":1.227321}2460gitlab # [ 274.101537] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.308Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"cb2c754d607a0519e003b312","created_at":"2026-09-06T06:50:27.878Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"98620ee17b9ed1d007b1847d828d8bf1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.886Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-cb2c754d607a0519e003b312: done: 0.194787 sec","job_status":"done","queue_duration_s":1.227299,"scheduling_latency_s":1.227321,"redis_calls":13,"redis_duration_s":0.004941,"redis_read_bytes":11,"redis_write_bytes":1567,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001708,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001677,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001556,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.049,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.049,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.127524,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000724114,"exclusive_lock_hold_duration_s":0.171866536,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.194787,"completed_at":"2026-09-06T06:50:29.308Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.072582,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2461gitlab # [ 274.171600] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.310Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"d6f30ee4f06009f0cd78a1a7","created_at":"2026-09-06T06:50:27.893Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0594a898f3c477e8339f23fe6f1cf0d9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.900Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-d6f30ee4f06009f0cd78a1a7: start","job_status":"start","queue_duration_s":1.409593,"scheduling_latency_s":1.409615}2462gitlab # [ 274.193198] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.338Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"d6f30ee4f06009f0cd78a1a7","created_at":"2026-09-06T06:50:27.893Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0594a898f3c477e8339f23fe6f1cf0d9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.900Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-d6f30ee4f06009f0cd78a1a7: done: 0.028408 sec","job_status":"done","queue_duration_s":1.409593,"scheduling_latency_s":1.409615,"redis_calls":11,"redis_duration_s":0.00247,"redis_read_bytes":9,"redis_write_bytes":1518,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000432,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001117,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000921,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01579,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00047073,"exclusive_lock_hold_duration_s":0.007683658,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.028408,"completed_at":"2026-09-06T06:50:29.338Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006665,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2463gitlab # [ 274.262491] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.339Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"f1d55f6986f4ca12cd6bb772","created_at":"2026-09-06T06:50:27.906Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab2535d51e1f0557113c6185a11f05d5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.913Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-f1d55f6986f4ca12cd6bb772: start","job_status":"start","queue_duration_s":1.426538,"scheduling_latency_s":1.426559}2464gitlab # [ 274.336362] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.352Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}2465gitlab # [ 274.337491] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.359Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"f1d55f6986f4ca12cd6bb772","created_at":"2026-09-06T06:50:27.906Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab2535d51e1f0557113c6185a11f05d5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.913Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-f1d55f6986f4ca12cd6bb772: done: 0.019291 sec","job_status":"done","queue_duration_s":1.426538,"scheduling_latency_s":1.426559,"redis_calls":9,"redis_duration_s":0.002266,"redis_read_bytes":7,"redis_write_bytes":1105,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000432,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001258,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000576,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012549,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019291,"completed_at":"2026-09-06T06:50:29.358Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000459,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2466gitlab # [ 274.356218] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.360Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"94bfb173a528fcc87c5ad50d","created_at":"2026-09-06T06:50:27.925Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9b97f34d331b0460841e09b9a72b0cc6","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.932Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-94bfb173a528fcc87c5ad50d: start","job_status":"start","queue_duration_s":1.427709,"scheduling_latency_s":1.427737}2467gitlab # [ 274.378403] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.384Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"94bfb173a528fcc87c5ad50d","created_at":"2026-09-06T06:50:27.925Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9b97f34d331b0460841e09b9a72b0cc6","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.932Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-94bfb173a528fcc87c5ad50d: done: 0.023994 sec","job_status":"done","queue_duration_s":1.427709,"scheduling_latency_s":1.427737,"redis_calls":9,"redis_duration_s":0.002064,"redis_read_bytes":7,"redis_write_bytes":1183,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000416,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001147,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000501,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012087,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.023994,"completed_at":"2026-09-06T06:50:29.384Z","load_balancing_strategy":"primary","db_duration_s":0.005873,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2468gitlab # [ 274.458368] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.386Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"bf7d183658ca90e98dcd31b4","created_at":"2026-09-06T06:50:27.939Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6da44c3a0603dbb72b1be585d6146346","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.946Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-bf7d183658ca90e98dcd31b4: start","job_status":"start","queue_duration_s":1.439079,"scheduling_latency_s":1.439101}2469gitlab # [ 274.467389] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.402Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"bf7d183658ca90e98dcd31b4","created_at":"2026-09-06T06:50:27.939Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6da44c3a0603dbb72b1be585d6146346","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.946Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-bf7d183658ca90e98dcd31b4: done: 0.016366 sec","job_status":"done","queue_duration_s":1.439079,"scheduling_latency_s":1.439101,"redis_calls":9,"redis_duration_s":0.002055,"redis_read_bytes":7,"redis_write_bytes":1119,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000478,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001134,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000443,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009895,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016366,"completed_at":"2026-09-06T06:50:29.402Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000371,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2470gitlab # [ 274.553975] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.403Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"7a0d79f2c0fa66ce08a82885","created_at":"2026-09-06T06:50:27.959Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c9720aa16d0da482c36d955d56b881a4","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.967Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-7a0d79f2c0fa66ce08a82885: start","job_status":"start","queue_duration_s":1.435773,"scheduling_latency_s":1.435794}2471gitlab # [ 274.555419] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.423Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"7a0d79f2c0fa66ce08a82885","created_at":"2026-09-06T06:50:27.959Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c9720aa16d0da482c36d955d56b881a4","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.967Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-7a0d79f2c0fa66ce08a82885: done: 0.020129 sec","job_status":"done","queue_duration_s":1.435773,"scheduling_latency_s":1.435794,"redis_calls":9,"redis_duration_s":0.00192,"redis_read_bytes":7,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000419,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001072,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000429,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012306,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020129,"completed_at":"2026-09-06T06:50:29.423Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002043,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2472gitlab # [ 274.636221] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.425Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"1321774476538a393d4efd15","created_at":"2026-09-06T06:50:27.975Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"567502ab847d7ce9502dab78e673336c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.982Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-1321774476538a393d4efd15: start","job_status":"start","queue_duration_s":1.442705,"scheduling_latency_s":1.442771}2473gitlab # [ 274.643546] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.450Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"1321774476538a393d4efd15","created_at":"2026-09-06T06:50:27.975Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"567502ab847d7ce9502dab78e673336c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.982Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-1321774476538a393d4efd15: done: 0.025141 sec","job_status":"done","queue_duration_s":1.442705,"scheduling_latency_s":1.442771,"redis_calls":20,"redis_duration_s":0.003928,"redis_read_bytes":23,"redis_write_bytes":4316,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001286,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1065,"redis_queues_calls":4,"redis_queues_duration_s":0.000534,"redis_queues_read_bytes":6,"redis_queues_write_bytes":2021,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.0017,"redis_queues_metadata_read_bytes":8,"redis_queues_metadata_write_bytes":1004,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000408,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017158,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000354794,"duration_s":0.025141,"completed_at":"2026-09-06T06:50:29.450Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001047,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2474gitlab # [ 274.733255] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.451Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"b5793e5e2eb7660aa7d8771f","created_at":"2026-09-06T06:50:27.989Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a13b3a1d995c526938b3c8a207fa7067","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.995Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-b5793e5e2eb7660aa7d8771f: start","job_status":"start","queue_duration_s":1.455666,"scheduling_latency_s":1.455687}2475gitlab # [ 274.734797] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.467Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"b5793e5e2eb7660aa7d8771f","created_at":"2026-09-06T06:50:27.989Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a13b3a1d995c526938b3c8a207fa7067","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:27.995Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-b5793e5e2eb7660aa7d8771f: done: 0.016178 sec","job_status":"done","queue_duration_s":1.455666,"scheduling_latency_s":1.455687,"redis_calls":11,"redis_duration_s":0.002279,"redis_read_bytes":8,"redis_write_bytes":1094,"redis_cache_calls":2,"redis_cache_duration_s":0.000427,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0004,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001039,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":482,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000413,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009675,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016178,"completed_at":"2026-09-06T06:50:29.467Z","load_balancing_strategy":"primary","db_duration_s":0.000335,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2476gitlab # [ 274.814162] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.469Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"51fba01f6a95e57af760d4be","created_at":"2026-09-06T06:50:28.004Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2d83c7f269f2b718cb7411bc3a59f778","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:28.012Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-51fba01f6a95e57af760d4be: start","job_status":"start","queue_duration_s":1.456157,"scheduling_latency_s":1.456178}2477gitlab # [ 274.820324] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.493Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"51fba01f6a95e57af760d4be","created_at":"2026-09-06T06:50:28.004Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2d83c7f269f2b718cb7411bc3a59f778","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:28.012Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-51fba01f6a95e57af760d4be: done: 0.024051 sec","job_status":"done","queue_duration_s":1.456157,"scheduling_latency_s":1.456178,"redis_calls":12,"redis_duration_s":0.002709,"redis_read_bytes":10,"redis_write_bytes":1576,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000418,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001302,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000989,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015324,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.005819455,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.024051,"completed_at":"2026-09-06T06:50:29.493Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001943,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2478gitlab # [ 274.888810] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.494Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"6334d3d93d0cb3fa2fbde027","created_at":"2026-09-06T06:50:28.020Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"167617dec5c8169f7c31b282d0f0925e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-06T06:50:28.027Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-6334d3d93d0cb3fa2fbde027: start","job_status":"start","queue_duration_s":1.466995,"scheduling_latency_s":1.467016}2479gitlab # [ 274.971415] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.518Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"6334d3d93d0cb3fa2fbde027","created_at":"2026-09-06T06:50:28.020Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"167617dec5c8169f7c31b282d0f0925e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-06T06:50:28.027Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-6334d3d93d0cb3fa2fbde027: done: 0.024047 sec","job_status":"done","queue_duration_s":1.466995,"scheduling_latency_s":1.467016,"redis_calls":9,"redis_duration_s":0.0020340000000000002,"redis_read_bytes":7,"redis_write_bytes":1068,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000448,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001103,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000483,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015474,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024047,"completed_at":"2026-09-06T06:50:29.518Z","load_balancing_strategy":"primary","db_duration_s":0.002185,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2480gitlab # [ 274.973208] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.519Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"490bd467cf5ad938f9195d9f","created_at":"2026-09-06T06:50:28.037Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"60d03cd9089f225b6b0fdbfef9fdbd74","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:28.047Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-490bd467cf5ad938f9195d9f: start","job_status":"start","queue_duration_s":1.471936,"scheduling_latency_s":1.471959}2481gitlab # [ 275.051516] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.538Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"490bd467cf5ad938f9195d9f","created_at":"2026-09-06T06:50:28.037Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"60d03cd9089f225b6b0fdbfef9fdbd74","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:28.047Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-490bd467cf5ad938f9195d9f: done: 0.018246 sec","job_status":"done","queue_duration_s":1.471936,"scheduling_latency_s":1.471959,"redis_calls":10,"redis_duration_s":0.00219,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00042,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001361,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000409,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010561,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039586,"duration_s":0.018246,"completed_at":"2026-09-06T06:50:29.538Z","load_balancing_strategy":"primary","db_duration_s":0.001014,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2482gitlab # [ 275.057784] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.539Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"bd16dd15d5c0bfbbba6700d0","created_at":"2026-09-06T06:50:28.055Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff965bc4e9cf80dd9d767a3b505151c2","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:28.067Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-bd16dd15d5c0bfbbba6700d0: start","job_status":"start","queue_duration_s":1.471617,"scheduling_latency_s":1.471638}2483gitlab # [ 275.081044] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.559Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"bd16dd15d5c0bfbbba6700d0","created_at":"2026-09-06T06:50:28.055Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff965bc4e9cf80dd9d767a3b505151c2","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:28.067Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-bd16dd15d5c0bfbbba6700d0: done: 0.019947 sec","job_status":"done","queue_duration_s":1.471617,"scheduling_latency_s":1.471638,"redis_calls":11,"redis_duration_s":0.002633,"redis_read_bytes":9,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000426,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001228,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011807,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00048833,"exclusive_lock_hold_duration_s":0.00305346,"duration_s":0.019947,"completed_at":"2026-09-06T06:50:29.559Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001607,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2484gitlab # [ 275.150246] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.560Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"667dd555df51c8a1e7dc6a44","created_at":"2026-09-06T06:50:28.152Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"04407161f23bdadefd65ff3f3859e24b","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:28.161Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-667dd555df51c8a1e7dc6a44: start","job_status":"start","queue_duration_s":1.399916,"scheduling_latency_s":1.399937}2485gitlab # [ 275.223446] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.580Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"667dd555df51c8a1e7dc6a44","created_at":"2026-09-06T06:50:28.152Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"04407161f23bdadefd65ff3f3859e24b","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:28.161Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-667dd555df51c8a1e7dc6a44: done: 0.019533 sec","job_status":"done","queue_duration_s":1.399916,"scheduling_latency_s":1.399937,"redis_calls":11,"redis_duration_s":0.002505,"redis_read_bytes":9,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000409,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001143,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000953,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011197,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000436927,"exclusive_lock_hold_duration_s":0.001827048,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.019533,"completed_at":"2026-09-06T06:50:29.580Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001071,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2486gitlab # [ 275.292081] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.582Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"3cf4b567b1bd9e329e8d38ea","created_at":"2026-09-06T06:50:28.172Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d55127f69ff494123154fac98e0a6ecf","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:28.183Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-3cf4b567b1bd9e329e8d38ea: start","job_status":"start","queue_duration_s":1.398564,"scheduling_latency_s":1.398586}2487gitlab # [ 275.293152] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.601Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"3cf4b567b1bd9e329e8d38ea","created_at":"2026-09-06T06:50:28.172Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d55127f69ff494123154fac98e0a6ecf","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:28.183Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-3cf4b567b1bd9e329e8d38ea: done: 0.019588 sec","job_status":"done","queue_duration_s":1.398564,"scheduling_latency_s":1.398586,"redis_calls":10,"redis_duration_s":0.002414,"redis_read_bytes":9,"redis_write_bytes":1087,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000418,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001547,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":566,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000449,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":216,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012272,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000557892,"duration_s":0.019588,"completed_at":"2026-09-06T06:50:29.601Z","load_balancing_strategy":"primary","db_duration_s":0.000353,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2488gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/bfeb273a2da919f0df84a793793005bc3005f6f5/statuses, in 1.81 seconds)2489gitlab # [ 275.372920] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.603Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"8b7fc64d1c4b33440bc22561","created_at":"2026-09-06T06:50:28.192Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e97b7e5785a58b2d18546d85209fb3dc","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:28.202Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-8b7fc64d1c4b33440bc22561: start","job_status":"start","queue_duration_s":1.400534,"scheduling_latency_s":1.400555}2490gitlab # [ 275.374440] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.625Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"8b7fc64d1c4b33440bc22561","created_at":"2026-09-06T06:50:28.192Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e97b7e5785a58b2d18546d85209fb3dc","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:28.202Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-8b7fc64d1c4b33440bc22561: done: 0.022071 sec","job_status":"done","queue_duration_s":1.400534,"scheduling_latency_s":1.400555,"redis_calls":13,"redis_duration_s":0.002762,"redis_read_bytes":10,"redis_write_bytes":1343,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000404,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":345,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00128,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001078,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":368,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012728,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000350045,"extra.packages_cleanup_delete_orphaned_dependencies_worker.last_processed_packages_dependency_id":0,"extra.packages_cleanup_delete_orphaned_dependencies_worker.deleted_rows_count":0,"duration_s":0.022071,"completed_at":"2026-09-06T06:50:29.625Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002174,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2491gitlab # [ 275.412217] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.626Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"0ce91db92bf68c82e066737c","created_at":"2026-09-06T06:50:28.225Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"878bab474fdd610e9c638569dc403981","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:28.235Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-0ce91db92bf68c82e066737c: start","job_status":"start","queue_duration_s":1.390932,"scheduling_latency_s":1.390953}2492gitlab # [ 275.484665] nix-daemon[2896]: accepted connection from pid 3548, user nixbot2493gitlab # [ 275.485736] nix-daemon[2896]: accepted connection from pid 3517, user nixbot2494gitlab # [ 275.487194] gitaly[914]: time="2026-09-06T06:50:30.950Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ7KWHR3WTY1ZDMT10NXH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:51:00.848" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:30.949" grpc.time_ms=0.617 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2495gitlab # [ 275.488078] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.645Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"0ce91db92bf68c82e066737c","created_at":"2026-09-06T06:50:28.225Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"878bab474fdd610e9c638569dc403981","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:28.235Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-0ce91db92bf68c82e066737c: done: 0.019424 sec","job_status":"done","queue_duration_s":1.390932,"scheduling_latency_s":1.390953,"redis_calls":11,"redis_duration_s":0.002401,"redis_read_bytes":9,"redis_write_bytes":1399,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000418,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001087,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000896,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011807,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000438603,"exclusive_lock_hold_duration_s":0.003753829,"duration_s":0.019424,"completed_at":"2026-09-06T06:50:29.645Z","load_balancing_strategy":"primary","db_duration_s":0.001994,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2496gitlab # [ 275.560875] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.647Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Releases::PublishEventWorker","jid":"e07840af6b23f22144403b68","created_at":"2026-09-06T06:50:28.247Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"250c0fad7d2a7bd9a02c4f323f6460a1","meta.root_caller_id":"Cronjob","meta.feature_category":"release_orchestration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9f5dbd6b3e0f8a09b95f6e4bc38c93c1137695f37704af6aead7c9933a73fb55","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:28.257Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Releases::PublishEventWorker JID-e07840af6b23f22144403b68: start","job_status":"start","queue_duration_s":1.389246,"scheduling_latency_s":1.389313}2497gitlab # [ 275.562264] gitaly[914]: time="2026-09-06T06:50:30.982Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1TQQ7KWHR3WTY1ZDMT10NXH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:50:40.165" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:30.976" grpc.time_ms=6.791 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2498gitlab # [ 275.563409] nixbot[2666]: {"ts": "2026-09-06T06:50:31.028Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/bfeb273a2da919f0df84a793793005bc3005f6f5 \"HTTP/1.1 201 Created\""}2499gitlab # [ 275.566297] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:31 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 1182500gitlab # [ 275.570141] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.668Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Releases::PublishEventWorker","jid":"e07840af6b23f22144403b68","created_at":"2026-09-06T06:50:28.247Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-0c94b75c5a014500","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"250c0fad7d2a7bd9a02c4f323f6460a1","meta.root_caller_id":"Cronjob","meta.feature_category":"release_orchestration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9f5dbd6b3e0f8a09b95f6e4bc38c93c1137695f37704af6aead7c9933a73fb55","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:28.257Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Releases::PublishEventWorker JID-e07840af6b23f22144403b68: done: 0.021231 sec","job_status":"done","queue_duration_s":1.389246,"scheduling_latency_s":1.389313,"redis_calls":10,"redis_duration_s":0.002165,"redis_read_bytes":9,"redis_write_bytes":1039,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0004,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001352,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000413,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012883,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000391949,"duration_s":0.021231,"completed_at":"2026-09-06T06:50:29.668Z","load_balancing_strategy":"primary","db_duration_s":0.002791,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2501gitlab # [ 275.641507] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.669Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de6966aef09ed2e4b3c1ba64","created_at":"2026-09-06T06:50:28.643Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-a72b501187e04ccb","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55d54a0a82c4e37dc3cfd65510c8351e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:28.761Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de6966aef09ed2e4b3c1ba64: start","job_status":"start","queue_duration_s":0.908614,"scheduling_latency_s":0.908636}2502gitlab # [ 275.653284] gitaly[914]: time="2026-09-06T06:50:31.082Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ7QQTHC3W6FC5VNE8JVX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:51:01.081" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:31.082" grpc.time_ms=0.585 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2503gitlab # [ 275.725231] gitaly[914]: time="2026-09-06T06:50:31.114Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQQ7KWHR3WTY1ZDMT10NXH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:50:31.112" grpc.time_ms=2.09 pid=914 span.kind=server system=grpc2504gitlab # [ 275.726439] nixbot[2666]: {"ts": "2026-09-06T06:50:31.167Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/bfeb273a2da919f0df84a793793005bc3005f6f5 \"HTTP/1.1 201 Created\""}2505gitlab # [ 275.728894] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.689Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de6966aef09ed2e4b3c1ba64","created_at":"2026-09-06T06:50:28.643Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-a72b501187e04ccb","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55d54a0a82c4e37dc3cfd65510c8351e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:28.761Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de6966aef09ed2e4b3c1ba64: done: 0.019447 sec","job_status":"done","queue_duration_s":0.908614,"scheduling_latency_s":0.908636,"redis_calls":15,"redis_duration_s":0.003188,"redis_read_bytes":12,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000412,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000832,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001944,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012608,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019447,"completed_at":"2026-09-06T06:50:29.689Z","load_balancing_strategy":"primary","db_duration_s":0.000349,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2506gitlab # [ 275.817310] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.690Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"098775dd124c37c90f702ea0","created_at":"2026-09-06T06:50:28.643Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-a72b501187e04ccb","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55d54a0a82c4e37dc3cfd65510c8351e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:28.761Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-098775dd124c37c90f702ea0: start","job_status":"start","queue_duration_s":0.929399,"scheduling_latency_s":0.929421}2507gitlab # [ 275.818474] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:31 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/bfeb273a2da919f0df84a793793005bc3005f6f5 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1342508gitlab # [ 275.819740] gitaly[914]: time="2026-09-06T06:50:31.123Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1TQQ7QQTHC3W6FC5VNE8JVX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:50:41.095" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:31.116" grpc.time_ms=6.949 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2509gitlab # [ 275.820831] gitaly[914]: time="2026-09-06T06:50:31.138Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQQ7KWHR3WTY1ZDMT10NXH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:50:31.138" grpc.time_ms=0.335 pid=914 span.kind=server system=grpc2510gitlab # [ 275.821740] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.705Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"098775dd124c37c90f702ea0","created_at":"2026-09-06T06:50:28.643Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-a72b501187e04ccb","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55d54a0a82c4e37dc3cfd65510c8351e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:28.761Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-098775dd124c37c90f702ea0: done: 0.015093 sec","job_status":"done","queue_duration_s":0.929399,"scheduling_latency_s":0.929421,"redis_calls":13,"redis_duration_s":0.0029679999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000855,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002113,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010013,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015093,"completed_at":"2026-09-06T06:50:29.705Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2511gitlab # [ 275.911979] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.706Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc3a65d8b9d8b470bfb85211","created_at":"2026-09-06T06:50:28.643Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-a72b501187e04ccb","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55d54a0a82c4e37dc3cfd65510c8351e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:28.761Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc3a65d8b9d8b470bfb85211: start","job_status":"start","queue_duration_s":0.94578,"scheduling_latency_s":0.945801}2512gitlab # [ 275.913298] gitaly[914]: time="2026-09-06T06:50:31.165Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQQ7KWHR3WTY1ZDMT10NXH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:50:31.164" grpc.time_ms=0.589 pid=914 span.kind=server system=grpc2513gitlab # [ 275.914126] gitaly[914]: time="2026-09-06T06:50:31.169Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ7KWHR3WTY1ZDMT10NXH forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-06T06:51:01.084" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:31.084" operations="[repack_refs]" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2514gitlab # [ 275.986251] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.721Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc3a65d8b9d8b470bfb85211","created_at":"2026-09-06T06:50:28.643Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-a72b501187e04ccb","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55d54a0a82c4e37dc3cfd65510c8351e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:28.761Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc3a65d8b9d8b470bfb85211: done: 0.014771 sec","job_status":"done","queue_duration_s":0.94578,"scheduling_latency_s":0.945801,"redis_calls":13,"redis_duration_s":0.00268,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00085,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00183,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014771,"completed_at":"2026-09-06T06:50:29.721Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2515gitlab # [ 275.987779] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.722Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3db7b59b24ed8acd7b74ab4","created_at":"2026-09-06T06:50:28.643Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-a72b501187e04ccb","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55d54a0a82c4e37dc3cfd65510c8351e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:28.761Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3db7b59b24ed8acd7b74ab4: start","job_status":"start","queue_duration_s":0.961815,"scheduling_latency_s":0.961836}2516gitlab # [ 276.071281] gitaly[914]: time="2026-09-06T06:50:31.170Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ7KWHR3WTY1ZDMT10NXH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-06T06:51:01.084" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:31.084" pid=914 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-09-06 06:49:19.598736269 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2517gitlab # [ 276.072776] gitaly[914]: time="2026-09-06T06:50:31.177Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ7KWHR3WTY1ZDMT10NXH diskcache=8b17ff21-7185-433b-9a96-38486a071803 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-06T06:51:01.084" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:31.084" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2518gitlab # [ 276.073988] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.737Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3db7b59b24ed8acd7b74ab4","created_at":"2026-09-06T06:50:28.643Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-a72b501187e04ccb","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55d54a0a82c4e37dc3cfd65510c8351e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:28.761Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3db7b59b24ed8acd7b74ab4: done: 0.014889 sec","job_status":"done","queue_duration_s":0.961815,"scheduling_latency_s":0.961836,"redis_calls":13,"redis_duration_s":0.002746,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000862,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001884,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009968,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014889,"completed_at":"2026-09-06T06:50:29.737Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2519gitlab # [ 276.147840] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.739Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4266b91398b8140c617fdc2f","created_at":"2026-09-06T06:50:28.643Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-a72b501187e04ccb","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55d54a0a82c4e37dc3cfd65510c8351e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:28.761Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4266b91398b8140c617fdc2f: start","job_status":"start","queue_duration_s":0.97798,"scheduling_latency_s":0.978002}2520gitlab # [ 276.149268] gitaly[914]: time="2026-09-06T06:50:31.178Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=86 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7591 command.oublock=0 command.real_time_ms=86 command.spawn_token_fork_ms=2 command.system_time_ms=46 command.user_time_ms=40 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ7KWHR3WTY1ZDMT10NXH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-06T06:51:01.084" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:31.084" grpc.time_ms=93.052 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2521gitlab # [ 276.150642] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.756Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4266b91398b8140c617fdc2f","created_at":"2026-09-06T06:50:28.643Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-a72b501187e04ccb","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55d54a0a82c4e37dc3cfd65510c8351e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:28.761Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4266b91398b8140c617fdc2f: done: 0.017809 sec","job_status":"done","queue_duration_s":0.97798,"scheduling_latency_s":0.978002,"redis_calls":13,"redis_duration_s":0.0028650000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00091,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001955,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011304,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017809,"completed_at":"2026-09-06T06:50:29.756Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2522gitlab # [ 276.225514] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.758Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d09870ff22a2a85034ede684","created_at":"2026-09-06T06:50:28.643Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-a72b501187e04ccb","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55d54a0a82c4e37dc3cfd65510c8351e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:28.761Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d09870ff22a2a85034ede684: start","job_status":"start","queue_duration_s":0.997302,"scheduling_latency_s":0.997324}2523gitlab # [ 276.226641] gitaly[914]: time="2026-09-06T06:50:31.191Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ7KWHR3WTY1ZDMT10NXH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-06T06:51:01.084" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:31.084" pid=914 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2524gitlab # [ 276.241807] gitaly[914]: time="2026-09-06T06:50:31.192Z" level=info msg="optimized repository" clean_stale_data_time=20.15731ms clean_work_trees_time="93.587µs" commit_graph_time="7.543µs" correlation_id=01M1TQQ7KWHR3WTY1ZDMT10NXH gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="8.102µs" pid=914 prune_time="7.543µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="7.823µs" storage_name=default system=housekeeping total_time=20.524955ms2525gitlab # [ 276.251461] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.773Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d09870ff22a2a85034ede684","created_at":"2026-09-06T06:50:28.643Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-a72b501187e04ccb","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55d54a0a82c4e37dc3cfd65510c8351e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:28.761Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d09870ff22a2a85034ede684: done: 0.014972 sec","job_status":"done","queue_duration_s":0.997302,"scheduling_latency_s":0.997324,"redis_calls":13,"redis_duration_s":0.0027559999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000859,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001897,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009923,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014972,"completed_at":"2026-09-06T06:50:29.773Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2526gitlab # [ 276.322065] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.774Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"908e76a2d14a7d89eed6adbe","created_at":"2026-09-06T06:50:28.643Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-a72b501187e04ccb","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55d54a0a82c4e37dc3cfd65510c8351e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:28.761Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-908e76a2d14a7d89eed6adbe: start","job_status":"start","queue_duration_s":1.013519,"scheduling_latency_s":1.013539}2527gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/bfeb273a2da919f0df84a793793005bc3005f6f5/statuses2528gitlab # [ 276.389436] gitaly[914]: time="2026-09-06T06:50:31.192Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ7KWHR3WTY1ZDMT10NXH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-06T06:51:01.084" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:31.084" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2529gitlab # [ 276.390873] gitaly[914]: time="2026-09-06T06:50:31.228Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ7WG372Z69H6GP0F083C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:51:01.126" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:31.227" grpc.time_ms=0.63 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2530gitlab # [ 276.392142] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.789Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"908e76a2d14a7d89eed6adbe","created_at":"2026-09-06T06:50:28.643Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-a72b501187e04ccb","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55d54a0a82c4e37dc3cfd65510c8351e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:28.761Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-908e76a2d14a7d89eed6adbe: done: 0.0147 sec","job_status":"done","queue_duration_s":1.013519,"scheduling_latency_s":1.013539,"redis_calls":13,"redis_duration_s":0.0027600000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000851,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001909,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009923,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0147,"completed_at":"2026-09-06T06:50:29.789Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2531gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/bfeb273a2da919f0df84a793793005bc3005f6f5/statuses, in 0.09 seconds)2532(finished: subtest: eval and build post commit statuses, in 5.58 seconds)2533(finished: run the VM test script, in 315.68 seconds)2534gitlab # [ 276.476059] sidekiq-cluster[2615]: {"severity":"INFO","time":"2026-09-06T06:50:29.790Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1139549bb3069d6d3eea5be8","created_at":"2026-09-06T06:50:28.643Z","trace_propagation_headers":{"sentry-trace":"b8a06225c5504808870e4ab63145ae6f-a72b501187e04ccb","baggage":"sentry-trace_id=b8a06225c5504808870e4ab63145ae6f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55d54a0a82c4e37dc3cfd65510c8351e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:28.761Z","job_size_bytes":2,"pid":2615,"sidekiq_tid":"m82r","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1139549bb3069d6d3eea5be8: start","job_status":"start","queue_duration_s":1.029481,"scheduling_latency_s":1.029501}2535test script finished in 315.70s2536cleanup2537kill QemuMachine (pid 46)2538gitlab # [ 276.477265] gitaly[914]: time="2026-09-06T06:50:31.235Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.rqemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2539gitlab # e2540(finished: cleanup, in 1.25 seconds)2541additionally exposed symbols:2542 gitlab,2543 vlan1,2544 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2545[]2546[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-09-06T06:49:25.573Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2547[]2548[]2549[]2550[]2551[]2552[]2553[]2554[]2555[]2556[]2557[]2558[]2559[]2560[]2561[]2562[]2563[]2564[]2565[]2566[]2567[]2568[]2569[]2570[]2571[]2572[]2573[]2574[]2575[]2576[]2577[]2578[]2579[]2580[]2581[]2582[]2583[]2584[]2585[]2586[]2587[]2588[]2589[]2590[]2591[]2592[]2593[]2594[]2595[]2596[]2597[]2598[]2599[]2600[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'bfeb273a2da919f0df84a793793005bc3005f6f5', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-09-06T06:50:22.905295Z', 'started_at': '2026-09-06T06:50:23.198057Z', 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': None}]2601[{'id': 5, 'sha': 'bfeb273a2da919f0df84a793793005bc3005f6f5', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-06T06:50:23.169Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2602[{'id': 5, 'sha': 'bfeb273a2da919f0df84a793793005bc3005f6f5', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-06T06:50:23.169Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2603[{'id': 5, 'sha': 'bfeb273a2da919f0df84a793793005bc3005f6f5', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-06T06:50:23.169Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2604[{'id': 5, 'sha': 'bfeb273a2da919f0df84a793793005bc3005f6f5', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 7s (1 warning)', 'created_at': '2026-09-06T06:50:23.169Z', 'started_at': None, 'finished_at': '2026-09-06T06:50:31.003Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'bfeb273a2da919f0df84a793793005bc3005f6f5', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-09-06T06:50:31.142Z', 'started_at': None, 'finished_at': '2026-09-06T06:50:31.293Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]