niks3-go-unit-tests
x86_64-linux.go-unit-tests
· build #114
· raw
1tribuchet: building on jamie2Running client tests...3=== RUN TestDoServerRequestAttachesToken4=== PAUSE TestDoServerRequestAttachesToken5=== RUN TestCaseHackSuffix6=== PAUSE TestCaseHackSuffix7=== RUN TestFilterOversizedClosures8=== PAUSE TestFilterOversizedClosures9=== RUN TestPartSizeForNAR10=== PAUSE TestPartSizeForNAR11=== RUN TestUploadMultipart_SupersededByPeer12=== PAUSE TestUploadMultipart_SupersededByPeer13=== RUN TestDumpPathMatchesNix14=== PAUSE TestDumpPathMatchesNix15=== RUN TestDumpPathSingleFile16=== PAUSE TestDumpPathSingleFile17=== RUN TestDumpPathWriterError18=== PAUSE TestDumpPathWriterError19=== RUN TestEncodeNixBase3220=== PAUSE TestEncodeNixBase3221=== RUN TestEncodeNixBase32WithRealHash22=== PAUSE TestEncodeNixBase32WithRealHash23=== RUN TestConvertHashToNix3224=== PAUSE TestConvertHashToNix3225=== RUN TestGetStorePathHash26=== PAUSE TestGetStorePathHash27=== RUN TestPathInfoHashCompatibility28=== PAUSE TestPathInfoHashCompatibility29=== RUN TestParsePathInfoJSON30=== PAUSE TestParsePathInfoJSON31=== RUN TestParsePathInfoJSONMultiplePaths32=== PAUSE TestParsePathInfoJSONMultiplePaths33=== RUN TestPathInfoCACompatibility34=== PAUSE TestPathInfoCACompatibility35=== RUN TestRateLimiterFeedback36=== PAUSE TestRateLimiterFeedback37=== RUN TestRateLimiterFeedback_400DoesNotCountAsSuccess38=== PAUSE TestRateLimiterFeedback_400DoesNotCountAsSuccess39=== RUN TestResolveStorePath40=== PAUSE TestResolveStorePath41=== RUN TestDoWithRetry_BodyReplayedViaGetBody42=== PAUSE TestDoWithRetry_BodyReplayedViaGetBody43=== RUN TestShellSplit44=== PAUSE TestShellSplit45=== RUN TestShellSplitErrors46=== PAUSE TestShellSplitErrors47=== RUN TestSetClientTLS48=== PAUSE TestSetClientTLS49=== RUN TestSetClientTLSDoesNotMutateDefaultTransport50=== PAUSE TestSetClientTLSDoesNotMutateDefaultTransport51=== RUN TestSetClientTLSErrors52=== PAUSE TestSetClientTLSErrors53=== RUN TestStaticToken54=== PAUSE TestStaticToken55=== RUN TestFileTokenReadsAndCaches56=== PAUSE TestFileTokenReadsAndCaches57=== RUN TestFileTokenMissing58=== PAUSE TestFileTokenMissing59=== RUN TestFileTokenEmpty60=== PAUSE TestFileTokenEmpty61=== RUN TestScriptTokenNoExpiryRerunsEveryCall62=== PAUSE TestScriptTokenNoExpiryRerunsEveryCall63=== RUN TestScriptTokenCachesUntilRefresh64=== PAUSE TestScriptTokenCachesUntilRefresh65=== RUN TestScriptTokenEmptyToken66=== PAUSE TestScriptTokenEmptyToken67=== RUN TestScriptTokenBadJSON68=== PAUSE TestScriptTokenBadJSON69=== RUN TestScriptTokenScriptFails70=== PAUSE TestScriptTokenScriptFails71=== RUN TestScriptTokenEmptyCommand72=== PAUSE TestScriptTokenEmptyCommand73=== CONT TestDoServerRequestAttachesToken74=== CONT TestResolveStorePath75=== CONT TestEncodeNixBase32WithRealHash76=== CONT TestParsePathInfoJSONMultiplePaths77--- PASS: TestEncodeNixBase32WithRealHash (0.00s)78=== CONT TestParsePathInfoJSON79=== RUN TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths80=== RUN TestParsePathInfoJSON/Nix_format81=== CONT TestFileTokenMissing82=== PAUSE TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths83=== RUN TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths84=== PAUSE TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths85=== CONT TestRateLimiterFeedback_400DoesNotCountAsSuccess86=== CONT TestScriptTokenBadJSON87--- PASS: TestResolveStorePath (0.00s)88=== CONT TestPathInfoCACompatibility89=== RUN TestPathInfoCACompatibility/null_ca_field90=== PAUSE TestPathInfoCACompatibility/null_ca_field91=== RUN TestPathInfoCACompatibility/old_string_format_-_text92=== PAUSE TestPathInfoCACompatibility/old_string_format_-_text93=== RUN TestPathInfoCACompatibility/old_string_format_-_fixed_recursive94=== PAUSE TestPathInfoCACompatibility/old_string_format_-_fixed_recursive95=== RUN TestPathInfoCACompatibility/new_structured_format_-_text96=== CONT TestDumpPathMatchesNix972026/07/21 08:16:53 WARN Rate limiter enabled after throttle name=server-test rate=598=== CONT TestEncodeNixBase3299=== CONT TestDumpPathWriterError100=== RUN TestEncodeNixBase32/test_string_hash101=== PAUSE TestEncodeNixBase32/test_string_hash102=== CONT TestDumpPathSingleFile103=== CONT TestGetStorePathHash104=== RUN TestGetStorePathHash/valid_store_path105=== PAUSE TestGetStorePathHash/valid_store_path106=== RUN TestGetStorePathHash/basename_without_hyphen_should_error107=== PAUSE TestGetStorePathHash/basename_without_hyphen_should_error108=== RUN TestGetStorePathHash/hash_with_invalid_characters_should_error109=== PAUSE TestGetStorePathHash/hash_with_invalid_characters_should_error110=== RUN TestGetStorePathHash/hash_with_wrong_length_should_error111=== PAUSE TestGetStorePathHash/hash_with_wrong_length_should_error112=== CONT TestPathInfoHashCompatibility113=== RUN TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)114=== PAUSE TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)115=== RUN TestPathInfoHashCompatibility/old_string_format_with_colon116=== PAUSE TestPathInfoHashCompatibility/old_string_format_with_colon117=== RUN TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI118=== PAUSE TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI119=== CONT TestSetClientTLSDoesNotMutateDefaultTransport120=== CONT TestFileTokenReadsAndCaches121=== CONT TestStaticToken122=== CONT TestSetClientTLSErrors123=== CONT TestShellSplitErrors124=== CONT TestSetClientTLS125=== CONT TestScriptTokenEmptyToken126=== CONT TestScriptTokenEmptyCommand127=== PAUSE TestParsePathInfoJSON/Nix_format128=== CONT TestScriptTokenScriptFails129=== CONT TestConvertHashToNix32130=== CONT TestFileTokenEmpty131=== CONT TestRateLimiterFeedback132=== PAUSE TestPathInfoCACompatibility/new_structured_format_-_text133--- PASS: TestFileTokenMissing (0.00s)134--- PASS: TestStaticToken (0.00s)135=== CONT TestScriptTokenCachesUntilRefresh136=== RUN TestEncodeNixBase32/empty_input137=== RUN TestPathInfoHashCompatibility/new_structured_format_with_sha512138=== CONT TestShellSplit139=== CONT TestDoWithRetry_BodyReplayedViaGetBody140=== RUN TestPathInfoCACompatibility/new_structured_format_-_nar_method141--- PASS: TestFileTokenReadsAndCaches (0.00s)142=== CONT TestPartSizeForNAR143=== CONT TestFilterOversizedClosures144=== RUN TestParsePathInfoJSON/Lix_format145=== CONT TestUploadMultipart_SupersededByPeer146--- PASS: TestScriptTokenBadJSON (0.00s)147--- PASS: TestShellSplitErrors (0.00s)148--- PASS: TestFileTokenEmpty (0.00s)149=== RUN TestConvertHashToNix32/SRI_format_to_Nix32150=== RUN TestRateLimiterFeedback/429_enables_limiter151=== PAUSE TestRateLimiterFeedback/429_enables_limiter152=== PAUSE TestEncodeNixBase32/empty_input153=== RUN TestRateLimiterFeedback/503_enables_limiter154--- PASS: TestShellSplit (0.00s)155=== CONT TestScriptTokenNoExpiryRerunsEveryCall156=== PAUSE TestRateLimiterFeedback/503_enables_limiter157=== PAUSE TestConvertHashToNix32/SRI_format_to_Nix32158=== RUN TestUploadMultipart_SupersededByPeer/exists159--- PASS: TestScriptTokenEmptyCommand (0.00s)160=== CONT TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths161=== CONT TestCaseHackSuffix162=== RUN TestRateLimiterFeedback/200_does_not_enable_limiter163=== PAUSE TestRateLimiterFeedback/200_does_not_enable_limiter164=== PAUSE TestUploadMultipart_SupersededByPeer/exists165=== RUN TestUploadMultipart_SupersededByPeer/missing166--- PASS: TestDoServerRequestAttachesToken (0.01s)167=== CONT TestGetStorePathHash/valid_store_path1682026/07/21 08:16:53 WARN Rate limiter enabled after throttle name=server-test rate=5169=== RUN TestConvertHashToNix32/already_Nix32_format1702026/07/21 08:16:53 WARN Request returned retryable status, retrying attempt=1 max_attempts=6 backoff=0s status=503 url=http://127.0.0.1:45659171=== PAUSE TestConvertHashToNix32/already_Nix32_format172=== CONT TestGetStorePathHash/hash_with_invalid_characters_should_error173=== RUN TestConvertHashToNix32/invalid_format1742026/07/21 08:16:53 WARN Rate limiter backed off name=server-test rate=51752026/07/21 08:16:53 WARN Request returned retryable status, retrying attempt=2 max_attempts=6 backoff=0s status=503 url=http://127.0.0.1:45659176=== PAUSE TestUploadMultipart_SupersededByPeer/missing177=== PAUSE TestConvertHashToNix32/invalid_format178=== RUN TestFilterOversizedClosures/no_limit_keeps_everything179=== CONT TestEncodeNixBase32/empty_input180=== RUN TestPartSizeForNAR/zero_stays_at_minimum181--- PASS: TestScriptTokenEmptyToken (0.01s)182=== RUN TestSetClientTLSErrors/missing_cert_file183=== PAUSE TestSetClientTLSErrors/missing_cert_file184=== CONT TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths185=== CONT TestConvertHashToNix32/already_Nix32_format186=== PAUSE TestPathInfoHashCompatibility/new_structured_format_with_sha512187=== PAUSE TestParsePathInfoJSON/Lix_format188=== PAUSE TestPathInfoCACompatibility/new_structured_format_-_nar_method189=== RUN TestRateLimiterFeedback/400_does_not_enable_limiter190=== CONT TestGetStorePathHash/basename_without_hyphen_should_error191=== CONT TestGetStorePathHash/hash_with_wrong_length_should_error192=== CONT TestUploadMultipart_SupersededByPeer/exists193=== CONT TestConvertHashToNix32/SRI_format_to_Nix32194=== CONT TestEncodeNixBase32/test_string_hash195=== PAUSE TestFilterOversizedClosures/no_limit_keeps_everything196=== PAUSE TestPartSizeForNAR/zero_stays_at_minimum197=== CONT TestPathInfoHashCompatibility/old_string_format_with_colon198=== RUN TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped199=== PAUSE TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped200=== RUN TestFilterOversizedClosures/all_closures_skipped201=== PAUSE TestFilterOversizedClosures/all_closures_skipped202=== CONT TestPathInfoCACompatibility/new_structured_format_-_text203=== CONT TestPathInfoCACompatibility/old_string_format_-_text204=== CONT TestUploadMultipart_SupersededByPeer/missing205=== RUN TestSetClientTLSErrors/missing_key_file206=== CONT TestConvertHashToNix32/invalid_format207=== CONT TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)208=== RUN TestParsePathInfoJSON/empty_input209=== CONT TestPathInfoHashCompatibility/new_structured_format_with_sha512210=== CONT TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI211=== CONT TestPathInfoCACompatibility/null_ca_field212=== CONT TestPathInfoCACompatibility/new_structured_format_-_nar_method213=== RUN TestPartSizeForNAR/small_stays_at_minimum214--- PASS: TestScriptTokenScriptFails (0.01s)215=== CONT TestPathInfoCACompatibility/old_string_format_-_fixed_recursive216=== PAUSE TestRateLimiterFeedback/400_does_not_enable_limiter217=== CONT TestFilterOversizedClosures/no_limit_keeps_everything218=== RUN TestSetClientTLS/rejects_connection_without_client_cert219--- PASS: TestSetClientTLSDoesNotMutateDefaultTransport (0.01s)220=== PAUSE TestPartSizeForNAR/small_stays_at_minimum221--- PASS: TestDoWithRetry_BodyReplayedViaGetBody (0.01s)222=== PAUSE TestSetClientTLSErrors/missing_key_file223=== RUN TestSetClientTLSErrors/missing_ca_file224=== CONT TestFilterOversizedClosures/all_closures_skipped2252026/07/21 08:16:53 WARN Skipping closure: path exceeds server max NAR size top_level_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper oversized_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper nar_size=100 max_nar_size=50226=== PAUSE TestParsePathInfoJSON/empty_input227=== CONT TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped2282026/07/21 08:16:53 WARN Skipping closure: path exceeds server max NAR size top_level_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper oversized_path=/nix/store/bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb-vm-image nar_size=5000 max_nar_size=2000229=== CONT TestRateLimiterFeedback/429_enables_limiter230=== CONT TestRateLimiterFeedback/200_does_not_enable_limiter231=== CONT TestRateLimiterFeedback/503_enables_limiter232=== CONT TestRateLimiterFeedback/400_does_not_enable_limiter233=== PAUSE TestSetClientTLS/rejects_connection_without_client_cert234--- PASS: TestConvertHashToNix32 (0.01s)235 --- PASS: TestConvertHashToNix32/already_Nix32_format (0.00s)236 --- PASS: TestConvertHashToNix32/SRI_format_to_Nix32 (0.00s)237 --- PASS: TestConvertHashToNix32/invalid_format (0.00s)238--- PASS: TestParsePathInfoJSONMultiplePaths (0.00s)239 --- PASS: TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths (0.00s)240 --- PASS: TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths (0.00s)241=== PAUSE TestSetClientTLSErrors/missing_ca_file242=== RUN TestPartSizeForNAR/80_GiB_fits_at_minimum243=== PAUSE TestPartSizeForNAR/80_GiB_fits_at_minimum244=== RUN TestParsePathInfoJSON/whitespace_only245=== RUN TestSetClientTLS/succeeds_with_client_cert_and_CA2462026/07/21 08:16:53 WARN Rate limiter enabled after throttle name=server-test rate=5247--- PASS: TestPathInfoHashCompatibility (0.01s)248 --- PASS: TestPathInfoHashCompatibility/old_string_format_with_colon (0.00s)249 --- PASS: TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI) (0.00s)250 --- PASS: TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI (0.00s)251 --- PASS: TestPathInfoHashCompatibility/new_structured_format_with_sha512 (0.00s)2522026/07/21 08:16:53 WARN Request returned retryable status, retrying attempt=1 max_attempts=2 backoff=0s status=429 url=http://127.0.0.1:37451253--- PASS: TestEncodeNixBase32 (0.01s)254 --- PASS: TestEncodeNixBase32/empty_input (0.00s)255 --- PASS: TestEncodeNixBase32/test_string_hash (0.00s)256--- PASS: TestGetStorePathHash (0.00s)257 --- PASS: TestGetStorePathHash/valid_store_path (0.00s)258 --- PASS: TestGetStorePathHash/hash_with_invalid_characters_should_error (0.00s)259 --- PASS: TestGetStorePathHash/hash_with_wrong_length_should_error (0.00s)260 --- PASS: TestGetStorePathHash/basename_without_hyphen_should_error (0.00s)261=== RUN TestSetClientTLSErrors/invalid_ca_file2622026/07/21 08:16:53 WARN Rate limiter enabled after throttle name=server-test rate=5263=== RUN TestPartSizeForNAR/115_GiB_needs_larger_parts2642026/07/21 08:16:53 WARN Request returned retryable status, retrying attempt=1 max_attempts=2 backoff=0s status=503 url=http://127.0.0.1:40073265=== PAUSE TestPartSizeForNAR/115_GiB_needs_larger_parts266=== PAUSE TestParsePathInfoJSON/whitespace_only267=== RUN TestParsePathInfoJSON/invalid_JSON2682026/07/21 08:16:53 WARN Rate limiter backed off name=server-test rate=5269=== PAUSE TestSetClientTLS/succeeds_with_client_cert_and_CA270=== RUN TestSetClientTLS/preserves_debug_logging_transport271--- PASS: TestUploadMultipart_SupersededByPeer (0.00s)272 --- PASS: TestUploadMultipart_SupersededByPeer/exists (0.00s)273 --- PASS: TestUploadMultipart_SupersededByPeer/missing (0.00s)2742026/07/21 08:16:53 WARN Rate limiter backed off name=server-test rate=5275--- PASS: TestScriptTokenCachesUntilRefresh (0.01s)276=== PAUSE TestSetClientTLSErrors/invalid_ca_file277=== RUN TestPartSizeForNAR/1_TiB278=== PAUSE TestPartSizeForNAR/1_TiB279=== PAUSE TestParsePathInfoJSON/invalid_JSON280=== CONT TestParsePathInfoJSON/Nix_format281=== CONT TestParsePathInfoJSON/whitespace_only282=== CONT TestParsePathInfoJSON/empty_input283--- PASS: TestPathInfoCACompatibility (0.01s)284 --- PASS: TestPathInfoCACompatibility/old_string_format_-_text (0.00s)285 --- PASS: TestPathInfoCACompatibility/new_structured_format_-_text (0.00s)286 --- PASS: TestPathInfoCACompatibility/null_ca_field (0.00s)287 --- PASS: TestPathInfoCACompatibility/old_string_format_-_fixed_recursive (0.00s)288 --- PASS: TestPathInfoCACompatibility/new_structured_format_-_nar_method (0.00s)289--- PASS: TestFilterOversizedClosures (0.00s)290 --- PASS: TestFilterOversizedClosures/no_limit_keeps_everything (0.00s)291 --- PASS: TestFilterOversizedClosures/all_closures_skipped (0.00s)292 --- PASS: TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped (0.00s)293=== CONT TestSetClientTLSErrors/missing_cert_file294=== CONT TestSetClientTLSErrors/invalid_ca_file295=== CONT TestSetClientTLSErrors/missing_ca_file296=== CONT TestSetClientTLSErrors/missing_key_file297=== RUN TestPartSizeForNAR/5_TiB_S3_max_object298=== PAUSE TestPartSizeForNAR/5_TiB_S3_max_object299=== RUN TestPartSizeForNAR/capped_at_5_GiB300=== PAUSE TestPartSizeForNAR/capped_at_5_GiB301=== CONT TestPartSizeForNAR/zero_stays_at_minimum302=== CONT TestPartSizeForNAR/1_TiB303=== PAUSE TestSetClientTLS/preserves_debug_logging_transport304=== CONT TestSetClientTLS/rejects_connection_without_client_cert305=== CONT TestSetClientTLS/succeeds_with_client_cert_and_CA306=== CONT TestPartSizeForNAR/80_GiB_fits_at_minimum307=== CONT TestSetClientTLS/preserves_debug_logging_transport308=== CONT TestParsePathInfoJSON/Lix_format309=== CONT TestParsePathInfoJSON/invalid_JSON310--- PASS: TestRateLimiterFeedback (0.01s)311 --- PASS: TestRateLimiterFeedback/400_does_not_enable_limiter (0.00s)312 --- PASS: TestRateLimiterFeedback/200_does_not_enable_limiter (0.00s)313 --- PASS: TestRateLimiterFeedback/429_enables_limiter (0.00s)314 --- PASS: TestRateLimiterFeedback/503_enables_limiter (0.00s)315=== CONT TestPartSizeForNAR/115_GiB_needs_larger_parts316=== CONT TestPartSizeForNAR/capped_at_5_GiB317=== CONT TestPartSizeForNAR/small_stays_at_minimum318=== CONT TestPartSizeForNAR/5_TiB_S3_max_object319--- PASS: TestParsePathInfoJSON (0.02s)320 --- PASS: TestParsePathInfoJSON/whitespace_only (0.00s)321 --- PASS: TestParsePathInfoJSON/empty_input (0.00s)322 --- PASS: TestParsePathInfoJSON/Nix_format (0.00s)323 --- PASS: TestParsePathInfoJSON/Lix_format (0.00s)324 --- PASS: TestParsePathInfoJSON/invalid_JSON (0.00s)325--- PASS: TestPartSizeForNAR (0.01s)326 --- PASS: TestPartSizeForNAR/zero_stays_at_minimum (0.00s)327 --- PASS: TestPartSizeForNAR/1_TiB (0.00s)328 --- PASS: TestPartSizeForNAR/80_GiB_fits_at_minimum (0.00s)329 --- PASS: TestPartSizeForNAR/115_GiB_needs_larger_parts (0.00s)330 --- PASS: TestPartSizeForNAR/capped_at_5_GiB (0.00s)331 --- PASS: TestPartSizeForNAR/small_stays_at_minimum (0.00s)332 --- PASS: TestPartSizeForNAR/5_TiB_S3_max_object (0.00s)333--- PASS: TestSetClientTLSErrors (0.01s)334 --- PASS: TestSetClientTLSErrors/missing_cert_file (0.00s)335 --- PASS: TestSetClientTLSErrors/missing_key_file (0.00s)336 --- PASS: TestSetClientTLSErrors/missing_ca_file (0.00s)337 --- PASS: TestSetClientTLSErrors/invalid_ca_file (0.00s)338--- PASS: TestScriptTokenNoExpiryRerunsEveryCall (0.01s)3392026/07/21 08:16:53 http: TLS handshake error from 127.0.0.1:60472: remote error: tls: bad certificate340--- PASS: TestSetClientTLS (0.01s)341 --- PASS: TestSetClientTLS/rejects_connection_without_client_cert (0.00s)342 --- PASS: TestSetClientTLS/succeeds_with_client_cert_and_CA (0.00s)343 --- PASS: TestSetClientTLS/preserves_debug_logging_transport (0.00s)344--- PASS: TestDumpPathWriterError (0.04s)345--- PASS: TestDumpPathSingleFile (0.06s)346--- PASS: TestCaseHackSuffix (0.06s)347--- PASS: TestDumpPathMatchesNix (0.09s)348--- PASS: TestRateLimiterFeedback_400DoesNotCountAsSuccess (1.00s)349PASS350Running server tests...351The files belonging to this database system will be owned by user "nixbld".352This user must also own the server process.353354The database cluster will be initialized with locale "C".355The default database encoding has accordingly been set to "SQL_ASCII".356The default text search configuration will be set to "english".357358Data page checksums are enabled.359360creating directory /build/postgres2021347828/data ... ok361creating subdirectories ... ok362selecting dynamic shared memory implementation ... posix363selecting default "max_connections" ... 100364selecting default "shared_buffers" ... 128MB365selecting default time zone ... UTC366creating configuration files ... ok367running bootstrap script ... ok368performing post-bootstrap initialization ... ok369syncing data to disk ... ok370371initdb: warning: enabling "trust" authentication for local connections372initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.373374Success. You can now start the database server using:375376 pg_ctl -D /build/postgres2021347828/data -l logfile start377378/build/postgres2021347828:5432 - no response3792026-07-21 08:16:55.347 UTC [112] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit3802026-07-21 08:16:55.348 UTC [112] LOG: listening on Unix socket "/build/postgres2021347828/.s.PGSQL.5432"3812026-07-21 08:16:55.353 UTC [119] LOG: database system was shut down at 2026-07-21 08:16:55 UTC3822026-07-21 08:16:55.358 UTC [112] LOG: database system is ready to accept connections383/build/postgres2021347828:5432 - accepting connections384{"timestamp":"2026-07-21T08:16:55.798166996Z","level":"ERROR","fields":{"message":"list_path_raw: revjob err VolumeNotFound"},"target":"rustfs_ecstore::cache_value::metacache_set","filename":"crates/ecstore/src/cache_value/metacache_set.rs","line_number":486,"threadName":"rustfs-worker","threadId":"ThreadId(646)"}385386thread 'rustfs-worker' (644) panicked at /build/rustfs-1.0.0-beta.7-vendor/source-registry-0/reqwest-0.13.4/src/async_impl/client.rs:2507:38:387Client::new(): reqwest::Error { kind: Builder, source: General("No CA certificates were loaded from the system") }388note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace389=== RUN TestService_AuthMiddleware390=== PAUSE TestService_AuthMiddleware391=== RUN TestService_AuthMiddleware_MTLSProxyHeader392=== PAUSE TestService_AuthMiddleware_MTLSProxyHeader393=== RUN TestService_AuthMiddleware_MTLSBoundSubjects394=== PAUSE TestService_AuthMiddleware_MTLSBoundSubjects395=== RUN TestService_ReadAuthMiddleware396=== PAUSE TestService_ReadAuthMiddleware397=== RUN TestService_AuthMiddleware_OIDC398=== PAUSE TestService_AuthMiddleware_OIDC399=== RUN TestCacheConfigHandler400=== PAUSE TestCacheConfigHandler401=== RUN TestCacheStatsHandler402=== PAUSE TestCacheStatsHandler403=== RUN TestClientCADerivations404=== PAUSE TestClientCADerivations405=== RUN TestClientErrorHandling406=== PAUSE TestClientErrorHandling407=== RUN TestClientIntegration408=== PAUSE TestClientIntegration409=== RUN TestClientMultipleUploads410=== PAUSE TestClientMultipleUploads411=== RUN TestClientWithDependencies412=== PAUSE TestClientWithDependencies413=== RUN TestPinProtectsFromGC414=== PAUSE TestPinProtectsFromGC415=== RUN TestGCAdvisoryLockBlocksConcurrentRun4162026-07-21 08:16:55.942 UTC [915] ERROR: relation "goose_db_version" does not exist at character 364172026-07-21 08:16:55.942 UTC [915] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4182026/07/21 08:16:55 OK 20241026095416_initial_model.sql (8.31ms)4192026/07/21 08:16:55 OK 20251210153512_drop_unused_gin_index.sql (1.49ms)4202026/07/21 08:16:55 OK 20251218171726_add_pins.sql (2.57ms)4212026/07/21 08:16:55 OK 20260628120000_add_object_size_and_stats.sql (2.39ms)4222026/07/21 08:16:55 goose: successfully migrated database to version: 202606281200004232026/07/21 08:16:55 OK 1_commit_pending_closure.sql (1.63ms)4242026/07/21 08:16:55 OK 2_object_stats_trigger.sql (652.22µs)4252026/07/21 08:16:55 goose: up to current file version: 2426--- PASS: TestGCAdvisoryLockBlocksConcurrentRun (0.14s)427=== RUN TestGCBugBareHashReferences428=== PAUSE TestGCBugBareHashReferences429=== RUN TestGCMetrics430=== PAUSE TestGCMetrics431=== RUN TestGCTaskStore_StartNew432=== PAUSE TestGCTaskStore_StartNew433=== RUN TestGCTaskStore_DeduplicateSameParams434=== PAUSE TestGCTaskStore_DeduplicateSameParams435=== RUN TestGCTaskStore_ConflictDifferentParams436=== PAUSE TestGCTaskStore_ConflictDifferentParams437=== RUN TestGCTaskStore_GetEmpty438=== PAUSE TestGCTaskStore_GetEmpty439=== RUN TestGCTaskStore_GetReturnsLatest440=== PAUSE TestGCTaskStore_GetReturnsLatest441=== RUN TestGCTaskStore_CompletedAllowsNewTask442=== PAUSE TestGCTaskStore_CompletedAllowsNewTask443=== RUN TestGCTaskStore_PhaseUpdates444=== PAUSE TestGCTaskStore_PhaseUpdates445=== RUN TestGCTaskStore_Fail446=== PAUSE TestGCTaskStore_Fail447=== RUN TestGracefulShutdownDrainsInflight448=== PAUSE TestGracefulShutdownDrainsInflight449=== RUN TestService_healthCheckHandler450=== PAUSE TestService_healthCheckHandler451=== RUN TestGenerateLandingPage452=== PAUSE TestGenerateLandingPage453=== RUN TestCacheConfigHandlerMaxNarSize454=== PAUSE TestCacheConfigHandlerMaxNarSize455=== RUN TestCreatePendingClosureRejectsOversizedNAR456=== PAUSE TestCreatePendingClosureRejectsOversizedNAR457=== RUN TestNARDeduplicationMetadataUploadBug458=== PAUSE TestNARDeduplicationMetadataUploadBug459=== RUN TestMetricsInventory460=== PAUSE TestMetricsInventory461=== RUN TestService_NativeMTLS462=== PAUSE TestService_NativeMTLS463=== RUN TestServerTLSConfig464=== PAUSE TestServerTLSConfig465=== RUN TestMultipartCleanup466=== PAUSE TestMultipartCleanup467=== RUN TestObjectStatsTrigger468=== PAUSE TestObjectStatsTrigger469=== RUN TestOrphanedObjectsGC470=== PAUSE TestOrphanedObjectsGC471=== RUN TestOrphanedObjectsGCStressTest472=== PAUSE TestOrphanedObjectsGCStressTest473=== RUN TestResurrectedObjectNotDeleted474=== PAUSE TestResurrectedObjectNotDeleted475=== RUN TestParseSingleRange476=== PAUSE TestParseSingleRange477=== RUN TestIsValidCachePath478=== PAUSE TestIsValidCachePath479=== RUN TestReadProxyNarinfo480=== PAUSE TestReadProxyNarinfo481=== RUN TestReadProxyNarinfoAlreadyDecompressed482=== PAUSE TestReadProxyNarinfoAlreadyDecompressed483=== RUN TestReadProxyNarStreaming484=== PAUSE TestReadProxyNarStreaming485=== RUN TestReadProxy404486=== PAUSE TestReadProxy404487=== RUN TestReadProxyInvalidPath488=== PAUSE TestReadProxyInvalidPath489=== RUN TestReadProxyHead490=== PAUSE TestReadProxyHead491=== RUN TestReadProxyConditionalGet492=== PAUSE TestReadProxyConditionalGet493=== RUN TestReadProxyRootRedirectsToIndexHTML494=== PAUSE TestReadProxyRootRedirectsToIndexHTML495=== RUN TestReadProxyDisabled496=== PAUSE TestReadProxyDisabled497=== RUN TestReadProxyRangeRequest498=== PAUSE TestReadProxyRangeRequest499=== RUN TestRedundantMultipartUpload500=== PAUSE TestRedundantMultipartUpload501=== RUN TestCompleteMultipartUpload_ErrorButObjectExists502=== PAUSE TestCompleteMultipartUpload_ErrorButObjectExists503=== RUN TestCompletedNarNotReofferedAcrossClosures504=== PAUSE TestCompletedNarNotReofferedAcrossClosures505=== RUN TestPresignedUploadRegisteredBeforeCommit506=== PAUSE TestPresignedUploadRegisteredBeforeCommit507=== RUN TestService_Rustfstest508=== PAUSE TestService_Rustfstest509=== RUN TestParseSize510=== PAUSE TestParseSize511=== RUN TestSkippedUploadsHandler512=== PAUSE TestSkippedUploadsHandler513=== RUN TestSystemdListenerNotActivated514--- PASS: TestSystemdListenerNotActivated (0.00s)515=== RUN TestWatchdogBeatsWhenHealthy516--- PASS: TestWatchdogBeatsWhenHealthy (0.02s)517=== RUN TestWatchdogSkipsWhenUnhealthy5182026/07/21 08:16:56 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"5192026/07/21 08:16:56 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"5202026/07/21 08:16:56 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"5212026/07/21 08:16:56 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"5222026/07/21 08:16:56 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"5232026/07/21 08:16:56 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"5242026/07/21 08:16:56 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"5252026/07/21 08:16:56 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"5262026/07/21 08:16:56 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"5272026/07/21 08:16:56 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"528--- PASS: TestWatchdogSkipsWhenUnhealthy (0.20s)529=== RUN TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle530=== PAUSE TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle531=== RUN TestProxyWriteTimeout532=== PAUSE TestProxyWriteTimeout533=== RUN TestIsValidUploadKey534=== PAUSE TestIsValidUploadKey535=== RUN TestUploadHandlersRejectInvalidKeys536=== PAUSE TestUploadHandlersRejectInvalidKeys537=== RUN TestUploadHandlersRejectOversizedBody538=== PAUSE TestUploadHandlersRejectOversizedBody539=== RUN TestService_cleanupPendingClosuresHandler540=== PAUSE TestService_cleanupPendingClosuresHandler541=== RUN TestService_createPendingClosureHandler542=== PAUSE TestService_createPendingClosureHandler543=== RUN TestService_verifyS3Integrity544=== PAUSE TestService_verifyS3Integrity545=== RUN TestCompleteMultipartUnregistered546=== PAUSE TestCompleteMultipartUnregistered547=== RUN TestCreatePendingClosure_SmallNARUsesSimplePUT548=== PAUSE TestCreatePendingClosure_SmallNARUsesSimplePUT549=== CONT TestService_AuthMiddleware550=== CONT TestService_cleanupPendingClosuresHandler551=== CONT TestGCTaskStore_PhaseUpdates552--- PASS: TestGCTaskStore_PhaseUpdates (0.00s)553=== CONT TestGCTaskStore_DeduplicateSameParams554--- PASS: TestGCTaskStore_DeduplicateSameParams (0.00s)555=== CONT TestClientMultipleUploads556=== CONT TestClientErrorHandling557=== RUN TestClientErrorHandling/InvalidStorePath558=== PAUSE TestClientErrorHandling/InvalidStorePath559=== RUN TestClientErrorHandling/InvalidAuthToken560=== CONT TestClientWithDependencies561=== CONT TestCreatePendingClosure_SmallNARUsesSimplePUT562=== CONT TestMultipartCleanup563=== CONT TestService_verifyS3Integrity564=== CONT TestService_createPendingClosureHandler565=== CONT TestServerTLSConfig566=== CONT TestService_NativeMTLS567=== CONT TestMetricsInventory568=== CONT TestNARDeduplicationMetadataUploadBug569=== CONT TestCreatePendingClosureRejectsOversizedNAR5702026/07/21 08:16:56 INFO Received uploads request method=POST path=/api/pending_closures571--- PASS: TestCreatePendingClosureRejectsOversizedNAR (0.00s)572=== CONT TestClientIntegration573=== CONT TestCacheConfigHandlerMaxNarSize574=== CONT TestGenerateLandingPage575--- PASS: TestCacheConfigHandlerMaxNarSize (0.00s)576=== CONT TestService_healthCheckHandler577=== CONT TestGracefulShutdownDrainsInflight578=== CONT TestGCTaskStore_Fail579--- PASS: TestGCTaskStore_Fail (0.00s)580=== CONT TestClientCADerivations581=== CONT TestGCTaskStore_StartNew582--- PASS: TestGCTaskStore_StartNew (0.00s)583=== CONT TestCacheStatsHandler584=== CONT TestGCMetrics5852026/07/21 08:16:56 INFO Starting HTTP server address=127.0.0.1:42009586=== CONT TestGCBugBareHashReferences587=== CONT TestPinProtectsFromGC5882026/07/21 08:16:56 INFO Shutdown signal received, draining in-flight requests timeout=10s589=== CONT TestCompleteMultipartUnregistered590=== PAUSE TestClientErrorHandling/InvalidAuthToken591=== RUN TestServerTLSConfig/no_client_CA592=== CONT TestService_AuthMiddleware_OIDC593--- PASS: TestGenerateLandingPage (0.00s)594=== CONT TestCacheConfigHandler595=== RUN TestCacheConfigHandler/full_config,_no_issuer596=== RUN TestClientErrorHandling/ServerNotAvailable597=== PAUSE TestServerTLSConfig/no_client_CA598=== RUN TestServerTLSConfig/missing_CA_file599=== PAUSE TestCacheConfigHandler/full_config,_no_issuer600=== PAUSE TestServerTLSConfig/missing_CA_file601=== RUN TestCacheConfigHandler/no_cache_url_configured602=== PAUSE TestClientErrorHandling/ServerNotAvailable603=== RUN TestServerTLSConfig/not_a_PEM_file604=== PAUSE TestServerTLSConfig/not_a_PEM_file605=== PAUSE TestCacheConfigHandler/no_cache_url_configured606=== CONT TestReadProxyDisabled607=== CONT TestUploadHandlersRejectOversizedBody608=== RUN TestCacheConfigHandler/no_signing_keys609=== PAUSE TestCacheConfigHandler/no_signing_keys610=== RUN TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator611=== PAUSE TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator612=== CONT TestUploadHandlersRejectInvalidKeys613=== RUN TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info614=== PAUSE TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info615=== RUN TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal616=== PAUSE TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal617=== RUN TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key618=== PAUSE TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key619=== RUN TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key620=== PAUSE TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key621=== CONT TestIsValidUploadKey622=== RUN TestIsValidUploadKey/narinfo623=== PAUSE TestIsValidUploadKey/narinfo624=== RUN TestIsValidUploadKey/nar_zst625=== PAUSE TestIsValidUploadKey/nar_zst626=== RUN TestIsValidUploadKey/nar_xz627=== PAUSE TestIsValidUploadKey/nar_xz628=== RUN TestIsValidUploadKey/nar_plain629=== PAUSE TestIsValidUploadKey/nar_plain630=== RUN TestIsValidUploadKey/listing631=== PAUSE TestIsValidUploadKey/listing632=== RUN TestIsValidUploadKey/build_log633=== PAUSE TestIsValidUploadKey/build_log634=== RUN TestIsValidUploadKey/build_log_home-manager_file635=== PAUSE TestIsValidUploadKey/build_log_home-manager_file636=== RUN TestIsValidUploadKey/build_log_plus_in_name637=== PAUSE TestIsValidUploadKey/build_log_plus_in_name638=== RUN TestIsValidUploadKey/build_log_question_mark639=== PAUSE TestIsValidUploadKey/build_log_question_mark640=== RUN TestIsValidUploadKey/build_log_equals641=== PAUSE TestIsValidUploadKey/build_log_equals642=== RUN TestIsValidUploadKey/realisation643=== PAUSE TestIsValidUploadKey/realisation644=== RUN TestIsValidUploadKey/realisation_plus_in_output645=== PAUSE TestIsValidUploadKey/realisation_plus_in_output646=== RUN TestIsValidUploadKey/nix-cache-info647=== PAUSE TestIsValidUploadKey/nix-cache-info648=== RUN TestIsValidUploadKey/index.html649=== PAUSE TestIsValidUploadKey/index.html650=== RUN TestIsValidUploadKey/narinfo_key,_nar_type651=== PAUSE TestIsValidUploadKey/narinfo_key,_nar_type652=== RUN TestIsValidUploadKey/nar_key,_narinfo_type653=== PAUSE TestIsValidUploadKey/nar_key,_narinfo_type654=== RUN TestIsValidUploadKey/listing_key,_narinfo_type655=== PAUSE TestIsValidUploadKey/listing_key,_narinfo_type656=== RUN TestIsValidUploadKey/traversal657=== PAUSE TestIsValidUploadKey/traversal658=== RUN TestIsValidUploadKey/traversal_nar659=== PAUSE TestIsValidUploadKey/traversal_nar660=== RUN TestIsValidUploadKey/absolute661=== PAUSE TestIsValidUploadKey/absolute662=== RUN TestIsValidUploadKey/empty_key663=== PAUSE TestIsValidUploadKey/empty_key664=== RUN TestIsValidUploadKey/unknown_type665=== PAUSE TestIsValidUploadKey/unknown_type666=== CONT TestProxyWriteTimeout667=== RUN TestProxyWriteTimeout/narinfo6682026/07/21 08:16:56 INFO OIDC provider initialized name=test669=== PAUSE TestProxyWriteTimeout/narinfo670=== RUN TestProxyWriteTimeout/1_GiB_nar671=== PAUSE TestProxyWriteTimeout/1_GiB_nar672=== RUN TestProxyWriteTimeout/10_GiB_nar673=== PAUSE TestProxyWriteTimeout/10_GiB_nar674=== RUN TestProxyWriteTimeout/unknown_size675=== PAUSE TestProxyWriteTimeout/unknown_size676=== CONT TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle677--- PASS: TestGracefulShutdownDrainsInflight (0.14s)678=== CONT TestSkippedUploadsHandler6792026/07/21 08:16:56 INFO Client skipped oversized paths paths=3 nar_bytes=5000000000680--- PASS: TestSkippedUploadsHandler (0.01s)681=== CONT TestParseSize682--- PASS: TestParseSize (0.00s)683=== CONT TestService_Rustfstest6842026-07-21 08:16:56.410 UTC [991] ERROR: relation "goose_db_version" does not exist at character 366852026-07-21 08:16:56.410 UTC [991] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC6862026-07-21 08:16:56.413 UTC [992] ERROR: relation "goose_db_version" does not exist at character 366872026-07-21 08:16:56.413 UTC [992] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC6882026-07-21 08:16:56.416 UTC [993] ERROR: relation "goose_db_version" does not exist at character 366892026-07-21 08:16:56.416 UTC [993] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC6902026-07-21 08:16:56.417 UTC [994] ERROR: relation "goose_db_version" does not exist at character 366912026-07-21 08:16:56.417 UTC [994] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC6922026-07-21 08:16:56.420 UTC [995] ERROR: relation "goose_db_version" does not exist at character 366932026-07-21 08:16:56.420 UTC [995] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC694=== RUN TestUploadHandlersRejectOversizedBody/create_pending_closure695=== PAUSE TestUploadHandlersRejectOversizedBody/create_pending_closure696=== RUN TestUploadHandlersRejectOversizedBody/complete_multipart697=== PAUSE TestUploadHandlersRejectOversizedBody/complete_multipart698=== RUN TestUploadHandlersRejectOversizedBody/request_more_parts699=== PAUSE TestUploadHandlersRejectOversizedBody/request_more_parts700=== CONT TestPresignedUploadRegisteredBeforeCommit7012026-07-21 08:16:56.437 UTC [997] ERROR: relation "goose_db_version" does not exist at character 367022026-07-21 08:16:56.437 UTC [997] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7032026/07/21 08:16:56 OK 20241026095416_initial_model.sql (17.08ms)7042026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (3.68ms)7052026-07-21 08:16:56.467 UTC [1000] ERROR: relation "goose_db_version" does not exist at character 367062026-07-21 08:16:56.467 UTC [1000] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7072026-07-21 08:16:56.468 UTC [1001] ERROR: relation "goose_db_version" does not exist at character 367082026-07-21 08:16:56.468 UTC [1001] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7092026/07/21 08:16:56 OK 20241026095416_initial_model.sql (35.29ms)7102026/07/21 08:16:56 OK 20241026095416_initial_model.sql (34.03ms)7112026/07/21 08:16:56 OK 20251218171726_add_pins.sql (16.7ms)7122026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (2.69ms)7132026/07/21 08:16:56 OK 20241026095416_initial_model.sql (30.14ms)7142026/07/21 08:16:56 OK 20241026095416_initial_model.sql (33.81ms)7152026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (7.26ms)7162026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (3.32ms)7172026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (4.88ms)7182026/07/21 08:16:56 OK 20251218171726_add_pins.sql (8.37ms)7192026/07/21 08:16:56 OK 20241026095416_initial_model.sql (45.53ms)7202026/07/21 08:16:56 OK 20251218171726_add_pins.sql (7.83ms)7212026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (12.19ms)7222026/07/21 08:16:56 goose: successfully migrated database to version: 202606281200007232026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (4.1ms)7242026/07/21 08:16:56 OK 20251218171726_add_pins.sql (9.37ms)7252026/07/21 08:16:56 OK 1_commit_pending_closure.sql (6.15ms)7262026/07/21 08:16:56 OK 20251218171726_add_pins.sql (11.17ms)7272026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (9.81ms)7282026/07/21 08:16:56 goose: successfully migrated database to version: 202606281200007292026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (9.89ms)7302026/07/21 08:16:56 goose: successfully migrated database to version: 202606281200007312026/07/21 08:16:56 OK 2_object_stats_trigger.sql (4.87ms)7322026/07/21 08:16:56 goose: up to current file version: 27332026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (8.41ms)7342026/07/21 08:16:56 goose: successfully migrated database to version: 202606281200007352026/07/21 08:16:56 OK 1_commit_pending_closure.sql (4.51ms)7362026/07/21 08:16:56 OK 1_commit_pending_closure.sql (4.79ms)7372026/07/21 08:16:56 OK 2_object_stats_trigger.sql (2.54ms)7382026/07/21 08:16:56 goose: up to current file version: 27392026/07/21 08:16:56 INFO Received uploads request method=POST path=/api/pending_closures7402026/07/21 08:16:56 INFO Received uploads request method=POST path=/api/pending_closures7412026/07/21 08:16:56 INFO Received uploads request method=POST path=/api/pending_closures7422026/07/21 08:16:56 INFO Received uploads request method=POST path=/api/pending_closures7432026/07/21 08:16:56 OK 1_commit_pending_closure.sql (13.67ms)7442026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (18.67ms)7452026/07/21 08:16:56 goose: successfully migrated database to version: 202606281200007462026/07/21 08:16:56 OK 2_object_stats_trigger.sql (12.31ms)7472026/07/21 08:16:56 goose: up to current file version: 27482026/07/21 08:16:56 OK 20251218171726_add_pins.sql (24.29ms)7492026/07/21 08:16:56 INFO Received uploads request method=POST path=/api/pending_closures7502026/07/21 08:16:56 OK 20241026095416_initial_model.sql (33.76ms)7512026/07/21 08:16:56 OK 20241026095416_initial_model.sql (31.91ms)7522026/07/21 08:16:56 OK 2_object_stats_trigger.sql (5.62ms)7532026/07/21 08:16:56 goose: up to current file version: 27542026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (3.68ms)7552026/07/21 08:16:56 OK 1_commit_pending_closure.sql (7.54ms)7562026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (3.62ms)7572026/07/21 08:16:56 INFO Received uploads request method=POST path=/api/pending_closures7582026/07/21 08:16:56 OK 2_object_stats_trigger.sql (4.3ms)7592026/07/21 08:16:56 goose: up to current file version: 27602026/07/21 08:16:56 OK 20251218171726_add_pins.sql (6.25ms)7612026/07/21 08:16:56 OK 20251218171726_add_pins.sql (6.44ms)7622026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (13.67ms)7632026/07/21 08:16:56 goose: successfully migrated database to version: 20260628120000764--- PASS: TestCreatePendingClosure_SmallNARUsesSimplePUT (0.31s)765=== CONT TestCompletedNarNotReofferedAcrossClosures7662026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (6.57ms)7672026/07/21 08:16:56 goose: successfully migrated database to version: 202606281200007682026/07/21 08:16:56 OK 1_commit_pending_closure.sql (6.77ms)7692026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (7ms)7702026/07/21 08:16:56 goose: successfully migrated database to version: 20260628120000771{"timestamp":"2026-07-21T08:16:56.53658372Z","level":"ERROR","fields":{"message":"system path read failed","path_kind":"data_usage","operation":"read_primary","reason":"config_not_found","object":"buckets/.usage.json","error":"Config not found"},"target":"rustfs_ecstore::data_usage","filename":"crates/ecstore/src/data_usage.rs","line_number":126,"threadName":"rustfs-worker","threadId":"ThreadId(763)"}7722026/07/21 08:16:56 INFO Created nix-cache-info in bucket bucket=bucket67732026/07/21 08:16:56 OK 1_commit_pending_closure.sql (4.07ms)7742026/07/21 08:16:56 OK 2_object_stats_trigger.sql (3.67ms)7752026/07/21 08:16:56 goose: up to current file version: 27762026/07/21 08:16:56 OK 1_commit_pending_closure.sql (4.94ms)7772026/07/21 08:16:56 OK 2_object_stats_trigger.sql (2.52ms)7782026/07/21 08:16:56 goose: up to current file version: 27792026/07/21 08:16:56 WARN Authentication failed token_preview=wrongtoken token_length=10 reason="static API token mismatch"780--- PASS: TestService_AuthMiddleware (0.33s)781=== CONT TestCompleteMultipartUpload_ErrorButObjectExists7822026/07/21 08:16:56 OK 2_object_stats_trigger.sql (2.62ms)7832026/07/21 08:16:56 goose: up to current file version: 27842026/07/21 08:16:56 INFO Created nix-cache-info in bucket bucket=bucket87852026/07/21 08:16:56 INFO Created nix-cache-info in bucket bucket=bucket97862026-07-21 08:16:56.560 UTC [1007] ERROR: relation "goose_db_version" does not exist at character 367872026-07-21 08:16:56.560 UTC [1007] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7882026-07-21 08:16:56.563 UTC [1011] ERROR: relation "goose_db_version" does not exist at character 367892026-07-21 08:16:56.563 UTC [1011] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7902026-07-21 08:16:56.563 UTC [1012] ERROR: relation "goose_db_version" does not exist at character 367912026-07-21 08:16:56.563 UTC [1012] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7922026-07-21 08:16:56.564 UTC [1013] ERROR: relation "goose_db_version" does not exist at character 367932026-07-21 08:16:56.564 UTC [1013] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7942026-07-21 08:16:56.576 UTC [1014] ERROR: relation "goose_db_version" does not exist at character 367952026-07-21 08:16:56.576 UTC [1014] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7962026-07-21 08:16:56.576 UTC [1018] ERROR: relation "goose_db_version" does not exist at character 367972026-07-21 08:16:56.576 UTC [1018] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7982026-07-21 08:16:56.577 UTC [1034] ERROR: relation "goose_db_version" does not exist at character 367992026-07-21 08:16:56.577 UTC [1034] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC8002026-07-21 08:16:56.578 UTC [1016] ERROR: relation "goose_db_version" does not exist at character 368012026-07-21 08:16:56.578 UTC [1016] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC8022026-07-21 08:16:56.578 UTC [1015] ERROR: relation "goose_db_version" does not exist at character 368032026-07-21 08:16:56.578 UTC [1015] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC804=== NAME TestClientMultipleUploads805 client_integration_test.go:338: Created store path 0: /build/TestClientMultipleUploads686248133/001/store/0d6dpvgvgs4qddhrdv3wli2jsih8wi3j-test-file-0.txt8062026-07-21 08:16:56.578 UTC [1035] ERROR: relation "goose_db_version" does not exist at character 368072026-07-21 08:16:56.578 UTC [1035] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC8082026-07-21 08:16:56.580 UTC [1037] ERROR: relation "goose_db_version" does not exist at character 368092026-07-21 08:16:56.580 UTC [1037] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC8102026-07-21 08:16:56.581 UTC [1036] ERROR: relation "goose_db_version" does not exist at character 368112026-07-21 08:16:56.581 UTC [1036] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC8122026/07/21 08:16:56 OK 20241026095416_initial_model.sql (11.22ms)8132026-07-21 08:16:56.581 UTC [1039] ERROR: relation "goose_db_version" does not exist at character 368142026-07-21 08:16:56.581 UTC [1039] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC8152026-07-21 08:16:56.581 UTC [1038] ERROR: relation "goose_db_version" does not exist at character 368162026-07-21 08:16:56.581 UTC [1038] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC8172026-07-21 08:16:56.583 UTC [1040] ERROR: relation "goose_db_version" does not exist at character 368182026-07-21 08:16:56.583 UTC [1040] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC8192026/07/21 08:16:56 OK 20241026095416_initial_model.sql (11.5ms)8202026/07/21 08:16:56 OK 20241026095416_initial_model.sql (12.38ms)8212026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (4.31ms)8222026/07/21 08:16:56 OK 20241026095416_initial_model.sql (12.73ms)8232026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (2.52ms)8242026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (2.03ms)8252026/07/21 08:16:56 OK 20251218171726_add_pins.sql (3.48ms)8262026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (2.71ms)8272026/07/21 08:16:56 OK 20251218171726_add_pins.sql (4.01ms)8282026/07/21 08:16:56 OK 20251218171726_add_pins.sql (5.44ms)8292026/07/21 08:16:56 OK 20251218171726_add_pins.sql (5.12ms)8302026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (5.29ms)8312026/07/21 08:16:56 goose: successfully migrated database to version: 202606281200008322026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (5.05ms)8332026/07/21 08:16:56 goose: successfully migrated database to version: 202606281200008342026/07/21 08:16:56 OK 20241026095416_initial_model.sql (12.74ms)835=== NAME TestClientIntegration836 client_integration_test.go:276: Created store path: /build/TestClientIntegration2072103718/002/store/18lm2a5w2590g4053l9cizysn8c8s9w5-test-file.txt8372026/07/21 08:16:56 OK 1_commit_pending_closure.sql (5.34ms)8382026/07/21 08:16:56 OK 20241026095416_initial_model.sql (14.24ms)8392026/07/21 08:16:56 OK 1_commit_pending_closure.sql (4.06ms)8402026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (5.6ms)8412026/07/21 08:16:56 goose: successfully migrated database to version: 202606281200008422026/07/21 08:16:56 OK 20241026095416_initial_model.sql (14.26ms)8432026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (7.03ms)8442026/07/21 08:16:56 goose: successfully migrated database to version: 202606281200008452026/07/21 08:16:56 OK 20241026095416_initial_model.sql (12.64ms)8462026/07/21 08:16:56 OK 20241026095416_initial_model.sql (14.02ms)8472026/07/21 08:16:56 OK 20241026095416_initial_model.sql (13.7ms)8482026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (3.01ms)8492026-07-21 08:16:56.602 UTC [1074] ERROR: relation "goose_db_version" does not exist at character 368502026-07-21 08:16:56.602 UTC [1074] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC8512026/07/21 08:16:56 OK 20241026095416_initial_model.sql (14.82ms)8522026/07/21 08:16:56 OK 2_object_stats_trigger.sql (2.72ms)8532026/07/21 08:16:56 goose: up to current file version: 28542026/07/21 08:16:56 OK 20241026095416_initial_model.sql (13.22ms)8552026/07/21 08:16:56 OK 20241026095416_initial_model.sql (14.13ms)8562026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (2.67ms)8572026/07/21 08:16:56 OK 2_object_stats_trigger.sql (3.41ms)8582026/07/21 08:16:56 goose: up to current file version: 28592026/07/21 08:16:56 OK 20241026095416_initial_model.sql (12.99ms)8602026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (2.29ms)8612026/07/21 08:16:56 OK 1_commit_pending_closure.sql (3.14ms)8622026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (3.03ms)8632026/07/21 08:16:56 OK 1_commit_pending_closure.sql (3.34ms)8642026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (2.15ms)8652026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (2.12ms)8662026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (2.17ms)8672026/07/21 08:16:56 OK 20241026095416_initial_model.sql (11.72ms)8682026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (2.61ms)8692026/07/21 08:16:56 OK 20251218171726_add_pins.sql (4.06ms)8702026/07/21 08:16:56 OK 2_object_stats_trigger.sql (1.77ms)8712026/07/21 08:16:56 goose: up to current file version: 28722026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (2.74ms)8732026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (2.18ms)8742026/07/21 08:16:56 OK 20251218171726_add_pins.sql (3.32ms)8752026/07/21 08:16:56 OK 2_object_stats_trigger.sql (2.75ms)8762026/07/21 08:16:56 goose: up to current file version: 28772026/07/21 08:16:56 OK 20251218171726_add_pins.sql (3.16ms)8782026/07/21 08:16:56 OK 20251218171726_add_pins.sql (3.49ms)8792026/07/21 08:16:56 OK 20251218171726_add_pins.sql (3.39ms)8802026/07/21 08:16:56 OK 20251218171726_add_pins.sql (3.72ms)8812026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (2.11ms)8822026/07/21 08:16:56 OK 20251218171726_add_pins.sql (4.07ms)8832026/07/21 08:16:56 INFO Created nix-cache-info in bucket bucket=bucket108842026/07/21 08:16:56 INFO Created nix-cache-info in bucket bucket=bucket118852026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (4.27ms)8862026/07/21 08:16:56 goose: successfully migrated database to version: 202606281200008872026/07/21 08:16:56 OK 20251218171726_add_pins.sql (4.43ms)8882026/07/21 08:16:56 OK 20251218171726_add_pins.sql (4.8ms)8892026/07/21 08:16:56 OK 20251218171726_add_pins.sql (4.87ms)8902026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (4.56ms)8912026/07/21 08:16:56 goose: successfully migrated database to version: 202606281200008922026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (4.63ms)8932026/07/21 08:16:56 goose: successfully migrated database to version: 202606281200008942026/07/21 08:16:56 OK 20251218171726_add_pins.sql (3.71ms)8952026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (4.57ms)8962026/07/21 08:16:56 goose: successfully migrated database to version: 202606281200008972026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (4.63ms)8982026/07/21 08:16:56 goose: successfully migrated database to version: 202606281200008992026/07/21 08:16:56 INFO Created nix-cache-info in bucket bucket=bucket139002026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (4.34ms)9012026/07/21 08:16:56 goose: successfully migrated database to version: 202606281200009022026/07/21 08:16:56 OK 1_commit_pending_closure.sql (2.02ms)9032026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (4.18ms)904=== NAME TestClientMultipleUploads9052026/07/21 08:16:56 goose: successfully migrated database to version: 20260628120000906 client_integration_test.go:338: Created store path 1: /build/TestClientMultipleUploads686248133/001/store/h7zar0k6zqhx6hxnfwvf82y883d5x43s-test-file-1.txt9072026/07/21 08:16:56 OK 2_object_stats_trigger.sql (1.56ms)9082026/07/21 08:16:56 goose: up to current file version: 29092026/07/21 08:16:56 OK 1_commit_pending_closure.sql (2.59ms)9102026/07/21 08:16:56 OK 1_commit_pending_closure.sql (2.46ms)9112026/07/21 08:16:56 OK 1_commit_pending_closure.sql (2.75ms)9122026/07/21 08:16:56 OK 1_commit_pending_closure.sql (2.9ms)9132026/07/21 08:16:56 OK 2_object_stats_trigger.sql (867.99µs)9142026/07/21 08:16:56 goose: up to current file version: 29152026/07/21 08:16:56 OK 1_commit_pending_closure.sql (3.04ms)9162026/07/21 08:16:56 OK 2_object_stats_trigger.sql (1.77ms)9172026/07/21 08:16:56 goose: up to current file version: 29182026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (6.6ms)9192026/07/21 08:16:56 goose: successfully migrated database to version: 202606281200009202026/07/21 08:16:56 OK 2_object_stats_trigger.sql (2.74ms)9212026/07/21 08:16:56 goose: up to current file version: 29222026/07/21 08:16:56 OK 2_object_stats_trigger.sql (1.87ms)9232026/07/21 08:16:56 goose: up to current file version: 29242026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (6.32ms)9252026/07/21 08:16:56 goose: successfully migrated database to version: 202606281200009262026/07/21 08:16:56 OK 1_commit_pending_closure.sql (3.89ms)927=== RUN TestService_AuthMiddleware_OIDC/valid_OIDC_token9282026/07/21 08:16:56 OK 2_object_stats_trigger.sql (2.4ms)929=== PAUSE TestService_AuthMiddleware_OIDC/valid_OIDC_token9302026/07/21 08:16:56 goose: up to current file version: 2931=== RUN TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected932=== PAUSE TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected9332026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (6.2ms)934=== RUN TestService_AuthMiddleware_OIDC/malformed_token_rejected9352026/07/21 08:16:56 goose: successfully migrated database to version: 20260628120000936=== PAUSE TestService_AuthMiddleware_OIDC/malformed_token_rejected937=== RUN TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured9382026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (6.73ms)939=== PAUSE TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured9402026/07/21 08:16:56 goose: successfully migrated database to version: 20260628120000941=== CONT TestRedundantMultipartUpload9422026/07/21 08:16:56 OK 20241026095416_initial_model.sql (11.47ms)943--- PASS: TestService_Rustfstest (0.25s)944=== CONT TestReadProxyRangeRequest9452026/07/21 08:16:56 OK 1_commit_pending_closure.sql (2.86ms)946--- PASS: TestCacheStatsHandler (0.40s)947=== CONT TestService_AuthMiddleware_MTLSBoundSubjects9482026/07/21 08:16:56 INFO Received cleanup request method=DELETE path=/api/pending_closures9492026/07/21 08:16:56 INFO Received complete multipart upload request method=POST path=/api/multipart/complete9502026/07/21 08:16:56 INFO Received uploads request method=POST path=/api/pending_closures9512026/07/21 08:16:56 OK 1_commit_pending_closure.sql (2.81ms)9522026/07/21 08:16:56 OK 2_object_stats_trigger.sql (2.6ms)9532026/07/21 08:16:56 goose: up to current file version: 29542026/07/21 08:16:56 OK 1_commit_pending_closure.sql (2.85ms)9552026/07/21 08:16:56 OK 1_commit_pending_closure.sql (2.52ms)9562026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (2.25ms)9572026/07/21 08:16:56 ERROR Failed to get multipart upload error="no rows in result set" upload_id=does-not-exist object_key=nar/0000000000000000000000000000000000000000000000000000.nar.zst958--- PASS: TestCompleteMultipartUnregistered (0.40s)9592026/07/21 08:16:56 INFO Aborted multipart uploads count=0960=== CONT TestService_ReadAuthMiddleware9612026/07/21 08:16:56 OK 2_object_stats_trigger.sql (2.57ms)9622026/07/21 08:16:56 goose: up to current file version: 29632026/07/21 08:16:56 OK 2_object_stats_trigger.sql (2.27ms)9642026/07/21 08:16:56 goose: up to current file version: 29652026/07/21 08:16:56 OK 2_object_stats_trigger.sql (1.65ms)9662026/07/21 08:16:56 goose: up to current file version: 29672026/07/21 08:16:56 INFO Received uploads request method=POST path=/api/pending_closures9682026/07/21 08:16:56 OK 2_object_stats_trigger.sql (1.55ms)9692026/07/21 08:16:56 goose: up to current file version: 29702026/07/21 08:16:56 OK 20251218171726_add_pins.sql (2.68ms)971--- PASS: TestService_healthCheckHandler (0.41s)972=== CONT TestReadProxyNarinfoAlreadyDecompressed9732026/07/21 08:16:56 WARN mTLS auth: subject not in bound subjects subject="CN=reader"9742026/07/21 08:16:56 WARN mTLS auth: subject not in bound subjects subject="CN=writer"975--- PASS: TestService_NativeMTLS (0.41s)976=== CONT TestReadProxyRootRedirectsToIndexHTML977--- PASS: TestReadProxyDisabled (0.40s)978=== CONT TestReadProxyConditionalGet9792026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (3.54ms)9802026/07/21 08:16:56 goose: successfully migrated database to version: 202606281200009812026/07/21 08:16:56 INFO Received cleanup request method=DELETE path=/api/pending_closures9822026/07/21 08:16:56 OK 1_commit_pending_closure.sql (2.38ms)9832026/07/21 08:16:56 INFO Aborted multipart uploads count=19842026/07/21 08:16:56 OK 2_object_stats_trigger.sql (1.47ms)9852026/07/21 08:16:56 goose: up to current file version: 29862026/07/21 08:16:56 INFO Received uploads request method=POST path=/api/pending_closures9872026/07/21 08:16:56 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete9882026-07-21 08:16:56.637 UTC [1034] ERROR: Closure does not exist: id=19892026-07-21 08:16:56.637 UTC [1034] CONTEXT: PL/pgSQL function commit_pending_closure(bigint) line 16 at RAISE9902026-07-21 08:16:56.637 UTC [1034] STATEMENT: -- name: CommitPendingClosure :exec991 SELECT commit_pending_closure($1::bigint)992 993--- PASS: TestService_cleanupPendingClosuresHandler (0.42s)994=== CONT TestReadProxyHead9952026/07/21 08:16:56 INFO Received cleanup request method=DELETE path=/api/pending_closures996--- PASS: TestMetricsInventory (0.42s)997=== CONT TestReadProxyInvalidPath9982026/07/21 08:16:56 INFO Aborted multipart uploads count=09992026/07/21 08:16:56 INFO Aborted multipart uploads count=110002026/07/21 08:16:56 WARN Force mode enabled - objects will be deleted immediately without grace period10012026/07/21 08:16:56 INFO Registered completed upload object_key=nar/jjjjjjjjjjjjjjjjjjjjjjjjjjjjjj0100000000000000000000.nar.zst10022026/07/21 08:16:56 INFO Received uploads request method=POST path=/api/pending_closures10032026-07-21 08:16:56.647 UTC [1151] ERROR: relation "goose_db_version" does not exist at character 3610042026-07-21 08:16:56.647 UTC [1151] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC10052026/07/21 08:16:56 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=010062026/07/21 08:16:56 INFO Vacuumed table table=pending_closures10072026/07/21 08:16:56 INFO Vacuumed table table=pending_objects10082026/07/21 08:16:56 INFO Vacuumed table table=multipart_uploads10092026/07/21 08:16:56 INFO Vacuumed table table=closures1010=== NAME TestClientWithDependencies1011 client_integration_test.go:593: Built derivation: /build/TestClientWithDependencies2048666533/001/store/rvj724r1wn4mgybhyc6w55v1qr49f147-test-script1012--- PASS: TestMultipartCleanup (0.43s)1013=== CONT TestReadProxy40410142026/07/21 08:16:56 INFO Vacuumed table table=objects1015=== NAME TestClientMultipleUploads1016 client_integration_test.go:338: Created store path 2: /build/TestClientMultipleUploads686248133/001/store/l98lrplyynw31clrcx3448z1bhdq002q-test-file-2.txt1017=== NAME TestNARDeduplicationMetadataUploadBug1018 metadata_upload_test.go:48: First store path: /build/TestNARDeduplicationMetadataUploadBug4229069561/001/store/09csdlxn8y87pw76h7rdp177w7pwjb7w-file1.txt1019--- PASS: TestGCMetrics (0.43s)1020=== CONT TestReadProxyNarStreaming1021--- PASS: TestPresignedUploadRegisteredBeforeCommit (0.23s)1022=== CONT TestService_AuthMiddleware_MTLSProxyHeader10232026/07/21 08:16:56 OK 20241026095416_initial_model.sql (11.94ms)10242026-07-21 08:16:56.678 UTC [1231] ERROR: relation "goose_db_version" does not exist at character 3610252026-07-21 08:16:56.678 UTC [1231] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC10262026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (3.26ms)10272026/07/21 08:16:56 WARN Failed to fetch cache config, uploading without size limit error="fetching cache config: server returned 404: 404 page not found\n"10282026/07/21 08:16:56 OK 20251218171726_add_pins.sql (4.08ms)1029=== NAME TestClientWithDependencies1030 client_integration_test.go:595: Found 1 dependencies (including self)10312026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (5.11ms)10322026/07/21 08:16:56 goose: successfully migrated database to version: 2026062812000010332026/07/21 08:16:56 INFO Received complete multipart upload request method=POST path=/api/multipart/complete1034=== NAME TestPinProtectsFromGC1035 client_integration_test.go:646: Pinned store path: /build/TestPinProtectsFromGC3889143764/001/store/2b4aigy7xa0q1rsyj83kf8sj8g63kj5y-pinned-file.txt1036 client_integration_test.go:647: Unpinned store path: /build/TestPinProtectsFromGC3889143764/001/store/615kk5bhvn0mki43hf1qmmwsjxpgbid3-unpinned-file.txt10372026/07/21 08:16:56 OK 1_commit_pending_closure.sql (4.44ms)10382026/07/21 08:16:56 OK 2_object_stats_trigger.sql (3.31ms)10392026/07/21 08:16:56 goose: up to current file version: 210402026/07/21 08:16:56 INFO Received uploads request method=POST path=/api/pending_closures1041=== NAME TestClientCADerivations1042 client_ca_test.go:136: Built CA derivation: /build/TestClientCADerivations2793120801/001/store/q45af6zkbgk26ji1qj5a000f6dv6g788-ca-test10432026/07/21 08:16:56 OK 20241026095416_initial_model.sql (29.97ms)10442026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (4.5ms)10452026/07/21 08:16:56 WARN Failed to fetch cache config, uploading without size limit error="fetching cache config: server returned 404: 404 page not found\n"10462026/07/21 08:16:56 OK 20251218171726_add_pins.sql (2.84ms)10472026/07/21 08:16:56 WARN Failed to fetch cache config, uploading without size limit error="fetching cache config: server returned 404: 404 page not found\n"10482026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (6.18ms)10492026/07/21 08:16:56 goose: successfully migrated database to version: 2026062812000010502026/07/21 08:16:56 OK 1_commit_pending_closure.sql (3.44ms)10512026/07/21 08:16:56 OK 2_object_stats_trigger.sql (3.46ms)10522026/07/21 08:16:56 goose: up to current file version: 210532026/07/21 08:16:56 INFO Received uploads request method=POST path=/api/pending_closures1054 client_ca_test.go:139: Found 1 dependencies (including self)10552026/07/21 08:16:56 INFO Received uploads request method=POST path=/api/pending_closures10562026/07/21 08:16:56 WARN Failed to fetch cache config, uploading without size limit error="fetching cache config: server returned 404: 404 page not found\n"10572026/07/21 08:16:56 INFO Received uploads request method=POST path=/api/pending_closures10582026/07/21 08:16:56 INFO Received uploads request method=POST path=/api/pending_closures10592026/07/21 08:16:56 INFO Received uploads request method=POST path=/api/pending_closures10602026/07/21 08:16:56 WARN Failed to fetch cache config, uploading without size limit error="fetching cache config: server returned 404: 404 page not found\n"10612026/07/21 08:16:56 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)10622026/07/21 08:16:56 INFO Uploading 18lm2a5w2590g4053l9cizysn8c8s9w5-test-file.txt (152B)10632026/07/21 08:16:56 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)10642026/07/21 08:16:56 INFO Uploading rvj724r1wn4mgybhyc6w55v1qr49f147-test-script (136B)10652026/07/21 08:16:56 WARN Failed to register uploaded object key=nar/11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk1.nar.zst error="server returned 404: 404 page not found\n"10662026/07/21 08:16:56 INFO Received complete multipart upload request method=POST path=/api/multipart/complete10672026/07/21 08:16:56 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)10682026/07/21 08:16:56 INFO Received uploads request method=POST path=/api/pending_closures10692026/07/21 08:16:56 INFO Uploading 09csdlxn8y87pw76h7rdp177w7pwjb7w-file1.txt (160B)10702026/07/21 08:16:56 WARN Failed to register uploaded object key=nar/1s7yghixzpinyqm7g59kyn3sav81pmnsdi5v63m6x4r2vacy907j.nar.zst error="server returned 404: 404 page not found\n"1071{"timestamp":"2026-07-21T08:16:56.780117014Z","level":"ERROR","fields":{"message":"complete_multipart_upload part error: \"part.1 not found\""},"target":"rustfs_ecstore::set_disk","filename":"crates/ecstore/src/set_disk.rs","line_number":3463,"threadName":"rustfs-worker","threadId":"ThreadId(516)"}1072{"timestamp":"2026-07-21T08:16:56.780184904Z","level":"ERROR","fields":{"message":"complete_multipart_upload etag err client=Some(\"deadbeef\"), stored=\"\", part_id=1, bucket=bucket27, object=nar/gggggggggggggggggggggggggggggg0300000000000000000000.nar.zst"},"target":"rustfs_ecstore::set_disk","filename":"crates/ecstore/src/set_disk.rs","line_number":3534,"threadName":"rustfs-worker","threadId":"ThreadId(516)"}10732026/07/21 08:16:56 WARN Failed to register uploaded object key=18lm2a5w2590g4053l9cizysn8c8s9w5.ls error="server returned 404: 404 page not found\n"10742026/07/21 08:16:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign10752026/07/21 08:16:56 INFO Signed narinfos id=1 count=110762026/07/21 08:16:56 WARN Failed to register uploaded object key=rvj724r1wn4mgybhyc6w55v1qr49f147.ls error="server returned 404: 404 page not found\n"10772026/07/21 08:16:56 WARN Failed to register uploaded object key=nar/1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf.nar.zst error="server returned 404: 404 page not found\n"10782026/07/21 08:16:56 INFO Uploading 1 narinfos10792026/07/21 08:16:56 WARN Failed to register uploaded object key=log/xkidjdbx3vflidkh7bhy94by1l3m52hj-test-script.drv error="server returned 404: 404 page not found\n"10802026/07/21 08:16:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign10812026/07/21 08:16:56 WARN CompleteMultipartUpload errored but object exists; treating as success error="One or more of the specified parts could not be found. The part may not have been uploaded, or the specified entity tag may not match the part's entity tag." object_key=nar/gggggggggggggggggggggggggggggg0300000000000000000000.nar.zst upload_id=NGQxMzNmY2ItZmQ1Yi00ZGE5LTgxZmYtZWM5MGYwZDZkMjFkLmI5OTVkNmFjLWM2Y2EtNDE3ZS05NjExLTU2MjY0MGQyZDNmZHgxNzg0NjIxODE2NzQ1NDE3NDQ210822026/07/21 08:16:56 INFO Signed narinfos id=1 count=110832026/07/21 08:16:56 INFO Uploading 1 narinfos10842026/07/21 08:16:56 WARN Failed to register uploaded object key=09csdlxn8y87pw76h7rdp177w7pwjb7w.ls error="server returned 404: 404 page not found\n"10852026/07/21 08:16:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign10862026/07/21 08:16:56 WARN Failed to register uploaded object key=18lm2a5w2590g4053l9cizysn8c8s9w5.narinfo error="server returned 404: 404 page not found\n"10872026/07/21 08:16:56 INFO Signed narinfos id=1 count=110882026/07/21 08:16:56 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete10892026/07/21 08:16:56 INFO Uploading 1 narinfos10902026/07/21 08:16:56 INFO Received uploads request method=POST path=/api/pending_closures10912026/07/21 08:16:56 WARN Failed to register uploaded object key=rvj724r1wn4mgybhyc6w55v1qr49f147.narinfo error="server returned 404: 404 page not found\n"10922026/07/21 08:16:56 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete10932026/07/21 08:16:56 WARN Failed to register uploaded object key=09csdlxn8y87pw76h7rdp177w7pwjb7w.narinfo error="server returned 404: 404 page not found\n"10942026/07/21 08:16:56 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete10952026/07/21 08:16:56 INFO Uploading 3 paths to 127.0.0.1 (0 already cached)10962026/07/21 08:16:56 INFO Uploading l98lrplyynw31clrcx3448z1bhdq002q-test-file-2.txt (160B)10972026/07/21 08:16:56 INFO Uploading 0d6dpvgvgs4qddhrdv3wli2jsih8wi3j-test-file-0.txt (160B)10982026/07/21 08:16:56 INFO Uploading h7zar0k6zqhx6hxnfwvf82y883d5x43s-test-file-1.txt (160B)10992026/07/21 08:16:56 INFO Completed upload id=111002026/07/21 08:16:56 INFO Upload complete. (73ms)11012026/07/21 08:16:56 INFO Completed multipart upload object_key=nar/gggggggggggggggggggggggggggggg0300000000000000000000.nar.zst upload_id=NGQxMzNmY2ItZmQ1Yi00ZGE5LTgxZmYtZWM5MGYwZDZkMjFkLmI5OTVkNmFjLWM2Y2EtNDE3ZS05NjExLTU2MjY0MGQyZDNmZHgxNzg0NjIxODE2NzQ1NDE3NDQ2 parts=11102--- PASS: TestCompleteMultipartUpload_ErrorButObjectExists (0.25s)1103=== CONT TestGCTaskStore_GetReturnsLatest1104--- PASS: TestGCTaskStore_GetReturnsLatest (0.00s)1105=== CONT TestGCTaskStore_CompletedAllowsNewTask1106--- PASS: TestGCTaskStore_CompletedAllowsNewTask (0.00s)1107=== CONT TestGCTaskStore_GetEmpty1108--- PASS: TestGCTaskStore_GetEmpty (0.00s)11092026/07/21 08:16:56 WARN Failed to register uploaded object key=nar/13p9pqi0ga6fx2apcwls9hjnv7nmf740ggpn5zvfzdsp5vz2bbg4.nar.zst error="server returned 404: 404 page not found\n"1110=== CONT TestGCTaskStore_ConflictDifferentParams1111--- PASS: TestGCTaskStore_ConflictDifferentParams (0.00s)1112=== CONT TestResurrectedObjectNotDeleted11132026/07/21 08:16:56 INFO Completed upload id=111142026/07/21 08:16:56 INFO Upload complete. (150ms)11152026/07/21 08:16:56 WARN Failed to register uploaded object key=nar/1823g6vx4q5zqvr73m7lkq1wpk40fin7bsc792di430yk7sg4lka.nar.zst error="server returned 404: 404 page not found\n"11162026/07/21 08:16:56 WARN Failed to register uploaded object key=nar/0ahq3izw3h0b0c08p3xdfclh758fwxnp85ccvflasb4vnfsv50ri.nar.zst error="server returned 404: 404 page not found\n"11172026/07/21 08:16:56 INFO Completed upload id=111182026/07/21 08:16:56 WARN Failed to register uploaded object key=0d6dpvgvgs4qddhrdv3wli2jsih8wi3j.ls error="server returned 404: 404 page not found\n"11192026/07/21 08:16:56 INFO Upload complete. (105ms)1120=== NAME TestClientIntegration1121 client_integration_test.go:292: Retrieved narinfo from S3:1122 StorePath: /build/TestClientIntegration2072103718/002/store/18lm2a5w2590g4053l9cizysn8c8s9w5-test-file.txt1123 URL: nar/11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk1.nar.zst1124 Compression: zstd1125 NarHash: sha256:11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk11126 NarSize: 1521127 References: 1128 CA: fixed:r:sha256:11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk111292026/07/21 08:16:56 WARN Failed to register uploaded object key=h7zar0k6zqhx6hxnfwvf82y883d5x43s.ls error="server returned 404: 404 page not found\n"1130=== NAME TestClientWithDependencies1131 client_integration_test.go:597: Skipping nix copy test - isolated store (/build/TestClientWithDependencies2048666533/001/store) requires matching store prefix1132=== NAME TestNARDeduplicationMetadataUploadBug1133 metadata_upload_test.go:54: Retrieved narinfo from S3:1134 StorePath: /build/TestNARDeduplicationMetadataUploadBug4229069561/001/store/09csdlxn8y87pw76h7rdp177w7pwjb7w-file1.txt11352026/07/21 08:16:56 WARN Failed to register uploaded object key=l98lrplyynw31clrcx3448z1bhdq002q.ls error="server returned 404: 404 page not found\n"1136 URL: nar/1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf.nar.zst1137 Compression: zstd1138 NarHash: sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf1139 NarSize: 1601140 References: 1141 CA: fixed:r:sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf11422026/07/21 08:16:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign11432026/07/21 08:16:56 INFO Signed narinfos id=3 count=111442026/07/21 08:16:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign11452026/07/21 08:16:56 INFO Signed narinfos id=1 count=111462026/07/21 08:16:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign11472026/07/21 08:16:56 INFO Signed narinfos id=2 count=111482026/07/21 08:16:56 INFO Uploading 3 narinfos1149=== NAME TestClientIntegration1150 client_integration_test.go:293: Retrieved .ls file from S3 (compressed size: 77 bytes)1151 client_integration_test.go:293: Decompressed .ls content (64 bytes):1152 {"version":1,"root":{"type":"regular","size":39,"narOffset":96}}1153 client_integration_test.go:296: Testing garbage collection...1154=== NAME TestNARDeduplicationMetadataUploadBug1155 metadata_upload_test.go:55: Retrieved .ls file from S3 (compressed size: 77 bytes)1156 metadata_upload_test.go:55: Decompressed .ls content (64 bytes):1157 {"version":1,"root":{"type":"regular","size":44,"narOffset":96}}11582026/07/21 08:16:56 WARN Failed to register uploaded object key=l98lrplyynw31clrcx3448z1bhdq002q.narinfo error="server returned 404: 404 page not found\n"11592026/07/21 08:16:56 WARN Failed to register uploaded object key=h7zar0k6zqhx6hxnfwvf82y883d5x43s.narinfo error="server returned 404: 404 page not found\n"11602026/07/21 08:16:56 WARN Failed to register uploaded object key=0d6dpvgvgs4qddhrdv3wli2jsih8wi3j.narinfo error="server returned 404: 404 page not found\n"11612026/07/21 08:16:56 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete11622026-07-21 08:16:56.803 UTC [1540] ERROR: relation "goose_db_version" does not exist at character 3611632026-07-21 08:16:56.803 UTC [1540] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC1164--- PASS: TestClientWithDependencies (0.59s)1165=== CONT TestReadProxyNarinfo11662026-07-21 08:16:56.804 UTC [1543] ERROR: relation "goose_db_version" does not exist at character 3611672026-07-21 08:16:56.804 UTC [1543] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC11682026-07-21 08:16:56.804 UTC [1544] ERROR: relation "goose_db_version" does not exist at character 3611692026-07-21 08:16:56.804 UTC [1544] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC11702026-07-21 08:16:56.805 UTC [1541] ERROR: relation "goose_db_version" does not exist at character 3611712026-07-21 08:16:56.805 UTC [1541] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC11722026-07-21 08:16:56.807 UTC [1545] ERROR: relation "goose_db_version" does not exist at character 3611732026-07-21 08:16:56.807 UTC [1545] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC11742026-07-21 08:16:56.808 UTC [1565] ERROR: relation "goose_db_version" does not exist at character 3611752026-07-21 08:16:56.808 UTC [1565] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC11762026-07-21 08:16:56.809 UTC [1555] ERROR: relation "goose_db_version" does not exist at character 3611772026-07-21 08:16:56.809 UTC [1555] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC11782026-07-21 08:16:56.810 UTC [1568] ERROR: relation "goose_db_version" does not exist at character 3611792026-07-21 08:16:56.810 UTC [1568] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC11802026/07/21 08:16:56 WARN Failed to fetch cache config, uploading without size limit error="fetching cache config: server returned 404: 404 page not found\n"11812026/07/21 08:16:56 INFO Received uploads request method=POST path=/api/pending_closures11822026/07/21 08:16:56 INFO Completed upload id=111832026/07/21 08:16:56 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete11842026/07/21 08:16:56 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)11852026/07/21 08:16:56 INFO Uploading 2b4aigy7xa0q1rsyj83kf8sj8g63kj5y-pinned-file.txt (128B)11862026/07/21 08:16:56 INFO Completed upload id=211872026/07/21 08:16:56 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete11882026/07/21 08:16:56 WARN Failed to register uploaded object key=nar/0qmhsg42pqsz7x6hh02j8gznnac3yi3qpjhrqbwvz88i194jbb5s.nar.zst error="server returned 404: 404 page not found\n"11892026/07/21 08:16:56 INFO Completed upload id=311902026/07/21 08:16:56 INFO Upload complete. (146ms)1191=== NAME TestClientMultipleUploads1192 client_integration_test.go:349: Uploaded 3 paths in 180.230947ms11932026/07/21 08:16:56 WARN Failed to register uploaded object key=2b4aigy7xa0q1rsyj83kf8sj8g63kj5y.ls error="server returned 404: 404 page not found\n"11942026/07/21 08:16:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign11952026/07/21 08:16:56 INFO Signed narinfos id=1 count=111962026/07/21 08:16:56 INFO Uploading 1 narinfos11972026/07/21 08:16:56 INFO Starting cleanup of old closures method=DELETE path=/api/closures11982026/07/21 08:16:56 INFO Garbage collection started11992026/07/21 08:16:56 WARN Failed to register uploaded object key=2b4aigy7xa0q1rsyj83kf8sj8g63kj5y.narinfo error="server returned 404: 404 page not found\n"12002026/07/21 08:16:56 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete12012026-07-21 08:16:56.840 UTC [1618] ERROR: relation "goose_db_version" does not exist at character 3612022026-07-21 08:16:56.840 UTC [1618] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC12032026/07/21 08:16:56 OK 20241026095416_initial_model.sql (11.71ms)12042026/07/21 08:16:56 OK 20241026095416_initial_model.sql (12.34ms)12052026/07/21 08:16:56 OK 20241026095416_initial_model.sql (12.72ms)12062026/07/21 08:16:56 OK 20241026095416_initial_model.sql (13.35ms)12072026/07/21 08:16:56 OK 20241026095416_initial_model.sql (12.4ms)12082026/07/21 08:16:56 INFO Received complete multipart upload request method=POST path=/api/multipart/complete12092026-07-21 08:16:56.844 UTC [1622] ERROR: relation "goose_db_version" does not exist at character 3612102026-07-21 08:16:56.844 UTC [1622] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC12112026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (3.21ms)12122026-07-21 08:16:56.845 UTC [1624] ERROR: relation "goose_db_version" does not exist at character 3612132026-07-21 08:16:56.845 UTC [1624] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC12142026-07-21 08:16:56.845 UTC [1623] ERROR: relation "goose_db_version" does not exist at character 3612152026-07-21 08:16:56.845 UTC [1623] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC1216=== NAME TestNARDeduplicationMetadataUploadBug1217 metadata_upload_test.go:64: Second store path (same content): /build/TestNARDeduplicationMetadataUploadBug4229069561/001/store/knvcbfyzp2mribpm7vrrclna22m320fv-file2.txt12182026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (3.72ms)12192026/07/21 08:16:56 OK 20241026095416_initial_model.sql (17.35ms)12202026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (3.84ms)1221--- PASS: TestClientMultipleUploads (0.63s)12222026/07/21 08:16:56 OK 20241026095416_initial_model.sql (16.32ms)1223=== CONT TestIsValidCachePath1224=== RUN TestIsValidCachePath/narinfo12252026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (4.19ms)1226=== PAUSE TestIsValidCachePath/narinfo1227=== RUN TestIsValidCachePath/narinfo_all_nix_base32_chars12282026/07/21 08:16:56 OK 20241026095416_initial_model.sql (15.97ms)1229=== PAUSE TestIsValidCachePath/narinfo_all_nix_base32_chars12302026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (4.32ms)1231=== RUN TestIsValidCachePath/nar_zst1232=== PAUSE TestIsValidCachePath/nar_zst1233=== RUN TestIsValidCachePath/nar_xz1234=== PAUSE TestIsValidCachePath/nar_xz1235=== RUN TestIsValidCachePath/nar_bz21236=== PAUSE TestIsValidCachePath/nar_bz21237=== RUN TestIsValidCachePath/nar_uncompressed1238=== PAUSE TestIsValidCachePath/nar_uncompressed1239=== RUN TestIsValidCachePath/ls1240=== PAUSE TestIsValidCachePath/ls1241=== RUN TestIsValidCachePath/log1242=== PAUSE TestIsValidCachePath/log1243=== RUN TestIsValidCachePath/realisation1244=== PAUSE TestIsValidCachePath/realisation1245=== RUN TestIsValidCachePath/nix-cache-info1246=== PAUSE TestIsValidCachePath/nix-cache-info12472026/07/21 08:16:56 OK 20251218171726_add_pins.sql (5.31ms)1248=== RUN TestIsValidCachePath/index.html12492026/07/21 08:16:56 INFO Completed upload id=11250=== PAUSE TestIsValidCachePath/index.html1251=== RUN TestIsValidCachePath/traversal_parent1252=== PAUSE TestIsValidCachePath/traversal_parent12532026/07/21 08:16:56 INFO Upload complete. (121ms)1254=== RUN TestIsValidCachePath/traversal_in_middle1255=== PAUSE TestIsValidCachePath/traversal_in_middle1256=== RUN TestIsValidCachePath/invalid_char_e1257=== PAUSE TestIsValidCachePath/invalid_char_e1258=== RUN TestIsValidCachePath/invalid_char_u1259=== PAUSE TestIsValidCachePath/invalid_char_u1260=== RUN TestIsValidCachePath/random_path1261=== PAUSE TestIsValidCachePath/random_path1262=== RUN TestIsValidCachePath/empty12632026/07/21 08:16:56 INFO Aborted multipart uploads count=01264=== PAUSE TestIsValidCachePath/empty12652026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (3.74ms)1266=== RUN TestIsValidCachePath/leading_slash1267=== PAUSE TestIsValidCachePath/leading_slash1268=== RUN TestIsValidCachePath/wrong_extension12692026/07/21 08:16:56 INFO Received complete multipart upload request method=POST path=/api/multipart/complete1270=== PAUSE TestIsValidCachePath/wrong_extension1271=== RUN TestIsValidCachePath/short_hash1272=== PAUSE TestIsValidCachePath/short_hash1273=== CONT TestParseSingleRange1274=== RUN TestParseSingleRange/none1275=== PAUSE TestParseSingleRange/none1276=== RUN TestParseSingleRange/unknown_unit1277=== PAUSE TestParseSingleRange/unknown_unit1278=== RUN TestParseSingleRange/multi-range_ignored1279=== PAUSE TestParseSingleRange/multi-range_ignored1280=== RUN TestParseSingleRange/malformed_no_dash1281=== PAUSE TestParseSingleRange/malformed_no_dash1282=== RUN TestParseSingleRange/malformed_both_empty1283=== PAUSE TestParseSingleRange/malformed_both_empty1284=== RUN TestParseSingleRange/malformed_end_before_start1285=== PAUSE TestParseSingleRange/malformed_end_before_start1286=== RUN TestParseSingleRange/closed1287=== PAUSE TestParseSingleRange/closed12882026/07/21 08:16:56 OK 20251218171726_add_pins.sql (5.79ms)1289=== RUN TestParseSingleRange/open-ended1290=== PAUSE TestParseSingleRange/open-ended1291=== RUN TestParseSingleRange/end_clamped_to_size12922026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (4.67ms)1293=== PAUSE TestParseSingleRange/end_clamped_to_size12942026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (4.75ms)1295=== RUN TestParseSingleRange/suffix1296=== PAUSE TestParseSingleRange/suffix1297=== RUN TestParseSingleRange/suffix_exceeds_size1298=== PAUSE TestParseSingleRange/suffix_exceeds_size1299=== RUN TestParseSingleRange/single_byte1300=== PAUSE TestParseSingleRange/single_byte1301=== RUN TestParseSingleRange/start_past_EOF1302=== PAUSE TestParseSingleRange/start_past_EOF13032026/07/21 08:16:56 OK 20251218171726_add_pins.sql (5.46ms)1304=== RUN TestParseSingleRange/start_far_past_EOF13052026/07/21 08:16:56 OK 20251218171726_add_pins.sql (6.01ms)1306=== PAUSE TestParseSingleRange/start_far_past_EOF13072026/07/21 08:16:56 OK 20251218171726_add_pins.sql (5.35ms)1308--- PASS: TestGCBugBareHashReferences (0.63s)1309=== CONT TestOrphanedObjectsGC1310=== CONT TestOrphanedObjectsGCStressTest13112026/07/21 08:16:56 INFO Received uploads request method=POST path=/api/pending_closures13122026/07/21 08:16:56 WARN Force mode enabled - objects will be deleted immediately without grace period13132026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (6.72ms)13142026/07/21 08:16:56 goose: successfully migrated database to version: 2026062812000013152026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (9.71ms)13162026/07/21 08:16:56 goose: successfully migrated database to version: 2026062812000013172026/07/21 08:16:56 OK 20251218171726_add_pins.sql (8.21ms)13182026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (6.81ms)13192026/07/21 08:16:56 goose: successfully migrated database to version: 2026062812000013202026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (7.18ms)13212026/07/21 08:16:56 goose: successfully migrated database to version: 2026062812000013222026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (6.97ms)13232026/07/21 08:16:56 goose: successfully migrated database to version: 2026062812000013242026/07/21 08:16:56 OK 20251218171726_add_pins.sql (7.89ms)13252026/07/21 08:16:56 OK 20251218171726_add_pins.sql (7.98ms)13262026/07/21 08:16:56 OK 20241026095416_initial_model.sql (11.8ms)13272026/07/21 08:16:56 OK 1_commit_pending_closure.sql (2.64ms)13282026/07/21 08:16:56 OK 20241026095416_initial_model.sql (10.94ms)13292026/07/21 08:16:56 OK 20241026095416_initial_model.sql (10.87ms)13302026/07/21 08:16:56 INFO Completed multipart upload object_key=nar/0000000000000000000000000000000000000000000000000000.nar.zst upload_id=NGQxMzNmY2ItZmQ1Yi00ZGE5LTgxZmYtZWM5MGYwZDZkMjFkLjk0ZGFiMTRkLWQ4NjctNDdhNi05ZGI0LWY1Y2E5MDQ0ZDU4OHgxNzg0NjIxODE2NTI1MzI5ODY0 parts=1013312026/07/21 08:16:56 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete13322026/07/21 08:16:56 OK 1_commit_pending_closure.sql (3.6ms)13332026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (1.95ms)13342026/07/21 08:16:56 OK 2_object_stats_trigger.sql (1.64ms)13352026/07/21 08:16:56 goose: up to current file version: 213362026/07/21 08:16:56 OK 20241026095416_initial_model.sql (10.89ms)13372026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (1.62ms)13382026/07/21 08:16:56 OK 1_commit_pending_closure.sql (2.83ms)13392026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (1.62ms)13402026/07/21 08:16:56 OK 1_commit_pending_closure.sql (2.99ms)13412026/07/21 08:16:56 INFO Completed multipart upload object_key=nar/dadb44fdadb44fdadb44fdadb44f000000000000000000000000.nar.zst upload_id=NGQxMzNmY2ItZmQ1Yi00ZGE5LTgxZmYtZWM5MGYwZDZkMjFkLjVhNTM2MTEzLWVjMGUtNGU5Yy04ZWI3LTA1M2JjMjE5MzI5MngxNzg0NjIxODE2NTM0MDUzMzY2 parts=1013422026/07/21 08:16:56 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete13432026/07/21 08:16:56 OK 1_commit_pending_closure.sql (3.95ms)13442026/07/21 08:16:56 OK 2_object_stats_trigger.sql (1.79ms)13452026/07/21 08:16:56 goose: up to current file version: 213462026/07/21 08:16:56 OK 2_object_stats_trigger.sql (2.93ms)13472026/07/21 08:16:56 goose: up to current file version: 213482026/07/21 08:16:56 OK 2_object_stats_trigger.sql (2.11ms)13492026/07/21 08:16:56 goose: up to current file version: 213502026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (6.47ms)13512026/07/21 08:16:56 goose: successfully migrated database to version: 2026062812000013522026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (4.92ms)13532026/07/21 08:16:56 goose: successfully migrated database to version: 2026062812000013542026/07/21 08:16:56 INFO Completed upload id=113552026/07/21 08:16:56 INFO Received get closure request method=GET path=/api/closures/0000000000000000000000000000000013562026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (2.35ms)13572026/07/21 08:16:56 OK 20251218171726_add_pins.sql (3.93ms)13582026/07/21 08:16:56 OK 2_object_stats_trigger.sql (2.16ms)13592026/07/21 08:16:56 goose: up to current file version: 213602026/07/21 08:16:56 OK 20251218171726_add_pins.sql (3.28ms)13612026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (6.22ms)13622026/07/21 08:16:56 goose: successfully migrated database to version: 2026062812000013632026/07/21 08:16:56 OK 20251218171726_add_pins.sql (4.08ms)13642026/07/21 08:16:56 INFO Received uploads request method=POST path=/api/pending_closures13652026/07/21 08:16:56 INFO Completed upload id=113662026/07/21 08:16:56 WARN mTLS auth: subject not in bound subjects subject="CN=untrusted,O=Other"13672026/07/21 08:16:56 WARN mTLS auth: bound subjects configured but subject DN unavailable13682026/07/21 08:16:56 WARN mTLS auth: subject not in bound subjects subject="CN=untrusted"1369--- PASS: TestService_AuthMiddleware_MTLSBoundSubjects (0.25s)1370=== CONT TestObjectStatsTrigger13712026/07/21 08:16:56 INFO Received uploads request method=POST path=/api/pending_closures1372--- PASS: TestReadProxyInvalidPath (0.23s)1373=== CONT TestClientErrorHandling/InvalidStorePath13742026/07/21 08:16:56 OK 1_commit_pending_closure.sql (2.88ms)13752026/07/21 08:16:56 OK 1_commit_pending_closure.sql (3.86ms)13762026/07/21 08:16:56 INFO Starting cleanup of old closures method=DELETE path=/api/closures13772026/07/21 08:16:56 OK 1_commit_pending_closure.sql (3.95ms)13782026/07/21 08:16:56 OK 20251218171726_add_pins.sql (3.69ms)13792026/07/21 08:16:56 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)13802026/07/21 08:16:56 INFO Uploading q45af6zkbgk26ji1qj5a000f6dv6g788-ca-test (144B)13812026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (4.49ms)13822026/07/21 08:16:56 goose: successfully migrated database to version: 2026062812000013832026/07/21 08:16:56 INFO Received uploads request method=POST path=/api/pending_closures13842026/07/21 08:16:56 OK 2_object_stats_trigger.sql (2.06ms)13852026/07/21 08:16:56 goose: up to current file version: 213862026/07/21 08:16:56 OK 2_object_stats_trigger.sql (2ms)13872026/07/21 08:16:56 goose: up to current file version: 213882026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (4.67ms)13892026/07/21 08:16:56 goose: successfully migrated database to version: 202606281200001390--- PASS: TestReadProxyConditionalGet (0.25s)13912026/07/21 08:16:56 INFO Object in database but missing from S3 key=dadb44fdadb44fdadb44fdadb44f0000.narinfo1392=== CONT TestClientErrorHandling/ServerNotAvailable13932026/07/21 08:16:56 WARN Found objects in DB but missing from S3, will re-upload count=113942026/07/21 08:16:56 WARN Failed to register uploaded object key=nar/04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n.nar.zst error="server returned 404: 404 page not found\n"13952026/07/21 08:16:56 WARN Failed to register uploaded object key=log/w4nmpdrjz9wp9w2p6cmn3xj3s6k24vdw-ca-test.drv error="server returned 404: 404 page not found\n"13962026/07/21 08:16:56 OK 2_object_stats_trigger.sql (3.63ms)1397--- PASS: TestReadProxyNarinfoAlreadyDecompressed (0.25s)13982026/07/21 08:16:56 goose: up to current file version: 21399=== CONT TestClientErrorHandling/InvalidAuthToken14002026/07/21 08:16:56 INFO Received uploads request method=POST path=/api/pending_closures14012026/07/21 08:16:56 WARN mTLS auth: subject not in bound subjects subject="CN=writer"1402--- PASS: TestService_ReadAuthMiddleware (0.25s)1403=== CONT TestServerTLSConfig/no_client_CA1404=== CONT TestServerTLSConfig/not_a_PEM_file14052026/07/21 08:16:56 WARN Failed to register uploaded object key=q45af6zkbgk26ji1qj5a000f6dv6g788.ls error="server returned 404: 404 page not found\n"1406=== CONT TestServerTLSConfig/missing_CA_file1407--- PASS: TestServerTLSConfig (0.01s)1408 --- PASS: TestServerTLSConfig/no_client_CA (0.00s)1409 --- PASS: TestServerTLSConfig/not_a_PEM_file (0.00s)1410 --- PASS: TestServerTLSConfig/missing_CA_file (0.00s)14112026/07/21 08:16:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign1412=== CONT TestCacheConfigHandler/full_config,_no_issuer1413=== CONT TestCacheConfigHandler/no_signing_keys1414=== CONT TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator1415=== CONT TestCacheConfigHandler/no_cache_url_configured1416--- PASS: TestCacheConfigHandler (0.00s)1417 --- PASS: TestCacheConfigHandler/full_config,_no_issuer (0.00s)1418 --- PASS: TestCacheConfigHandler/no_signing_keys (0.00s)1419 --- PASS: TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator (0.00s)1420 --- PASS: TestCacheConfigHandler/no_cache_url_configured (0.00s)1421=== CONT TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info14222026/07/21 08:16:56 INFO Received uploads request method=POST path=/14232026/07/21 08:16:56 INFO Signed narinfos id=1 count=11424=== CONT TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key14252026/07/21 08:16:56 INFO Uploading 1 narinfos14262026/07/21 08:16:56 INFO Received complete multipart upload request method=POST path=/1427=== CONT TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key14282026/07/21 08:16:56 INFO Received request for more parts method=POST path=/14292026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (7.04ms)1430=== CONT TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal14312026/07/21 08:16:56 goose: successfully migrated database to version: 2026062812000014322026/07/21 08:16:56 INFO Received uploads request method=POST path=/1433--- PASS: TestService_verifyS3Integrity (0.66s)14342026/07/21 08:16:56 OK 1_commit_pending_closure.sql (5.51ms)1435--- PASS: TestUploadHandlersRejectInvalidKeys (0.00s)1436 --- PASS: TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info (0.00s)1437 --- PASS: TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key (0.00s)1438 --- PASS: TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key (0.00s)1439 --- PASS: TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal (0.00s)14402026/07/21 08:16:56 OK 20260628120000_add_object_size_and_stats.sql (6.26ms)1441=== CONT TestIsValidUploadKey/narinfo14422026/07/21 08:16:56 goose: successfully migrated database to version: 202606281200001443=== CONT TestIsValidUploadKey/realisation_plus_in_output1444=== CONT TestIsValidUploadKey/empty_key1445=== CONT TestIsValidUploadKey/absolute1446=== CONT TestIsValidUploadKey/traversal_nar1447=== CONT TestIsValidUploadKey/traversal1448=== CONT TestIsValidUploadKey/listing_key,_narinfo_type1449=== CONT TestIsValidUploadKey/unknown_type1450=== CONT TestIsValidUploadKey/nar_key,_narinfo_type1451=== CONT TestIsValidUploadKey/narinfo_key,_nar_type1452=== CONT TestIsValidUploadKey/index.html14532026/07/21 08:16:56 OK 1_commit_pending_closure.sql (5.68ms)1454=== CONT TestIsValidUploadKey/build_log_equals1455=== CONT TestIsValidUploadKey/realisation1456=== CONT TestIsValidUploadKey/nix-cache-info1457=== CONT TestIsValidUploadKey/build_log1458=== CONT TestIsValidUploadKey/nar_plain1459=== CONT TestIsValidUploadKey/listing1460=== CONT TestIsValidUploadKey/build_log_question_mark1461=== CONT TestIsValidUploadKey/build_log_home-manager_file1462=== CONT TestIsValidUploadKey/nar_xz1463=== CONT TestProxyWriteTimeout/narinfo1464=== CONT TestProxyWriteTimeout/10_GiB_nar1465=== CONT TestIsValidUploadKey/build_log_plus_in_name1466--- PASS: TestReadProxyRangeRequest (0.26s)1467=== CONT TestIsValidUploadKey/nar_zst1468=== CONT TestProxyWriteTimeout/unknown_size1469=== CONT TestUploadHandlersRejectOversizedBody/request_more_parts1470=== CONT TestProxyWriteTimeout/1_GiB_nar1471=== CONT TestUploadHandlersRejectOversizedBody/complete_multipart14722026/07/21 08:16:56 INFO Received request for more parts method=POST path=/1473--- PASS: TestIsValidUploadKey (0.10s)1474 --- PASS: TestIsValidUploadKey/narinfo (0.00s)1475 --- PASS: TestIsValidUploadKey/realisation_plus_in_output (0.00s)1476 --- PASS: TestIsValidUploadKey/empty_key (0.00s)1477 --- PASS: TestIsValidUploadKey/absolute (0.00s)1478 --- PASS: TestIsValidUploadKey/traversal_nar (0.00s)1479 --- PASS: TestIsValidUploadKey/traversal (0.00s)1480 --- PASS: TestIsValidUploadKey/listing_key,_narinfo_type (0.00s)1481 --- PASS: TestIsValidUploadKey/unknown_type (0.00s)1482 --- PASS: TestIsValidUploadKey/nar_key,_narinfo_type (0.00s)1483 --- PASS: TestIsValidUploadKey/narinfo_key,_nar_type (0.00s)1484 --- PASS: TestIsValidUploadKey/index.html (0.00s)1485 --- PASS: TestIsValidUploadKey/build_log_equals (0.00s)1486 --- PASS: TestIsValidUploadKey/realisation (0.00s)1487 --- PASS: TestIsValidUploadKey/nix-cache-info (0.00s)1488 --- PASS: TestIsValidUploadKey/build_log (0.00s)1489 --- PASS: TestIsValidUploadKey/nar_plain (0.00s)1490 --- PASS: TestIsValidUploadKey/listing (0.00s)1491 --- PASS: TestIsValidUploadKey/build_log_question_mark (0.00s)1492 --- PASS: TestIsValidUploadKey/build_log_home-manager_file (0.00s)1493 --- PASS: TestIsValidUploadKey/nar_xz (0.00s)1494 --- PASS: TestIsValidUploadKey/build_log_plus_in_name (0.00s)1495 --- PASS: TestIsValidUploadKey/nar_zst (0.00s)14962026/07/21 08:16:56 WARN Failed to register uploaded object key=q45af6zkbgk26ji1qj5a000f6dv6g788.narinfo error="server returned 404: 404 page not found\n"1497--- PASS: TestProxyWriteTimeout (0.00s)1498 --- PASS: TestProxyWriteTimeout/narinfo (0.00s)1499 --- PASS: TestProxyWriteTimeout/10_GiB_nar (0.00s)1500 --- PASS: TestProxyWriteTimeout/unknown_size (0.00s)1501 --- PASS: TestProxyWriteTimeout/1_GiB_nar (0.00s)15022026/07/21 08:16:56 OK 1_commit_pending_closure.sql (3.07ms)1503=== CONT TestUploadHandlersRejectOversizedBody/create_pending_closure15042026/07/21 08:16:56 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete15052026/07/21 08:16:56 INFO Received complete multipart upload request method=POST path=/15062026/07/21 08:16:56 OK 2_object_stats_trigger.sql (2.77ms)1507--- PASS: TestReadProxyRootRedirectsToIndexHTML (0.25s)15082026/07/21 08:16:56 goose: up to current file version: 21509=== CONT TestService_AuthMiddleware_OIDC/valid_OIDC_token15102026/07/21 08:16:56 INFO Received uploads request method=POST path=/15112026/07/21 08:16:56 OK 2_object_stats_trigger.sql (3.18ms)15122026/07/21 08:16:56 goose: up to current file version: 215132026/07/21 08:16:56 OK 1_commit_pending_closure.sql (4.13ms)15142026/07/21 08:16:56 OK 2_object_stats_trigger.sql (2.62ms)15152026/07/21 08:16:56 goose: up to current file version: 215162026/07/21 08:16:56 OK 2_object_stats_trigger.sql (2.21ms)15172026/07/21 08:16:56 goose: up to current file version: 21518--- PASS: TestReadProxy404 (0.24s)15192026/07/21 08:16:56 INFO Aborted multipart uploads count=01520=== CONT TestService_AuthMiddleware_OIDC/malformed_token_rejected15212026/07/21 08:16:56 WARN Authentication failed token_preview=not-a-valid-jwt token_length=15 oidc_error="no provider could verify the token (signature or issuer mismatch)" oidc_provider="" tried_providers=[test]1522=== CONT TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured1523=== CONT TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected15242026/07/21 08:16:56 INFO Received uploads request method=POST path=/api/pending_closures1525--- PASS: TestService_AuthMiddleware_MTLSProxyHeader (0.23s)1526=== CONT TestIsValidCachePath/narinfo1527=== CONT TestIsValidCachePath/index.html1528=== CONT TestIsValidCachePath/short_hash1529=== CONT TestIsValidCachePath/invalid_char_u1530=== CONT TestIsValidCachePath/invalid_char_e1531=== CONT TestIsValidCachePath/random_path1532=== CONT TestIsValidCachePath/traversal_in_middle1533=== CONT TestIsValidCachePath/wrong_extension1534=== CONT TestIsValidCachePath/traversal_parent1535=== CONT TestIsValidCachePath/leading_slash15362026/07/21 08:16:56 INFO OIDC auth successful provider=test1537=== CONT TestIsValidCachePath/empty1538=== CONT TestIsValidCachePath/nar_xz15392026/07/21 08:16:56 WARN Authentication failed token_preview=eyJhbGciOi...O5GKRxe07A token_length=702 oidc_error="bound claims validation failed: claim \"repository_owner\" value [otherorg] not in allowed patterns [myorg]" oidc_provider=test tried_providers=[test]1540=== CONT TestIsValidCachePath/nar_uncompressed1541=== CONT TestIsValidCachePath/nar_bz215422026/07/21 08:16:56 INFO Completed upload id=11543=== CONT TestIsValidCachePath/nar_zst15442026/07/21 08:16:56 INFO Upload complete. (108ms)1545=== CONT TestIsValidCachePath/ls1546=== CONT TestIsValidCachePath/log1547=== CONT TestIsValidCachePath/narinfo_all_nix_base32_chars1548=== CONT TestIsValidCachePath/realisation1549=== CONT TestIsValidCachePath/nix-cache-info1550--- PASS: TestService_AuthMiddleware_OIDC (0.40s)1551 --- PASS: TestService_AuthMiddleware_OIDC/malformed_token_rejected (0.00s)1552 --- PASS: TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured (0.00s)1553 --- PASS: TestService_AuthMiddleware_OIDC/valid_OIDC_token (0.01s)1554 --- PASS: TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected (0.00s)1555=== CONT TestParseSingleRange/start_past_EOF1556=== CONT TestParseSingleRange/single_byte1557=== CONT TestParseSingleRange/suffix_exceeds_size1558=== CONT TestParseSingleRange/start_far_past_EOF1559=== CONT TestParseSingleRange/end_clamped_to_size1560=== CONT TestParseSingleRange/open-ended1561--- PASS: TestIsValidCachePath (0.00s)1562 --- PASS: TestIsValidCachePath/narinfo (0.00s)1563 --- PASS: TestIsValidCachePath/index.html (0.00s)1564 --- PASS: TestIsValidCachePath/short_hash (0.00s)1565 --- PASS: TestIsValidCachePath/invalid_char_u (0.00s)1566 --- PASS: TestIsValidCachePath/invalid_char_e (0.00s)1567 --- PASS: TestIsValidCachePath/random_path (0.00s)1568 --- PASS: TestIsValidCachePath/traversal_in_middle (0.00s)1569 --- PASS: TestIsValidCachePath/wrong_extension (0.00s)1570 --- PASS: TestIsValidCachePath/traversal_parent (0.00s)1571 --- PASS: TestIsValidCachePath/leading_slash (0.00s)1572 --- PASS: TestIsValidCachePath/empty (0.00s)1573 --- PASS: TestIsValidCachePath/nar_xz (0.00s)1574 --- PASS: TestIsValidCachePath/nar_uncompressed (0.00s)1575 --- PASS: TestIsValidCachePath/nar_bz2 (0.00s)1576 --- PASS: TestIsValidCachePath/nar_zst (0.00s)1577 --- PASS: TestIsValidCachePath/ls (0.00s)1578 --- PASS: TestIsValidCachePath/log (0.00s)1579 --- PASS: TestIsValidCachePath/narinfo_all_nix_base32_chars (0.00s)1580 --- PASS: TestIsValidCachePath/realisation (0.00s)1581 --- PASS: TestIsValidCachePath/nix-cache-info (0.00s)1582--- PASS: TestReadProxyHead (0.25s)1583=== CONT TestParseSingleRange/suffix1584=== CONT TestParseSingleRange/malformed_both_empty1585=== CONT TestParseSingleRange/malformed_no_dash1586=== CONT TestParseSingleRange/none1587=== CONT TestParseSingleRange/closed1588=== CONT TestParseSingleRange/malformed_end_before_start1589--- PASS: TestReadProxyNarStreaming (0.23s)1590=== CONT TestParseSingleRange/multi-range_ignored1591=== CONT TestParseSingleRange/unknown_unit1592--- PASS: TestParseSingleRange (0.00s)1593 --- PASS: TestParseSingleRange/start_past_EOF (0.00s)1594 --- PASS: TestParseSingleRange/single_byte (0.00s)1595 --- PASS: TestParseSingleRange/suffix_exceeds_size (0.00s)1596 --- PASS: TestParseSingleRange/start_far_past_EOF (0.00s)1597 --- PASS: TestParseSingleRange/end_clamped_to_size (0.00s)1598 --- PASS: TestParseSingleRange/open-ended (0.00s)1599 --- PASS: TestParseSingleRange/suffix (0.00s)1600 --- PASS: TestParseSingleRange/malformed_both_empty (0.00s)1601 --- PASS: TestParseSingleRange/malformed_no_dash (0.00s)1602 --- PASS: TestParseSingleRange/none (0.00s)1603 --- PASS: TestParseSingleRange/closed (0.00s)1604 --- PASS: TestParseSingleRange/malformed_end_before_start (0.00s)1605 --- PASS: TestParseSingleRange/multi-range_ignored (0.00s)1606 --- PASS: TestParseSingleRange/unknown_unit (0.00s)1607=== NAME TestClientCADerivations1608 client_ca_test.go:180: Narinfo contains CA field: StorePath: /build/TestClientCADerivations2793120801/001/store/q45af6zkbgk26ji1qj5a000f6dv6g788-ca-test1609 URL: nar/04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n.nar.zst1610 Compression: zstd1611 NarHash: sha256:04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n1612 NarSize: 1441613 References: 1614 Deriver: /build/TestClientCADerivations2793120801/001/store/w4nmpdrjz9wp9w2p6cmn3xj3s6k24vdw-ca-test.drv1615 CA: fixed:r:sha256:04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n1616 client_ca_test.go:185: Checking for realisation files in S3...1617 client_ca_test.go:207: No realisation files uploaded - this is expected for locally built CA derivations1618 client_ca_test.go:208: Locally built CA derivations don't have DrvOutput IDs until they're substituted from a cache16192026/07/21 08:16:56 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=2 objects-deleted-after-grace-period=0 objects-failed-to-delete=016202026/07/21 08:16:56 INFO Vacuumed table table=pending_closures16212026/07/21 08:16:56 INFO Vacuumed table table=pending_objects16222026/07/21 08:16:56 INFO Vacuumed table table=multipart_uploads16232026/07/21 08:16:56 WARN Failed to fetch cache config, uploading without size limit error="fetching cache config: server returned 404: 404 page not found\n"16242026/07/21 08:16:56 WARN Failed to fetch cache config, uploading without size limit error="fetching cache config: server returned 404: 404 page not found\n"16252026/07/21 08:16:56 INFO Vacuumed table table=closures16262026/07/21 08:16:56 INFO Vacuumed table table=objects16272026/07/21 08:16:56 INFO Received uploads request method=POST path=/api/pending_closures16282026/07/21 08:16:56 INFO Received uploads request method=POST path=/api/pending_closures16292026-07-21 08:16:56.965 UTC [1914] ERROR: relation "goose_db_version" does not exist at character 3616302026-07-21 08:16:56.965 UTC [1914] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC16312026-07-21 08:16:56.965 UTC [1933] ERROR: relation "goose_db_version" does not exist at character 3616322026-07-21 08:16:56.965 UTC [1933] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC16332026/07/21 08:16:56 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)16342026/07/21 08:16:56 INFO Uploading 615kk5bhvn0mki43hf1qmmwsjxpgbid3-unpinned-file.txt (128B)16352026/07/21 08:16:56 WARN Failed to register uploaded object key=nar/0gh0wdnr6gmk4r5sfzzh12isnl14rgmkrwy1ws41hpsrlndclg5h.nar.zst error="server returned 404: 404 page not found\n"16362026/07/21 08:16:56 INFO Uploading 0 paths to 127.0.0.1 (1 already cached)16372026/07/21 08:16:56 WARN Failed to register uploaded object key=615kk5bhvn0mki43hf1qmmwsjxpgbid3.ls error="server returned 404: 404 page not found\n"16382026/07/21 08:16:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign16392026/07/21 08:16:56 INFO Signed narinfos id=2 count=116402026/07/21 08:16:56 INFO Uploading 1 narinfos16412026/07/21 08:16:56 WARN Failed to register uploaded object key=knvcbfyzp2mribpm7vrrclna22m320fv.ls error="server returned 404: 404 page not found\n"16422026/07/21 08:16:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign16432026/07/21 08:16:56 INFO Signed narinfos id=2 count=116442026/07/21 08:16:56 INFO Received get closure request method=GET path=/api/closures/0000000000000000000000000000000016452026/07/21 08:16:56 INFO Uploading 1 narinfos16462026/07/21 08:16:56 WARN Failed to register uploaded object key=615kk5bhvn0mki43hf1qmmwsjxpgbid3.narinfo error="server returned 404: 404 page not found\n"1647--- PASS: TestService_createPendingClosureHandler (0.76s)16482026/07/21 08:16:56 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete16492026/07/21 08:16:56 INFO Completed upload id=216502026/07/21 08:16:56 INFO Upload complete. (89ms)16512026/07/21 08:16:56 WARN Failed to register uploaded object key=knvcbfyzp2mribpm7vrrclna22m320fv.narinfo error="server returned 404: 404 page not found\n"16522026/07/21 08:16:56 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete16532026/07/21 08:16:56 INFO Completed upload id=216542026/07/21 08:16:56 INFO Upload complete. (90ms)1655=== NAME TestNARDeduplicationMetadataUploadBug1656 metadata_upload_test.go:76: Retrieved narinfo from S3:1657 StorePath: /build/TestNARDeduplicationMetadataUploadBug4229069561/001/store/knvcbfyzp2mribpm7vrrclna22m320fv-file2.txt1658 URL: nar/1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf.nar.zst1659 Compression: zstd1660 NarHash: sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf1661 NarSize: 1601662 References: 1663 CA: fixed:r:sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf16642026/07/21 08:16:56 OK 20241026095416_initial_model.sql (10ms)16652026/07/21 08:16:56 OK 20241026095416_initial_model.sql (9.92ms)16662026/07/21 08:16:56 OK 20251210153512_drop_unused_gin_index.sql (2ms)1667 metadata_upload_test.go:77: Retrieved .ls file from S3 (compressed size: 62 bytes)1668 metadata_upload_test.go:77: Decompressed .ls content (49 bytes):1669 {"version":1,"root":{"type":"regular","size":44}}16702026-07-21 08:16:56.985 UTC [1944] ERROR: relation "goose_db_version" does not exist at character 3616712026-07-21 08:16:56.985 UTC [1944] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC1672--- PASS: TestNARDeduplicationMetadataUploadBug (0.77s)16732026-07-21 08:16:56.995 UTC [1946] ERROR: relation "goose_db_version" does not exist at character 3616742026-07-21 08:16:56.995 UTC [1946] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC16752026/07/21 08:16:56 WARN Request failed, retrying attempt=1 max_attempts=6 backoff=100ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config16762026/07/21 08:16:57 OK 20251210153512_drop_unused_gin_index.sql (20.41ms)16772026/07/21 08:16:57 OK 20251218171726_add_pins.sql (21.44ms)16782026/07/21 08:16:57 OK 20251218171726_add_pins.sql (3.19ms)16792026/07/21 08:16:57 INFO Received create pin request method=POST path=/api/pins/myapp16802026/07/21 08:16:57 OK 20260628120000_add_object_size_and_stats.sql (4.18ms)16812026/07/21 08:16:57 goose: successfully migrated database to version: 2026062812000016822026/07/21 08:16:57 OK 20260628120000_add_object_size_and_stats.sql (3.9ms)16832026/07/21 08:16:57 goose: successfully migrated database to version: 2026062812000016842026/07/21 08:16:57 OK 1_commit_pending_closure.sql (3.3ms)16852026/07/21 08:16:57 OK 1_commit_pending_closure.sql (4.24ms)16862026-07-21 08:16:57.015 UTC [2049] ERROR: relation "goose_db_version" does not exist at character 3616872026-07-21 08:16:57.015 UTC [2049] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC16882026-07-21 08:16:57.015 UTC [2050] ERROR: relation "goose_db_version" does not exist at character 3616892026-07-21 08:16:57.015 UTC [2050] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC16902026/07/21 08:16:57 OK 2_object_stats_trigger.sql (2.3ms)16912026/07/21 08:16:57 goose: up to current file version: 216922026/07/21 08:16:57 INFO Created/updated pin name=myapp store_path=/build/TestPinProtectsFromGC3889143764/001/store/2b4aigy7xa0q1rsyj83kf8sj8g63kj5y-pinned-file.txt narinfo_key=2b4aigy7xa0q1rsyj83kf8sj8g63kj5y.narinfo16932026/07/21 08:16:57 OK 20241026095416_initial_model.sql (10.21ms)1694=== NAME TestClientCADerivations16952026/07/21 08:16:57 OK 20241026095416_initial_model.sql (9.74ms)1696 client_ca_test.go:258: nix copy output: warning: you don't have Internet access; disabling some network-dependent features1697 warning: failed to create TLS context for AWS credential providers; SSO, STS WebIdentity, and ECS container authentication will be unavailable16982026/07/21 08:16:57 OK 2_object_stats_trigger.sql (1.23ms)1699 error: binary cache 's3://bucket11?endpoint=http://localhost:40313®ion=eu-west-1' is for Nix stores with prefix '/nix/store', not '/build/TestClientCADerivations2793120801/001/store'17002026/07/21 08:16:57 goose: up to current file version: 21701 client_ca_test.go:259: nix copy failed (might be expected with isolated stores): exit status 117022026-07-21 08:16:57.017 UTC [2051] ERROR: relation "goose_db_version" does not exist at character 3617032026-07-21 08:16:57.017 UTC [2051] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC17042026/07/21 08:16:57 INFO Starting cleanup of old closures method=DELETE path=/api/closures17052026/07/21 08:16:57 INFO Garbage collection started17062026/07/21 08:16:57 OK 20251210153512_drop_unused_gin_index.sql (1.4ms)17072026/07/21 08:16:57 OK 20251210153512_drop_unused_gin_index.sql (1.47ms)17082026/07/21 08:16:57 OK 20251218171726_add_pins.sql (2.87ms)17092026/07/21 08:16:57 OK 20251218171726_add_pins.sql (2.57ms)1710--- PASS: TestClientCADerivations (0.80s)1711--- PASS: TestReadProxyNarinfo (0.22s)17122026/07/21 08:16:57 OK 20260628120000_add_object_size_and_stats.sql (3.22ms)17132026/07/21 08:16:57 goose: successfully migrated database to version: 2026062812000017142026/07/21 08:16:57 OK 20260628120000_add_object_size_and_stats.sql (4.67ms)17152026/07/21 08:16:57 goose: successfully migrated database to version: 2026062812000017162026/07/21 08:16:57 OK 1_commit_pending_closure.sql (2.38ms)17172026/07/21 08:16:57 OK 20241026095416_initial_model.sql (7.53ms)17182026/07/21 08:16:57 INFO Aborted multipart uploads count=017192026/07/21 08:16:57 OK 1_commit_pending_closure.sql (3.06ms)17202026/07/21 08:16:57 OK 2_object_stats_trigger.sql (1.81ms)17212026/07/21 08:16:57 goose: up to current file version: 217222026/07/21 08:16:57 OK 20241026095416_initial_model.sql (8.34ms)17232026/07/21 08:16:57 OK 20251210153512_drop_unused_gin_index.sql (1.08ms)17242026/07/21 08:16:57 OK 2_object_stats_trigger.sql (1.11ms)17252026/07/21 08:16:57 goose: up to current file version: 217262026/07/21 08:16:57 OK 20251210153512_drop_unused_gin_index.sql (1.3ms)17272026/07/21 08:16:57 INFO Received complete multipart upload request method=POST path=/api/multipart/complete17282026/07/21 08:16:57 OK 20241026095416_initial_model.sql (8.74ms)17292026/07/21 08:16:57 WARN Force mode enabled - objects will be deleted immediately without grace period17302026/07/21 08:16:57 OK 20251218171726_add_pins.sql (2ms)17312026/07/21 08:16:57 OK 20251210153512_drop_unused_gin_index.sql (1.28ms)17322026/07/21 08:16:57 OK 20251218171726_add_pins.sql (2.03ms)17332026/07/21 08:16:57 OK 20260628120000_add_object_size_and_stats.sql (2.46ms)17342026/07/21 08:16:57 goose: successfully migrated database to version: 2026062812000017352026/07/21 08:16:57 OK 20251218171726_add_pins.sql (2.05ms)17362026/07/21 08:16:57 OK 20260628120000_add_object_size_and_stats.sql (2.9ms)17372026/07/21 08:16:57 goose: successfully migrated database to version: 2026062812000017382026/07/21 08:16:57 OK 1_commit_pending_closure.sql (1.35ms)17392026/07/21 08:16:57 OK 2_object_stats_trigger.sql (655.2µs)17402026/07/21 08:16:57 goose: up to current file version: 217412026/07/21 08:16:57 OK 1_commit_pending_closure.sql (1.54ms)17422026/07/21 08:16:57 OK 20260628120000_add_object_size_and_stats.sql (2.97ms)17432026/07/21 08:16:57 goose: successfully migrated database to version: 2026062812000017442026/07/21 08:16:57 OK 2_object_stats_trigger.sql (633.65µs)17452026/07/21 08:16:57 goose: up to current file version: 217462026/07/21 08:16:57 OK 1_commit_pending_closure.sql (1.47ms)17472026/07/21 08:16:57 OK 2_object_stats_trigger.sql (639.37µs)17482026/07/21 08:16:57 goose: up to current file version: 217492026/07/21 08:16:57 INFO Completed multipart upload object_key=nar/hhhhhhhhhhhhhhhhhhhhhhhhhhhhhh0100000000000000000000.nar.zst upload_id=NGQxMzNmY2ItZmQ1Yi00ZGE5LTgxZmYtZWM5MGYwZDZkMjFkLmYxODE3N2YwLTkxMTMtNDZjOC1iZTg2LTdmYjNhZWZlZWM3M3gxNzg0NjIxODE2NzIyOTcxMjM2 parts=1217502026/07/21 08:16:57 INFO Received uploads request method=POST path=/api/pending_closures1751--- PASS: TestResurrectedObjectNotDeleted (0.25s)1752--- PASS: TestCompletedNarNotReofferedAcrossClosures (0.51s)1753--- PASS: TestObjectStatsTrigger (0.18s)17542026/07/21 08:16:57 WARN Request failed, retrying attempt=2 max_attempts=6 backoff=181.17287ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config17552026/07/21 08:16:57 INFO Received complete multipart upload request method=POST path=/api/multipart/complete17562026/07/21 08:16:57 INFO Completed multipart upload object_key=nar/gggggggggggggggggggggggggggggg0100000000000000000000.nar.zst upload_id=NGQxMzNmY2ItZmQ1Yi00ZGE5LTgxZmYtZWM5MGYwZDZkMjFkLmNjOGExOGE3LTg4MDAtNGNjNi05ZGFjLTAwNDQ4NzVhNWVhNHgxNzg0NjIxODE2ODg0MzA3NzU3 parts=121757--- PASS: TestRedundantMultipartUpload (0.52s)17582026/07/21 08:16:57 WARN Failed to fetch cache config, uploading without size limit error="fetching cache config: server returned 404: 404 page not found\n"17592026/07/21 08:16:57 WARN Authentication failed token_preview=invalid-token token_length=13 reason="static API token mismatch"17602026/07/21 08:16:57 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=3 objects-deleted-after-grace-period=2001 objects-failed-to-delete=017612026/07/21 08:16:57 INFO Vacuumed table table=pending_closures17622026/07/21 08:16:57 INFO Vacuumed table table=pending_objects17632026/07/21 08:16:57 INFO Vacuumed table table=multipart_uploads17642026/07/21 08:16:57 INFO Vacuumed table table=closures17652026/07/21 08:16:57 INFO Vacuumed table table=objects17662026/07/21 08:16:57 WARN Request failed, retrying attempt=3 max_attempts=6 backoff=415.493296ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config1767=== NAME TestOrphanedObjectsGC1768 orphaned_objects_gc_test.go:290: GC Test Summary:1769 orphaned_objects_gc_test.go:291: - Kept: 2 objects from closure A1770 orphaned_objects_gc_test.go:292: - Deleted: 2 objects from closure B1771 orphaned_objects_gc_test.go:293: - Deleted: 6 orphaned chain objects (X1->X2->X3)1772 orphaned_objects_gc_test.go:294: - Deleted: 2 orphaned single objects (Y)1773 orphaned_objects_gc_test.go:295: - Total deleted: 10 objects1774--- PASS: TestOrphanedObjectsGC (0.43s)1775--- PASS: TestUploadHandlersRejectOversizedBody (0.20s)1776 --- PASS: TestUploadHandlersRejectOversizedBody/complete_multipart (0.05s)1777 --- PASS: TestUploadHandlersRejectOversizedBody/request_more_parts (0.06s)1778 --- PASS: TestUploadHandlersRejectOversizedBody/create_pending_closure (0.61s)17792026/07/21 08:16:57 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=3 objects-deleted-after-grace-period=2001 objects-failed-to-delete=017802026/07/21 08:16:57 INFO Vacuumed table table=pending_closures17812026/07/21 08:16:57 INFO Vacuumed table table=pending_objects17822026/07/21 08:16:57 INFO Vacuumed table table=multipart_uploads17832026/07/21 08:16:57 INFO Vacuumed table table=closures17842026/07/21 08:16:57 INFO Vacuumed table table=objects1785=== NAME TestOrphanedObjectsGCStressTest1786 orphaned_objects_gc_test.go:425: Created 10 active closures, 5 to-delete closures, 20 orphaned chains17872026/07/21 08:16:57 WARN Request failed, retrying attempt=4 max_attempts=6 backoff=853.600395ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config1788 orphaned_objects_gc_test.go:446: Marked 210 objects for deletion1789 orphaned_objects_gc_test.go:509: Stress test completed successfully:1790 orphaned_objects_gc_test.go:510: - Active objects preserved: 201791 orphaned_objects_gc_test.go:511: - Objects deleted: 2101792 orphaned_objects_gc_test.go:512: - Total GC'd: 2101793--- PASS: TestOrphanedObjectsGCStressTest (0.95s)17942026/07/21 08:16:58 WARN Request failed, retrying attempt=5 max_attempts=6 backoff=1.615919441s error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config17952026/07/21 08:16:58 INFO Garbage collection progress phase="" failed_uploads_deleted=0 old_closures_deleted=1 objects_marked=3 objects_deleted=2001 objects_failed=01796=== NAME TestClientIntegration1797 client_integration_test.go:303: Objects in database after GC:1798 client_integration_test.go:303: Successfully deleted all objects with GC --force1799--- PASS: TestClientIntegration (2.63s)18002026/07/21 08:16:59 INFO Garbage collection progress phase="" failed_uploads_deleted=0 old_closures_deleted=1 objects_marked=3 objects_deleted=2001 objects_failed=01801=== NAME TestPinProtectsFromGC1802 client_integration_test.go:709: Pin successfully protected closure from garbage collection1803--- PASS: TestPinProtectsFromGC (2.80s)18042026/07/21 08:16:59 WARN Rate limiter enabled after throttle name=s3-test rate=518052026/07/21 08:16:59 WARN S3 rate limit hit operation="complete multipart upload" error="Please reduce your request rate."1806=== NAME TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle1807 throttle_test.go:213: Proxy stats: total=15, throttled=10, completeMultipart=101808 throttle_test.go:215: Rate limiter: enabled=true, rate=5.001809--- PASS: TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle (3.16s)18102026/07/21 08:17:00 WARN Failed to fetch cache config, uploading without size limit error="fetching cache config: sending request: request failed after retries: Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused"18112026/07/21 08:17:00 WARN Request failed, retrying attempt=1 max_attempts=6 backoff=100ms error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures18122026/07/21 08:17:00 WARN Request failed, retrying attempt=2 max_attempts=6 backoff=203.611452ms error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures18132026/07/21 08:17:00 WARN Request failed, retrying attempt=3 max_attempts=6 backoff=413.160684ms error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures18142026/07/21 08:17:00 WARN Request failed, retrying attempt=4 max_attempts=6 backoff=758.839504ms error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures18152026/07/21 08:17:01 WARN Request failed, retrying attempt=5 max_attempts=6 backoff=1.541012381s error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures1816--- PASS: TestClientErrorHandling (0.01s)1817 --- PASS: TestClientErrorHandling/InvalidStorePath (0.21s)1818 --- PASS: TestClientErrorHandling/InvalidAuthToken (0.33s)1819 --- PASS: TestClientErrorHandling/ServerNotAvailable (6.36s)1820PASS1821{"timestamp":"2026-07-21T08:17:03.737936112Z","level":"ERROR","fields":{"message":"Unknown connection IO error:Cancelled","peer_addr":"127.0.0.1:35594"},"target":"rustfs::server::http","filename":"rustfs/src/server/http.rs","line_number":973,"threadName":"rustfs-worker","threadId":"ThreadId(760)"}18222026-07-21 08:17:03.886 UTC [112] LOG: received smart shutdown request18232026-07-21 08:17:03.889 UTC [112] LOG: background worker "logical replication launcher" (PID 122) exited with exit code 118242026-07-21 08:17:03.900 UTC [117] LOG: shutting down18252026-07-21 08:17:03.900 UTC [117] LOG: checkpoint starting: shutdown immediate18262026-07-21 08:17:05.617 UTC [117] LOG: checkpoint complete: wrote 11019 buffers (67.3%), wrote 3 SLRU buffers; 0 WAL file(s) added, 0 removed, 13 recycled; write=0.252 s, sync=1.452 s, total=1.717 s; sync files=15167, longest=0.003 s, average=0.001 s; distance=208459 kB, estimate=208459 kB; lsn=0/E2F2160, redo lsn=0/E2F216018272026-07-21 08:17:05.705 UTC [112] LOG: database system is shut down1828Running OIDC tests...1829=== RUN TestGlobMatch1830=== PAUSE TestGlobMatch1831=== RUN TestAudienceForIssuer1832=== PAUSE TestAudienceForIssuer1833=== RUN TestValidateToken_ValidToken1834=== PAUSE TestValidateToken_ValidToken1835=== RUN TestValidateToken_WrongAudience1836=== PAUSE TestValidateToken_WrongAudience1837=== RUN TestValidateToken_Expired1838=== PAUSE TestValidateToken_Expired1839=== RUN TestValidateToken_BoundClaimsMismatch1840=== PAUSE TestValidateToken_BoundClaimsMismatch1841=== RUN TestValidateToken_BoundSubjectMismatch1842=== PAUSE TestValidateToken_BoundSubjectMismatch1843=== RUN TestValidateToken_MultipleProviders1844=== PAUSE TestValidateToken_MultipleProviders1845=== RUN TestValidateToken_NoMatchingProvider1846=== PAUSE TestValidateToken_NoMatchingProvider1847=== CONT TestGlobMatch1848=== CONT TestValidateToken_BoundClaimsMismatch1849=== RUN TestGlobMatch/foo_foo1850=== PAUSE TestGlobMatch/foo_foo1851=== RUN TestGlobMatch/foo_bar1852=== PAUSE TestGlobMatch/foo_bar1853=== RUN TestGlobMatch/*_1854=== PAUSE TestGlobMatch/*_1855=== RUN TestGlobMatch/*_anything1856=== PAUSE TestGlobMatch/*_anything1857=== CONT TestValidateToken_ValidToken1858=== CONT TestAudienceForIssuer1859--- PASS: TestAudienceForIssuer (0.00s)1860=== CONT TestValidateToken_MultipleProviders1861=== CONT TestValidateToken_NoMatchingProvider1862=== CONT TestValidateToken_BoundSubjectMismatch1863=== CONT TestValidateToken_Expired1864=== CONT TestValidateToken_WrongAudience1865=== RUN TestGlobMatch/foo*_foo1866=== PAUSE TestGlobMatch/foo*_foo1867=== RUN TestGlobMatch/foo*_foobar1868=== PAUSE TestGlobMatch/foo*_foobar1869=== RUN TestGlobMatch/foo*_bar1870=== PAUSE TestGlobMatch/foo*_bar1871=== RUN TestGlobMatch/*bar_bar1872=== PAUSE TestGlobMatch/*bar_bar1873=== RUN TestGlobMatch/*bar_foobar1874=== PAUSE TestGlobMatch/*bar_foobar1875=== RUN TestGlobMatch/*bar_foo1876=== PAUSE TestGlobMatch/*bar_foo1877=== RUN TestGlobMatch/foo*bar_foobar1878=== PAUSE TestGlobMatch/foo*bar_foobar1879=== RUN TestGlobMatch/foo*bar_foo123bar1880=== PAUSE TestGlobMatch/foo*bar_foo123bar1881=== RUN TestGlobMatch/foo*bar_foobarbaz1882=== PAUSE TestGlobMatch/foo*bar_foobarbaz1883=== RUN TestGlobMatch/*/*_foo/bar1884=== PAUSE TestGlobMatch/*/*_foo/bar1885=== RUN TestGlobMatch/*/*_foo1886=== PAUSE TestGlobMatch/*/*_foo1887=== RUN TestGlobMatch/refs/heads/*_refs/heads/main1888=== PAUSE TestGlobMatch/refs/heads/*_refs/heads/main1889=== RUN TestGlobMatch/refs/heads/*_refs/tags/v1.01890=== PAUSE TestGlobMatch/refs/heads/*_refs/tags/v1.01891=== RUN TestGlobMatch/refs/*/main_refs/heads/main1892=== PAUSE TestGlobMatch/refs/*/main_refs/heads/main1893=== RUN TestGlobMatch/fo?_foo1894=== PAUSE TestGlobMatch/fo?_foo1895=== RUN TestGlobMatch/fo?_fo1896=== PAUSE TestGlobMatch/fo?_fo1897=== RUN TestGlobMatch/fo?_fooo1898=== PAUSE TestGlobMatch/fo?_fooo1899=== RUN TestGlobMatch/?oo_foo1900=== PAUSE TestGlobMatch/?oo_foo1901=== RUN TestGlobMatch/?oo_boo1902=== PAUSE TestGlobMatch/?oo_boo1903=== RUN TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main1904=== PAUSE TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main1905=== RUN TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main1906=== PAUSE TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main1907=== CONT TestGlobMatch/?oo_boo1908=== CONT TestGlobMatch/foo_foo1909=== CONT TestGlobMatch/fo?_fo1910=== CONT TestGlobMatch/foo*bar_foo123bar1911=== CONT TestGlobMatch/foo*bar_foobar1912=== CONT TestGlobMatch/fo?_foo1913=== CONT TestGlobMatch/*bar_foo1914=== CONT TestGlobMatch/refs/*/main_refs/heads/main19152026/07/21 08:17:06 INFO OIDC provider initialized name=test1916=== CONT TestGlobMatch/*_1917=== CONT TestGlobMatch/refs/heads/*_refs/tags/v1.01918=== CONT TestGlobMatch/refs/heads/*_refs/heads/main19192026/07/21 08:17:06 INFO OIDC provider initialized name=provider11920=== CONT TestGlobMatch/*bar_bar1921=== CONT TestGlobMatch/*bar_foobar1922=== CONT TestGlobMatch/foo*_bar1923=== CONT TestGlobMatch/*/*_foo19242026/07/21 08:17:06 INFO OIDC provider initialized name=test1925=== CONT TestGlobMatch/foo*_foobar1926=== CONT TestGlobMatch/?oo_foo1927=== CONT TestGlobMatch/*/*_foo/bar1928=== CONT TestGlobMatch/foo*_foo19292026/07/21 08:17:06 INFO OIDC provider initialized name=test1930=== CONT TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main19312026/07/21 08:17:06 INFO OIDC provider initialized name=test1932=== CONT TestGlobMatch/fo?_fooo1933=== CONT TestGlobMatch/foo*bar_foobarbaz1934=== CONT TestGlobMatch/*_anything1935=== CONT TestGlobMatch/foo_bar19362026/07/21 08:17:06 INFO OIDC provider initialized name=test1937=== CONT TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main1938--- PASS: TestGlobMatch (0.01s)1939 --- PASS: TestGlobMatch/?oo_boo (0.00s)1940 --- PASS: TestGlobMatch/foo_foo (0.00s)1941 --- PASS: TestGlobMatch/fo?_fo (0.00s)1942 --- PASS: TestGlobMatch/foo*bar_foo123bar (0.00s)1943 --- PASS: TestGlobMatch/foo*bar_foobar (0.00s)1944 --- PASS: TestGlobMatch/fo?_foo (0.00s)1945 --- PASS: TestGlobMatch/*bar_foo (0.00s)1946 --- PASS: TestGlobMatch/refs/*/main_refs/heads/main (0.00s)1947 --- PASS: TestGlobMatch/*_ (0.00s)1948 --- PASS: TestGlobMatch/refs/heads/*_refs/tags/v1.0 (0.00s)1949 --- PASS: TestGlobMatch/refs/heads/*_refs/heads/main (0.00s)1950 --- PASS: TestGlobMatch/*bar_bar (0.00s)1951 --- PASS: TestGlobMatch/*bar_foobar (0.00s)1952 --- PASS: TestGlobMatch/foo*_bar (0.00s)1953 --- PASS: TestGlobMatch/*/*_foo (0.00s)1954 --- PASS: TestGlobMatch/foo*_foobar (0.00s)1955 --- PASS: TestGlobMatch/?oo_foo (0.00s)1956 --- PASS: TestGlobMatch/*/*_foo/bar (0.00s)1957 --- PASS: TestGlobMatch/foo*_foo (0.00s)1958 --- PASS: TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main (0.00s)1959 --- PASS: TestGlobMatch/fo?_fooo (0.00s)1960 --- PASS: TestGlobMatch/foo*bar_foobarbaz (0.00s)1961 --- PASS: TestGlobMatch/*_anything (0.00s)1962 --- PASS: TestGlobMatch/foo_bar (0.00s)1963 --- PASS: TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main (0.00s)19642026/07/21 08:17:06 INFO OIDC provider initialized name=provider219652026/07/21 08:17:06 INFO OIDC provider initialized name=provider11966--- PASS: TestValidateToken_NoMatchingProvider (0.01s)1967--- PASS: TestValidateToken_BoundClaimsMismatch (0.01s)1968--- PASS: TestValidateToken_ValidToken (0.01s)1969--- PASS: TestValidateToken_BoundSubjectMismatch (0.01s)1970--- PASS: TestValidateToken_WrongAudience (0.01s)1971--- PASS: TestValidateToken_Expired (0.01s)1972--- PASS: TestValidateToken_MultipleProviders (0.01s)1973PASS1974Running hook tests...1975=== RUN TestSendPathsEmpty1976=== PAUSE TestSendPathsEmpty1977=== RUN TestQueueEnqueueAndFetch1978=== PAUSE TestQueueEnqueueAndFetch1979=== RUN TestQueueDeduplication1980=== PAUSE TestQueueDeduplication1981=== RUN TestQueueRemove1982=== PAUSE TestQueueRemove1983=== RUN TestQueueFetchBatchLimit1984=== PAUSE TestQueueFetchBatchLimit1985=== RUN TestQueueFetchRemoveLifecycle1986=== PAUSE TestQueueFetchRemoveLifecycle1987=== RUN TestQueueConcurrentWriters1988=== PAUSE TestQueueConcurrentWriters1989=== RUN TestServerClientIntegration1990=== PAUSE TestServerClientIntegration1991=== RUN TestServerQueueError1992=== PAUSE TestServerQueueError1993=== RUN TestGetListenerSocketActivation1994 server_test.go:210: === RUN TestGetListenerSocketActivation1995 --- PASS: TestGetListenerSocketActivation (0.00s)1996 PASS1997 1998--- PASS: TestGetListenerSocketActivation (0.01s)1999=== RUN TestWorkerUploadsAndRemoves2000=== PAUSE TestWorkerUploadsAndRemoves2001=== RUN TestWorkerSkipsGCdPaths2002=== PAUSE TestWorkerSkipsGCdPaths2003=== RUN TestWorkerPrunesClosureDeps2004=== PAUSE TestWorkerPrunesClosureDeps2005=== CONT TestSendPathsEmpty2006=== CONT TestWorkerSkipsGCdPaths2007--- PASS: TestSendPathsEmpty (0.00s)2008=== CONT TestWorkerPrunesClosureDeps2009=== CONT TestQueueConcurrentWriters2010=== CONT TestQueueDeduplication2011=== CONT TestQueueEnqueueAndFetch2012=== CONT TestServerQueueError2013=== CONT TestQueueFetchRemoveLifecycle2014=== CONT TestWorkerUploadsAndRemoves2015=== CONT TestServerClientIntegration2016=== CONT TestQueueFetchBatchLimit2017=== CONT TestQueueRemove20182026/07/21 08:17:06 ERROR Failed to queue paths error="permission denied" count=12019--- PASS: TestServerQueueError (0.00s)2020--- PASS: TestServerClientIntegration (0.00s)2021--- PASS: TestQueueFetchBatchLimit (0.01s)20222026/07/21 08:17:06 INFO Upload queue status pending=220232026/07/21 08:17:06 INFO Upload queue status pending=220242026/07/21 08:17:06 INFO Uploading batch count=120252026/07/21 08:17:06 INFO Uploading batch count=220262026/07/21 08:17:06 INFO Upload queue status pending=220272026/07/21 08:17:06 WARN Store path no longer exists (garbage collected?), removing from queue path=/build/TestWorkerSkipsGCdPaths808938564/002/nonexistent2028--- PASS: TestQueueEnqueueAndFetch (0.02s)2029--- PASS: TestQueueDeduplication (0.02s)20302026/07/21 08:17:06 INFO Uploading batch count=12031--- PASS: TestQueueRemove (0.02s)2032--- PASS: TestQueueFetchRemoveLifecycle (0.02s)2033--- PASS: TestWorkerPrunesClosureDeps (0.07s)2034--- PASS: TestWorkerUploadsAndRemoves (0.07s)2035--- PASS: TestWorkerSkipsGCdPaths (0.07s)2036--- PASS: TestQueueConcurrentWriters (0.38s)2037PASS