niks3-go-unit-tests
checks.aarch64-darwin.go-unit-tests
· build #343
· raw
1Running client tests...2=== RUN TestDoServerRequestAttachesToken3=== PAUSE TestDoServerRequestAttachesToken4=== RUN TestRegisterUploadedObjectReusesConnections5=== PAUSE TestRegisterUploadedObjectReusesConnections6=== RUN TestCaseHackSuffix7=== PAUSE TestCaseHackSuffix8=== RUN TestFilterOversizedClosures9=== PAUSE TestFilterOversizedClosures10=== RUN TestUploadMultipart_PartsInParallel11=== PAUSE TestUploadMultipart_PartsInParallel12=== RUN TestPartSizeForNAR13=== PAUSE TestPartSizeForNAR14=== RUN TestUploadMultipart_SupersededByPeer15=== PAUSE TestUploadMultipart_SupersededByPeer16=== RUN TestDumpPathCaseHackMatchesNix17--- PASS: TestDumpPathCaseHackMatchesNix (0.03s)18=== RUN TestDumpPathCaseHackCollision19--- PASS: TestDumpPathCaseHackCollision (0.00s)20=== RUN TestDumpPathMatchesNix21=== PAUSE TestDumpPathMatchesNix22=== RUN TestDumpPathSingleFile23=== PAUSE TestDumpPathSingleFile24=== RUN TestDumpPathWriterError25=== PAUSE TestDumpPathWriterError26=== RUN TestEncodeNixBase3227=== PAUSE TestEncodeNixBase3228=== RUN TestEncodeNixBase32WithRealHash29=== PAUSE TestEncodeNixBase32WithRealHash30=== RUN TestConvertHashToNix3231=== PAUSE TestConvertHashToNix3232=== RUN TestGetStorePathHash33=== PAUSE TestGetStorePathHash34=== RUN TestPathInfoHashCompatibility35=== PAUSE TestPathInfoHashCompatibility36=== RUN TestParsePathInfoJSON37=== PAUSE TestParsePathInfoJSON38=== RUN TestParsePathInfoJSONMultiplePaths39=== PAUSE TestParsePathInfoJSONMultiplePaths40=== RUN TestPathInfoCACompatibility41=== PAUSE TestPathInfoCACompatibility42=== RUN TestRateLimiterFeedback43=== PAUSE TestRateLimiterFeedback44=== RUN TestRateLimiterFeedback_400DoesNotCountAsSuccess45=== PAUSE TestRateLimiterFeedback_400DoesNotCountAsSuccess46=== RUN TestResolveStorePath47=== PAUSE TestResolveStorePath48=== RUN TestDoWithRetry_BodyReplayedViaGetBody49=== PAUSE TestDoWithRetry_BodyReplayedViaGetBody50=== RUN TestShellSplit51=== PAUSE TestShellSplit52=== RUN TestShellSplitErrors53=== PAUSE TestShellSplitErrors54=== RUN TestStreamPushReportsEveryPath55=== PAUSE TestStreamPushReportsEveryPath56=== RUN TestStreamPushBatchesUnderLoad57=== PAUSE TestStreamPushBatchesUnderLoad58=== RUN TestStreamPushIsolatesFailures59=== PAUSE TestStreamPushIsolatesFailures60=== RUN TestStreamPushGivesUpOnDeadServer61=== PAUSE TestStreamPushGivesUpOnDeadServer62=== RUN TestStreamPushRequestLine63=== PAUSE TestStreamPushRequestLine64=== RUN TestStreamPushReportsSignatures65=== PAUSE TestStreamPushReportsSignatures66=== RUN TestClientSignaturesByStorePath67=== PAUSE TestClientSignaturesByStorePath68=== RUN TestSetClientTLS69=== PAUSE TestSetClientTLS70=== RUN TestSetClientTLSDoesNotMutateDefaultTransport71=== PAUSE TestSetClientTLSDoesNotMutateDefaultTransport72=== RUN TestSetClientTLSErrors73=== PAUSE TestSetClientTLSErrors74=== RUN TestStaticToken75=== PAUSE TestStaticToken76=== RUN TestFileTokenReadsAndCaches77=== PAUSE TestFileTokenReadsAndCaches78=== RUN TestFileTokenMissing79=== PAUSE TestFileTokenMissing80=== RUN TestFileTokenEmpty81=== PAUSE TestFileTokenEmpty82=== RUN TestScriptTokenNoExpiryRerunsEveryCall83=== PAUSE TestScriptTokenNoExpiryRerunsEveryCall84=== RUN TestScriptTokenCachesUntilRefresh85=== PAUSE TestScriptTokenCachesUntilRefresh86=== RUN TestScriptTokenEmptyToken87=== PAUSE TestScriptTokenEmptyToken88=== RUN TestScriptTokenBadJSON89=== PAUSE TestScriptTokenBadJSON90=== RUN TestScriptTokenScriptFails91=== PAUSE TestScriptTokenScriptFails92=== RUN TestScriptTokenEmptyCommand93=== PAUSE TestScriptTokenEmptyCommand94=== CONT TestDoServerRequestAttachesToken95=== CONT TestScriptTokenNoExpiryRerunsEveryCall96=== CONT TestClientSignaturesByStorePath97=== CONT TestShellSplit98=== CONT TestResolveStorePath99=== CONT TestEncodeNixBase32WithRealHash100=== CONT TestScriptTokenEmptyCommand101=== CONT TestRateLimiterFeedback102=== CONT TestScriptTokenScriptFails103=== CONT TestScriptTokenBadJSON104=== CONT TestScriptTokenEmptyToken105=== CONT TestScriptTokenCachesUntilRefresh106--- PASS: TestClientSignaturesByStorePath (0.00s)107--- PASS: TestShellSplit (0.00s)108=== CONT TestDoWithRetry_BodyReplayedViaGetBody109=== CONT TestRateLimiterFeedback_400DoesNotCountAsSuccess110=== RUN TestRateLimiterFeedback/429_enables_limiter111--- PASS: TestEncodeNixBase32WithRealHash (0.00s)112--- PASS: TestScriptTokenEmptyCommand (0.00s)113--- PASS: TestResolveStorePath (0.00s)114=== CONT TestPathInfoCACompatibility115=== RUN TestPathInfoCACompatibility/null_ca_field116=== PAUSE TestPathInfoCACompatibility/null_ca_field117=== RUN TestPathInfoCACompatibility/old_string_format_-_text118=== PAUSE TestPathInfoCACompatibility/old_string_format_-_text119=== PAUSE TestRateLimiterFeedback/429_enables_limiter1202026/10/01 10:41:33 WARN Rate limiter enabled after throttle name=server-test rate=5121=== RUN TestPathInfoCACompatibility/old_string_format_-_fixed_recursive122=== RUN TestRateLimiterFeedback/503_enables_limiter123=== PAUSE TestPathInfoCACompatibility/old_string_format_-_fixed_recursive124=== PAUSE TestRateLimiterFeedback/503_enables_limiter125=== RUN TestPathInfoCACompatibility/new_structured_format_-_text126=== RUN TestRateLimiterFeedback/200_does_not_enable_limiter127=== PAUSE TestPathInfoCACompatibility/new_structured_format_-_text128=== RUN TestPathInfoCACompatibility/new_structured_format_-_nar_method129=== PAUSE TestPathInfoCACompatibility/new_structured_format_-_nar_method130=== PAUSE TestRateLimiterFeedback/200_does_not_enable_limiter131=== RUN TestRateLimiterFeedback/400_does_not_enable_limiter132=== PAUSE TestRateLimiterFeedback/400_does_not_enable_limiter133=== CONT TestParsePathInfoJSONMultipl2026/10/01 10:41:33 WARN Rate limiter enabled after throttle name=server-test rate=51342026/10/01 10:41:33 WARN Request returned retryable status, retrying attempt=1 max_attempts=6 backoff=0s status=503 url=http://127.0.0.1:64284135ePaths136=== RUN TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths137=== PAUSE TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths138=== RUN TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths139=== PAUSE TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths140=== CONT TestParsePathInfoJSON141=== RUN TestParsePathInfoJSON/Nix_format142=== PAUSE TestParsePathInfoJSON/Nix_format143=== RUN TestParsePathInfoJSON/Lix_format144=== PAUSE TestParsePathInfoJSON/Lix_format145=== CONT TestPathInfoHashCompatibility146=== RUN TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)147=== PAUSE TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)148=== RUN TestParsePathInfoJSON/empty_input149=== RUN TestPathInfoHashCompatibility/old_string_format_with_colon150=== PAUSE TestParsePathInfoJSON/empty_input151=== RUN TestParsePathInfoJSON/whitespace_only152=== PAUSE TestParsePathInfoJSON/whitespace_only1532026/10/01 10:41:33 WARN Rate limiter backed off name=server-test rate=5154=== PAUSE TestPathInfoHashCompatibility/old_string_format_with_colon1552026/10/01 10:41:33 WARN Request returned retryable status, retrying attempt=2 max_attempts=6 backoff=0s status=503 url=http://127.0.0.1:64284156=== RUN TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI157=== PAUSE TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI158=== RUN TestPathInfoHashCompatibility/new_structured_format_with_sha512159=== RUN TestParsePathInfoJSON/invalid_JSON160=== PAUSE TestParsePathInfoJSON/invalid_JSON161=== PAUSE TestPathInfoHashCompatibility/new_structured_format_with_sha512162=== CONT TestGetStorePathHash163=== CONT TestConvertHashToNix32164=== RUN TestConvertHashToNix32/SRI_format_to_Nix32165=== RUN TestGetStorePathHash/valid_store_path166=== PAUSE TestGetStorePathHash/valid_store_path167--- PASS: TestScriptTokenScriptFails (0.00s)168=== CONT TestStaticToken169--- PASS: TestStaticToken (0.00s)170=== CONT TestFileTokenEmpty171=== PAUSE TestConvertHashToNix32/SRI_format_to_Nix32172--- PASS: TestDoServerRequestAttachesToken (0.00s)173=== CONT TestFileTokenMissing174=== RUN TestGetStorePathHash/basename_without_hyphen_should_error175=== RUN TestConvertHashToNix32/already_Nix32_format176=== PAUSE TestConvertHashToNix32/already_Nix32_format177=== CONT TestFileTokenReadsAndCaches178=== RUN TestConvertHashToNix32/invalid_format179--- PASS: TestDoWithRetry_BodyReplayedViaGetBody (0.00s)180=== PAUSE TestConvertHashToNix32/invalid_format181=== PAUSE TestGetStorePathHash/basename_without_hyphen_should_error182=== CONT TestStreamPushIsolatesFailures183=== RUN TestGetStorePathHash/hash_with_invalid_characters_should_error184=== PAUSE TestGetStorePathHash/hash_with_invalid_characters_should_error185=== RUN TestGetStorePathHash/hash_with_wrong_length_should_error186=== PAUSE TestGetStorePathHash/hash_with_wrong_length_should_error187=== CONT TestStreamPushReportsSignatures1882026/10/01 10:41:33 ERROR Upload failed error="bad path" count=31892026/10/01 10:41:33 ERROR Upload failed error=boom count=1190--- PASS: TestStreamPushIsolatesFailures (0.00s)191--- PASS: TestStreamPushReportsSignatures (0.00s)192=== CONT TestStreamPushRequestLine193=== CONT TestStreamPushGivesUpOnDeadServer1942026/10/01 10:41:33 ERROR Upload failed error=boom count=11952026/10/01 10:41:33 ERROR Upload failed error="connection refused" count=201962026/10/01 10:41:33 ERROR Server seems unavailable, giving up on batch untried=17197--- PASS: TestFileTokenMissing (0.00s)198=== CONT TestUploadMultipart_SupersededByPeer199=== RUN TestUploadMultipart_SupersededByPeer/exists200=== PAUSE TestUploadMultipart_SupersededByPeer/exists201--- PASS: TestStreamPushGivesUpOnDeadServer (0.00s)202=== RUN TestUploadMultipart_SupersededByPeer/missing203=== CONT TestEncodeNixBase32204=== PAUSE TestUploadMultipart_SupersededByPeer/missing205=== RUN TestEncodeNixBase32/test_string_hash206=== PAUSE TestEncodeNixBase32/test_string_hash207--- PASS: TestFileTokenEmpty (0.00s)208=== CONT TestDumpPathSingleFile209=== RUN TestEncodeNixBase32/empty_input210=== CONT TestDumpPathWriterError211=== PAUSE TestEncodeNixBase32/empty_input212=== CONT TestDumpPathMatchesNix213--- PASS: TestFileTokenReadsAndCaches (0.00s)214=== CONT TestFilterOversizedClosures215=== RUN TestFilterOversizedClosures/no_limit_keeps_everything216=== PAUSE TestFilterOversizedClosures/no_limit_keeps_everything217=== RUN TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped218=== PAUSE TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped219=== RUN TestFilterOversizedClosures/all_closures_skipped220=== PAUSE TestFilterOversizedClosures/all_closures_skipped221=== CONT TestPartSizeForNAR222=== RUN TestPartSizeForNAR/zero_stays_at_minimum223=== PAUSE TestPartSizeForNAR/zero_stays_at_minimum224=== RUN TestPartSizeForNAR/small_stays_at_minimum225=== PAUSE TestPartSizeForNAR/small_stays_at_minimum226=== RUN TestPartSizeForNAR/80_GiB_fits_at_minimum227=== PAUSE TestPartSizeForNAR/80_GiB_fits_at_minimum228=== RUN TestPartSizeForNAR/115_GiB_needs_larger_parts229=== PAUSE TestPartSizeForNAR/115_GiB_needs_larger_parts230=== RUN TestPartSizeForNAR/1_TiB231=== PAUSE TestPartSizeForNAR/1_TiB232=== RUN TestPartSizeForNAR/5_TiB_S3_max_object233=== PAUSE TestPartSizeForNAR/5_TiB_S3_max_object234=== RUN TestPartSizeForNAR/capped_at_5_GiB235=== PAUSE TestPartSizeForNAR/capped_at_5_GiB236=== CONT TestUploadMultipart_PartsInParallel237--- PASS: TestScriptTokenBadJSON (0.01s)238=== CONT TestSetClientTLSDoesNotMutateDefaultTransport239--- PASS: TestScriptTokenEmptyToken (0.01s)240=== CONT TestSetClientTLSErrors241=== RUN TestSetClientTLSErrors/missing_cert_file242=== PAUSE TestSetClientTLSErrors/missing_cert_file243=== RUN TestSetClientTLSErrors/missing_key_file244=== PAUSE TestSetClientTLSErrors/missing_key_file245=== RUN TestSetClientTLSErrors/missing_ca_file246=== PAUSE TestSetClientTLSErrors/missing_ca_file247--- PASS: TestSetClientTLSDoesNotMutateDefaultTransport (0.00s)248=== CONT TestStreamPushReportsEveryPath249=== RUN TestSetClientTLSErrors/invalid_ca_file250=== PAUSE TestSetClientTLSErrors/invalid_ca_file251=== CONT TestStreamPushBatchesUnderLoad252--- PASS: TestStreamPushReportsEveryPath (0.00s)253=== CONT TestCaseHackSuffix254--- PASS: TestStreamPushRequestLine (0.01s)255=== CONT TestRegisterUploadedObjectReusesConnections256--- PASS: TestScriptTokenNoExpiryRerunsEveryCall (0.03s)257=== CONT TestSetClientTLS258--- PASS: TestScriptTokenCachesUntilRefresh (0.03s)259=== CONT TestShellSplitErrors260--- PASS: TestShellSplitErrors (0.00s)261=== CONT TestPathInfoCACompatibility/null_ca_field262=== CONT TestRateLimiterFeedback/429_enables_limiter263=== RUN TestSetClientTLS/rejects_connection_without_client_cert264=== PAUSE TestSetClientTLS/rejects_connection_without_client_cert265=== RUN TestSetClientTLS/succeeds_with_client_cert_and_CA266=== PAUSE TestSetClientTLS/succeeds_with_client_cert_and_CA267=== RUN TestSetClientTLS/preserves_debug_logging_transport268=== PAUSE TestSetClientTLS/preserves_debug_logging_transport269=== CONT TestPathInfoCACompatibility/old_string_format_-_text270=== CONT TestPathInfoCACompatibility/new_structured_format_-_nar_method271=== CONT TestPathInfoCACompatibility/new_structured_format_-_text272=== CONT TestPathInfoCACompatibility/old_string_format_-_fixed_recursive273--- PASS: TestPathInfoCACompatibility (0.00s)274 --- PASS: TestPathInfoCACompatibility/null_ca_field (0.00s)275 --- PASS: TestPathInfoCACompatibility/old_string_format_-_text (0.00s)276 --- PASS: TestPathInfoCACompatibility/new_structured_format_-_nar_method (0.00s)277 --- PASS: TestPathInfoCACompatibility/new_structured_format_-_text (0.00s)278 --- PASS: TestPathInfoCACompatibility/old_string_format_-_fixed_recursive (0.00s)2792026/10/01 10:41:33 WARN Rate limiter enabled after throttle name=server-test rate=5280=== CONT TestRateLimiterFeedback/400_does_not_enable_limiter2812026/10/01 10:41:33 WARN Request returned retryable status, retrying attempt=1 max_attempts=2 backoff=0s status=429 url=http://127.0.0.1:643582822026/10/01 10:41:33 WARN Rate limiter backed off name=server-test rate=5283=== CONT TestRateLimiterFeedback/200_does_not_enable_limiter284=== CONT TestRateLimiterFeedback/503_enables_limiter2852026/10/01 10:41:33 WARN Rate limiter enabled after throttle name=server-test rate=52862026/10/01 10:41:33 WARN Request returned retryable status, retrying attempt=1 max_attempts=2 backoff=0s status=503 url=http://127.0.0.1:64365287=== CONT TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths288=== CONT TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths289--- PASS: TestParsePathInfoJSONMultiplePaths (0.00s)290 --- PASS: TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths (0.00s)291 --- PASS: TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths (0.00s)292=== CONT TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)293=== CONT TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI294=== CONT TestPathInfoHashCompatibility/new_structured_format_with_sha512295=== CONT TestParsePathInfoJSON/Nix_format296=== CONT TestPathInfoHashCompatibility/old_string_format_with_colon297--- PASS: TestPathInfoHashCompatibility (0.00s)298 --- PASS: TestPathInfoHashCompatibility/old_string_format_with_dash_(SR2026/10/01 10:41:33 WARN Rate limiter backed off name=server-test rate=5299I) (0.00s)300 --- PASS: TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI (0.00s)301 --- PASS: TestPathInfoHashCompatibility/new_structured_format_with_sha512 (0.00s)302 --- PASS: TestPathInfoHashCompatibility/old_string_format_with_colon (0.00s)303=== CONT TestParsePathInfoJSON/whitespace_only304=== CONT TestParsePathInfoJSON/invalid_JSON305=== CONT TestParsePathInfoJSON/empty_input306=== CONT TestParsePathInfoJSON/Lix_format307--- PASS: TestRateLimiterFeedback (0.00s)308 --- PASS: TestRateLimiterFeedback/429_enables_limiter (0.01s)309 --- PASS: TestRateLimiterFeedback/400_does_not_enable_limiter (0.00s)310 --- PASS: TestRateLimiterFeedback/200_does_not_enable_limiter (0.00s)311 --- PASS: TestRateLimiterFeedback/503_enables_limiter (0.00s)312=== CONT TestConvertHashToNix32/SRI_format_to_Nix32313=== CONT TestConvertHashToNix32/invalid_format314=== CONT TestConvertHashToNix32/already_Nix32_format315--- PASS: TestConvertHashToNix32 (0.00s)316 --- PASS: TestConvertHashToNix32/SRI_format_to_Nix32 (0.00s)317 --- PASS: TestConvertHashToNix32/invalid_format (0.00s)318 --- PASS: TestConvertHashToNix32/already_Nix32_format (0.00s)319--- PASS: TestParsePathInfoJSON (0.00s)320 --- PASS: TestParsePathInfoJSON/Nix_format (0.00s)321 --- PASS: TestParsePathInfoJSON/whitespace_only (0.00s)322 --- PASS: TestParsePathInfoJSON/invalid_JSON (0.00s)323 --- PASS: TestParsePathInfoJSON/empty_input (0.00s)324 --- PASS: TestParsePathInfoJSON/Lix_format (0.00s)325=== CONT TestGetStorePathHash/valid_store_path326=== CONT TestGetStorePathHash/hash_with_wrong_length_should_error327=== CONT TestGetStorePathHash/basename_without_hyphen_should_error328=== CONT TestGetStorePathHash/hash_with_invalid_characters_should_error329--- PASS: TestGetStorePathHash (0.00s)330 --- PASS: TestGetStorePathHash/valid_store_path (0.00s)331 --- PASS: TestGetStorePathHash/hash_with_wrong_length_should_error (0.00s)332 --- PASS: TestGetStorePathHash/basename_without_hyphen_should_error (0.00s)333 --- PASS: TestGetStorePathHash/hash_with_invalid_characters_should_error (0.00s)334=== CONT TestUploadMultipart_SupersededByPeer/exists335=== CONT TestUploadMultipart_SupersededByPeer/missing336=== CONT TestEncodeNixBase32/test_string_hash337=== CONT TestEncodeNixBase32/empty_input338--- PASS: TestEncodeNixBase32 (0.00s)339 --- PASS: TestEncodeNixBase32/test_string_hash (0.00s)340 --- PASS: TestEncodeNixBase32/empty_input (0.00s)341=== CONT TestFilterOversizedClosures/no_limit_keeps_everything342=== CONT TestPartSizeForNAR/zero_stays_at_minimum343=== CONT TestFilterOversizedClosures/all_closures_skipped3442026/10/01 10:41:33 WARN Skipping closure: path exceeds server max NAR size top_level_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper oversized_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper nar_size=100 max_nar_size=50345=== CONT TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped3462026/10/01 10:41:33 WARN Skipping closure: path exceeds server max NAR size top_level_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper oversized_path=/nix/store/bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb-vm-image nar_size=5000 max_nar_size=2000347--- PASS: TestFilterOversizedClosures (0.00s)348 --- PASS: TestFilterOversizedClosures/no_limit_keeps_everything (0.00s)349 --- PASS: TestFilterOversizedClosures/all_closures_skipped (0.00s)350 --- PASS: TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped (0.00s)351=== CONT TestPartSizeForNAR/1_TiB352=== CONT TestPartSizeForNAR/capped_at_5_GiB353=== CONT TestPartSizeForNAR/5_TiB_S3_max_object354=== CONT TestPartSizeForNAR/80_GiB_fits_at_minimum355=== CONT TestPartSizeForNAR/115_GiB_needs_larger_parts356=== CONT TestPartSizeForNAR/small_stays_at_minimum357--- PASS: TestPartSizeForNAR (0.00s)358 --- PASS: TestPartSizeForNAR/zero_stays_at_minimum (0.00s)359 --- PASS: TestPartSizeForNAR/1_TiB (0.00s)360 --- PASS: TestPartSizeForNAR/capped_at_5_GiB (0.00s)361 --- PASS: TestPartSizeForNAR/5_TiB_S3_max_object (0.00s)362 --- PASS: TestPartSizeForNAR/80_GiB_fits_at_minimum (0.00s)363 --- PASS: TestPartSizeForNAR/115_GiB_needs_larger_parts (0.00s)364 --- PASS: TestPartSizeForNAR/small_stays_at_minimum (0.00s)365=== CONT TestSetClientTLSErrors/missing_cert_file366--- PASS: TestUploadMultipart_SupersededByPeer (0.00s)367 --- PASS: TestUploadMultipart_SupersededByPeer/missing (0.00s)368 --- PASS: TestUploadMultipart_SupersededByPeer/exists (0.00s)369--- PASS: TestDumpPathWriterError (0.04s)370=== CONT TestSetClientTLSErrors/invalid_ca_file371=== CONT TestSetClientTLSErrors/missing_key_file372=== CONT TestSetClientTLSErrors/missing_ca_file373=== CONT TestSetClientTLS/rejects_connection_without_client_cert374=== CONT TestSetClientTLS/preserves_debug_logging_transport375=== CONT TestSetClientTLS/succeeds_with_client_cert_and_CA376--- PASS: TestSetClientTLSErrors (0.00s)377 --- PASS: TestSetClientTLSErrors/missing_cert_file (0.00s)378 --- PASS: TestSetClientTLSErrors/missing_key_file (0.00s)379 --- PASS: TestSetClientTLSErrors/missing_ca_file (0.00s)380 --- PASS: TestSetClientTLSErrors/invalid_ca_file (0.00s)381--- PASS: TestRegisterUploadedObjectReusesConnections (0.03s)3822026/10/01 10:41:33 http: TLS handshake error from 127.0.0.1:64371: remote error: tls: bad certificate383--- PASS: TestSetClientTLS (0.00s)384 --- PASS: TestSetClientTLS/preserves_debug_logging_transport (0.00s)385 --- PASS: TestSetClientTLS/succeeds_with_client_cert_and_CA (0.00s)386 --- PASS: TestSetClientTLS/rejects_connection_without_client_cert (0.01s)387--- PASS: TestDumpPathSingleFile (0.05s)388--- PASS: TestCaseHackSuffix (0.04s)389--- PASS: TestDumpPathMatchesNix (0.07s)390--- PASS: TestStreamPushBatchesUnderLoad (0.10s)391--- PASS: TestUploadMultipart_PartsInParallel (0.61s)392--- PASS: TestRateLimiterFeedback_400DoesNotCountAsSuccess (1.00s)393PASS394Running server tests...395The files belonging to this database system will be owned by user "_nixbld10".396This user must also own the server process.397398The database cluster will be initialized with locale "C".399The default database encoding has accordingly been set to "SQL_ASCII".400The default text search configuration will be set to "english".401402Data page checksums are enabled.403404creating directory /nix/var/nix/builds/nix-64170-818717140/postgres104581756/data ... ok405creating subdirectories ... ok406selecting dynamic shared memory implementation ... posix407selecting default "max_connections" ... 100408selecting default "shared_buffers" ... 128MB409selecting default time zone ... UTC410creating configuration files ... ok411running bootstrap script ... ok412performing post-bootstrap initialization ... ok413syncing data to disk ... ok414415initdb: warning: enabling "trust" authentication for local connections416initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.417418Success. You can now start the database server using:419420 pg_ctl -D /nix/var/nix/builds/nix-64170-818717140/postgres104581756/data -l logfile start421422/nix/var/nix/builds/nix-64170-818717140/postgres104581756:5432 - no response4232026-10-01 10:41:35.528 UTC [64222] LOG: starting PostgreSQL 18.6 on aarch64-apple-darwin25.6.0, compiled by clang version 21.1.8, 64-bit4242026-10-01 10:41:35.528 UTC [64222] LOG: listening on Unix socket "/nix/var/nix/builds/nix-64170-818717140/postgres104581756/.s.PGSQL.5432"4252026-10-01 10:41:35.530 UTC [64229] LOG: database system was shut down at 2026-10-01 10:41:35 UTC4262026-10-01 10:41:35.531 UTC [64222] LOG: database system is ready to accept connections427/nix/var/nix/builds/nix-64170-818717140/postgres104581756:5432 - accepting connections428{"timestamp":"2026-10-01T10:41:35.746028Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"48cbb022-8f5a-4eae-b66e-70de46259f04","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"GET","uri":"/health/ready","status_code":503,"suppressed_errors":0,"duration_ms":0,"result":"server_error","target":"rustfs::server::http","filename":"rustfs/src/server/layer.rs","line_number":501,"threadName":"rustfs-worker","threadId":"ThreadId(11)"}429=== RUN TestService_AuthMiddleware430=== PAUSE TestService_AuthMiddleware431=== RUN TestService_AuthMiddleware_MTLSProxyHeader432=== PAUSE TestService_AuthMiddleware_MTLSProxyHeader433=== RUN TestService_AuthMiddleware_MTLSBoundSubjects434=== PAUSE TestService_AuthMiddleware_MTLSBoundSubjects435=== RUN TestService_ReadAuthMiddleware436=== PAUSE TestService_ReadAuthMiddleware437=== RUN TestService_AuthMiddleware_OIDC438=== PAUSE TestService_AuthMiddleware_OIDC439=== RUN TestService_RequireScope_OIDC440=== PAUSE TestService_RequireScope_OIDC441=== RUN TestService_ReadScope_PublicByDefault442=== PAUSE TestService_ReadScope_PublicByDefault443=== RUN TestCacheConfigHandler444=== PAUSE TestCacheConfigHandler445=== RUN TestCacheStatsHandler446=== PAUSE TestCacheStatsHandler447=== RUN TestClientCADerivations448=== PAUSE TestClientCADerivations449=== RUN TestClientErrorHandling450=== PAUSE TestClientErrorHandling451=== RUN TestClientIntegration452=== PAUSE TestClientIntegration453=== RUN TestClientMultipleUploads454=== PAUSE TestClientMultipleUploads455=== RUN TestClientWithDependencies456=== PAUSE TestClientWithDependencies457=== RUN TestClientSharedPathCommittedMidPush458=== PAUSE TestClientSharedPathCommittedMidPush459=== RUN TestPinProtectsFromGC460=== PAUSE TestPinProtectsFromGC461=== RUN TestClientPushesUseOnePush462=== PAUSE TestClientPushesUseOnePush463=== RUN TestClientFallsBackToClosures464=== PAUSE TestClientFallsBackToClosures465=== RUN TestConcurrentCommitsSharingObjectsDoNotDeadlock466=== PAUSE TestConcurrentCommitsSharingObjectsDoNotDeadlock467=== RUN TestResolveDBConnectionString468=== PAUSE TestResolveDBConnectionString469=== RUN TestConnectWaitsForAPeerMigration470=== PAUSE TestConnectWaitsForAPeerMigration471=== RUN TestLeadElectsOneAndHandsOver472=== PAUSE TestLeadElectsOneAndHandsOver473=== RUN TestLeadIncumbentWinsAfterRestart4742026/10/01 10:41:36 INFO lead: acquired remote=192.0.2.1:12344752026/10/01 10:41:36 INFO lead: released remote=192.0.2.1:12344762026/10/01 10:41:36 INFO lead: acquired remote=192.0.2.1:12344772026/10/01 10:41:36 INFO lead: released remote=192.0.2.1:1234478--- PASS: TestLeadIncumbentWinsAfterRestart (0.85s)479=== RUN TestLeadEndsOnShutdown480=== PAUSE TestLeadEndsOnShutdown481=== RUN TestGCAdvisoryLockBlocksConcurrentRun482=== PAUSE TestGCAdvisoryLockBlocksConcurrentRun483=== RUN TestGCBugBareHashReferences484=== PAUSE TestGCBugBareHashReferences485=== RUN TestGCMetrics486=== PAUSE TestGCMetrics487=== RUN TestPushDedupSurvivesConcurrentGC488=== PAUSE TestPushDedupSurvivesConcurrentGC489=== RUN TestDeduplicatedObjectsRecordedAsPending490=== PAUSE TestDeduplicatedObjectsRecordedAsPending491=== RUN TestGCSweepSkipsPendingObjects492=== PAUSE TestGCSweepSkipsPendingObjects493=== RUN TestTombstonedObjectOfferedWithoutWaiting494=== PAUSE TestTombstonedObjectOfferedWithoutWaiting495=== RUN TestGCSweepDeliversEachKeyOnce496=== PAUSE TestGCSweepDeliversEachKeyOnce497=== RUN TestCreatePendingClosureVerifyS3FailureReleasesConnection498=== PAUSE TestCreatePendingClosureVerifyS3FailureReleasesConnection499=== RUN TestForceGCDuringPushOffersSweptObject500=== PAUSE TestForceGCDuringPushOffersSweptObject501=== RUN TestFailedS3DeleteKeepsTombstone502=== PAUSE TestFailedS3DeleteKeepsTombstone503=== RUN TestSweepSkipsRowsLockedByPush504=== PAUSE TestSweepSkipsRowsLockedByPush505=== RUN TestRegisterCompletedObjectNeedsPendingRow506=== PAUSE TestRegisterCompletedObjectNeedsPendingRow507=== RUN TestGetExistingObjectsLocksRows508=== PAUSE TestGetExistingObjectsLocksRows509=== RUN TestSweepRechecksPendingAfterLocking510=== PAUSE TestSweepRechecksPendingAfterLocking511=== RUN TestPushWaitsForSweepHoldingRow512=== PAUSE TestPushWaitsForSweepHoldingRow513=== RUN TestCommitRacingPendingCleanupKeepsObjects514=== PAUSE TestCommitRacingPendingCleanupKeepsObjects515=== RUN TestGCEndsOnShutdown516=== PAUSE TestGCEndsOnShutdown517=== RUN TestGCTaskStore_StartNew518=== PAUSE TestGCTaskStore_StartNew519=== RUN TestGCTaskStore_DeduplicateSameParams520=== PAUSE TestGCTaskStore_DeduplicateSameParams521=== RUN TestGCTaskStore_ConflictDifferentParams522=== PAUSE TestGCTaskStore_ConflictDifferentParams523=== RUN TestGCTaskStore_GetEmpty524=== PAUSE TestGCTaskStore_GetEmpty525=== RUN TestGCTaskStore_GetReturnsLatest526=== PAUSE TestGCTaskStore_GetReturnsLatest527=== RUN TestGCTaskStore_CompletedAllowsNewTask528=== PAUSE TestGCTaskStore_CompletedAllowsNewTask529=== RUN TestGCTaskStore_PhaseUpdates530=== PAUSE TestGCTaskStore_PhaseUpdates531=== RUN TestGCTaskStore_Fail532=== PAUSE TestGCTaskStore_Fail533=== RUN TestGracefulShutdownDrainsInflight534=== PAUSE TestGracefulShutdownDrainsInflight535=== RUN TestService_healthCheckHandler536=== PAUSE TestService_healthCheckHandler537=== RUN TestService_readinessHandler538=== PAUSE TestService_readinessHandler539=== RUN TestGenerateLandingPage540=== PAUSE TestGenerateLandingPage541=== RUN TestCacheConfigHandlerMaxNarSize542=== PAUSE TestCacheConfigHandlerMaxNarSize543=== RUN TestCreatePendingClosureRejectsOversizedNAR544=== PAUSE TestCreatePendingClosureRejectsOversizedNAR545=== RUN TestNARDeduplicationMetadataUploadBug546=== PAUSE TestNARDeduplicationMetadataUploadBug547=== RUN TestMetricsInventory548=== PAUSE TestMetricsInventory549=== RUN TestService_NativeMTLS550=== PAUSE TestService_NativeMTLS551=== RUN TestServerTLSConfig552=== PAUSE TestServerTLSConfig553=== RUN TestMultipartCleanup554=== PAUSE TestMultipartCleanup555=== RUN TestMultipartUploadAbortedWhenCancelledBeforeRecorded556=== PAUSE TestMultipartUploadAbortedWhenCancelledBeforeRecorded557=== RUN TestPendingCleanupUsesOneCutoff558=== PAUSE TestPendingCleanupUsesOneCutoff559=== RUN TestObjectStatsTrigger560=== PAUSE TestObjectStatsTrigger561=== RUN TestOrphanedObjectsGC562=== PAUSE TestOrphanedObjectsGC563=== RUN TestOrphanedObjectsGCStressTest564=== PAUSE TestOrphanedObjectsGCStressTest565=== RUN TestCreatePin_ReservedPins566=== PAUSE TestCreatePin_ReservedPins567=== RUN TestPresentReportsOnlyClosureRoots568=== PAUSE TestPresentReportsOnlyClosureRoots569=== RUN TestPresentNotReportedWhileGCDeletesClosure570=== PAUSE TestPresentNotReportedWhileGCDeletesClosure571=== RUN TestParseSingleRange572=== PAUSE TestParseSingleRange573=== RUN TestProxyHeadersOnlyTrustedOnSocket574=== PAUSE TestProxyHeadersOnlyTrustedOnSocket575=== RUN TestIsValidCachePath576=== PAUSE TestIsValidCachePath577=== RUN TestReadProxyNarinfo578=== PAUSE TestReadProxyNarinfo579=== RUN TestReadProxyNarinfoAlreadyDecompressed580=== PAUSE TestReadProxyNarinfoAlreadyDecompressed581=== RUN TestReadProxyNarStreaming582=== PAUSE TestReadProxyNarStreaming583=== RUN TestReadProxy404584=== PAUSE TestReadProxy404585=== RUN TestReadProxyInvalidPath586=== PAUSE TestReadProxyInvalidPath587=== RUN TestReadProxyHead588=== PAUSE TestReadProxyHead589=== RUN TestReadProxyOutlastsServerWriteTimeout590=== PAUSE TestReadProxyOutlastsServerWriteTimeout591=== RUN TestReadProxyConditionalGet592=== PAUSE TestReadProxyConditionalGet593=== RUN TestReadProxyRootRedirectsToIndexHTML594=== PAUSE TestReadProxyRootRedirectsToIndexHTML595=== RUN TestReadProxyDisabled596=== PAUSE TestReadProxyDisabled597=== RUN TestReadRedirectNar598=== PAUSE TestReadRedirectNar599=== RUN TestReadRedirectKeepsNarinfoProxied600=== PAUSE TestReadRedirectKeepsNarinfoProxied601=== RUN TestReadProxyRangeRequest602=== PAUSE TestReadProxyRangeRequest603=== RUN TestReadRedirectUsesPublicS3URL604=== PAUSE TestReadRedirectUsesPublicS3URL605=== RUN TestPush_OverlappingRootsStoreOneRowPerKey606=== PAUSE TestPush_OverlappingRootsStoreOneRowPerKey607=== RUN TestPush_CompleteCommitsEveryRoot608=== PAUSE TestPush_CompleteCommitsEveryRoot609=== RUN TestPush_SkippedKeySurvivesGCBeforeCommit610=== PAUSE TestPush_SkippedKeySurvivesGCBeforeCommit611=== RUN TestPush_RejectsBadRequests612=== PAUSE TestPush_RejectsBadRequests613=== RUN TestPush_SignsNarinfosOfItsPendingObjects614=== PAUSE TestPush_SignsNarinfosOfItsPendingObjects615=== RUN TestRedundantMultipartUpload616=== PAUSE TestRedundantMultipartUpload617=== RUN TestCompleteMultipartUpload_ErrorButObjectExists618=== PAUSE TestCompleteMultipartUpload_ErrorButObjectExists619=== RUN TestCompletedNarNotReofferedAcrossClosures620=== PAUSE TestCompletedNarNotReofferedAcrossClosures621=== RUN TestPresignedUploadRegisteredBeforeCommit622=== PAUSE TestPresignedUploadRegisteredBeforeCommit623=== RUN TestService_Rustfstest624=== PAUSE TestService_Rustfstest625=== RUN TestParseSize626=== PAUSE TestParseSize627=== RUN TestSkippedUploadsHandler628=== PAUSE TestSkippedUploadsHandler629=== RUN TestSystemdListenerNotActivated630--- PASS: TestSystemdListenerNotActivated (0.00s)631=== RUN TestWatchdogBeatsWhenHealthy632--- PASS: TestWatchdogBeatsWhenHealthy (0.02s)633=== RUN TestWatchdogSkipsWhenUnhealthy6342026/10/01 10:41:36 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"6352026/10/01 10:41:36 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"6362026/10/01 10:41:36 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"6372026/10/01 10:41:36 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"6382026/10/01 10:41:36 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"6392026/10/01 10:41:36 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"6402026/10/01 10:41:36 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"6412026/10/01 10:41:36 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"6422026/10/01 10:41:36 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"643--- PASS: TestWatchdogSkipsWhenUnhealthy (0.20s)644=== RUN TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle645=== PAUSE TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle646=== RUN TestProxyWriteTimeout647=== PAUSE TestProxyWriteTimeout648=== RUN TestPendingClosureWriteTimeout649=== PAUSE TestPendingClosureWriteTimeout650=== RUN TestIsValidUploadKey651=== PAUSE TestIsValidUploadKey652=== RUN TestUploadHandlersRejectInvalidKeys653=== PAUSE TestUploadHandlersRejectInvalidKeys654=== RUN TestUploadHandlersRejectOversizedBody655=== PAUSE TestUploadHandlersRejectOversizedBody656=== RUN TestService_cleanupPendingClosuresHandler657=== PAUSE TestService_cleanupPendingClosuresHandler658=== RUN TestService_createPendingClosureHandler659=== PAUSE TestService_createPendingClosureHandler660=== RUN TestService_verifyS3Integrity661=== PAUSE TestService_verifyS3Integrity662=== RUN TestCompleteMultipartUnregistered663=== PAUSE TestCompleteMultipartUnregistered664=== RUN TestCreatePendingClosure_SmallNARUsesSimplePUT665=== PAUSE TestCreatePendingClosure_SmallNARUsesSimplePUT666=== CONT TestPush_CompleteCommitsEveryRoot667=== CONT TestService_AuthMiddleware668=== CONT TestGCTaskStore_ConflictDifferentParams669--- PASS: TestGCTaskStore_ConflictDifferentParams (0.00s)670=== CONT TestCreatePin_ReservedPins671=== CONT TestOrphanedObjectsGCStressTest672=== CONT TestReadProxyHead673=== CONT TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle674=== CONT TestSkippedUploadsHandler675=== CONT TestParseSize676=== CONT TestService_Rustfstest677=== CONT TestCreatePendingClosureRejectsOversizedNAR678--- PASS: TestParseSize (0.00s)679=== CONT TestPresignedUploadRegisteredBeforeCommit6802026/10/01 10:41:36 INFO Client skipped oversized paths paths=3 nar_bytes=50000000006812026/10/01 10:41:36 INFO Received uploads request method=POST path=/api/pending_closures682--- PASS: TestCreatePendingClosureRejectsOversizedNAR (0.00s)683=== CONT TestCompletedNarNotReofferedAcrossClosures684--- PASS: TestSkippedUploadsHandler (0.01s)685=== CONT TestCompleteMultipartUpload_ErrorButObjectExists6862026/10/01 10:41:37 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:64390/oidc6872026/10/01 10:41:37 INFO Received push request method=POST path=/api/pushes6882026/10/01 10:41:37 INFO Received complete push request method=POST path=/api/pushes/1/complete689--- PASS: TestPush_CompleteCommitsEveryRoot (0.49s)690=== CONT TestRedundantMultipartUpload691--- PASS: TestReadProxyHead (0.59s)692=== CONT TestOrphanedObjectsGC6932026/10/01 10:41:37 WARN Authentication failed token_preview=wrongtoken token_length=10 reason="static API token mismatch"694--- PASS: TestService_AuthMiddleware (0.73s)695=== CONT TestPush_SignsNarinfosOfItsPendingObjects6962026/10/01 10:41:37 INFO Received uploads request method=POST path=/api/pending_closures6972026/10/01 10:41:38 INFO Received complete multipart upload request method=POST path=/api/multipart/complete698--- PASS: TestService_Rustfstest (1.08s)699=== CONT TestObjectStatsTrigger7002026/10/01 10:41:38 WARN CompleteMultipartUpload errored but object exists; treating as success error="The specified key does not exist." object_key=nar/gggggggggggggggggggggggggggggg0300000000000000000000.nar.zst upload_id=NWUyMGM2NmItMDhlYi00NDZjLThjYTgtMDg2NTE5YzA4NTI5LmJiMjE5NTRiLTA5NDgtNGJhZS04OWJmLWMzYTJjN2E0MDdiOHgxNzkwODUxMjk3ODU5OTQ0MDAw7012026/10/01 10:41:38 INFO Completed multipart upload object_key=nar/gggggggggggggggggggggggggggggg0300000000000000000000.nar.zst upload_id=NWUyMGM2NmItMDhlYi00NDZjLThjYTgtMDg2NTE5YzA4NTI5LmJiMjE5NTRiLTA5NDgtNGJhZS04OWJmLWMzYTJjN2E0MDdiOHgxNzkwODUxMjk3ODU5OTQ0MDAw parts=1702--- PASS: TestCompleteMultipartUpload_ErrorButObjectExists (1.10s)703=== CONT TestPush_RejectsBadRequests7042026/10/01 10:41:38 INFO Received uploads request method=POST path=/api/pending_closures7052026/10/01 10:41:38 INFO Received uploads request method=POST path=/api/pending_closures7062026/10/01 10:41:38 INFO Received complete multipart upload request method=POST path=/api/multipart/complete7072026/10/01 10:41:38 INFO Registered completed upload object_key=nar/jjjjjjjjjjjjjjjjjjjjjjjjjjjjjj0100000000000000000000.nar.zst7082026/10/01 10:41:38 INFO Received uploads request method=POST path=/api/pending_closures709--- PASS: TestPresignedUploadRegisteredBeforeCommit (1.77s)710=== CONT TestPendingCleanupUsesOneCutoff7112026/10/01 10:41:38 INFO Received uploads request method=POST path=/api/pending_closures7122026/10/01 10:41:39 INFO Received create pin request method=POST path=/api/pins/worker-x86_64-linux7132026/10/01 10:41:39 WARN Refused reserved pin name=worker-x86_64-linux7142026/10/01 10:41:39 INFO Received create pin request method=POST path=/api/pins/worker-x86_64-linux7152026/10/01 10:41:39 INFO Received create pin request method=POST path=/api/pins/my-app7162026/10/01 10:41:39 INFO Received create pin request method=POST path=/api/pins/worker-x86_64-linux717--- PASS: TestCreatePin_ReservedPins (2.26s)718=== CONT TestPush_SkippedKeySurvivesGCBeforeCommit7192026/10/01 10:41:39 INFO Received uploads request method=POST path=/api/pending_closures7202026/10/01 10:41:39 INFO Received uploads request method=POST path=/api/pending_closures7212026/10/01 10:41:40 INFO Received push request method=POST path=/api/pushes7222026/10/01 10:41:40 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign7232026/10/01 10:41:40 INFO Signed narinfos id=1 count=1724--- PASS: TestPush_SignsNarinfosOfItsPendingObjects (2.42s)725=== CONT TestMultipartUploadAbortedWhenCancelledBeforeRecorded726--- PASS: TestObjectStatsTrigger (2.37s)727=== CONT TestService_cleanupPendingClosuresHandler728=== NAME TestOrphanedObjectsGC729 orphaned_objects_gc_test.go:290: GC Test Summary:730 orphaned_objects_gc_test.go:291: - Kept: 2 objects from closure A731 orphaned_objects_gc_test.go:292: - Deleted: 2 objects from closure B732 orphaned_objects_gc_test.go:293: - Deleted: 6 orphaned chain objects (X1->X2->X3)733 orphaned_objects_gc_test.go:294: - Deleted: 2 orphaned single objects (Y)734 orphaned_objects_gc_test.go:295: - Total deleted: 10 objects735--- PASS: TestOrphanedObjectsGC (3.02s)736=== CONT TestCreatePendingClosure_SmallNARUsesSimplePUT737=== RUN TestPush_RejectsBadRequests/root_not_in_objects738=== PAUSE TestPush_RejectsBadRequests/root_not_in_objects739=== RUN TestPush_RejectsBadRequests/no_roots740=== PAUSE TestPush_RejectsBadRequests/no_roots741=== RUN TestPush_RejectsBadRequests/no_objects742=== PAUSE TestPush_RejectsBadRequests/no_objects743=== RUN TestPush_RejectsBadRequests/bad_root744=== PAUSE TestPush_RejectsBadRequests/bad_root745=== CONT TestMultipartCleanup7462026/10/01 10:41:40 INFO Received complete multipart upload request method=POST path=/api/multipart/complete7472026/10/01 10:41:40 INFO Completed multipart upload object_key=nar/hhhhhhhhhhhhhhhhhhhhhhhhhhhhhh0100000000000000000000.nar.zst upload_id=NWUyMGM2NmItMDhlYi00NDZjLThjYTgtMDg2NTE5YzA4NTI5LjJlMjU0ZDlkLThhNTEtNDZiNC05MDUyLTRjNTc5ZmZiMGFmOXgxNzkwODUxMjk4OTIyMzcyMDAw parts=127482026/10/01 10:41:40 INFO Received uploads request method=POST path=/api/pending_closures749--- PASS: TestCompletedNarNotReofferedAcrossClosures (3.82s)750=== CONT TestCompleteMultipartUnregistered7512026/10/01 10:41:41 INFO Received complete multipart upload request method=POST path=/api/multipart/complete7522026/10/01 10:41:41 INFO Completed multipart upload object_key=nar/gggggggggggggggggggggggggggggg0100000000000000000000.nar.zst upload_id=NWUyMGM2NmItMDhlYi00NDZjLThjYTgtMDg2NTE5YzA4NTI5LjdiNDBmYzgwLTRkZDYtNGI5Yi05NjU1LTRiY2I0MDFjMTIxN3gxNzkwODUxMjk5NDQ2Mzg5MDAw parts=127532026/10/01 10:41:41 INFO Received uploads request method=POST path=/api/pending_closures7542026/10/01 10:41:41 INFO Received uploads request method=POST path=/api/pending_closures7552026/10/01 10:41:41 INFO Received uploads request method=POST path=/api/pending_closures7562026/10/01 10:41:41 INFO Received uploads request method=POST path=/api/pending_closures7572026/10/01 10:41:41 INFO Received cleanup request method=DELETE path=/api/pending_closures7582026/10/01 10:41:41 INFO Received push request method=POST path=/api/pushes7592026/10/01 10:41:41 INFO Received complete push request method=POST path=/api/pushes/1/complete7602026/10/01 10:41:41 INFO Received push request method=POST path=/api/pushes7612026/10/01 10:41:41 INFO Aborted multipart uploads count=0 kept=07622026/10/01 10:41:41 WARN Force mode enabled - objects will be deleted immediately without grace period7632026/10/01 10:41:41 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=2 objects-deleted-after-grace-period=2 objects-failed-to-delete=07642026/10/01 10:41:41 INFO Vacuumed table table=pending_closures7652026/10/01 10:41:41 INFO Vacuumed table table=pending_objects7662026/10/01 10:41:42 INFO Vacuumed table table=multipart_uploads7672026/10/01 10:41:42 INFO Vacuumed table table=closures7682026/10/01 10:41:42 INFO Vacuumed table table=objects7692026/10/01 10:41:42 INFO Received complete push request method=POST path=/api/pushes/2/complete770--- PASS: TestPush_SkippedKeySurvivesGCBeforeCommit (2.87s)771=== CONT TestService_verifyS3Integrity7722026/10/01 10:41:42 WARN Rate limiter enabled after throttle name=s3-test rate=57732026/10/01 10:41:42 WARN S3 rate limit hit operation="complete multipart upload" error="Please reduce your request rate."774=== NAME TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle775 throttle_test.go:213: Proxy stats: total=13, throttled=10, completeMultipart=10776 throttle_test.go:215: Rate limiter: enabled=true, rate=5.00777--- PASS: TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle (5.78s)778=== CONT TestServerTLSConfig779=== RUN TestServerTLSConfig/no_client_CA780=== PAUSE TestServerTLSConfig/no_client_CA781=== RUN TestServerTLSConfig/missing_CA_file782=== PAUSE TestServerTLSConfig/missing_CA_file783=== RUN TestServerTLSConfig/not_a_PEM_file784=== PAUSE TestServerTLSConfig/not_a_PEM_file785=== CONT TestService_createPendingClosureHandler7862026/10/01 10:41:42 INFO Received uploads request method=POST path=/api/pending_closures787--- PASS: TestMultipartUploadAbortedWhenCancelledBeforeRecorded (2.76s)788=== CONT TestService_NativeMTLS7892026/10/01 10:41:43 INFO Received complete multipart upload request method=POST path=/api/multipart/complete7902026/10/01 10:41:43 INFO Received cleanup request method=DELETE path=/api/pending_closures7912026/10/01 10:41:43 INFO Aborted multipart uploads count=0 kept=07922026/10/01 10:41:43 INFO Received uploads request method=POST path=/api/pending_closures7932026/10/01 10:41:43 WARN Failed to abort redundant multipart upload, keeping its row object_key=nar/gggggggggggggggggggggggggggggg0200000000000000000000.nar.zst upload_id=NWUyMGM2NmItMDhlYi00NDZjLThjYTgtMDg2NTE5YzA4NTI5Ljk1OWVkNWU4LWViM2EtNGQ3NS1hN2M3LWYyNGE5NmZmMzA2ZHgxNzkwODUxMzAxMjk2NzIwMDAw error="Get \"http://127.0.0.1:1/bucket12/?location=\": dial tcp 127.0.0.1:1: connect: connection refused"7942026/10/01 10:41:43 INFO Completed multipart upload object_key=nar/gggggggggggggggggggggggggggggg0200000000000000000000.nar.zst upload_id=NWUyMGM2NmItMDhlYi00NDZjLThjYTgtMDg2NTE5YzA4NTI5LmVmMDM5MTg0LTA3ZGYtNGYyMS1hOTRjLTU1OGUwY2E3ZWFhN3gxNzkwODUxMzAxMjUxNzg2MDAw parts=127952026/10/01 10:41:43 INFO Received cleanup request method=DELETE path=/api/pending_closures7962026/10/01 10:41:43 INFO Aborted multipart uploads count=1 kept=0797--- PASS: TestRedundantMultipartUpload (5.68s)798=== CONT TestIsValidUploadKey799=== RUN TestIsValidUploadKey/narinfo800=== PAUSE TestIsValidUploadKey/narinfo801=== RUN TestIsValidUploadKey/nar_zst802=== PAUSE TestIsValidUploadKey/nar_zst803=== RUN TestIsValidUploadKey/nar_xz804=== PAUSE TestIsValidUploadKey/nar_xz805=== RUN TestIsValidUploadKey/nar_plain806=== PAUSE TestIsValidUploadKey/nar_plain807=== RUN TestIsValidUploadKey/listing808=== PAUSE TestIsValidUploadKey/listing809=== RUN TestIsValidUploadKey/build_log810=== PAUSE TestIsValidUploadKey/build_log811=== RUN TestIsValidUploadKey/build_log_home-manager_file812=== PAUSE TestIsValidUploadKey/build_log_home-manager_file813=== RUN TestIsValidUploadKey/build_log_plus_in_name814=== PAUSE TestIsValidUploadKey/build_log_plus_in_name815=== RUN TestIsValidUploadKey/build_log_question_mark816=== PAUSE TestIsValidUploadKey/build_log_question_mark817=== RUN TestIsValidUploadKey/build_log_equals818=== PAUSE TestIsValidUploadKey/build_log_equals819=== RUN TestIsValidUploadKey/realisation820=== PAUSE TestIsValidUploadKey/realisation821=== RUN TestIsValidUploadKey/realisation_plus_in_output822=== PAUSE TestIsValidUploadKey/realisation_plus_in_output823=== RUN TestIsValidUploadKey/nix-cache-info824=== PAUSE TestIsValidUploadKey/nix-cache-info825=== RUN TestIsValidUploadKey/index.html826=== PAUSE TestIsValidUploadKey/index.html827=== RUN TestIsValidUploadKey/narinfo_key,_nar_type828=== PAUSE TestIsValidUploadKey/narinfo_key,_nar_type829=== RUN TestIsValidUploadKey/nar_key,_narinfo_type830=== PAUSE TestIsValidUploadKey/nar_key,_narinfo_type831=== RUN TestIsValidUploadKey/listing_key,_narinfo_type832=== PAUSE TestIsValidUploadKey/listing_key,_narinfo_type833=== RUN TestIsValidUploadKey/traversal834=== PAUSE TestIsValidUploadKey/traversal835=== RUN TestIsValidUploadKey/traversal_nar836=== PAUSE TestIsValidUploadKey/traversal_nar837=== RUN TestIsValidUploadKey/absolute838=== PAUSE TestIsValidUploadKey/absolute839=== RUN TestIsValidUploadKey/empty_key840=== PAUSE TestIsValidUploadKey/empty_key841=== RUN TestIsValidUploadKey/unknown_type842=== PAUSE TestIsValidUploadKey/unknown_type843=== CONT TestMetricsInventory8442026/10/01 10:41:43 INFO Received cleanup request method=DELETE path=/api/pending_closures8452026/10/01 10:41:43 INFO Aborted multipart uploads count=1 kept=08462026/10/01 10:41:43 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete8472026-10-01 10:41:43.149 UTC [64328] ERROR: Closure does not exist: id=18482026-10-01 10:41:43.149 UTC [64328] CONTEXT: PL/pgSQL function commit_pending_closure(bigint) line 12 at RAISE8492026-10-01 10:41:43.149 UTC [64328] STATEMENT: -- name: CommitPendingClosure :exec850 SELECT commit_pending_closure($1::bigint)851 852--- PASS: TestService_cleanupPendingClosuresHandler (2.77s)853=== CONT TestUploadHandlersRejectOversizedBody854=== RUN TestUploadHandlersRejectOversizedBody/create_pending_closure855=== PAUSE TestUploadHandlersRejectOversizedBody/create_pending_closure856=== RUN TestUploadHandlersRejectOversizedBody/complete_multipart857=== PAUSE TestUploadHandlersRejectOversizedBody/complete_multipart858=== RUN TestUploadHandlersRejectOversizedBody/request_more_parts859=== PAUSE TestUploadHandlersRejectOversizedBody/request_more_parts860=== CONT TestUploadHandlersRejectInvalidKeys861=== RUN TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info862=== PAUSE TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info863=== RUN TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal864=== PAUSE TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal865=== RUN TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key866=== PAUSE TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key867=== RUN TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key868=== PAUSE TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key869=== CONT TestNARDeduplicationMetadataUploadBug8702026/10/01 10:41:43 INFO Received uploads request method=POST path=/api/pending_closures871--- PASS: TestCreatePendingClosure_SmallNARUsesSimplePUT (2.83s)872=== CONT TestReadRedirectNar873=== NAME TestOrphanedObjectsGCStressTest874 orphaned_objects_gc_test.go:425: Created 10 active closures, 5 to-delete closures, 20 orphaned chains875 orphaned_objects_gc_test.go:446: Marked 210 objects for deletion8762026/10/01 10:41:43 INFO Received uploads request method=POST path=/api/pending_closures8772026/10/01 10:41:43 INFO Received cleanup request method=DELETE path=/api/pending_closures8782026/10/01 10:41:43 WARN Failed to abort upload, keeping its closure key=nar/dadb44fdadb44fdadb44fdadb44f000000000000000000000000.nar.zst error="Get \"http://127.0.0.1:1/bucket22/?location=\": dial tcp 127.0.0.1:1: connect: connection refused" code=""8792026/10/01 10:41:43 INFO Aborted multipart uploads count=0 kept=18802026/10/01 10:41:43 INFO Received cleanup request method=DELETE path=/api/pending_closures8812026/10/01 10:41:43 INFO Aborted multipart uploads count=1 kept=08822026/10/01 10:41:43 INFO Received complete multipart upload request method=POST path=/api/multipart/complete8832026/10/01 10:41:43 ERROR Failed to get multipart upload error="no rows in result set" upload_id=does-not-exist object_key=nar/0000000000000000000000000000000000000000000000000000.nar.zst884--- PASS: TestCompleteMultipartUnregistered (2.98s)885=== CONT TestReadRedirectUsesPublicS3URL886--- PASS: TestMultipartCleanup (3.10s)887=== CONT TestReadProxyRangeRequest8882026/10/01 10:41:43 INFO Received uploads request method=POST path=/api/pending_closures8892026/10/01 10:41:44 INFO Received uploads request method=POST path=/api/pending_closures8902026/10/01 10:41:44 INFO Received uploads request method=POST path=/api/pending_closures8912026/10/01 10:41:44 INFO Received uploads request method=POST path=/api/pending_closures8922026/10/01 10:41:44 WARN mTLS auth: subject not in bound subjects subject="CN=reader"8932026/10/01 10:41:44 WARN mTLS auth: subject not in bound subjects subject="CN=reader"894--- PASS: TestService_NativeMTLS (1.90s)895=== CONT TestPush_OverlappingRootsStoreOneRowPerKey8962026/10/01 10:41:45 INFO Received complete multipart upload request method=POST path=/api/multipart/complete897=== NAME TestNARDeduplicationMetadataUploadBug898 metadata_upload_test.go:48: First store path: /nix/var/nix/builds/nix-64170-818717140/TestNARDeduplicationMetadataUploadBug3372368221/001/store/kbzhsvm7gg8jj4dw6313l3p5qiwz8lpw-file1.txt899--- PASS: TestMetricsInventory (2.28s)900=== CONT TestReadRedirectKeepsNarinfoProxied9012026/10/01 10:41:45 INFO Received push request method=POST path=/api/pushes9022026/10/01 10:41:45 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)9032026/10/01 10:41:45 INFO Uploading kbzhsvm7gg8jj4dw6313l3p5qiwz8lpw-file1.txt (160B)9042026/10/01 10:41:45 WARN Failed to register uploaded object key=nar/1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf.nar.zst error="server returned 404: 404 page not found\n"9052026/10/01 10:41:45 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign9062026/10/01 10:41:45 WARN Failed to register uploaded object key=kbzhsvm7gg8jj4dw6313l3p5qiwz8lpw.ls error="server returned 404: 404 page not found\n"9072026/10/01 10:41:45 INFO Signed narinfos id=1 count=19082026/10/01 10:41:45 INFO Uploading 1 narinfos9092026/10/01 10:41:45 INFO Received complete push request method=POST path=/api/pushes/1/complete9102026/10/01 10:41:45 WARN Failed to register uploaded object key=kbzhsvm7gg8jj4dw6313l3p5qiwz8lpw.narinfo error="server returned 404: 404 page not found\n"9112026/10/01 10:41:45 INFO Upload complete. (126ms)912=== NAME TestNARDeduplicationMetadataUploadBug913 metadata_upload_test.go:54: Retrieved narinfo from S3:914 StorePath: /nix/var/nix/builds/nix-64170-818717140/TestNARDeduplicationMetadataUploadBug3372368221/001/store/kbzhsvm7gg8jj4dw6313l3p5qiwz8lpw-file1.txt915 URL: nar/1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf.nar.zst916 Compression: zstd917 NarHash: sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf918 NarSize: 160919 References: 920 CA: fixed:r:sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf921 metadata_upload_test.go:55: Retrieved .ls file from S3 (compressed size: 77 bytes)922 metadata_upload_test.go:55: Decompressed .ls content (64 bytes):923 {"version":1,"root":{"type":"regular","size":44,"narOffset":96}}924--- PASS: TestReadRedirectNar (2.23s)925=== CONT TestLeadEndsOnShutdown9262026/10/01 10:41:45 INFO Completed multipart upload object_key=nar/dadb44fdadb44fdadb44fdadb44f000000000000000000000000.nar.zst upload_id=NWUyMGM2NmItMDhlYi00NDZjLThjYTgtMDg2NTE5YzA4NTI5LmJlY2JkMzZlLTBiOTQtNDYxYi05Zjc5LWI0ZjY1N2EzZDkxOXgxNzkwODUxMzA0MDA0NzA1MDAw parts=109272026/10/01 10:41:45 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete928=== NAME TestOrphanedObjectsGCStressTest929 orphaned_objects_gc_test.go:509: Stress test completed successfully:930 orphaned_objects_gc_test.go:510: - Active objects preserved: 20931 orphaned_objects_gc_test.go:511: - Objects deleted: 210932 orphaned_objects_gc_test.go:512: - Total GC'd: 210933--- PASS: TestOrphanedObjectsGCStressTest (8.69s)934=== CONT TestFailedS3DeleteKeepsTombstone9352026/10/01 10:41:45 INFO Completed upload id=19362026/10/01 10:41:45 INFO Received uploads request method=POST path=/api/pending_closures9372026/10/01 10:41:45 INFO Received uploads request method=POST path=/api/pending_closures9382026/10/01 10:41:45 INFO Object in database but missing from S3 key=dadb44fdadb44fdadb44fdadb44f0000.narinfo9392026/10/01 10:41:45 WARN Found objects in DB but missing from S3, will re-upload count=1940--- PASS: TestService_verifyS3Integrity (3.56s)941=== CONT TestForceGCDuringPushOffersSweptObject942=== RUN TestForceGCDuringPushOffersSweptObject/before_pending_rows943=== PAUSE TestForceGCDuringPushOffersSweptObject/before_pending_rows944=== RUN TestForceGCDuringPushOffersSweptObject/after_presence_check945=== PAUSE TestForceGCDuringPushOffersSweptObject/after_presence_check946=== CONT TestGCTaskStore_DeduplicateSameParams947--- PASS: TestGCTaskStore_DeduplicateSameParams (0.00s)948=== CONT TestCreatePendingClosureVerifyS3FailureReleasesConnection949=== NAME TestNARDeduplicationMetadataUploadBug950 metadata_upload_test.go:64: Second store path (same content): /nix/var/nix/builds/nix-64170-818717140/TestNARDeduplicationMetadataUploadBug3372368221/001/store/35a10nl6zn2vfvasv3b5hyn1yp1hfb23-file2.txt9512026/10/01 10:41:45 INFO Received push request method=POST path=/api/pushes9522026/10/01 10:41:45 INFO Uploading 0 paths to 127.0.0.1 (1 already cached)9532026/10/01 10:41:45 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign9542026/10/01 10:41:45 INFO Signed narinfos id=2 count=19552026/10/01 10:41:45 INFO Uploading 1 narinfos9562026/10/01 10:41:45 WARN Failed to register uploaded object key=35a10nl6zn2vfvasv3b5hyn1yp1hfb23.ls error="server returned 404: 404 page not found\n"9572026/10/01 10:41:45 INFO Received complete push request method=POST path=/api/pushes/2/complete9582026/10/01 10:41:45 WARN Failed to register uploaded object key=35a10nl6zn2vfvasv3b5hyn1yp1hfb23.narinfo error="server returned 404: 404 page not found\n"9592026/10/01 10:41:45 INFO Upload complete. (79ms)960 metadata_upload_test.go:76: Retrieved narinfo from S3:961 StorePath: /nix/var/nix/builds/nix-64170-818717140/TestNARDeduplicationMetadataUploadBug3372368221/001/store/35a10nl6zn2vfvasv3b5hyn1yp1hfb23-file2.txt962 URL: nar/1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf.nar.zst963 Compression: zstd964 NarHash: sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf965 NarSize: 160966 References: 967 CA: fixed:r:sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf968 metadata_upload_test.go:77: Retrieved .ls file from S3 (compressed size: 62 bytes)969 metadata_upload_test.go:77: Decompressed .ls content (49 bytes):970 {"version":1,"root":{"type":"regular","size":44}}9712026/10/01 10:41:45 INFO Received complete multipart upload request method=POST path=/api/multipart/complete972--- PASS: TestReadRedirectUsesPublicS3URL (2.12s)973=== CONT TestGCTaskStore_StartNew974--- PASS: TestGCTaskStore_StartNew (0.00s)975=== CONT TestGCSweepDeliversEachKeyOnce9762026/10/01 10:41:45 INFO Completed multipart upload object_key=nar/0000000000000000000000000000000000000000000000000000.nar.zst upload_id=NWUyMGM2NmItMDhlYi00NDZjLThjYTgtMDg2NTE5YzA4NTI5LjgyNDM2M2ZiLWE3NWUtNDAzNS1iMWQ4LWIwODQwODM2NDU1YngxNzkwODUxMzA0NDk1MzUxMDAw parts=109772026/10/01 10:41:45 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete978--- PASS: TestNARDeduplicationMetadataUploadBug (2.70s)979=== CONT TestGCEndsOnShutdown9802026/10/01 10:41:45 INFO Completed upload id=19812026/10/01 10:41:45 INFO Received get closure request method=GET path=/api/closures/000000000000000000000000000000009822026/10/01 10:41:45 INFO Received uploads request method=POST path=/api/pending_closures9832026/10/01 10:41:45 INFO Starting cleanup of old closures method=DELETE path=/api/closures9842026/10/01 10:41:45 INFO Aborted multipart uploads count=0 kept=09852026/10/01 10:41:45 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=09862026/10/01 10:41:45 INFO Vacuumed table table=pending_closures9872026/10/01 10:41:45 INFO Vacuumed table table=pending_objects9882026/10/01 10:41:45 INFO Vacuumed table table=multipart_uploads9892026/10/01 10:41:45 INFO Vacuumed table table=closures9902026/10/01 10:41:45 INFO Vacuumed table table=objects9912026/10/01 10:41:45 INFO Received get closure request method=GET path=/api/closures/00000000000000000000000000000000992--- PASS: TestService_createPendingClosureHandler (3.27s)993=== CONT TestTombstonedObjectOfferedWithoutWaiting994--- PASS: TestReadProxyRangeRequest (2.31s)995=== CONT TestCommitRacingPendingCleanupKeepsObjects9962026/10/01 10:41:46 INFO Received push request method=POST path=/api/pushes997--- PASS: TestPush_OverlappingRootsStoreOneRowPerKey (2.03s)998=== CONT TestGCSweepSkipsPendingObjects999--- PASS: TestReadRedirectKeepsNarinfoProxied (1.94s)1000=== CONT TestDeduplicatedObjectsRecordedAsPending10012026/10/01 10:41:47 INFO Aborted multipart uploads count=1 kept=010022026/10/01 10:41:47 INFO Received uploads request method=POST path=/api/pending_closures10032026/10/01 10:41:47 INFO Received cleanup request method=DELETE path=/api/pending_closures10042026/10/01 10:41:47 INFO Aborted multipart uploads count=1 kept=01005--- PASS: TestPendingCleanupUsesOneCutoff (8.98s)1006=== CONT TestPushWaitsForSweepHoldingRow1007{"timestamp":"2026-10-01T10:41:47.703477Z","level":"ERROR","message":"Scanner cycle completed without a durable data usage snapshot","event":"scanner_persist_state","component":"scanner","subsystem":"runtime","cycle":3,"outcome":"NoUpdate","state":"usage_not_durable","target":"rustfs::scanner","filename":"crates/scanner/src/scanner.rs","line_number":2350,"threadName":"rustfs-worker","threadId":"ThreadId(11)"}1008--- PASS: TestCreatePendingClosureVerifyS3FailureReleasesConnection (2.29s)1009=== CONT TestPushDedupSurvivesConcurrentGC10102026/10/01 10:41:47 INFO Received uploads request method=POST path=/api/pending_closures10112026/10/01 10:41:48 INFO Aborted multipart uploads count=0 kept=010122026/10/01 10:41:48 WARN Force mode enabled - objects will be deleted immediately without grace period10132026/10/01 10:41:48 ERROR failed to remove object object=nar/dddddddddddddddddddddddddddddddddddddddddddddddddddd.nar.zst error="Access Denied."10142026/10/01 10:41:48 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.narinfo error="Access Denied."1015--- PASS: TestFailedS3DeleteKeepsTombstone (2.50s)1016=== CONT TestSweepRechecksPendingAfterLocking10172026/10/01 10:41:48 INFO lead: acquired remote=192.0.2.1:123410182026/10/01 10:41:48 INFO lead: released remote=192.0.2.1:12341019--- PASS: TestLeadEndsOnShutdown (2.63s)1020=== CONT TestGCMetrics10212026/10/01 10:41:48 INFO Aborted multipart uploads count=0 kept=010222026/10/01 10:41:48 WARN Force mode enabled - objects will be deleted immediately without grace period10232026/10/01 10:41:48 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=3 objects-deleted-after-grace-period=3 objects-failed-to-delete=010242026/10/01 10:41:48 INFO Vacuumed table table=pending_closures10252026/10/01 10:41:48 INFO Vacuumed table table=pending_objects10262026/10/01 10:41:48 INFO Vacuumed table table=multipart_uploads10272026/10/01 10:41:48 INFO Vacuumed table table=closures10282026/10/01 10:41:48 INFO Vacuumed table table=objects1029--- PASS: TestGCSweepDeliversEachKeyOnce (2.86s)1030=== CONT TestGetExistingObjectsLocksRows1031--- PASS: TestGCEndsOnShutdown (2.93s)1032=== CONT TestGCBugBareHashReferences10332026/10/01 10:41:49 INFO Received uploads request method=POST path=/api/pending_closures1034--- PASS: TestTombstonedObjectOfferedWithoutWaiting (3.15s)1035=== CONT TestRegisterCompletedObjectNeedsPendingRow10362026/10/01 10:41:49 INFO Aborted multipart uploads count=0 kept=010372026/10/01 10:41:49 WARN Force mode enabled - objects will be deleted immediately without grace period10382026/10/01 10:41:49 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=010392026/10/01 10:41:49 INFO Vacuumed table table=pending_closures10402026/10/01 10:41:49 INFO Vacuumed table table=pending_objects10412026/10/01 10:41:49 INFO Vacuumed table table=multipart_uploads10422026/10/01 10:41:49 INFO Vacuumed table table=closures10432026/10/01 10:41:49 INFO Vacuumed table table=objects1044--- PASS: TestCommitRacingPendingCleanupKeepsObjects (3.63s)1045=== CONT TestGCAdvisoryLockBlocksConcurrentRun10462026/10/01 10:41:49 INFO Received uploads request method=POST path=/api/pending_closures10472026/10/01 10:41:49 INFO Aborted multipart uploads count=0 kept=010482026/10/01 10:41:49 WARN Force mode enabled - objects will be deleted immediately without grace period10492026/10/01 10:41:49 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=010502026/10/01 10:41:50 INFO Vacuumed table table=pending_closures10512026/10/01 10:41:50 INFO Vacuumed table table=pending_objects10522026/10/01 10:41:50 INFO Vacuumed table table=multipart_uploads10532026/10/01 10:41:50 INFO Vacuumed table table=closures10542026/10/01 10:41:50 INFO Vacuumed table table=objects1055--- PASS: TestGCSweepSkipsPendingObjects (3.30s)1056=== CONT TestSweepSkipsRowsLockedByPush10572026/10/01 10:41:50 INFO Received uploads request method=POST path=/api/pending_closures1058--- PASS: TestDeduplicatedObjectsRecordedAsPending (3.10s)1059=== CONT TestGracefulShutdownDrainsInflight10602026/10/01 10:41:50 INFO Starting HTTP server address=127.0.0.1:6453310612026/10/01 10:41:50 INFO Shutdown signal received, draining in-flight requests timeout=10s1062--- PASS: TestGracefulShutdownDrainsInflight (0.07s)1063=== CONT TestCacheConfigHandlerMaxNarSize1064--- PASS: TestCacheConfigHandlerMaxNarSize (0.00s)1065=== CONT TestGenerateLandingPage1066--- PASS: TestGenerateLandingPage (0.00s)1067=== CONT TestLeadElectsOneAndHandsOver10682026/10/01 10:41:50 INFO Received uploads request method=POST path=/api/pending_closures10692026/10/01 10:41:51 INFO Received uploads request method=POST path=/api/pending_closures1070--- PASS: TestPushWaitsForSweepHoldingRow (3.62s)1071=== CONT TestConnectWaitsForAPeerMigration10722026/10/01 10:41:51 INFO Aborted multipart uploads count=0 kept=010732026/10/01 10:41:51 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=010742026/10/01 10:41:51 INFO Vacuumed table table=pending_closures10752026/10/01 10:41:51 INFO Vacuumed table table=pending_objects10762026/10/01 10:41:51 INFO Vacuumed table table=multipart_uploads10772026/10/01 10:41:51 INFO Vacuumed table table=closures10782026/10/01 10:41:51 INFO Aborted multipart uploads count=0 kept=010792026/10/01 10:41:51 INFO Vacuumed table table=objects10802026/10/01 10:41:51 WARN Force mode enabled - objects will be deleted immediately without grace period10812026/10/01 10:41:51 INFO Aborted multipart uploads count=0 kept=010822026/10/01 10:41:51 WARN Force mode enabled - objects will be deleted immediately without grace period10832026/10/01 10:41:51 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=010842026/10/01 10:41:51 INFO Vacuumed table table=pending_closures10852026/10/01 10:41:51 INFO Vacuumed table table=pending_objects10862026/10/01 10:41:51 INFO Vacuumed table table=multipart_uploads10872026/10/01 10:41:51 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=010882026/10/01 10:41:51 INFO Vacuumed table table=closures10892026/10/01 10:41:51 INFO Vacuumed table table=objects1090--- PASS: TestPushDedupSurvivesConcurrentGC (3.78s)1091=== CONT TestResolveDBConnectionString10922026/10/01 10:41:51 INFO Vacuumed table table=pending_closures1093=== RUN TestResolveDBConnectionString/flag_wins1094=== PAUSE TestResolveDBConnectionString/flag_wins1095=== RUN TestResolveDBConnectionString/file_when_flag_empty1096=== PAUSE TestResolveDBConnectionString/file_when_flag_empty1097=== RUN TestResolveDBConnectionString/missing_file_is_an_error1098=== PAUSE TestResolveDBConnectionString/missing_file_is_an_error1099=== RUN TestResolveDBConnectionString/PGHOST_allows_empty1100=== PAUSE TestResolveDBConnectionString/PGHOST_allows_empty1101=== RUN TestResolveDBConnectionString/nothing_configured1102=== PAUSE TestResolveDBConnectionString/nothing_configured1103=== CONT TestConcurrentCommitsSharingObjectsDoNotDeadlock11042026/10/01 10:41:51 INFO Vacuumed table table=pending_objects11052026/10/01 10:41:51 INFO Vacuumed table table=multipart_uploads11062026/10/01 10:41:51 INFO Vacuumed table table=closures11072026/10/01 10:41:51 INFO Vacuumed table table=objects1108--- PASS: TestSweepRechecksPendingAfterLocking (3.64s)1109=== CONT TestClientFallsBackToClosures11102026/10/01 10:41:51 INFO Aborted multipart uploads count=0 kept=011112026/10/01 10:41:51 WARN Force mode enabled - objects will be deleted immediately without grace period11122026/10/01 10:41:51 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=011132026/10/01 10:41:51 INFO Vacuumed table table=pending_closures11142026/10/01 10:41:51 INFO Vacuumed table table=pending_objects11152026/10/01 10:41:51 INFO Vacuumed table table=multipart_uploads11162026/10/01 10:41:51 INFO Vacuumed table table=closures11172026/10/01 10:41:51 INFO Vacuumed table table=objects1118--- PASS: TestGCMetrics (3.70s)1119=== CONT TestClientPushesUseOnePush1120--- PASS: TestGetExistingObjectsLocksRows (3.56s)1121=== CONT TestPinProtectsFromGC1122{"timestamp":"2026-10-01T10:41:52.754Z","level":"ERROR","message":"Scanner cycle completed without a durable data usage snapshot","event":"scanner_persist_state","component":"scanner","subsystem":"runtime","cycle":3,"outcome":"NoUpdate","state":"usage_not_durable","target":"rustfs::scanner","filename":"crates/scanner/src/scanner.rs","line_number":2350,"threadName":"rustfs-worker","threadId":"ThreadId(10)"}1123--- PASS: TestGCBugBareHashReferences (4.06s)1124=== CONT TestClientSharedPathCommittedMidPush1125--- PASS: TestRegisterCompletedObjectNeedsPendingRow (3.74s)1126=== CONT TestClientWithDependencies1127--- PASS: TestGCAdvisoryLockBlocksConcurrentRun (3.46s)1128=== CONT TestClientMultipleUploads11292026/10/01 10:41:53 INFO Aborted multipart uploads count=0 kept=011302026/10/01 10:41:53 WARN Force mode enabled - objects will be deleted immediately without grace period11312026/10/01 10:41:53 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=011322026/10/01 10:41:53 INFO Vacuumed table table=pending_closures11332026/10/01 10:41:53 INFO Vacuumed table table=pending_objects11342026/10/01 10:41:53 INFO Vacuumed table table=multipart_uploads11352026/10/01 10:41:53 INFO Vacuumed table table=closures11362026/10/01 10:41:53 INFO Vacuumed table table=objects11372026/10/01 10:41:53 INFO Aborted multipart uploads count=0 kept=011382026/10/01 10:41:53 WARN Force mode enabled - objects will be deleted immediately without grace period11392026/10/01 10:41:53 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=011402026/10/01 10:41:53 INFO Vacuumed table table=pending_closures11412026/10/01 10:41:53 INFO Vacuumed table table=pending_objects11422026/10/01 10:41:53 INFO Vacuumed table table=multipart_uploads11432026/10/01 10:41:53 INFO Vacuumed table table=closures11442026/10/01 10:41:53 INFO Vacuumed table table=objects1145--- PASS: TestSweepSkipsRowsLockedByPush (3.61s)1146=== CONT TestClientIntegration11472026/10/01 10:41:53 INFO lead: acquired remote=192.0.2.1:123411482026/10/01 10:41:54 INFO lead: released remote=192.0.2.1:123411492026/10/01 10:41:54 INFO lead: acquired remote=192.0.2.1:123411502026/10/01 10:41:54 INFO lead: released remote=192.0.2.1:12341151--- PASS: TestLeadElectsOneAndHandsOver (3.60s)1152=== CONT TestClientErrorHandling1153=== RUN TestClientErrorHandling/InvalidStorePath1154=== PAUSE TestClientErrorHandling/InvalidStorePath1155=== RUN TestClientErrorHandling/InvalidAuthToken1156=== PAUSE TestClientErrorHandling/InvalidAuthToken1157=== RUN TestClientErrorHandling/ServerNotAvailable1158=== PAUSE TestClientErrorHandling/ServerNotAvailable1159=== CONT TestService_readinessHandler11602026/10/01 10:41:55 INFO Received uploads request method=POST path=/api/pending_closures11612026/10/01 10:41:55 INFO Received uploads request method=POST path=/api/pending_closures11622026/10/01 10:41:55 INFO Uploading 2 paths to 127.0.0.1 (1 already cached)11632026/10/01 10:41:55 INFO Uploading j6q3nin2vqzsal0caar1l3ij0km5kx9f-shared-dep (136B)11642026/10/01 10:41:55 INFO Uploading shq0bqj6gv010r7p2f1yy0ay9ljwdcsp-a (248B)11652026/10/01 10:41:55 WARN Failed to register uploaded object key=nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst error="server returned 404: 404 page not found\n"11662026/10/01 10:41:55 WARN Failed to register uploaded object key=shq0bqj6gv010r7p2f1yy0ay9ljwdcsp.ls error="server returned 404: 404 page not found\n"11672026/10/01 10:41:55 WARN Failed to register uploaded object key=j6q3nin2vqzsal0caar1l3ij0km5kx9f.ls error="server returned 404: 404 page not found\n"11682026/10/01 10:41:55 WARN Failed to register uploaded object key=mjipyv1srqdxb4vkc8khqpv2dnsfrw2m.ls error="server returned 404: 404 page not found\n"11692026/10/01 10:41:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign11702026/10/01 10:41:55 WARN Failed to register uploaded object key=nar/1vjmclji2fic93lgkalqj3ndfld25wvdyqmyf60fdqjqwpq8vvd5.nar.zst error="server returned 404: 404 page not found\n"11712026/10/01 10:41:55 INFO Signed narinfos id=1 count=211722026/10/01 10:41:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign11732026/10/01 10:41:55 INFO Signed narinfos id=2 count=211742026/10/01 10:41:55 INFO Uploading 4 narinfos11752026/10/01 10:41:55 WARN Failed to register uploaded object key=shq0bqj6gv010r7p2f1yy0ay9ljwdcsp.narinfo error="server returned 404: 404 page not found\n"11762026/10/01 10:41:55 WARN Failed to register uploaded object key=mjipyv1srqdxb4vkc8khqpv2dnsfrw2m.narinfo error="server returned 404: 404 page not found\n"11772026/10/01 10:41:55 WARN Failed to register uploaded object key=j6q3nin2vqzsal0caar1l3ij0km5kx9f.narinfo error="server returned 404: 404 page not found\n"11782026/10/01 10:41:55 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete11792026/10/01 10:41:55 WARN Failed to register uploaded object key=j6q3nin2vqzsal0caar1l3ij0km5kx9f.narinfo error="server returned 404: 404 page not found\n"11802026/10/01 10:41:55 INFO Completed upload id=111812026/10/01 10:41:55 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete11822026/10/01 10:41:55 INFO Completed upload id=211832026/10/01 10:41:55 INFO Upload complete. (196ms)1184=== NAME TestClientFallsBackToClosures1185 client_pushes_test.go:112: Retrieved narinfo from S3:1186 StorePath: /nix/var/nix/builds/nix-64170-818717140/TestClientFallsBackToClosures3388190430/001/store/j6q3nin2vqzsal0caar1l3ij0km5kx9f-shared-dep1187 URL: nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst1188 Compression: zstd1189 NarHash: sha256:1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y821190 NarSize: 1361191 References: 1192 CA: text:sha256:08nxw05k7b0pzzy0f3swvnw4ldxdbclkdnklpidwmrxdhvfrmv7n1193 client_pushes_test.go:112: Retrieved narinfo from S3:1194 StorePath: /nix/var/nix/builds/nix-64170-818717140/TestClientFallsBackToClosures3388190430/001/store/shq0bqj6gv010r7p2f1yy0ay9ljwdcsp-a1195 URL: nar/1vjmclji2fic93lgkalqj3ndfld25wvdyqmyf60fdqjqwpq8vvd5.nar.zst1196 Compression: zstd1197 NarHash: sha256:1vjmclji2fic93lgkalqj3ndfld25wvdyqmyf60fdqjqwpq8vvd51198 NarSize: 2481199 References: /nix/var/nix/builds/nix-64170-818717140/TestClientFallsBackToClosures3388190430/001/store/j6q3nin2vqzsal0caar1l3ij0km5kx9f-shared-dep1200 CA: text:sha256:0s2767jpaq519gsdd2qvzj4pgrn9m4v93x4xhq9vs3hv72pj1ysi1201 client_pushes_test.go:112: Retrieved narinfo from S3:1202 StorePath: /nix/var/nix/builds/nix-64170-818717140/TestClientFallsBackToClosures3388190430/001/store/mjipyv1srqdxb4vkc8khqpv2dnsfrw2m-b1203 URL: nar/1vjmclji2fic93lgkalqj3ndfld25wvdyqmyf60fdqjqwpq8vvd5.nar.zst1204 Compression: zstd1205 NarHash: sha256:1vjmclji2fic93lgkalqj3ndfld25wvdyqmyf60fdqjqwpq8vvd51206 NarSize: 2481207 References: /nix/var/nix/builds/nix-64170-818717140/TestClientFallsBackToClosures3388190430/001/store/j6q3nin2vqzsal0caar1l3ij0km5kx9f-shared-dep1208 CA: text:sha256:0s2767jpaq519gsdd2qvzj4pgrn9m4v93x4xhq9vs3hv72pj1ysi12092026/10/01 10:41:55 INFO Received push request method=POST path=/api/pushes12102026/10/01 10:41:55 INFO Uploading 2 paths to 127.0.0.1 (1 already cached)12112026/10/01 10:41:55 INFO Uploading 6m2vf11c8v4496zk4q5919z1jvwlzx6m-a (248B)12122026/10/01 10:41:55 INFO Uploading 475lr5vg0bjsg2dv160wsx8jvb007w5a-shared-dep (136B)12132026/10/01 10:41:55 WARN Failed to register uploaded object key=3gxcflnzh4619kavdpnn1aag86iqk5cx.ls error="server returned 404: 404 page not found\n"1214--- PASS: TestClientFallsBackToClosures (3.86s)1215=== CONT TestClientCADerivations12162026/10/01 10:41:55 WARN Failed to register uploaded object key=475lr5vg0bjsg2dv160wsx8jvb007w5a.ls error="server returned 404: 404 page not found\n"12172026/10/01 10:41:55 WARN Failed to register uploaded object key=nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst error="server returned 404: 404 page not found\n"12182026/10/01 10:41:55 WARN Failed to register uploaded object key=nar/01q19vww0xs1diarnj6j4iv00wl5kv69xgvx8c0ccg97x9klyf0p.nar.zst error="server returned 404: 404 page not found\n"12192026/10/01 10:41:55 WARN Failed to register uploaded object key=6m2vf11c8v4496zk4q5919z1jvwlzx6m.ls error="server returned 404: 404 page not found\n"12202026/10/01 10:41:55 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign12212026/10/01 10:41:55 INFO Signed narinfos id=1 count=312222026/10/01 10:41:55 INFO Uploading 3 narinfos12232026/10/01 10:41:55 WARN Failed to register uploaded object key=475lr5vg0bjsg2dv160wsx8jvb007w5a.narinfo error="server returned 404: 404 page not found\n"12242026/10/01 10:41:55 WARN Failed to register uploaded object key=3gxcflnzh4619kavdpnn1aag86iqk5cx.narinfo error="server returned 404: 404 page not found\n"12252026/10/01 10:41:55 INFO Received complete push request method=POST path=/api/pushes/1/complete12262026/10/01 10:41:55 WARN Failed to register uploaded object key=6m2vf11c8v4496zk4q5919z1jvwlzx6m.narinfo error="server returned 404: 404 page not found\n"12272026/10/01 10:41:55 INFO Upload complete. (183ms)1228=== NAME TestClientPushesUseOnePush1229 client_pushes_test.go:97: Retrieved narinfo from S3:1230 StorePath: /nix/var/nix/builds/nix-64170-818717140/TestClientPushesUseOnePush3503928741/001/store/475lr5vg0bjsg2dv160wsx8jvb007w5a-shared-dep1231 URL: nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst1232 Compression: zstd1233 NarHash: sha256:1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y821234 NarSize: 1361235 References: 1236 CA: text:sha256:08nxw05k7b0pzzy0f3swvnw4ldxdbclkdnklpidwmrxdhvfrmv7n1237 client_pushes_test.go:97: Retrieved narinfo from S3:1238 StorePath: /nix/var/nix/builds/nix-64170-818717140/TestClientPushesUseOnePush3503928741/001/store/6m2vf11c8v4496zk4q5919z1jvwlzx6m-a1239 URL: nar/01q19vww0xs1diarnj6j4iv00wl5kv69xgvx8c0ccg97x9klyf0p.nar.zst1240 Compression: zstd1241 NarHash: sha256:01q19vww0xs1diarnj6j4iv00wl5kv69xgvx8c0ccg97x9klyf0p1242 NarSize: 2481243 References: /nix/var/nix/builds/nix-64170-818717140/TestClientPushesUseOnePush3503928741/001/store/475lr5vg0bjsg2dv160wsx8jvb007w5a-shared-dep1244 CA: text:sha256:17pcfyccpavd0lkxqpchlmh03m6ml7nalg8yc9j6mfygfa79vpab1245 client_pushes_test.go:97: Retrieved narinfo from S3:1246 StorePath: /nix/var/nix/builds/nix-64170-818717140/TestClientPushesUseOnePush3503928741/001/store/3gxcflnzh4619kavdpnn1aag86iqk5cx-b1247 URL: nar/01q19vww0xs1diarnj6j4iv00wl5kv69xgvx8c0ccg97x9klyf0p.nar.zst1248 Compression: zstd1249 NarHash: sha256:01q19vww0xs1diarnj6j4iv00wl5kv69xgvx8c0ccg97x9klyf0p1250 NarSize: 2481251 References: /nix/var/nix/builds/nix-64170-818717140/TestClientPushesUseOnePush3503928741/001/store/475lr5vg0bjsg2dv160wsx8jvb007w5a-shared-dep1252 CA: text:sha256:17pcfyccpavd0lkxqpchlmh03m6ml7nalg8yc9j6mfygfa79vpab1253--- PASS: TestClientPushesUseOnePush (3.86s)1254=== CONT TestCacheStatsHandler1255=== NAME TestPinProtectsFromGC1256 client_integration_test.go:731: Pinned store path: /nix/var/nix/builds/nix-64170-818717140/TestPinProtectsFromGC145462170/001/store/dwkm1hcqlqfzmg4l36a24gnbqma6fdsy-pinned-file.txt1257 client_integration_test.go:732: Unpinned store path: /nix/var/nix/builds/nix-64170-818717140/TestPinProtectsFromGC145462170/001/store/hpg8ml4d62arfp8wjcmc1j6vn6rcgrw0-unpinned-file.txt12582026/10/01 10:41:55 INFO Received push request method=POST path=/api/pushes12592026/10/01 10:41:55 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)12602026/10/01 10:41:55 INFO Uploading dwkm1hcqlqfzmg4l36a24gnbqma6fdsy-pinned-file.txt (128B)12612026/10/01 10:41:55 WARN Failed to register uploaded object key=dwkm1hcqlqfzmg4l36a24gnbqma6fdsy.ls error="server returned 404: 404 page not found\n"12622026/10/01 10:41:55 WARN Failed to register uploaded object key=nar/0qmhsg42pqsz7x6hh02j8gznnac3yi3qpjhrqbwvz88i194jbb5s.nar.zst error="server returned 404: 404 page not found\n"12632026/10/01 10:41:55 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign12642026/10/01 10:41:55 INFO Signed narinfos id=1 count=112652026/10/01 10:41:55 INFO Uploading 1 narinfos12662026/10/01 10:41:55 INFO Received complete push request method=POST path=/api/pushes/1/complete12672026/10/01 10:41:55 WARN Failed to register uploaded object key=dwkm1hcqlqfzmg4l36a24gnbqma6fdsy.narinfo error="server returned 404: 404 page not found\n"12682026/10/01 10:41:56 INFO Upload complete. (175ms)1269--- PASS: TestConcurrentCommitsSharingObjectsDoNotDeadlock (4.30s)1270=== CONT TestService_healthCheckHandler12712026/10/01 10:41:56 INFO Received push request method=POST path=/api/pushes12722026/10/01 10:41:56 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)12732026/10/01 10:41:56 INFO Uploading hpg8ml4d62arfp8wjcmc1j6vn6rcgrw0-unpinned-file.txt (128B)12742026/10/01 10:41:56 WARN Failed to register uploaded object key=hpg8ml4d62arfp8wjcmc1j6vn6rcgrw0.ls error="server returned 404: 404 page not found\n"12752026/10/01 10:41:56 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign12762026/10/01 10:41:56 INFO Signed narinfos id=2 count=112772026/10/01 10:41:56 WARN Failed to register uploaded object key=nar/0gh0wdnr6gmk4r5sfzzh12isnl14rgmkrwy1ws41hpsrlndclg5h.nar.zst error="server returned 404: 404 page not found\n"12782026/10/01 10:41:56 INFO Uploading 1 narinfos12792026/10/01 10:41:56 INFO Received complete push request method=POST path=/api/pushes/2/complete12802026/10/01 10:41:56 WARN Failed to register uploaded object key=hpg8ml4d62arfp8wjcmc1j6vn6rcgrw0.narinfo error="server returned 404: 404 page not found\n"12812026/10/01 10:41:56 INFO Upload complete. (89ms)12822026/10/01 10:41:56 INFO Starting cleanup of old closures method=DELETE path=/api/closures12832026/10/01 10:41:56 INFO Garbage collection started12842026/10/01 10:41:56 INFO Aborted multipart uploads count=0 kept=012852026/10/01 10:41:56 WARN Force mode enabled - objects will be deleted immediately without grace period12862026/10/01 10:41:56 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=3 objects-deleted-after-grace-period=3 objects-failed-to-delete=012872026/10/01 10:41:56 INFO Vacuumed table table=pending_closures12882026/10/01 10:41:56 INFO Received push request method=POST path=/api/pushes12892026/10/01 10:41:56 INFO Vacuumed table table=pending_objects12902026/10/01 10:41:56 INFO Vacuumed table table=multipart_uploads12912026/10/01 10:41:56 INFO Uploading 2 paths to 127.0.0.1 (0 already cached)12922026/10/01 10:41:56 INFO Uploading myhqz0lrz4q8a36wzxixr7nsgqa9mis2-top (256B)12932026/10/01 10:41:56 INFO Uploading cxw9x6cjm7q92gni5a1z68bxrvfwmnm3-shared-dep (136B)12942026/10/01 10:41:56 WARN Failed to register uploaded object key=nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst error="server returned 404: 404 page not found\n"12952026/10/01 10:41:56 WARN Failed to register uploaded object key=cxw9x6cjm7q92gni5a1z68bxrvfwmnm3.ls error="server returned 404: 404 page not found\n"12962026/10/01 10:41:56 WARN Failed to register uploaded object key=nar/16wwzq5iijm147zvixgfpmbm593kqra27n0aw09y7hrs57d9vbg0.nar.zst error="server returned 404: 404 page not found\n"12972026/10/01 10:41:56 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign12982026/10/01 10:41:56 WARN Failed to register uploaded object key=myhqz0lrz4q8a36wzxixr7nsgqa9mis2.ls error="server returned 404: 404 page not found\n"12992026/10/01 10:41:56 INFO Signed narinfos id=1 count=213002026/10/01 10:41:56 INFO Uploading 2 narinfos13012026/10/01 10:41:56 INFO Vacuumed table table=closures13022026/10/01 10:41:56 WARN Failed to register uploaded object key=myhqz0lrz4q8a36wzxixr7nsgqa9mis2.narinfo error="server returned 404: 404 page not found\n"13032026/10/01 10:41:56 INFO Received complete push request method=POST path=/api/pushes/1/complete13042026/10/01 10:41:56 WARN Failed to register uploaded object key=cxw9x6cjm7q92gni5a1z68bxrvfwmnm3.narinfo error="server returned 404: 404 page not found\n"13052026/10/01 10:41:56 INFO Vacuumed table table=objects13062026/10/01 10:41:56 INFO Upload complete. (144ms)1307=== NAME TestClientSharedPathCommittedMidPush1308 client_integration_test.go:680: Retrieved narinfo from S3:1309 StorePath: /nix/var/nix/builds/nix-64170-818717140/TestClientSharedPathCommittedMidPush3325488489/001/store/cxw9x6cjm7q92gni5a1z68bxrvfwmnm3-shared-dep1310 URL: nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst1311 Compression: zstd1312 NarHash: sha256:1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y821313 NarSize: 1361314 References: 1315 CA: text:sha256:08nxw05k7b0pzzy0f3swvnw4ldxdbclkdnklpidwmrxdhvfrmv7n1316 client_integration_test.go:680: Retrieved narinfo from S3:1317 StorePath: /nix/var/nix/builds/nix-64170-818717140/TestClientSharedPathCommittedMidPush3325488489/001/store/myhqz0lrz4q8a36wzxixr7nsgqa9mis2-top1318 URL: nar/16wwzq5iijm147zvixgfpmbm593kqra27n0aw09y7hrs57d9vbg0.nar.zst1319 Compression: zstd1320 NarHash: sha256:16wwzq5iijm147zvixgfpmbm593kqra27n0aw09y7hrs57d9vbg01321 NarSize: 2561322 References: /nix/var/nix/builds/nix-64170-818717140/TestClientSharedPathCommittedMidPush3325488489/001/store/cxw9x6cjm7q92gni5a1z68bxrvfwmnm3-shared-dep1323 CA: text:sha256:1wdnwckpzldn0x2ac0zy5dpjzpb22d4anhjqf6zlxgcl1lc5m2r21324--- PASS: TestClientSharedPathCommittedMidPush (3.58s)1325=== CONT TestCacheConfigHandler1326=== RUN TestCacheConfigHandler/full_config,_no_issuer1327=== PAUSE TestCacheConfigHandler/full_config,_no_issuer1328=== RUN TestCacheConfigHandler/no_cache_url_configured1329=== PAUSE TestCacheConfigHandler/no_cache_url_configured1330=== RUN TestCacheConfigHandler/no_signing_keys1331=== PAUSE TestCacheConfigHandler/no_signing_keys1332=== RUN TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator1333=== PAUSE TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator1334=== CONT TestService_ReadAuthMiddleware1335=== NAME TestClientWithDependencies1336 client_integration_test.go:613: Built derivation: /nix/var/nix/builds/nix-64170-818717140/TestClientWithDependencies1031716675/001/store/b00h4068gnl0hkvn8zs078vi9k6dv68z-test-script1337 client_integration_test.go:615: Found 1 dependencies (including self)1338=== NAME TestClientMultipleUploads1339 client_integration_test.go:358: Created store path 0: /nix/var/nix/builds/nix-64170-818717140/TestClientMultipleUploads2681810552/001/store/b1653c6k6b3r6rfmxq9x0c4l67n9ik89-test-file-0.txt13402026/10/01 10:41:56 INFO Received push request method=POST path=/api/pushes13412026/10/01 10:41:56 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)13422026/10/01 10:41:56 INFO Uploading b00h4068gnl0hkvn8zs078vi9k6dv68z-test-script (136B)13432026/10/01 10:41:56 WARN Failed to register uploaded object key=b00h4068gnl0hkvn8zs078vi9k6dv68z.ls error="server returned 404: 404 page not found\n"1344 client_integration_test.go:358: Created store path 1: /nix/var/nix/builds/nix-64170-818717140/TestClientMultipleUploads2681810552/001/store/rkqkn7qi17yqnf6qgg6b922g0zq0hqbf-test-file-1.txt13452026/10/01 10:41:56 WARN Failed to register uploaded object key=log/59zg8z5mcy4344axcknm89k4ic6yishq-test-script.drv error="server returned 404: 404 page not found\n"13462026/10/01 10:41:56 WARN Failed to register uploaded object key=nar/1s7yghixzpinyqm7g59kyn3sav81pmnsdi5v63m6x4r2vacy907j.nar.zst error="server returned 404: 404 page not found\n"13472026/10/01 10:41:56 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign13482026/10/01 10:41:56 INFO Signed narinfos id=1 count=113492026/10/01 10:41:56 INFO Uploading 1 narinfos13502026/10/01 10:41:56 INFO Received complete push request method=POST path=/api/pushes/1/complete13512026/10/01 10:41:56 WARN Failed to register uploaded object key=b00h4068gnl0hkvn8zs078vi9k6dv68z.narinfo error="server returned 404: 404 page not found\n"13522026/10/01 10:41:56 INFO Upload complete. (176ms)1353=== NAME TestClientWithDependencies1354 client_integration_test.go:617: Skipping nix copy test - isolated store (/nix/var/nix/builds/nix-64170-818717140/TestClientWithDependencies1031716675/001/store) requires matching store prefix1355=== NAME TestClientMultipleUploads1356 client_integration_test.go:358: Created store path 2: /nix/var/nix/builds/nix-64170-818717140/TestClientMultipleUploads2681810552/001/store/4rf48zfwd1a1aqwhs86kmbda33vlhxs8-test-file-2.txt1357--- PASS: TestClientWithDependencies (4.01s)1358=== CONT TestService_AuthMiddleware_MTLSBoundSubjects1359=== NAME TestClientIntegration1360 client_integration_test.go:286: Created store path: /nix/var/nix/builds/nix-64170-818717140/TestClientIntegration3765902013/002/store/w3zmr8inz505fv3ixzqccz2qi8s7q3lk-test-file.txt13612026/10/01 10:41:56 INFO Received push request method=POST path=/api/pushes13622026/10/01 10:41:56 INFO Uploading 3 paths to 127.0.0.1 (0 already cached)13632026/10/01 10:41:56 INFO Uploading 4rf48zfwd1a1aqwhs86kmbda33vlhxs8-test-file-2.txt (160B)13642026/10/01 10:41:56 INFO Uploading rkqkn7qi17yqnf6qgg6b922g0zq0hqbf-test-file-1.txt (160B)13652026/10/01 10:41:56 INFO Uploading b1653c6k6b3r6rfmxq9x0c4l67n9ik89-test-file-0.txt (160B)13662026/10/01 10:41:56 WARN Failed to register uploaded object key=4rf48zfwd1a1aqwhs86kmbda33vlhxs8.ls error="server returned 404: 404 page not found\n"13672026/10/01 10:41:56 WARN Failed to register uploaded object key=nar/0ahq3izw3h0b0c08p3xdfclh758fwxnp85ccvflasb4vnfsv50ri.nar.zst error="server returned 404: 404 page not found\n"13682026/10/01 10:41:56 WARN Failed to register uploaded object key=b1653c6k6b3r6rfmxq9x0c4l67n9ik89.ls error="server returned 404: 404 page not found\n"13692026/10/01 10:41:56 WARN Failed to register uploaded object key=rkqkn7qi17yqnf6qgg6b922g0zq0hqbf.ls error="server returned 404: 404 page not found\n"13702026/10/01 10:41:56 WARN Failed to register uploaded object key=nar/13p9pqi0ga6fx2apcwls9hjnv7nmf740ggpn5zvfzdsp5vz2bbg4.nar.zst error="server returned 404: 404 page not found\n"13712026/10/01 10:41:56 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign13722026/10/01 10:41:56 WARN Failed to register uploaded object key=nar/1823g6vx4q5zqvr73m7lkq1wpk40fin7bsc792di430yk7sg4lka.nar.zst error="server returned 404: 404 page not found\n"13732026/10/01 10:41:56 INFO Signed narinfos id=1 count=313742026/10/01 10:41:56 INFO Uploading 3 narinfos13752026/10/01 10:41:56 WARN Failed to register uploaded object key=rkqkn7qi17yqnf6qgg6b922g0zq0hqbf.narinfo error="server returned 404: 404 page not found\n"13762026/10/01 10:41:56 WARN Failed to register uploaded object key=b1653c6k6b3r6rfmxq9x0c4l67n9ik89.narinfo error="server returned 404: 404 page not found\n"13772026/10/01 10:41:56 INFO Received complete push request method=POST path=/api/pushes/1/complete13782026/10/01 10:41:56 WARN Failed to register uploaded object key=4rf48zfwd1a1aqwhs86kmbda33vlhxs8.narinfo error="server returned 404: 404 page not found\n"13792026/10/01 10:41:56 WARN readiness check failed error="closed pool"1380--- PASS: TestService_readinessHandler (2.89s)1381=== CONT TestService_AuthMiddleware_MTLSProxyHeader13822026/10/01 10:41:57 INFO Upload complete. (132ms)1383=== NAME TestClientMultipleUploads1384 client_integration_test.go:369: Uploaded 3 paths in 167.875667ms13852026/10/01 10:41:57 INFO Received push request method=POST path=/api/pushes13862026/10/01 10:41:57 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)13872026/10/01 10:41:57 INFO Uploading w3zmr8inz505fv3ixzqccz2qi8s7q3lk-test-file.txt (152B)13882026/10/01 10:41:57 WARN Failed to register uploaded object key=w3zmr8inz505fv3ixzqccz2qi8s7q3lk.ls error="server returned 404: 404 page not found\n"13892026/10/01 10:41:57 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign13902026/10/01 10:41:57 WARN Failed to register uploaded object key=nar/11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk1.nar.zst error="server returned 404: 404 page not found\n"13912026/10/01 10:41:57 INFO Signed narinfos id=1 count=113922026/10/01 10:41:57 INFO Uploading 1 narinfos13932026/10/01 10:41:57 INFO Received complete push request method=POST path=/api/pushes/1/complete13942026/10/01 10:41:57 WARN Failed to register uploaded object key=w3zmr8inz505fv3ixzqccz2qi8s7q3lk.narinfo error="server returned 404: 404 page not found\n"13952026/10/01 10:41:57 INFO Upload complete. (136ms)1396--- PASS: TestClientMultipleUploads (3.95s)1397=== CONT TestService_AuthMiddleware_OIDC13982026/10/01 10:41:57 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:64657/oidc13992026/10/01 10:41:57 INFO All 1 paths already cached1400=== NAME TestClientIntegration1401 client_integration_test.go:312: Retrieved narinfo from S3:1402 StorePath: /nix/var/nix/builds/nix-64170-818717140/TestClientIntegration3765902013/002/store/w3zmr8inz505fv3ixzqccz2qi8s7q3lk-test-file.txt1403 URL: nar/11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk1.nar.zst1404 Compression: zstd1405 NarHash: sha256:11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk11406 NarSize: 1521407 References: 1408 CA: fixed:r:sha256:11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk11409 client_integration_test.go:313: Retrieved .ls file from S3 (compressed size: 77 bytes)1410 client_integration_test.go:313: Decompressed .ls content (64 bytes):1411 {"version":1,"root":{"type":"regular","size":39,"narOffset":96}}1412 client_integration_test.go:316: Testing garbage collection...14132026/10/01 10:41:57 INFO Starting cleanup of old closures method=DELETE path=/api/closures14142026/10/01 10:41:57 INFO Garbage collection started14152026/10/01 10:41:57 INFO Aborted multipart uploads count=0 kept=014162026/10/01 10:41:57 WARN Force mode enabled - objects will be deleted immediately without grace period14172026/10/01 10:41:57 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=3 objects-deleted-after-grace-period=3 objects-failed-to-delete=014182026/10/01 10:41:57 INFO Vacuumed table table=pending_closures14192026/10/01 10:41:57 INFO Vacuumed table table=pending_objects14202026/10/01 10:41:57 INFO Vacuumed table table=multipart_uploads14212026/10/01 10:41:57 INFO Vacuumed table table=closures14222026/10/01 10:41:57 INFO Vacuumed table table=objects1423--- PASS: TestCacheStatsHandler (1.96s)1424=== CONT TestGCTaskStore_CompletedAllowsNewTask1425--- PASS: TestGCTaskStore_CompletedAllowsNewTask (0.00s)1426=== CONT TestService_ReadScope_PublicByDefault14272026/10/01 10:41:58 INFO Garbage collection progress phase="" failed_uploads_deleted=0 old_closures_deleted=1 objects_marked=3 objects_deleted=3 objects_failed=014282026/10/01 10:41:58 INFO Received create pin request method=POST path=/api/pins/myapp14292026/10/01 10:41:58 INFO Created/updated pin name=myapp store_path=/nix/var/nix/builds/nix-64170-818717140/TestPinProtectsFromGC145462170/001/store/dwkm1hcqlqfzmg4l36a24gnbqma6fdsy-pinned-file.txt narinfo_key=dwkm1hcqlqfzmg4l36a24gnbqma6fdsy.narinfo14302026/10/01 10:41:58 INFO Starting cleanup of old closures method=DELETE path=/api/closures14312026/10/01 10:41:58 INFO Garbage collection started14322026/10/01 10:41:58 INFO Aborted multipart uploads count=0 kept=014332026/10/01 10:41:58 WARN Force mode enabled - objects will be deleted immediately without grace period14342026/10/01 10:41:58 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=014352026/10/01 10:41:58 INFO Vacuumed table table=pending_closures14362026/10/01 10:41:58 INFO Vacuumed table table=pending_objects14372026/10/01 10:41:58 INFO Vacuumed table table=multipart_uploads14382026/10/01 10:41:58 INFO Vacuumed table table=closures14392026/10/01 10:41:58 INFO Vacuumed table table=objects1440--- PASS: TestService_healthCheckHandler (2.30s)1441=== CONT TestGCTaskStore_Fail1442--- PASS: TestGCTaskStore_Fail (0.00s)1443=== CONT TestService_RequireScope_OIDC14442026/10/01 10:41:58 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:64668/oidc1445=== NAME TestClientCADerivations1446 client_ca_test.go:136: Built CA derivation: /nix/var/nix/builds/nix-64170-818717140/TestClientCADerivations4071433758/001/store/fp3wdgk418ikzch0va3bq85jx8l97x9v-ca-test1447--- PASS: TestService_ReadAuthMiddleware (2.16s)1448=== CONT TestGCTaskStore_PhaseUpdates1449--- PASS: TestGCTaskStore_PhaseUpdates (0.00s)1450=== CONT TestReadProxyNarinfo1451=== NAME TestClientCADerivations1452 client_ca_test.go:139: Found 1 dependencies (including self)14532026/10/01 10:41:58 INFO Received push request method=POST path=/api/pushes1454--- PASS: TestService_AuthMiddleware_MTLSProxyHeader (1.77s)1455=== CONT TestParseSingleRange1456=== RUN TestParseSingleRange/none1457=== PAUSE TestParseSingleRange/none1458=== RUN TestParseSingleRange/unknown_unit1459=== PAUSE TestParseSingleRange/unknown_unit1460=== RUN TestParseSingleRange/multi-range_ignored1461=== PAUSE TestParseSingleRange/multi-range_ignored1462=== RUN TestParseSingleRange/malformed_no_dash1463=== PAUSE TestParseSingleRange/malformed_no_dash1464=== RUN TestParseSingleRange/malformed_both_empty1465=== PAUSE TestParseSingleRange/malformed_both_empty1466=== RUN TestParseSingleRange/malformed_end_before_start1467=== PAUSE TestParseSingleRange/malformed_end_before_start1468=== RUN TestParseSingleRange/closed1469=== PAUSE TestParseSingleRange/closed1470=== RUN TestParseSingleRange/open-ended1471=== PAUSE TestParseSingleRange/open-ended1472=== RUN TestParseSingleRange/end_clamped_to_size1473=== PAUSE TestParseSingleRange/end_clamped_to_size1474=== RUN TestParseSingleRange/suffix1475=== PAUSE TestParseSingleRange/suffix1476=== RUN TestParseSingleRange/suffix_exceeds_size1477=== PAUSE TestParseSingleRange/suffix_exceeds_size1478=== RUN TestParseSingleRange/single_byte1479=== PAUSE TestParseSingleRange/single_byte1480=== RUN TestParseSingleRange/start_past_EOF1481=== PAUSE TestParseSingleRange/start_past_EOF1482=== RUN TestParseSingleRange/start_far_past_EOF1483=== PAUSE TestParseSingleRange/start_far_past_EOF1484=== CONT TestReadProxyInvalidPath14852026/10/01 10:41:58 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)14862026/10/01 10:41:58 INFO Uploading fp3wdgk418ikzch0va3bq85jx8l97x9v-ca-test (144B)14872026/10/01 10:41:58 WARN Failed to register uploaded object key=fp3wdgk418ikzch0va3bq85jx8l97x9v.ls error="server returned 404: 404 page not found\n"14882026/10/01 10:41:58 WARN Failed to register uploaded object key=nar/04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n.nar.zst error="server returned 404: 404 page not found\n"14892026/10/01 10:41:58 WARN Failed to register uploaded object key=log/rg4bsp60zsnzqpwrp0h74fh5698mdr4w-ca-test.drv error="server returned 404: 404 page not found\n"14902026/10/01 10:41:58 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign14912026/10/01 10:41:58 INFO Signed narinfos id=1 count=114922026/10/01 10:41:58 INFO Uploading 1 narinfos14932026/10/01 10:41:58 INFO Received complete push request method=POST path=/api/pushes/1/complete14942026/10/01 10:41:58 WARN Failed to register uploaded object key=fp3wdgk418ikzch0va3bq85jx8l97x9v.narinfo error="server returned 404: 404 page not found\n"14952026/10/01 10:41:58 INFO Upload complete. (304ms)1496=== NAME TestClientCADerivations1497 client_ca_test.go:180: Narinfo contains CA field: StorePath: /nix/var/nix/builds/nix-64170-818717140/TestClientCADerivations4071433758/001/store/fp3wdgk418ikzch0va3bq85jx8l97x9v-ca-test1498 URL: nar/04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n.nar.zst1499 Compression: zstd1500 NarHash: sha256:04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n1501 NarSize: 1441502 References: 1503 Deriver: /nix/var/nix/builds/nix-64170-818717140/TestClientCADerivations4071433758/001/store/rg4bsp60zsnzqpwrp0h74fh5698mdr4w-ca-test.drv1504 CA: fixed:r:sha256:04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n1505 client_ca_test.go:185: Checking for realisation files in S3...1506 client_ca_test.go:207: No realisation files uploaded - this is expected for locally built CA derivations1507 client_ca_test.go:208: Locally built CA derivations don't have DrvOutput IDs until they're substituted from a cache1508{"timestamp":"2026-10-01T10:41:59.015288Z","level":"ERROR","message":"Scanner cycle completed without a durable data usage snapshot","event":"scanner_persist_state","component":"scanner","subsystem":"runtime","cycle":3,"outcome":"NoUpdate","state":"usage_not_durable","target":"rustfs::scanner","filename":"crates/scanner/src/scanner.rs","line_number":2350,"threadName":"rustfs-worker","threadId":"ThreadId(11)"}15092026/10/01 10:41:59 WARN mTLS auth: subject not in bound subjects subject="CN=untrusted,O=Other"15102026/10/01 10:41:59 WARN mTLS auth: bound subjects configured but subject DN unavailable15112026/10/01 10:41:59 WARN mTLS auth: subject not in bound subjects subject="CN=untrusted"1512--- PASS: TestService_AuthMiddleware_MTLSBoundSubjects (2.14s)1513=== CONT TestIsValidCachePath1514=== RUN TestIsValidCachePath/narinfo1515=== PAUSE TestIsValidCachePath/narinfo1516=== RUN TestIsValidCachePath/narinfo_all_nix_base32_chars1517=== PAUSE TestIsValidCachePath/narinfo_all_nix_base32_chars1518=== RUN TestIsValidCachePath/nar_zst1519=== PAUSE TestIsValidCachePath/nar_zst1520=== RUN TestIsValidCachePath/nar_xz1521=== PAUSE TestIsValidCachePath/nar_xz1522=== RUN TestIsValidCachePath/nar_bz21523=== PAUSE TestIsValidCachePath/nar_bz21524=== RUN TestIsValidCachePath/nar_uncompressed1525=== PAUSE TestIsValidCachePath/nar_uncompressed1526=== RUN TestIsValidCachePath/ls1527=== PAUSE TestIsValidCachePath/ls1528=== RUN TestIsValidCachePath/log1529=== PAUSE TestIsValidCachePath/log1530=== RUN TestIsValidCachePath/realisation1531=== PAUSE TestIsValidCachePath/realisation1532=== RUN TestIsValidCachePath/nix-cache-info1533=== PAUSE TestIsValidCachePath/nix-cache-info1534=== RUN TestIsValidCachePath/index.html1535=== PAUSE TestIsValidCachePath/index.html1536=== RUN TestIsValidCachePath/traversal_parent1537=== PAUSE TestIsValidCachePath/traversal_parent1538=== RUN TestIsValidCachePath/traversal_in_middle1539=== PAUSE TestIsValidCachePath/traversal_in_middle1540=== RUN TestIsValidCachePath/invalid_char_e1541=== PAUSE TestIsValidCachePath/invalid_char_e1542=== RUN TestIsValidCachePath/invalid_char_u1543=== PAUSE TestIsValidCachePath/invalid_char_u1544=== RUN TestIsValidCachePath/random_path1545=== PAUSE TestIsValidCachePath/random_path1546=== RUN TestIsValidCachePath/empty1547=== PAUSE TestIsValidCachePath/empty1548=== RUN TestIsValidCachePath/leading_slash1549=== PAUSE TestIsValidCachePath/leading_slash1550=== RUN TestIsValidCachePath/wrong_extension1551=== PAUSE TestIsValidCachePath/wrong_extension1552=== RUN TestIsValidCachePath/short_hash1553=== PAUSE TestIsValidCachePath/short_hash1554=== CONT TestReadProxy4041555=== NAME TestClientCADerivations1556 client_ca_test.go:258: nix copy output: error: binary cache 's3://bucket63?endpoint=http://localhost:64376®ion=eu-west-1' is for Nix stores with prefix '/nix/store', not '/nix/var/nix/builds/nix-64170-818717140/TestClientCADerivations4071433758/001/store'1557 client_ca_test.go:259: nix copy failed (might be expected with isolated stores): exit status 11558--- PASS: TestClientCADerivations (3.51s)1559=== CONT TestProxyHeadersOnlyTrustedOnSocket15602026/10/01 10:41:59 INFO Garbage collection progress phase="" failed_uploads_deleted=0 old_closures_deleted=1 objects_marked=3 objects_deleted=3 objects_failed=01561=== NAME TestClientIntegration1562 client_integration_test.go:323: Objects in database after GC:1563 client_integration_test.go:323: Successfully deleted all objects with GC --force1564--- PASS: TestClientIntegration (5.53s)1565=== CONT TestReadProxyNarStreaming1566--- PASS: TestConnectWaitsForAPeerMigration (7.96s)1567=== CONT TestReadProxyNarinfoAlreadyDecompressed1568=== RUN TestService_AuthMiddleware_OIDC/valid_OIDC_token1569=== PAUSE TestService_AuthMiddleware_OIDC/valid_OIDC_token1570=== RUN TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected1571=== PAUSE TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected1572=== RUN TestService_AuthMiddleware_OIDC/malformed_token_rejected1573=== PAUSE TestService_AuthMiddleware_OIDC/malformed_token_rejected1574=== RUN TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured1575=== PAUSE TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured1576=== CONT TestPresentNotReportedWhileGCDeletesClosure1577--- PASS: TestService_ReadScope_PublicByDefault (1.86s)1578=== CONT TestReadProxyRootRedirectsToIndexHTML1579=== RUN TestService_RequireScope_OIDC/builder_may_write1580=== PAUSE TestService_RequireScope_OIDC/builder_may_write1581=== RUN TestService_RequireScope_OIDC/builder_may_not_admin1582=== PAUSE TestService_RequireScope_OIDC/builder_may_not_admin1583=== RUN TestService_RequireScope_OIDC/ops_may_admin1584=== PAUSE TestService_RequireScope_OIDC/ops_may_admin1585=== RUN TestService_RequireScope_OIDC/ops_may_not_write1586=== PAUSE TestService_RequireScope_OIDC/ops_may_not_write1587=== RUN TestService_RequireScope_OIDC/reader_may_not_write1588=== PAUSE TestService_RequireScope_OIDC/reader_may_not_write1589=== RUN TestService_RequireScope_OIDC/static_token_may_admin1590=== PAUSE TestService_RequireScope_OIDC/static_token_may_admin1591=== RUN TestService_RequireScope_OIDC/static_token_may_write1592=== PAUSE TestService_RequireScope_OIDC/static_token_may_write1593=== RUN TestService_RequireScope_OIDC/reader_may_read1594=== PAUSE TestService_RequireScope_OIDC/reader_may_read1595=== RUN TestService_RequireScope_OIDC/writer_implies_read1596=== PAUSE TestService_RequireScope_OIDC/writer_implies_read1597=== RUN TestService_RequireScope_OIDC/anonymous_may_not_read1598=== PAUSE TestService_RequireScope_OIDC/anonymous_may_not_read1599=== CONT TestPresentReportsOnlyClosureRoots1600=== NAME TestPinProtectsFromGC1601 client_integration_test.go:840: Pin successfully protected closure from garbage collection1602--- PASS: TestPinProtectsFromGC (7.98s)1603=== CONT TestReadProxyDisabled16042026/10/01 10:42:00 ERROR Failed to decompress narinfo error="decompressed size exceeds configured limit"1605--- PASS: TestReadProxyInvalidPath (2.43s)1606=== CONT TestReadProxyConditionalGet16072026/10/01 10:42:01 ERROR Refusing narinfo larger than the limit key=5hcdxyjf9yiq7qf3i4548drb6sjmwa1v.narinfo limit=167772161608--- PASS: TestReadProxyNarinfo (2.60s)1609=== CONT TestReadProxyOutlastsServerWriteTimeout1610--- PASS: TestReadProxy404 (2.76s)1611=== CONT TestGCTaskStore_GetReturnsLatest1612--- PASS: TestGCTaskStore_GetReturnsLatest (0.00s)1613=== CONT TestPendingClosureWriteTimeout1614=== RUN TestPendingClosureWriteTimeout/empty1615=== PAUSE TestPendingClosureWriteTimeout/empty1616=== RUN TestPendingClosureWriteTimeout/400_objects1617=== PAUSE TestPendingClosureWriteTimeout/400_objects1618=== RUN TestPendingClosureWriteTimeout/670k_objects1619=== PAUSE TestPendingClosureWriteTimeout/670k_objects1620=== RUN TestPendingClosureWriteTimeout/handler_extends_the_server's_deadline1621=== PAUSE TestPendingClosureWriteTimeout/handler_extends_the_server's_deadline1622=== CONT TestProxyWriteTimeout1623=== RUN TestProxyWriteTimeout/narinfo1624=== PAUSE TestProxyWriteTimeout/narinfo1625=== RUN TestProxyWriteTimeout/1_GiB_nar1626=== PAUSE TestProxyWriteTimeout/1_GiB_nar1627=== RUN TestProxyWriteTimeout/10_GiB_nar1628=== PAUSE TestProxyWriteTimeout/10_GiB_nar1629=== RUN TestProxyWriteTimeout/unknown_size1630=== PAUSE TestProxyWriteTimeout/unknown_size1631=== CONT TestGCTaskStore_GetEmpty1632--- PASS: TestGCTaskStore_GetEmpty (0.00s)1633=== CONT TestPush_RejectsBadRequests/root_not_in_objects16342026/10/01 10:42:01 INFO Received push request method=POST path=/api/pushes1635=== CONT TestPush_RejectsBadRequests/no_objects16362026/10/01 10:42:01 INFO Received push request method=POST path=/api/pushes1637=== CONT TestPush_RejectsBadRequests/bad_root16382026/10/01 10:42:01 INFO Received push request method=POST path=/api/pushes1639=== CONT TestPush_RejectsBadRequests/no_roots16402026/10/01 10:42:01 INFO Received push request method=POST path=/api/pushes1641=== CONT TestServerTLSConfig/no_client_CA1642=== CONT TestServerTLSConfig/not_a_PEM_file1643--- PASS: TestPush_RejectsBadRequests (2.60s)1644 --- PASS: TestPush_RejectsBadRequests/root_not_in_objects (0.00s)1645 --- PASS: TestPush_RejectsBadRequests/no_objects (0.00s)1646 --- PASS: TestPush_RejectsBadRequests/bad_root (0.00s)1647 --- PASS: TestPush_RejectsBadRequests/no_roots (0.00s)1648=== CONT TestServerTLSConfig/missing_CA_file1649--- PASS: TestServerTLSConfig (0.00s)1650 --- PASS: TestServerTLSConfig/no_client_CA (0.00s)1651 --- PASS: TestServerTLSConfig/not_a_PEM_file (0.03s)1652 --- PASS: TestServerTLSConfig/missing_CA_file (0.00s)1653=== CONT TestIsValidUploadKey/narinfo1654=== CONT TestIsValidUploadKey/realisation_plus_in_output1655=== CONT TestIsValidUploadKey/unknown_type1656=== CONT TestIsValidUploadKey/empty_key1657=== CONT TestIsValidUploadKey/absolute1658=== CONT TestIsValidUploadKey/traversal_nar1659=== CONT TestIsValidUploadKey/traversal1660=== CONT TestIsValidUploadKey/listing_key,_narinfo_type1661=== CONT TestIsValidUploadKey/nar_key,_narinfo_type1662=== CONT TestIsValidUploadKey/narinfo_key,_nar_type1663=== CONT TestIsValidUploadKey/index.html1664=== CONT TestIsValidUploadKey/nix-cache-info1665=== CONT TestIsValidUploadKey/build_log_home-manager_file1666=== CONT TestIsValidUploadKey/realisation1667=== CONT TestIsValidUploadKey/build_log_equals1668=== CONT TestIsValidUploadKey/build_log_question_mark1669=== CONT TestIsValidUploadKey/build_log_plus_in_name1670=== CONT TestIsValidUploadKey/nar_plain1671=== CONT TestIsValidUploadKey/build_log1672=== CONT TestIsValidUploadKey/listing1673=== CONT TestIsValidUploadKey/nar_xz1674=== CONT TestIsValidUploadKey/nar_zst1675--- PASS: TestIsValidUploadKey (0.00s)1676 --- PASS: TestIsValidUploadKey/narinfo (0.00s)1677 --- PASS: TestIsValidUploadKey/realisation_plus_in_output (0.00s)1678 --- PASS: TestIsValidUploadKey/unknown_type (0.00s)1679 --- PASS: TestIsValidUploadKey/empty_key (0.00s)1680 --- PASS: TestIsValidUploadKey/absolute (0.00s)1681 --- PASS: TestIsValidUploadKey/traversal_nar (0.00s)1682 --- PASS: TestIsValidUploadKey/traversal (0.00s)1683 --- PASS: TestIsValidUploadKey/listing_key,_narinfo_type (0.00s)1684 --- PASS: TestIsValidUploadKey/nar_key,_narinfo_type (0.00s)1685 --- PASS: TestIsValidUploadKey/narinfo_key,_nar_type (0.00s)1686 --- PASS: TestIsValidUploadKey/index.html (0.00s)1687 --- PASS: TestIsValidUploadKey/nix-cache-info (0.00s)1688 --- PASS: TestIsValidUploadKey/build_log_home-manager_file (0.00s)1689 --- PASS: TestIsValidUploadKey/realisation (0.00s)1690 --- PASS: TestIsValidUploadKey/build_log_equals (0.00s)1691 --- PASS: TestIsValidUploadKey/build_log_question_mark (0.00s)1692 --- PASS: TestIsValidUploadKey/build_log_plus_in_name (0.00s)1693 --- PASS: TestIsValidUploadKey/nar_plain (0.00s)1694 --- PASS: TestIsValidUploadKey/build_log (0.00s)1695 --- PASS: TestIsValidUploadKey/listing (0.00s)1696 --- PASS: TestIsValidUploadKey/nar_xz (0.00s)1697 --- PASS: TestIsValidUploadKey/nar_zst (0.00s)1698=== CONT TestUploadHandlersRejectOversizedBody/create_pending_closure16992026/10/01 10:42:01 INFO Received uploads request method=POST path=/17002026/10/01 10:42:01 INFO Starting HTTP server address=/nix/var/nix/builds/nix-64170-818717140/TestProxyHeadersOnlyTrustedOnSocket4162315781/001/proxy.sock17012026/10/01 10:42:01 INFO Starting HTTP server address=127.0.0.1:6470817022026/10/01 10:42:01 WARN mTLS auth: subject not in bound subjects subject="CN=someone"17032026/10/01 10:42:01 INFO Shutdown signal received, draining in-flight requests timeout=10s1704--- PASS: TestProxyHeadersOnlyTrustedOnSocket (2.84s)1705=== CONT TestUploadHandlersRejectOversizedBody/request_more_parts17062026/10/01 10:42:01 INFO Received request for more parts method=POST path=/1707=== CONT TestUploadHandlersRejectOversizedBody/complete_multipart17082026/10/01 10:42:01 INFO Received complete multipart upload request method=POST path=/1709=== CONT TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info17102026/10/01 10:42:02 INFO Received uploads request method=POST path=/1711=== CONT TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key17122026/10/01 10:42:02 INFO Received complete multipart upload request method=POST path=/1713=== CONT TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key17142026/10/01 10:42:02 INFO Received request for more parts method=POST path=/1715=== CONT TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal17162026/10/01 10:42:02 INFO Received uploads request method=POST path=/1717--- PASS: TestUploadHandlersRejectInvalidKeys (0.00s)1718 --- PASS: TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info (0.00s)1719 --- PASS: TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key (0.00s)1720 --- PASS: TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key (0.00s)1721 --- PASS: TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal (0.00s)1722=== CONT TestForceGCDuringPushOffersSweptObject/before_pending_rows1723=== CONT TestForceGCDuringPushOffersSweptObject/after_presence_check1724--- PASS: TestUploadHandlersRejectOversizedBody (0.03s)1725 --- PASS: TestUploadHandlersRejectOversizedBody/request_more_parts (0.02s)1726 --- PASS: TestUploadHandlersRejectOversizedBody/complete_multipart (0.02s)1727 --- PASS: TestUploadHandlersRejectOversizedBody/create_pending_closure (0.32s)1728--- PASS: TestReadProxyNarStreaming (3.02s)1729=== CONT TestResolveDBConnectionString/flag_wins1730=== CONT TestResolveDBConnectionString/PGHOST_allows_empty1731=== CONT TestResolveDBConnectionString/nothing_configured1732=== CONT TestResolveDBConnectionString/missing_file_is_an_error1733=== CONT TestResolveDBConnectionString/file_when_flag_empty1734=== CONT TestClientErrorHandling/InvalidStorePath1735--- PASS: TestResolveDBConnectionString (0.04s)1736 --- PASS: TestResolveDBConnectionString/flag_wins (0.00s)1737 --- PASS: TestResolveDBConnectionString/PGHOST_allows_empty (0.00s)1738 --- PASS: TestResolveDBConnectionString/nothing_configured (0.00s)1739 --- PASS: TestResolveDBConnectionString/missing_file_is_an_error (0.00s)1740 --- PASS: TestResolveDBConnectionString/file_when_flag_empty (0.00s)1741--- PASS: TestReadProxyNarinfoAlreadyDecompressed (3.31s)1742=== CONT TestClientErrorHandling/ServerNotAvailable17432026/10/01 10:42:02 WARN Request failed, retrying attempt=1 max_attempts=6 backoff=100ms error="Post \"http://localhost:19999/api/objects/present\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/objects/present17442026/10/01 10:42:03 WARN Request failed, retrying attempt=2 max_attempts=6 backoff=214.140064ms error="Post \"http://localhost:19999/api/objects/present\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/objects/present1745--- PASS: TestReadProxyRootRedirectsToIndexHTML (3.51s)1746=== CONT TestClientErrorHandling/InvalidAuthToken17472026/10/01 10:42:03 WARN Request failed, retrying attempt=3 max_attempts=6 backoff=387.633452ms error="Post \"http://localhost:19999/api/objects/present\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/objects/present1748--- PASS: TestPresentNotReportedWhileGCDeletesClosure (4.09s)1749=== CONT TestCacheConfigHandler/full_config,_no_issuer1750=== CONT TestCacheConfigHandler/no_signing_keys1751=== CONT TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator1752=== CONT TestCacheConfigHandler/no_cache_url_configured1753--- PASS: TestCacheConfigHandler (0.00s)1754 --- PASS: TestCacheConfigHandler/full_config,_no_issuer (0.00s)1755 --- PASS: TestCacheConfigHandler/no_signing_keys (0.00s)1756 --- PASS: TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator (0.00s)1757 --- PASS: TestCacheConfigHandler/no_cache_url_configured (0.00s)1758=== CONT TestParseSingleRange/none1759=== CONT TestParseSingleRange/open-ended1760=== CONT TestParseSingleRange/start_far_past_EOF1761=== CONT TestParseSingleRange/start_past_EOF1762=== CONT TestParseSingleRange/single_byte1763=== CONT TestParseSingleRange/suffix_exceeds_size1764=== CONT TestParseSingleRange/suffix1765=== CONT TestParseSingleRange/end_clamped_to_size1766=== CONT TestParseSingleRange/malformed_both_empty1767=== CONT TestParseSingleRange/closed1768=== CONT TestParseSingleRange/malformed_end_before_start1769=== CONT TestParseSingleRange/multi-range_ignored1770=== CONT TestParseSingleRange/malformed_no_dash1771=== CONT TestParseSingleRange/unknown_unit1772--- PASS: TestParseSingleRange (0.00s)1773 --- PASS: TestParseSingleRange/none (0.00s)1774 --- PASS: TestParseSingleRange/open-ended (0.00s)1775 --- PASS: TestParseSingleRange/start_far_past_EOF (0.00s)1776 --- PASS: TestParseSingleRange/start_past_EOF (0.00s)1777 --- PASS: TestParseSingleRange/single_byte (0.00s)1778 --- PASS: TestParseSingleRange/suffix_exceeds_size (0.00s)1779 --- PASS: TestParseSingleRange/suffix (0.00s)1780 --- PASS: TestParseSingleRange/end_clamped_to_size (0.00s)1781 --- PASS: TestParseSingleRange/malformed_both_empty (0.00s)1782 --- PASS: TestParseSingleRange/closed (0.00s)1783 --- PASS: TestParseSingleRange/malformed_end_before_start (0.00s)1784 --- PASS: TestParseSingleRange/multi-range_ignored (0.00s)1785 --- PASS: TestParseSingleRange/malformed_no_dash (0.00s)1786 --- PASS: TestParseSingleRange/unknown_unit (0.00s)1787=== CONT TestIsValidCachePath/narinfo1788=== CONT TestIsValidCachePath/index.html1789=== CONT TestIsValidCachePath/short_hash1790=== CONT TestIsValidCachePath/wrong_extension1791=== CONT TestIsValidCachePath/leading_slash1792=== CONT TestIsValidCachePath/empty1793=== CONT TestIsValidCachePath/random_path1794=== CONT TestIsValidCachePath/invalid_char_u1795=== CONT TestIsValidCachePath/invalid_char_e1796=== CONT TestIsValidCachePath/traversal_in_middle1797=== CONT TestIsValidCachePath/traversal_parent1798=== CONT TestIsValidCachePath/nar_uncompressed1799=== CONT TestIsValidCachePath/nix-cache-info1800=== CONT TestIsValidCachePath/realisation1801=== CONT TestIsValidCachePath/log1802=== CONT TestIsValidCachePath/ls1803=== CONT TestIsValidCachePath/nar_xz1804=== CONT TestIsValidCachePath/nar_bz21805=== CONT TestIsValidCachePath/nar_zst1806=== CONT TestIsValidCachePath/narinfo_all_nix_base32_chars1807--- PASS: TestIsValidCachePath (0.00s)1808 --- PASS: TestIsValidCachePath/narinfo (0.00s)1809 --- PASS: TestIsValidCachePath/index.html (0.00s)1810 --- PASS: TestIsValidCachePath/short_hash (0.00s)1811 --- PASS: TestIsValidCachePath/wrong_extension (0.00s)1812 --- PASS: TestIsValidCachePath/leading_slash (0.00s)1813 --- PASS: TestIsValidCachePath/empty (0.00s)1814 --- PASS: TestIsValidCachePath/random_path (0.00s)1815 --- PASS: TestIsValidCachePath/invalid_char_u (0.00s)1816 --- PASS: TestIsValidCachePath/invalid_char_e (0.00s)1817 --- PASS: TestIsValidCachePath/traversal_in_middle (0.00s)1818 --- PASS: TestIsValidCachePath/traversal_parent (0.00s)1819 --- PASS: TestIsValidCachePath/nar_uncompressed (0.00s)1820 --- PASS: TestIsValidCachePath/nix-cache-info (0.00s)1821 --- PASS: TestIsValidCachePath/realisation (0.00s)1822 --- PASS: TestIsValidCachePath/log (0.00s)1823 --- PASS: TestIsValidCachePath/ls (0.00s)1824 --- PASS: TestIsValidCachePath/nar_xz (0.00s)1825 --- PASS: TestIsValidCachePath/nar_bz2 (0.00s)1826 --- PASS: TestIsValidCachePath/nar_zst (0.00s)1827 --- PASS: TestIsValidCachePath/narinfo_all_nix_base32_chars (0.00s)1828=== CONT TestService_AuthMiddleware_OIDC/valid_OIDC_token1829=== CONT TestService_AuthMiddleware_OIDC/malformed_token_rejected18302026/10/01 10:42:03 WARN Authentication failed token_preview=not-a-valid-jwt token_length=15 oidc_error="no provider could verify the token (signature or issuer mismatch)" oidc_provider="" tried_providers=[test]1831=== CONT TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured1832=== CONT TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected18332026/10/01 10:42:03 WARN Authentication failed token_preview=eyJhbGciOi...spH0nL9PGw token_length=701 oidc_error="no rule matched: claim \"repository_owner\" value [otherorg] not in allowed patterns [myorg]" oidc_provider=test tried_providers=[test]1834=== CONT TestService_RequireScope_OIDC/builder_may_write1835=== CONT TestService_RequireScope_OIDC/static_token_may_admin1836=== CONT TestService_RequireScope_OIDC/anonymous_may_not_read1837=== CONT TestService_RequireScope_OIDC/writer_implies_read1838=== CONT TestService_RequireScope_OIDC/reader_may_read1839=== CONT TestService_RequireScope_OIDC/static_token_may_write1840=== CONT TestService_RequireScope_OIDC/ops_may_not_write1841=== CONT TestService_RequireScope_OIDC/reader_may_not_write1842=== CONT TestService_RequireScope_OIDC/ops_may_admin1843=== CONT TestService_RequireScope_OIDC/builder_may_not_admin1844=== CONT TestPendingClosureWriteTimeout/empty1845=== CONT TestPendingClosureWriteTimeout/670k_objects1846=== CONT TestPendingClosureWriteTimeout/handler_extends_the_server's_deadline1847--- PASS: TestService_RequireScope_OIDC (1.62s)1848 --- PASS: TestService_RequireScope_OIDC/builder_may_write (0.00s)1849 --- PASS: TestService_RequireScope_OIDC/static_token_may_admin (0.00s)1850 --- PASS: TestService_RequireScope_OIDC/anonymous_may_not_read (0.00s)1851 --- PASS: TestService_RequireScope_OIDC/writer_implies_read (0.00s)1852 --- PASS: TestService_RequireScope_OIDC/reader_may_read (0.00s)1853 --- PASS: TestService_RequireScope_OIDC/static_token_may_write (0.00s)1854 --- PASS: TestService_RequireScope_OIDC/ops_may_not_write (0.00s)1855 --- PASS: TestService_RequireScope_OIDC/reader_may_not_write (0.00s)1856 --- PASS: TestService_RequireScope_OIDC/ops_may_admin (0.00s)1857 --- PASS: TestService_RequireScope_OIDC/builder_may_not_admin (0.00s)1858--- PASS: TestService_AuthMiddleware_OIDC (2.18s)1859 --- PASS: TestService_AuthMiddleware_OIDC/valid_OIDC_token (0.01s)1860 --- PASS: TestService_AuthMiddleware_OIDC/malformed_token_rejected (0.00s)1861 --- PASS: TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured (0.00s)1862 --- PASS: TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected (0.00s)1863--- PASS: TestPresentReportsOnlyClosureRoots (3.54s)1864=== CONT TestPendingClosureWriteTimeout/400_objects1865=== CONT TestProxyWriteTimeout/narinfo1866=== CONT TestProxyWriteTimeout/10_GiB_nar1867=== CONT TestProxyWriteTimeout/unknown_size1868=== CONT TestProxyWriteTimeout/1_GiB_nar1869--- PASS: TestProxyWriteTimeout (0.00s)1870 --- PASS: TestProxyWriteTimeout/narinfo (0.00s)1871 --- PASS: TestProxyWriteTimeout/10_GiB_nar (0.00s)1872 --- PASS: TestProxyWriteTimeout/unknown_size (0.00s)1873 --- PASS: TestProxyWriteTimeout/1_GiB_nar (0.00s)18742026/10/01 10:42:03 WARN Request failed, retrying attempt=4 max_attempts=6 backoff=865.940373ms error="Post \"http://localhost:19999/api/objects/present\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/objects/present1875--- PASS: TestReadProxyDisabled (3.46s)1876--- PASS: TestReadProxyConditionalGet (2.99s)18772026/10/01 10:42:04 WARN Request failed, retrying attempt=5 max_attempts=6 backoff=1.483253249s error="Post \"http://localhost:19999/api/objects/present\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/objects/present18782026/10/01 10:42:04 INFO Received uploads request method=POST path=/api/pending_closures18792026/10/01 10:42:04 INFO Aborted multipart uploads count=0 kept=018802026/10/01 10:42:04 WARN Force mode enabled - objects will be deleted immediately without grace period18812026/10/01 10:42:04 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=1 objects-deleted-after-grace-period=1 objects-failed-to-delete=018822026/10/01 10:42:04 INFO Vacuumed table table=pending_closures18832026/10/01 10:42:04 INFO Vacuumed table table=pending_objects18842026/10/01 10:42:04 INFO Vacuumed table table=multipart_uploads18852026/10/01 10:42:04 INFO Vacuumed table table=closures18862026/10/01 10:42:04 INFO Vacuumed table table=objects18872026/10/01 10:42:05 INFO Received uploads request method=POST path=/api/pending_closures18882026/10/01 10:42:05 INFO Aborted multipart uploads count=0 kept=018892026/10/01 10:42:05 WARN Force mode enabled - objects will be deleted immediately without grace period18902026/10/01 10:42:05 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=018912026/10/01 10:42:05 INFO Vacuumed table table=pending_closures18922026/10/01 10:42:05 INFO Vacuumed table table=pending_objects18932026/10/01 10:42:05 INFO Vacuumed table table=multipart_uploads18942026/10/01 10:42:05 INFO Vacuumed table table=closures18952026/10/01 10:42:05 INFO Vacuumed table table=objects1896--- PASS: TestForceGCDuringPushOffersSweptObject (0.00s)1897 --- PASS: TestForceGCDuringPushOffersSweptObject/before_pending_rows (3.06s)1898 --- PASS: TestForceGCDuringPushOffersSweptObject/after_presence_check (3.25s)18992026/10/01 10:42:05 INFO Received uploads request method=POST path=/api/pending_closures19002026/10/01 10:42:05 WARN Authentication failed token_preview=invalid-token token_length=13 reason="static API token mismatch"19012026/10/01 10:42:05 WARN Authentication failed token_preview=invalid-token token_length=13 reason="static API token mismatch"19022026/10/01 10:42:06 WARN Request failed, retrying attempt=1 max_attempts=6 backoff=100ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config19032026/10/01 10:42:06 WARN Request failed, retrying attempt=2 max_attempts=6 backoff=212.762905ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config19042026/10/01 10:42:06 WARN Request failed, retrying attempt=3 max_attempts=6 backoff=372.732039ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config1905--- PASS: TestPendingClosureWriteTimeout (0.00s)1906 --- PASS: TestPendingClosureWriteTimeout/empty (0.00s)1907 --- PASS: TestPendingClosureWriteTimeout/670k_objects (0.00s)1908 --- PASS: TestPendingClosureWriteTimeout/400_objects (0.00s)1909 --- PASS: TestPendingClosureWriteTimeout/handler_extends_the_server's_deadline (3.32s)19102026/10/01 10:42:06 WARN Request failed, retrying attempt=4 max_attempts=6 backoff=769.397749ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config1911{"timestamp":"2026-10-01T10:42:06.912139Z","level":"ERROR","message":"Scanner cycle completed without a durable data usage snapshot","event":"scanner_persist_state","component":"scanner","subsystem":"runtime","cycle":3,"outcome":"NoUpdate","state":"usage_not_durable","target":"rustfs::scanner","filename":"crates/scanner/src/scanner.rs","line_number":2350,"threadName":"rustfs-worker","threadId":"ThreadId(9)"}19122026/10/01 10:42:07 WARN Request failed, retrying attempt=5 max_attempts=6 backoff=1.498491642s error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config1913--- PASS: TestReadProxyOutlastsServerWriteTimeout (7.51s)19142026/10/01 10:42:09 WARN Failed to fetch cache config, uploading without size limit error="fetching cache config: sending request: request failed after retries: Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused"19152026/10/01 10:42:09 WARN Request failed, retrying attempt=1 max_attempts=6 backoff=100ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config19162026/10/01 10:42:09 WARN Request failed, retrying attempt=2 max_attempts=6 backoff=201.29996ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config19172026/10/01 10:42:09 WARN Request failed, retrying attempt=3 max_attempts=6 backoff=371.488936ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config19182026/10/01 10:42:09 WARN Request failed, retrying attempt=4 max_attempts=6 backoff=876.126006ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config19192026/10/01 10:42:10 WARN Request failed, retrying attempt=5 max_attempts=6 backoff=1.703425438s error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config19202026/10/01 10:42:12 WARN Request failed, retrying attempt=1 max_attempts=6 backoff=100ms error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures19212026/10/01 10:42:12 WARN Request failed, retrying attempt=2 max_attempts=6 backoff=209.192347ms error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures1922{"timestamp":"2026-10-01T10:42:12.438034Z","level":"ERROR","message":"Scanner cycle completed without a durable data usage snapshot","event":"scanner_persist_state","component":"scanner","subsystem":"runtime","cycle":3,"outcome":"NoUpdate","state":"usage_not_durable","target":"rustfs::scanner","filename":"crates/scanner/src/scanner.rs","line_number":2350,"threadName":"rustfs-worker","threadId":"ThreadId(3)"}19232026/10/01 10:42:12 WARN Request failed, retrying attempt=3 max_attempts=6 backoff=385.535841ms error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures19242026/10/01 10:42:12 WARN Request failed, retrying attempt=4 max_attempts=6 backoff=837.535594ms error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures19252026/10/01 10:42:13 WARN Request failed, retrying attempt=5 max_attempts=6 backoff=1.715484486s error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures1926--- PASS: TestClientErrorHandling (0.00s)1927 --- PASS: TestClientErrorHandling/InvalidStorePath (3.33s)1928 --- PASS: TestClientErrorHandling/InvalidAuthToken (2.83s)1929 --- PASS: TestClientErrorHandling/ServerNotAvailable (12.98s)1930PASS1931{"timestamp":"2026-10-01T10:42:15.5511Z","level":"ERROR","message":"HTTP transport failed","event":"http_transport_failed","component":"server","subsystem":"transport","peer_addr":"127.0.0.1:64487","error_kind":"io_error","error":"Cancelled","result":"transport_error","target":"rustfs::server::http","filename":"rustfs/src/server/http.rs","line_number":2354,"threadName":"rustfs-worker","threadId":"ThreadId(10)"}19322026-10-01 10:42:15.661 UTC [64222] LOG: received smart shutdown request19332026-10-01 10:42:15.662 UTC [64222] LOG: background worker "logical replication launcher" (PID 64232) exited with exit code 119342026-10-01 10:42:15.665 UTC [64227] LOG: shutting down19352026-10-01 10:42:15.665 UTC [64227] LOG: checkpoint starting: shutdown immediate19362026-10-01 10:42:16.871 UTC [64227] LOG: checkpoint complete: wrote 12570 buffers (76.7%), wrote 5 SLRU buffers; 0 WAL file(s) added, 0 removed, 25 recycled; write=0.649 s, sync=0.503 s, total=1.207 s; sync files=29656, longest=0.001 s, average=0.001 s; distance=417227 kB, estimate=417227 kB; lsn=0/1AEFFC10, redo lsn=0/1AEFFC1019372026-10-01 10:42:16.877 UTC [64222] LOG: database system is shut down1938Running OIDC tests...1939=== RUN TestAudienceForIssuer1940=== PAUSE TestAudienceForIssuer1941=== RUN TestGlobMatch1942=== PAUSE TestGlobMatch1943=== RUN TestValidateToken_ValidToken1944=== PAUSE TestValidateToken_ValidToken1945=== RUN TestValidateToken_WrongAudience1946=== PAUSE TestValidateToken_WrongAudience1947=== RUN TestValidateToken_Expired1948=== PAUSE TestValidateToken_Expired1949=== RUN TestValidateToken_BoundClaimsMismatch1950=== PAUSE TestValidateToken_BoundClaimsMismatch1951=== RUN TestValidateToken_BoundSubjectMismatch1952=== PAUSE TestValidateToken_BoundSubjectMismatch1953=== RUN TestValidateToken_MultipleProviders1954=== PAUSE TestValidateToken_MultipleProviders1955=== RUN TestValidateToken_NoMatchingProvider1956=== PAUSE TestValidateToken_NoMatchingProvider1957=== RUN TestValidateToken_KubernetesServiceAccount1958=== PAUSE TestValidateToken_KubernetesServiceAccount1959=== RUN TestNewValidator_KubernetesRequiresCA1960=== PAUSE TestNewValidator_KubernetesRequiresCA1961=== RUN TestValidateToken_KubernetesIssuerFromOwnToken1962=== PAUSE TestValidateToken_KubernetesIssuerFromOwnToken1963=== RUN TestPins_ReservedForMatchingRule1964=== PAUSE TestPins_ReservedForMatchingRule1965=== RUN TestPins_TopLevelShorthand1966=== PAUSE TestPins_TopLevelShorthand1967=== RUN TestPins_ConfigValidation1968=== PAUSE TestPins_ConfigValidation1969=== RUN TestScopes_LegacyProviderDefaultsToWrite1970=== PAUSE TestScopes_LegacyProviderDefaultsToWrite1971=== RUN TestScopes_Rules1972=== PAUSE TestScopes_Rules1973=== RUN TestScopes_ConfigValidation1974=== PAUSE TestScopes_ConfigValidation1975=== CONT TestAudienceForIssuer1976--- PASS: TestAudienceForIssuer (0.00s)1977=== CONT TestValidateToken_NoMatchingProvider1978=== CONT TestPins_ConfigValidation1979=== CONT TestValidateToken_KubernetesServiceAccount1980=== CONT TestScopes_Rules1981=== CONT TestValidateToken_Expired1982=== CONT TestValidateToken_ValidToken1983=== CONT TestGlobMatch1984=== RUN TestGlobMatch/foo_foo1985=== PAUSE TestGlobMatch/foo_foo1986=== RUN TestGlobMatch/foo_bar1987=== PAUSE TestGlobMatch/foo_bar1988=== RUN TestGlobMatch/*_1989=== PAUSE TestGlobMatch/*_1990=== RUN TestGlobMatch/*_anything1991=== PAUSE TestGlobMatch/*_anything1992=== RUN TestGlobMatch/foo*_foo1993=== PAUSE TestGlobMatch/foo*_foo1994=== RUN TestGlobMatch/foo*_foobar1995=== PAUSE TestGlobMatch/foo*_foobar1996=== RUN TestGlobMatch/foo*_bar1997=== PAUSE TestGlobMatch/foo*_bar1998=== RUN TestGlobMatch/*bar_bar1999=== PAUSE TestGlobMatch/*bar_bar2000=== RUN TestGlobMatch/*bar_foobar2001=== PAUSE TestGlobMatch/*bar_foobar2002=== RUN TestGlobMatch/*bar_foo2003=== PAUSE TestGlobMatch/*bar_foo2004=== RUN TestGlobMatch/foo*bar_foobar2005=== PAUSE TestGlobMatch/foo*bar_foobar2006=== RUN TestGlobMatch/foo*bar_foo123bar2007=== PAUSE TestGlobMatch/foo*bar_foo123bar2008=== RUN TestGlobMatch/foo*bar_foobarbaz2009=== PAUSE TestGlobMatch/foo*bar_foobarbaz2010=== RUN TestGlobMatch/*/*_foo/bar2011=== PAUSE TestGlobMatch/*/*_foo/bar2012=== RUN TestGlobMatch/*/*_foo2013=== PAUSE TestGlobMatch/*/*_foo2014=== RUN TestGlobMatch/refs/heads/*_refs/heads/main2015=== PAUSE TestGlobMatch/refs/heads/*_refs/heads/main2016=== RUN TestGlobMatch/refs/heads/*_refs/tags/v1.02017=== PAUSE TestGlobMatch/refs/heads/*_refs/tags/v1.02018=== RUN TestGlobMatch/refs/*/main_refs/heads/main2019=== PAUSE TestGlobMatch/refs/*/main_refs/heads/main2020=== RUN TestGlobMatch/fo?_foo2021=== PAUSE TestGlobMatch/fo?_foo2022=== RUN TestGlobMatch/fo?_fo2023=== PAUSE TestGlobMatch/fo?_fo2024=== RUN TestGlobMatch/fo?_fooo2025=== PAUSE TestGlobMatch/fo?_fooo2026=== RUN TestGlobMatch/?oo_foo2027=== PAUSE TestGlobMatch/?oo_foo2028=== RUN TestGlobMatch/?oo_boo2029=== PAUSE TestGlobMatch/?oo_boo2030=== RUN TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main2031=== PAUSE TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main2032=== RUN TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main2033=== PAUSE TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main2034--- PASS: TestPins_ConfigValidation (0.00s)2035=== CONT TestScopes_ConfigValidation2036=== CONT TestValidateToken_MultipleProviders2037--- PASS: TestScopes_ConfigValidation (0.00s)2038=== CONT TestPins_ReservedForMatchingRule2039=== CONT TestScopes_LegacyProviderDefaultsToWrite2040=== CONT TestValidateToken_BoundSubjectMismatch2041=== CONT TestValidateToken_WrongAudience20422026/10/01 10:42:18 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:64808/oidc2043--- PASS: TestValidateToken_Expired (0.07s)2044=== CONT TestPins_TopLevelShorthand20452026/10/01 10:42:18 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:64810/oidc2046--- PASS: TestPins_ReservedForMatchingRule (0.08s)2047=== CONT TestValidateToken_KubernetesIssuerFromOwnToken20482026/10/01 10:42:18 INFO OIDC provider initialized name=provider1 issuer=http://127.0.0.1:64806/oidc2049--- PASS: TestValidateToken_NoMatchingProvider (0.08s)2050=== CONT TestValidateToken_BoundClaimsMismatch20512026/10/01 10:42:18 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:64814/oidc2052--- PASS: TestScopes_LegacyProviderDefaultsToWrite (0.08s)2053=== CONT TestNewValidator_KubernetesRequiresCA20542026/10/01 10:42:18 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:64818/oidc20552026/10/01 10:42:18 INFO OIDC provider initialized name=kubernetes issuer=https://127.0.0.1:648162056--- PASS: TestValidateToken_BoundSubjectMismatch (0.08s)2057=== CONT TestGlobMatch/foo_foo2058=== CONT TestGlobMatch/*/*_foo/bar2059=== CONT TestGlobMatch/foo*_bar2060=== CONT TestGlobMatch/foo*bar_foobarbaz2061=== CONT TestGlobMatch/foo*bar_foo123bar2062=== CONT TestGlobMatch/foo*bar_foobar2063=== CONT TestGlobMatch/*bar_foo2064=== CONT TestGlobMatch/*bar_foobar2065=== CONT TestGlobMatch/*bar_bar2066=== CONT TestGlobMatch/*_anything2067=== CONT TestGlobMatch/foo*_foobar2068=== CONT TestGlobMatch/foo*_foo2069=== CONT TestGlobMatch/foo_bar2070=== CONT TestGlobMatch/*_2071=== CONT TestGlobMatch/fo?_fo2072=== CONT TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main2073=== CONT TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main2074=== CONT TestGlobMatch/?oo_boo2075=== CONT TestGlobMatch/?oo_foo2076=== CONT TestGlobMatch/fo?_fooo2077=== CONT TestGlobMatch/refs/heads/*_refs/tags/v1.02078=== CONT TestGlobMatch/fo?_foo2079=== CONT TestGlobMatch/refs/*/main_refs/heads/main2080=== CONT TestGlobMatch/refs/heads/*_refs/heads/main2081=== CONT TestGlobMatch/*/*_foo2082--- PASS: TestGlobMatch (0.00s)2083 --- PASS: TestGlobMatch/foo_foo (0.00s)2084 --- PASS: TestGlobMatch/*/*_foo/bar (0.00s)2085 --- PASS: TestGlobMatch/foo*_bar (0.00s)2086 --- PASS: TestGlobMatch/foo*bar_foobarbaz (0.00s)2087 --- PASS: TestGlobMatch/foo*bar_foo123bar (0.00s)2088 --- PASS: TestGlobMatch/foo*bar_foobar (0.00s)2089 --- PASS: TestGlobMatch/*bar_foo (0.00s)2090 --- PASS: TestGlobMatch/*bar_foobar (0.00s)2091 --- PASS: TestGlobMatch/*bar_bar (0.00s)2092 --- PASS: TestGlobMatch/*_anything (0.00s)2093 --- PASS: TestGlobMatch/foo*_foobar (0.00s)2094 --- PASS: TestGlobMatch/foo*_foo (0.00s)2095 --- PASS: TestGlobMatch/foo_bar (0.00s)2096 --- PASS: TestGlobMatch/*_ (0.00s)2097 --- PASS: TestGlobMatch/fo?_fo (0.00s)2098 --- PASS: TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main (0.00s)2099 --- PASS: TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main (0.00s)2100 --- PASS: TestGlobMatch/?oo_boo (0.00s)2101 --- PASS: TestGlobMatch/?oo_foo (0.00s)2102 --- PASS: TestGlobMatch/fo?_fooo (0.00s)2103 --- PASS: TestGlobMatch/refs/heads/*_refs/tags/v1.0 (0.00s)2104 --- PASS: TestGlobMatch/fo?_foo (0.00s)2105 --- PASS: TestGlobMatch/refs/*/main_refs/heads/main (0.00s)2106 --- PASS: TestGlobMatch/refs/heads/*_refs/heads/main (0.00s)2107 --- PASS: TestGlobMatch/*/*_foo (0.00s)2108--- PASS: TestValidateToken_KubernetesServiceAccount (0.10s)21092026/10/01 10:42:18 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:64820/oidc2110--- PASS: TestValidateToken_ValidToken (0.11s)21112026/10/01 10:42:18 INFO OIDC provider initialized name=kubernetes issuer=https://oidc.eks.invalid/id/ABC12321122026/10/01 10:42:18 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:64823/oidc2113--- PASS: TestValidateToken_BoundClaimsMismatch (0.04s)2114--- PASS: TestValidateToken_KubernetesIssuerFromOwnToken (0.05s)21152026/10/01 10:42:18 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:64826/oidc2116--- PASS: TestValidateToken_WrongAudience (0.12s)21172026/10/01 10:42:18 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:64830/oidc2118--- PASS: TestScopes_Rules (0.14s)21192026/10/01 10:42:18 http: TLS handshake error from 127.0.0.1:64829: remote error: tls: bad certificate2120--- PASS: TestNewValidator_KubernetesRequiresCA (0.05s)21212026/10/01 10:42:18 INFO OIDC provider initialized name=provider1 issuer=http://127.0.0.1:64807/oidc21222026/10/01 10:42:18 INFO OIDC provider initialized name=provider2 issuer=http://127.0.0.1:64832/oidc2123--- PASS: TestValidateToken_MultipleProviders (0.17s)21242026/10/01 10:42:18 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:64835/oidc2125--- PASS: TestPins_TopLevelShorthand (0.17s)2126PASS2127Running hook tests...2128=== RUN TestSendPathsEmpty2129=== PAUSE TestSendPathsEmpty2130=== RUN TestQueueEnqueueAndFetch2131=== PAUSE TestQueueEnqueueAndFetch2132=== RUN TestQueueDeduplication2133=== PAUSE TestQueueDeduplication2134=== RUN TestQueueRemove2135=== PAUSE TestQueueRemove2136=== RUN TestQueueFetchBatchLimit2137=== PAUSE TestQueueFetchBatchLimit2138=== RUN TestQueueRetryMovesToBack2139=== PAUSE TestQueueRetryMovesToBack2140=== RUN TestQueueFetchRemoveLifecycle2141=== PAUSE TestQueueFetchRemoveLifecycle2142=== RUN TestQueueConcurrentWriters2143=== PAUSE TestQueueConcurrentWriters2144=== RUN TestQueueRemoveLargeClosure2145=== PAUSE TestQueueRemoveLargeClosure2146=== RUN TestServerClientIntegration2147=== PAUSE TestServerClientIntegration2148=== RUN TestServerQueueError2149=== PAUSE TestServerQueueError2150=== RUN TestGetListenerSocketActivation2151 server_test.go:210: === RUN TestGetListenerSocketActivation2152 --- PASS: TestGetListenerSocketActivation (0.00s)2153 PASS2154 2155--- PASS: TestGetListenerSocketActivation (0.01s)2156=== RUN TestDrainIsolatesPoisonPath2157=== PAUSE TestDrainIsolatesPoisonPath2158=== RUN TestRunNotBlockedByPoisonHead2159=== PAUSE TestRunNotBlockedByPoisonHead2160=== RUN TestDrainGivesUpWhenServerDown2161=== PAUSE TestDrainGivesUpWhenServerDown2162=== RUN TestFailedPathPrunedByLaterClosure2163=== PAUSE TestFailedPathPrunedByLaterClosure2164=== RUN TestWorkerUploadsAndRemoves2165=== PAUSE TestWorkerUploadsAndRemoves2166=== RUN TestWorkerSkipsGCdPaths2167=== PAUSE TestWorkerSkipsGCdPaths2168=== RUN TestWorkerPrunesClosureDeps2169=== PAUSE TestWorkerPrunesClosureDeps2170=== RUN TestDrainTimeout2171=== PAUSE TestDrainTimeout2172=== CONT TestSendPathsEmpty2173=== CONT TestServerQueueError2174=== CONT TestQueueRetryMovesToBack2175--- PASS: TestSendPathsEmpty (0.00s)2176=== CONT TestQueueFetchBatchLimit2177=== CONT TestQueueRemove2178=== CONT TestQueueDeduplication2179=== CONT TestQueueEnqueueAndFetch2180=== CONT TestQueueRemoveLargeClosure2181=== CONT TestServerClientIntegration2182=== CONT TestQueueConcurrentWriters2183=== CONT TestQueueFetchRemoveLifecycle21842026/10/01 10:42:18 ERROR Failed to queue paths error="permission denied" count=12185--- PASS: TestServerQueueError (0.00s)2186=== CONT TestWorkerUploadsAndRemoves2187--- PASS: TestServerClientIntegration (0.00s)2188=== CONT TestDrainTimeout21892026/10/01 10:42:18 INFO Upload queue status pending=221902026/10/01 10:42:18 INFO Uploading batch count=22191--- PASS: TestQueueEnqueueAndFetch (0.01s)2192=== CONT TestWorkerPrunesClosureDeps21932026/10/01 10:42:18 INFO Uploading batch count=22194--- PASS: TestQueueDeduplication (0.01s)2195=== CONT TestWorkerSkipsGCdPaths2196--- PASS: TestQueueFetchBatchLimit (0.01s)2197=== CONT TestDrainGivesUpWhenServerDown2198--- PASS: TestQueueRetryMovesToBack (0.01s)2199=== CONT TestFailedPathPrunedByLaterClosure2200--- PASS: TestQueueRemove (0.01s)2201=== CONT TestRunNotBlockedByPoisonHead2202--- PASS: TestQueueFetchRemoveLifecycle (0.01s)2203=== CONT TestDrainIsolatesPoisonPath22042026/10/01 10:42:18 INFO Upload queue status pending=222052026/10/01 10:42:18 INFO Uploading batch count=122062026/10/01 10:42:18 INFO Upload queue status pending=222072026/10/01 10:42:18 WARN Store path no longer exists (garbage collected?), removing from queue path=/nix/var/nix/builds/nix-64170-818717140/TestWorkerSkipsGCdPaths3332708551/002/nonexistent22082026/10/01 10:42:18 INFO Upload queue status pending=322092026/10/01 10:42:18 INFO Uploading batch count=122102026/10/01 10:42:18 ERROR Upload failed error="upload failed" count=122112026/10/01 10:42:18 INFO Uploading batch count=122122026/10/01 10:42:18 INFO Uploading batch count=122132026/10/01 10:42:18 ERROR Upload failed error="upload failed" count=122142026/10/01 10:42:18 INFO Uploading batch count=422152026/10/01 10:42:18 ERROR Upload failed error="upload failed" count=422162026/10/01 10:42:18 INFO Uploading batch count=122172026/10/01 10:42:18 INFO Uploading batch count=222182026/10/01 10:42:18 ERROR Upload failed, will retry later error="upload failed" path=/nix/var/nix/builds/nix-64170-818717140/TestDrainIsolatesPoisonPath2756552550/002/bbb22192026/10/01 10:42:18 ERROR Upload failed error="upload failed" count=222202026/10/01 10:42:18 ERROR Upload failed, will retry later error="upload failed" path=/nix/var/nix/builds/nix-64170-818717140/TestDrainGivesUpWhenServerDown1084606652/002/a22212026/10/01 10:42:18 INFO Uploading batch count=122222026/10/01 10:42:18 ERROR Upload failed, will retry later error="upload failed" path=/nix/var/nix/builds/nix-64170-818717140/TestDrainGivesUpWhenServerDown1084606652/002/b22232026/10/01 10:42:18 INFO Uploading batch count=122242026/10/01 10:42:18 ERROR Upload failed error="upload failed" count=122252026/10/01 10:42:18 INFO Uploading batch count=222262026/10/01 10:42:18 ERROR Upload failed error="upload failed" count=222272026/10/01 10:42:18 ERROR Upload failed, will retry later error="upload failed" path=/nix/var/nix/builds/nix-64170-818717140/TestDrainGivesUpWhenServerDown1084606652/002/c22282026/10/01 10:42:18 INFO Uploading batch count=122292026/10/01 10:42:18 ERROR Upload failed error="upload failed" count=122302026/10/01 10:42:18 INFO Uploading batch count=122312026/10/01 10:42:18 ERROR Upload failed error="upload failed" count=122322026/10/01 10:42:18 ERROR Upload failed, will retry later error="upload failed" path=/nix/var/nix/builds/nix-64170-818717140/TestDrainGivesUpWhenServerDown1084606652/002/d22332026/10/01 10:42:18 ERROR Drain finished with paths left in queue remaining=122342026/10/01 10:42:18 INFO Uploading batch count=222352026/10/01 10:42:18 ERROR Upload failed error="upload failed" count=222362026/10/01 10:42:18 ERROR Upload failed, will retry later error="upload failed" path=/nix/var/nix/builds/nix-64170-818717140/TestDrainGivesUpWhenServerDown1084606652/002/e22372026/10/01 10:42:18 ERROR Upload failed, will retry later error="upload failed" path=/nix/var/nix/builds/nix-64170-818717140/TestDrainGivesUpWhenServerDown1084606652/002/f2238--- PASS: TestFailedPathPrunedByLaterClosure (0.01s)22392026/10/01 10:42:18 ERROR Drain finished with paths left in queue remaining=102240--- PASS: TestDrainIsolatesPoisonPath (0.01s)2241--- PASS: TestDrainGivesUpWhenServerDown (0.01s)2242--- PASS: TestWorkerUploadsAndRemoves (0.03s)2243--- PASS: TestWorkerPrunesClosureDeps (0.02s)2244--- PASS: TestWorkerSkipsGCdPaths (0.02s)2245--- PASS: TestQueueRemoveLargeClosure (0.06s)2246--- PASS: TestQueueConcurrentWriters (0.16s)22472026/10/01 10:42:19 ERROR Upload failed error="context deadline exceeded" count=222482026/10/01 10:42:19 ERROR Drain finished with paths left in queue remaining=42249--- PASS: TestDrainTimeout (0.21s)22502026/10/01 10:42:19 INFO Uploading batch count=122512026/10/01 10:42:19 INFO Uploading batch count=122522026/10/01 10:42:19 INFO Uploading batch count=122532026/10/01 10:42:19 ERROR Upload failed error="upload failed" count=122542026/10/01 10:42:19 INFO Uploading batch count=122552026/10/01 10:42:19 ERROR Upload failed error="upload failed" count=122562026/10/01 10:42:19 INFO Uploading batch count=122572026/10/01 10:42:19 ERROR Upload failed error="upload failed" count=122582026/10/01 10:42:19 INFO Uploading batch count=122592026/10/01 10:42:19 ERROR Upload failed error="upload failed" count=122602026/10/01 10:42:19 ERROR Drain finished with paths left in queue remaining=12261--- PASS: TestRunNotBlockedByPoisonHead (1.03s)2262PASS