niks3-go-unit-tests
checks.aarch64-linux.go-unit-tests
· build #399
· raw
1tribuchet: building on eliza2Running client tests...3=== RUN TestDoServerRequestAttachesToken4=== PAUSE TestDoServerRequestAttachesToken5=== RUN TestRegisterUploadedObjectReusesConnections6=== PAUSE TestRegisterUploadedObjectReusesConnections7=== RUN TestRunGarbageCollection_FinishedOnAnotherReplica8=== PAUSE TestRunGarbageCollection_FinishedOnAnotherReplica9=== RUN TestRunGarbageCollection_NotFoundAfterLocalRun10=== PAUSE TestRunGarbageCollection_NotFoundAfterLocalRun11=== RUN TestCaseHackSuffix12=== PAUSE TestCaseHackSuffix13=== RUN TestFilterOversizedClosures14=== PAUSE TestFilterOversizedClosures15=== RUN TestUploadMultipart_PartsInParallel16=== PAUSE TestUploadMultipart_PartsInParallel17=== RUN TestPartSizeForNAR18=== PAUSE TestPartSizeForNAR19=== RUN TestUploadMultipart_SupersededByPeer20=== PAUSE TestUploadMultipart_SupersededByPeer21=== RUN TestDumpPathCaseHackMatchesNix22--- PASS: TestDumpPathCaseHackMatchesNix (0.04s)23=== RUN TestDumpPathCaseHackCollision24--- PASS: TestDumpPathCaseHackCollision (0.00s)25=== RUN TestDumpPathMatchesNix26=== PAUSE TestDumpPathMatchesNix27=== RUN TestDumpPathSingleFile28=== PAUSE TestDumpPathSingleFile29=== RUN TestDumpPathWriterError30=== PAUSE TestDumpPathWriterError31=== RUN TestEncodeNixBase3232=== PAUSE TestEncodeNixBase3233=== RUN TestEncodeNixBase32WithRealHash34=== PAUSE TestEncodeNixBase32WithRealHash35=== RUN TestConvertHashToNix3236=== PAUSE TestConvertHashToNix3237=== RUN TestGetStorePathHash38=== PAUSE TestGetStorePathHash39=== RUN TestPathInfoHashCompatibility40=== PAUSE TestPathInfoHashCompatibility41=== RUN TestParsePathInfoJSON42=== PAUSE TestParsePathInfoJSON43=== RUN TestParsePathInfoJSONMultiplePaths44=== PAUSE TestParsePathInfoJSONMultiplePaths45=== RUN TestPathInfoCACompatibility46=== PAUSE TestPathInfoCACompatibility47=== RUN TestRateLimiterFeedback48=== PAUSE TestRateLimiterFeedback49=== RUN TestRateLimiterFeedback_400DoesNotCountAsSuccess50=== PAUSE TestRateLimiterFeedback_400DoesNotCountAsSuccess51=== RUN TestResolveStorePath52=== PAUSE TestResolveStorePath53=== RUN TestDoWithRetry_BodyReplayedViaGetBody54=== PAUSE TestDoWithRetry_BodyReplayedViaGetBody55=== RUN TestRetryTimeoutOutlastsMaxRetries56=== PAUSE TestRetryTimeoutOutlastsMaxRetries57=== RUN TestShellSplit58=== PAUSE TestShellSplit59=== RUN TestShellSplitErrors60=== PAUSE TestShellSplitErrors61=== RUN TestStreamPushReportsEveryPath62=== PAUSE TestStreamPushReportsEveryPath63=== RUN TestStreamPushBatchesUnderLoad64=== PAUSE TestStreamPushBatchesUnderLoad65=== RUN TestStreamPushIsolatesFailures66=== PAUSE TestStreamPushIsolatesFailures67=== RUN TestStreamPushGivesUpOnDeadServer68=== PAUSE TestStreamPushGivesUpOnDeadServer69=== RUN TestStreamPushRequestLine70=== PAUSE TestStreamPushRequestLine71=== RUN TestStreamPushReportsSignatures72=== PAUSE TestStreamPushReportsSignatures73=== RUN TestStreamPushReportsSkippedPaths74=== PAUSE TestStreamPushReportsSkippedPaths75=== RUN TestClientSignaturesByStorePath76=== PAUSE TestClientSignaturesByStorePath77=== RUN TestStreamPushStopsWhenCanceled78=== PAUSE TestStreamPushStopsWhenCanceled79=== RUN TestSetClientTLS80=== PAUSE TestSetClientTLS81=== RUN TestSetClientTLSDoesNotMutateDefaultTransport82=== PAUSE TestSetClientTLSDoesNotMutateDefaultTransport83=== RUN TestSetClientTLSErrors84=== PAUSE TestSetClientTLSErrors85=== RUN TestStaticToken86=== PAUSE TestStaticToken87=== RUN TestFileTokenReadsAndCaches88=== PAUSE TestFileTokenReadsAndCaches89=== RUN TestFileTokenMissing90=== PAUSE TestFileTokenMissing91=== RUN TestFileTokenEmpty92=== PAUSE TestFileTokenEmpty93=== RUN TestScriptTokenNoExpiryRerunsEveryCall94=== PAUSE TestScriptTokenNoExpiryRerunsEveryCall95=== RUN TestScriptTokenCachesUntilRefresh96=== PAUSE TestScriptTokenCachesUntilRefresh97=== RUN TestScriptTokenEmptyToken98=== PAUSE TestScriptTokenEmptyToken99=== RUN TestScriptTokenBadJSON100=== PAUSE TestScriptTokenBadJSON101=== RUN TestScriptTokenScriptFails102=== PAUSE TestScriptTokenScriptFails103=== RUN TestScriptTokenEmptyCommand104=== PAUSE TestScriptTokenEmptyCommand105=== CONT TestDoServerRequestAttachesToken106=== CONT TestScriptTokenScriptFails107=== CONT TestRetryTimeoutOutlastsMaxRetries108=== CONT TestScriptTokenBadJSON109=== CONT TestScriptTokenEmptyCommand110--- PASS: TestScriptTokenEmptyCommand (0.00s)111=== CONT TestClientSignaturesByStorePath112--- PASS: TestClientSignaturesByStorePath (0.00s)113=== CONT TestStreamPushReportsSkippedPaths114=== CONT TestScriptTokenEmptyToken115--- PASS: TestStreamPushReportsSkippedPaths (0.00s)116=== CONT TestScriptTokenCachesUntilRefresh117=== CONT TestParsePathInfoJSONMultiplePaths118=== CONT TestScriptTokenNoExpiryRerunsEveryCall119=== CONT TestFileTokenEmpty120=== CONT TestDoWithRetry_BodyReplayedViaGetBody121=== CONT TestFileTokenMissing122=== CONT TestResolveStorePath123=== CONT TestFileTokenReadsAndCaches124=== CONT TestRateLimiterFeedback_400DoesNotCountAsSuccess125=== CONT TestStaticToken126=== CONT TestRateLimiterFeedback127=== CONT TestSetClientTLSErrors128=== CONT TestSetClientTLSDoesNotMutateDefaultTransport129=== CONT TestPathInfoCACompatibility130=== CONT TestSetClientTLS131=== CONT TestGetStorePathHash132=== CONT TestStreamPushStopsWhenCanceled133=== CONT TestParsePathInfoJSON134=== CONT TestStreamPushRequestLine135--- PASS: TestScriptTokenScriptFails (0.00s)136=== CONT TestPathInfoHashCompatibility137--- PASS: TestScriptTokenBadJSON (0.00s)138=== RUN TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths139--- PASS: TestStaticToken (0.00s)140=== CONT TestStreamPushReportsSignatures141=== CONT TestStreamPushGivesUpOnDeadServer142=== RUN TestRateLimiterFeedback/429_enables_limiter143=== PAUSE TestRateLimiterFeedback/429_enables_limiter144=== RUN TestRateLimiterFeedback/503_enables_limiter145=== PAUSE TestRateLimiterFeedback/503_enables_limiter146=== RUN TestRateLimiterFeedback/200_does_not_enable_limiter147=== PAUSE TestRateLimiterFeedback/200_does_not_enable_limiter148=== RUN TestRateLimiterFeedback/400_does_not_enable_limiter149=== PAUSE TestRateLimiterFeedback/400_does_not_enable_limiter150=== CONT TestStreamPushIsolatesFailures151--- PASS: TestFileTokenEmpty (0.00s)152=== CONT TestStreamPushBatchesUnderLoad153=== RUN TestPathInfoCACompatibility/null_ca_field154=== CONT TestShellSplitErrors155--- PASS: TestShellSplitErrors (0.00s)156=== CONT TestShellSplit1572026/10/08 12:57:59 WARN Request returned retryable status, retrying attempt=1 backoff=1ms status=502 url=http://127.0.0.1:40999158=== PAUSE TestPathInfoCACompatibility/null_ca_field159--- PASS: TestShellSplit (0.00s)1602026/10/08 12:57:59 ERROR Upload failed error="bad path" count=31612026/10/08 12:57:59 ERROR Upload failed error="connection refused" count=201622026/10/08 12:57:59 ERROR Server seems unavailable, giving up on batch untried=17163--- PASS: TestScriptTokenEmptyToken (0.00s)164=== CONT TestStreamPushReportsEveryPath165=== RUN TestPathInfoCACompatibility/old_string_format_-_text166=== RUN TestGetStorePathHash/valid_store_path167=== RUN TestParsePathInfoJSON/Nix_format1682026/10/08 12:57:59 WARN Rate limiter enabled after throttle name=server-test rate=5169=== PAUSE TestParsePathInfoJSON/Nix_format1702026/10/08 12:57:59 WARN Request returned retryable status, retrying attempt=1 backoff=0s status=503 url=http://127.0.0.1:38269171=== RUN TestParsePathInfoJSON/Lix_format172=== CONT TestUploadMultipart_PartsInParallel1732026/10/08 12:57:59 WARN Rate limiter enabled after throttle name=server-test rate=5174--- PASS: TestFileTokenReadsAndCaches (0.00s)175--- PASS: TestStreamPushStopsWhenCanceled (0.00s)176=== PAUSE TestParsePathInfoJSON/Lix_format177=== RUN TestParsePathInfoJSON/empty_input178--- PASS: TestStreamPushIsolatesFailures (0.00s)179=== CONT TestUploadMultipart_SupersededByPeer180=== CONT TestDumpPathSingleFile1812026/10/08 12:57:59 ERROR Upload failed error=boom count=1182=== CONT TestDumpPathMatchesNix183--- PASS: TestStreamPushReportsEveryPath (0.00s)184--- PASS: TestDoServerRequestAttachesToken (0.01s)1852026/10/08 12:57:59 WARN Rate limiter backed off name=server-test rate=5186=== RUN TestUploadMultipart_SupersededByPeer/exists1872026/10/08 12:57:59 WARN Request returned retryable status, retrying attempt=2 backoff=0s status=503 url=http://127.0.0.1:38269188=== RUN TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)189=== PAUSE TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths190=== PAUSE TestGetStorePathHash/valid_store_path191=== CONT TestDumpPathWriterError1922026/10/08 12:57:59 WARN Request returned retryable status, retrying attempt=2 backoff=1ms status=502 url=http://127.0.0.1:40999193=== PAUSE TestPathInfoCACompatibility/old_string_format_-_text194=== PAUSE TestParsePathInfoJSON/empty_input195=== CONT TestPartSizeForNAR196=== RUN TestParsePathInfoJSON/whitespace_only197=== PAUSE TestParsePathInfoJSON/whitespace_only198=== RUN TestPartSizeForNAR/zero_stays_at_minimum1992026/10/08 12:57:59 ERROR Upload failed error=boom count=1200=== RUN TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths201=== PAUSE TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths202=== PAUSE TestPartSizeForNAR/zero_stays_at_minimum203=== RUN TestPartSizeForNAR/small_stays_at_minimum204=== CONT TestCaseHackSuffix205=== PAUSE TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)206=== RUN TestPathInfoHashCompatibility/old_string_format_with_colon207=== PAUSE TestPathInfoHashCompatibility/old_string_format_with_colon208=== RUN TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI209=== CONT TestRunGarbageCollection_NotFoundAfterLocalRun210=== CONT TestRunGarbageCollection_FinishedOnAnotherReplica211=== RUN TestPathInfoCACompatibility/old_string_format_-_fixed_recursive212=== PAUSE TestPathInfoCACompatibility/old_string_format_-_fixed_recursive213--- PASS: TestStreamPushGivesUpOnDeadServer (0.00s)214--- PASS: TestResolveStorePath (0.00s)215=== RUN TestSetClientTLSErrors/missing_cert_file216=== RUN TestGetStorePathHash/basename_without_hyphen_should_error217--- PASS: TestStreamPushReportsSignatures (0.02s)218--- PASS: TestFileTokenMissing (0.02s)219--- PASS: TestDoWithRetry_BodyReplayedViaGetBody (0.03s)220=== RUN TestParsePathInfoJSON/invalid_JSON221=== CONT TestFilterOversizedClosures222=== RUN TestFilterOversizedClosures/no_limit_keeps_everything223=== CONT TestConvertHashToNix32224=== PAUSE TestPartSizeForNAR/small_stays_at_minimum225=== RUN TestConvertHashToNix32/SRI_format_to_Nix32226=== RUN TestPartSizeForNAR/80_GiB_fits_at_minimum227=== PAUSE TestPartSizeForNAR/80_GiB_fits_at_minimum228=== RUN TestPartSizeForNAR/115_GiB_needs_larger_parts229=== PAUSE TestUploadMultipart_SupersededByPeer/exists230=== PAUSE TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI231=== PAUSE TestConvertHashToNix32/SRI_format_to_Nix32232=== RUN TestPathInfoCACompatibility/new_structured_format_-_text233=== PAUSE TestPartSizeForNAR/115_GiB_needs_larger_parts234=== PAUSE TestSetClientTLSErrors/missing_cert_file235=== RUN TestSetClientTLSErrors/missing_key_file236=== PAUSE TestParsePathInfoJSON/invalid_JSON237=== PAUSE TestFilterOversizedClosures/no_limit_keeps_everything2382026/10/08 12:57:59 INFO Garbage collection started239=== RUN TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped2402026/10/08 12:57:59 INFO Garbage collection started241=== RUN TestUploadMultipart_SupersededByPeer/missing242=== PAUSE TestUploadMultipart_SupersededByPeer/missing2432026/10/08 12:57:59 WARN Request returned retryable status, retrying attempt=1 backoff=1ms status=502 url=http://127.0.0.1:40999244=== RUN TestPathInfoHashCompatibility/new_structured_format_with_sha512245=== PAUSE TestPathInfoHashCompatibility/new_structured_format_with_sha512246=== CONT TestEncodeNixBase32247=== RUN TestEncodeNixBase32/test_string_hash248=== PAUSE TestEncodeNixBase32/test_string_hash249=== RUN TestEncodeNixBase32/empty_input250=== PAUSE TestEncodeNixBase32/empty_input251=== RUN TestConvertHashToNix32/already_Nix32_format252=== PAUSE TestConvertHashToNix32/already_Nix32_format253=== RUN TestConvertHashToNix32/invalid_format254--- PASS: TestSetClientTLSDoesNotMutateDefaultTransport (0.03s)255=== PAUSE TestPathInfoCACompatibility/new_structured_format_-_text256=== PAUSE TestSetClientTLSErrors/missing_key_file257=== RUN TestSetClientTLSErrors/missing_ca_file258=== RUN TestPartSizeForNAR/1_TiB259=== PAUSE TestPartSizeForNAR/1_TiB260=== RUN TestPartSizeForNAR/5_TiB_S3_max_object261=== PAUSE TestPartSizeForNAR/5_TiB_S3_max_object262=== RUN TestPartSizeForNAR/capped_at_5_GiB263=== CONT TestRegisterUploadedObjectReusesConnections264=== RUN TestSetClientTLS/rejects_connection_without_client_cert265=== PAUSE TestSetClientTLS/rejects_connection_without_client_cert266=== RUN TestSetClientTLS/succeeds_with_client_cert_and_CA267=== PAUSE TestSetClientTLS/succeeds_with_client_cert_and_CA268=== RUN TestSetClientTLS/preserves_debug_logging_transport269=== PAUSE TestSetClientTLS/preserves_debug_logging_transport270=== PAUSE TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped271=== RUN TestFilterOversizedClosures/all_closures_skipped272=== PAUSE TestFilterOversizedClosures/all_closures_skipped273=== CONT TestEncodeNixBase32WithRealHash274--- PASS: TestEncodeNixBase32WithRealHash (0.00s)275=== CONT TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths276=== CONT TestRateLimiterFeedback/503_enables_limiter277=== CONT TestRateLimiterFeedback/429_enables_limiter278=== CONT TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths279--- PASS: TestParsePathInfoJSONMultiplePaths (0.03s)280 --- PASS: TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths (0.00s)281 --- PASS: TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths (0.00s)282=== CONT TestRateLimiterFeedback/400_does_not_enable_limiter2832026/10/08 12:57:59 WARN Request returned retryable status, retrying attempt=2 backoff=1ms status=502 url=http://127.0.0.1:40999284=== CONT TestParsePathInfoJSON/Nix_format2852026/10/08 12:57:59 INFO Garbage collection progress phase=running_on_another_replica failed_uploads_deleted=0 old_closures_deleted=0 objects_marked=0 objects_deleted=0 objects_failed=0286=== PAUSE TestGetStorePathHash/basename_without_hyphen_should_error2872026/10/08 12:57:59 WARN Rate limiter enabled after throttle name=server-test rate=5288=== RUN TestGetStorePathHash/hash_with_invalid_characters_should_error2892026/10/08 12:57:59 WARN Request returned retryable status, retrying attempt=1 backoff=0s status=429 url=http://127.0.0.1:34331290=== PAUSE TestGetStorePathHash/hash_with_invalid_characters_should_error291=== RUN TestGetStorePathHash/hash_with_wrong_length_should_error292--- PASS: TestRunGarbageCollection_NotFoundAfterLocalRun (0.00s)293=== PAUSE TestGetStorePathHash/hash_with_wrong_length_should_error2942026/10/08 12:57:59 WARN Rate limiter enabled after throttle name=server-test rate=5295=== CONT TestParsePathInfoJSON/whitespace_only2962026/10/08 12:57:59 WARN Request returned retryable status, retrying attempt=1 backoff=0s status=503 url=http://127.0.0.1:35825297=== CONT TestParsePathInfoJSON/Lix_format298=== PAUSE TestConvertHashToNix32/invalid_format299=== CONT TestParsePathInfoJSON/invalid_JSON300=== CONT TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)3012026/10/08 12:57:59 WARN Rate limiter backed off name=server-test rate=5302=== PAUSE TestSetClientTLSErrors/missing_ca_file303=== RUN TestSetClientTLSErrors/invalid_ca_file3042026/10/08 12:57:59 WARN Rate limiter backed off name=server-test rate=5305=== PAUSE TestSetClientTLSErrors/invalid_ca_file306=== PAUSE TestPartSizeForNAR/capped_at_5_GiB307=== CONT TestPathInfoHashCompatibility/old_string_format_with_colon308=== CONT TestSetClientTLS/rejects_connection_without_client_cert309=== RUN TestPathInfoCACompatibility/new_structured_format_-_nar_method310=== CONT TestParsePathInfoJSON/empty_input311=== CONT TestSetClientTLS/preserves_debug_logging_transport312=== CONT TestSetClientTLS/succeeds_with_client_cert_and_CA3132026/10/08 12:57:59 WARN Request returned retryable status, retrying attempt=3 backoff=1ms status=502 url=http://127.0.0.1:40999314=== CONT TestFilterOversizedClosures/no_limit_keeps_everything315=== CONT TestFilterOversizedClosures/all_closures_skipped3162026/10/08 12:57:59 WARN Skipping closure: path exceeds server max NAR size top_level_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper oversized_path=/nix/store/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa-small nar_size=1000 max_nar_size=50317=== PAUSE TestPathInfoCACompatibility/new_structured_format_-_nar_method318=== CONT TestUploadMultipart_SupersededByPeer/exists319=== CONT TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped3202026/10/08 12:57:59 WARN Skipping closure: path exceeds server max NAR size top_level_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper oversized_path=/nix/store/bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb-vm-image nar_size=5000 max_nar_size=2000321=== CONT TestGetStorePathHash/hash_with_wrong_length_should_error3222026/10/08 12:57:59 WARN Garbage collection finished on another replica. Its statistics are not available here323=== CONT TestGetStorePathHash/hash_with_invalid_characters_should_error324=== CONT TestGetStorePathHash/basename_without_hyphen_should_error325=== CONT TestConvertHashToNix32/SRI_format_to_Nix32326=== CONT TestConvertHashToNix32/already_Nix32_format327=== CONT TestUploadMultipart_SupersededByPeer/missing328=== CONT TestEncodeNixBase32/test_string_hash329=== CONT TestPathInfoHashCompatibility/new_structured_format_with_sha512330=== CONT TestRateLimiterFeedback/200_does_not_enable_limiter331=== CONT TestEncodeNixBase32/empty_input332=== CONT TestConvertHashToNix32/invalid_format333=== CONT TestSetClientTLSErrors/missing_cert_file334=== CONT TestPartSizeForNAR/zero_stays_at_minimum335=== CONT TestSetClientTLSErrors/invalid_ca_file336=== CONT TestSetClientTLSErrors/missing_ca_file337=== CONT TestSetClientTLSErrors/missing_key_file338=== CONT TestPartSizeForNAR/capped_at_5_GiB339=== CONT TestPartSizeForNAR/5_TiB_S3_max_object340=== CONT TestPartSizeForNAR/1_TiB341=== CONT TestPartSizeForNAR/115_GiB_needs_larger_parts342=== CONT TestPartSizeForNAR/80_GiB_fits_at_minimum3432026/10/08 12:57:59 WARN Request returned retryable status, retrying attempt=4 backoff=1ms status=502 url=http://127.0.0.1:40999344=== CONT TestPartSizeForNAR/small_stays_at_minimum345=== CONT TestPathInfoCACompatibility/null_ca_field346=== CONT TestPathInfoCACompatibility/new_structured_format_-_text347=== CONT TestPathInfoCACompatibility/old_string_format_-_fixed_recursive348=== CONT TestPathInfoCACompatibility/old_string_format_-_text349--- PASS: TestParsePathInfoJSON (0.03s)350 --- PASS: TestParsePathInfoJSON/Nix_format (0.00s)351 --- PASS: TestParsePathInfoJSON/whitespace_only (0.00s)352 --- PASS: TestParsePathInfoJSON/Lix_format (0.00s)353 --- PASS: TestParsePathInfoJSON/invalid_JSON (0.00s)354 --- PASS: TestParsePathInfoJSON/empty_input (0.00s)355--- PASS: TestScriptTokenNoExpiryRerunsEveryCall (0.03s)356=== CONT TestGetStorePathHash/valid_store_path357--- PASS: TestFilterOversizedClosures (0.00s)358 --- PASS: TestFilterOversizedClosures/no_limit_keeps_everything (0.00s)359 --- PASS: TestFilterOversizedClosures/all_closures_skipped (0.00s)360 --- PASS: TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped (0.00s)361=== CONT TestPathInfoCACompatibility/new_structured_format_-_nar_method362=== CONT TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI363--- PASS: TestGetStorePathHash (0.03s)364 --- PASS: TestGetStorePathHash/hash_with_wrong_length_should_error (0.00s)365 --- PASS: TestGetStorePathHash/hash_with_invalid_characters_should_error (0.00s)366 --- PASS: TestGetStorePathHash/basename_without_hyphen_should_error (0.00s)367 --- PASS: TestGetStorePathHash/valid_store_path (0.00s)368--- PASS: TestRunGarbageCollection_FinishedOnAnotherReplica (0.00s)369--- PASS: TestPartSizeForNAR (0.00s)370 --- PASS: TestPartSizeForNAR/zero_stays_at_minimum (0.00s)371 --- PASS: TestPartSizeForNAR/capped_at_5_GiB (0.00s)372 --- PASS: TestPartSizeForNAR/5_TiB_S3_max_object (0.00s)373 --- PASS: TestPartSizeForNAR/1_TiB (0.00s)374 --- PASS: TestPartSizeForNAR/115_GiB_needs_larger_parts (0.00s)375 --- PASS: TestPartSizeForNAR/80_GiB_fits_at_minimum (0.00s)376 --- PASS: TestPartSizeForNAR/small_stays_at_minimum (0.00s)377--- PASS: TestEncodeNixBase32 (0.00s)378 --- PASS: TestEncodeNixBase32/empty_input (0.00s)379 --- PASS: TestEncodeNixBase32/test_string_hash (0.00s)380--- PASS: TestConvertHashToNix32 (0.00s)381 --- PASS: TestConvertHashToNix32/SRI_format_to_Nix32 (0.00s)382 --- PASS: TestConvertHashToNix32/invalid_format (0.00s)383 --- PASS: TestConvertHashToNix32/already_Nix32_format (0.00s)384--- PASS: TestScriptTokenCachesUntilRefresh (0.04s)385--- PASS: TestPathInfoHashCompatibility (0.03s)386 --- PASS: TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI) (0.00s)387 --- PASS: TestPathInfoHashCompatibility/old_string_format_with_colon (0.00s)388 --- PASS: TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI (0.00s)389 --- PASS: TestPathInfoHashCompatibility/new_structured_format_with_sha512 (0.00s)390--- PASS: TestPathInfoCACompatibility (0.03s)391 --- PASS: TestPathInfoCACompatibility/null_ca_field (0.00s)392 --- PASS: TestPathInfoCACompatibility/new_structured_format_-_text (0.00s)393 --- PASS: TestPathInfoCACompatibility/old_string_format_-_fixed_recursive (0.00s)394 --- PASS: TestPathInfoCACompatibility/old_string_format_-_text (0.00s)395 --- PASS: TestPathInfoCACompatibility/new_structured_format_-_nar_method (0.00s)396--- PASS: TestSetClientTLSErrors (0.03s)397 --- PASS: TestSetClientTLSErrors/missing_cert_file (0.00s)398 --- PASS: TestSetClientTLSErrors/invalid_ca_file (0.00s)399 --- PASS: TestSetClientTLSErrors/missing_ca_file (0.00s)400 --- PASS: TestSetClientTLSErrors/missing_key_file (0.00s)401--- PASS: TestRateLimiterFeedback (0.00s)402 --- PASS: TestRateLimiterFeedback/400_does_not_enable_limiter (0.00s)403 --- PASS: TestRateLimiterFeedback/503_enables_limiter (0.00s)404 --- PASS: TestRateLimiterFeedback/429_enables_limiter (0.00s)405 --- PASS: TestRateLimiterFeedback/200_does_not_enable_limiter (0.00s)406--- PASS: TestUploadMultipart_SupersededByPeer (0.03s)407 --- PASS: TestUploadMultipart_SupersededByPeer/exists (0.00s)408 --- PASS: TestUploadMultipart_SupersededByPeer/missing (0.00s)4092026/10/08 12:57:59 WARN Request returned retryable status, retrying attempt=5 backoff=1ms status=502 url=http://127.0.0.1:409994102026/10/08 12:57:59 WARN Request returned retryable status, retrying attempt=6 backoff=1ms status=502 url=http://127.0.0.1:409994112026/10/08 12:57:59 WARN Request returned retryable status, retrying attempt=7 backoff=1ms status=502 url=http://127.0.0.1:409994122026/10/08 12:57:59 WARN Request returned retryable status, retrying attempt=8 backoff=1ms status=502 url=http://127.0.0.1:409994132026/10/08 12:57:59 WARN Request returned retryable status, retrying attempt=9 backoff=1ms status=502 url=http://127.0.0.1:409994142026/10/08 12:57:59 WARN Request returned retryable status, retrying attempt=10 backoff=1ms status=502 url=http://127.0.0.1:409994152026/10/08 12:57:59 WARN Request returned retryable status, retrying attempt=11 backoff=1ms status=502 url=http://127.0.0.1:409994162026/10/08 12:57:59 WARN Request returned retryable status, retrying attempt=12 backoff=1ms status=502 url=http://127.0.0.1:409994172026/10/08 12:57:59 WARN Request returned retryable status, retrying attempt=13 backoff=1ms status=502 url=http://127.0.0.1:40999418--- PASS: TestStreamPushRequestLine (0.05s)4192026/10/08 12:57:59 http: TLS handshake error from 127.0.0.1:37640: remote error: tls: bad certificate420--- PASS: TestSetClientTLS (0.03s)421 --- PASS: TestSetClientTLS/succeeds_with_client_cert_and_CA (0.01s)422 --- PASS: TestSetClientTLS/preserves_debug_logging_transport (0.01s)423 --- PASS: TestSetClientTLS/rejects_connection_without_client_cert (0.02s)4242026/10/08 12:57:59 WARN Request returned retryable status, retrying attempt=14 backoff=1ms status=502 url=http://127.0.0.1:409994252026/10/08 12:57:59 WARN Request returned retryable status, retrying attempt=15 backoff=1ms status=502 url=http://127.0.0.1:40999426--- PASS: TestRegisterUploadedObjectReusesConnections (0.02s)4272026/10/08 12:57:59 WARN Request returned retryable status, retrying attempt=16 backoff=1ms status=502 url=http://127.0.0.1:409994282026/10/08 12:57:59 WARN Request returned retryable status, retrying attempt=17 backoff=1ms status=502 url=http://127.0.0.1:40999429--- PASS: TestDumpPathSingleFile (0.05s)430--- PASS: TestRetryTimeoutOutlastsMaxRetries (0.06s)431--- PASS: TestCaseHackSuffix (0.03s)432--- PASS: TestDumpPathWriterError (0.04s)433--- PASS: TestDumpPathMatchesNix (0.10s)434--- PASS: TestStreamPushBatchesUnderLoad (0.10s)435--- PASS: TestUploadMultipart_PartsInParallel (0.65s)436--- PASS: TestRateLimiterFeedback_400DoesNotCountAsSuccess (1.00s)437PASS438Running server tests...439The files belonging to this database system will be owned by user "nixbld".440This user must also own the server process.441442The database cluster will be initialized with locale "C".443The default database encoding has accordingly been set to "SQL_ASCII".444The default text search configuration will be set to "english".445446Data page checksums are enabled.447448creating directory /build/postgres575508365/data ... ok449creating subdirectories ... ok450selecting dynamic shared memory implementation ... posix451selecting default "max_connections" ... 100452selecting default "shared_buffers" ... 128MB453selecting default time zone ... UTC454creating configuration files ... ok455running bootstrap script ... ok456performing post-bootstrap initialization ... ok457syncing data to disk ... ok458459initdb: warning: enabling "trust" authentication for local connections460initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.461462Success. You can now start the database server using:463464 pg_ctl -D /build/postgres575508365/data -l logfile start465466/build/postgres575508365:5432 - no response4672026-10-08 12:58:01.712 UTC [128] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit4682026-10-08 12:58:01.712 UTC [128] LOG: listening on Unix socket "/build/postgres575508365/.s.PGSQL.5432"4692026-10-08 12:58:01.717 UTC [135] LOG: database system was shut down at 2026-10-08 12:58:01 UTC4702026-10-08 12:58:01.721 UTC [128] LOG: database system is ready to accept connections471/build/postgres575508365:5432 - accepting connections472{"timestamp":"2026-10-08T12:58:01.913565246Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"51c7b688-1a98-42e2-958a-53b249ea8a96","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"GET","uri":"/health/ready","status_code":503,"suppressed_errors":0,"duration_ms":0,"result":"server_error","target":"rustfs::server::http","filename":"rustfs/src/server/layer.rs","line_number":501,"threadName":"rustfs-worker","threadId":"ThreadId(209)"}473=== RUN TestService_AuthMiddleware474=== PAUSE TestService_AuthMiddleware475=== RUN TestService_AuthMiddleware_MTLSProxyHeader476=== PAUSE TestService_AuthMiddleware_MTLSProxyHeader477=== RUN TestService_AuthMiddleware_MTLSBoundSubjects478=== PAUSE TestService_AuthMiddleware_MTLSBoundSubjects479=== RUN TestService_ReadAuthMiddleware480=== PAUSE TestService_ReadAuthMiddleware481=== RUN TestService_AuthMiddleware_OIDC482=== PAUSE TestService_AuthMiddleware_OIDC483=== RUN TestService_RequireScope_OIDC484=== PAUSE TestService_RequireScope_OIDC485=== RUN TestService_ReadScope_PublicByDefault486=== PAUSE TestService_ReadScope_PublicByDefault487=== RUN TestCacheConfigHandler488=== PAUSE TestCacheConfigHandler489=== RUN TestCacheStatsHandler490=== PAUSE TestCacheStatsHandler491=== RUN TestClientCADerivations492=== PAUSE TestClientCADerivations493=== RUN TestClientErrorHandling494=== PAUSE TestClientErrorHandling495=== RUN TestClientIntegration496=== PAUSE TestClientIntegration497=== RUN TestClientMultipleUploads498=== PAUSE TestClientMultipleUploads499=== RUN TestClientWithDependencies500=== PAUSE TestClientWithDependencies501=== RUN TestClientSharedPathCommittedMidPush502=== PAUSE TestClientSharedPathCommittedMidPush503=== RUN TestPinProtectsFromGC504=== PAUSE TestPinProtectsFromGC505=== RUN TestClientPushesUseOnePush506=== PAUSE TestClientPushesUseOnePush507=== RUN TestClientFallsBackToClosures508=== PAUSE TestClientFallsBackToClosures509=== RUN TestDeleteClosuresRacingPins510=== PAUSE TestDeleteClosuresRacingPins511=== RUN TestConcurrentCommitsSharingObjectsDoNotDeadlock512=== PAUSE TestConcurrentCommitsSharingObjectsDoNotDeadlock513=== RUN TestResolveDBConnectionString514=== PAUSE TestResolveDBConnectionString515=== RUN TestConnectWaitsForAPeerMigration516=== PAUSE TestConnectWaitsForAPeerMigration517=== RUN TestLeadElectsOneAndHandsOver518=== PAUSE TestLeadElectsOneAndHandsOver519=== RUN TestLeadIncumbentWinsAfterRestart5202026/10/08 12:58:02 INFO lead: acquired remote=192.0.2.1:12345212026/10/08 12:58:02 INFO lead: released remote=192.0.2.1:12345222026/10/08 12:58:02 INFO lead: acquired remote=192.0.2.1:12345232026/10/08 12:58:03 INFO lead: released remote=192.0.2.1:1234524--- PASS: TestLeadIncumbentWinsAfterRestart (1.84s)525=== RUN TestLeadIncumbentAnnouncesAtOnce526=== PAUSE TestLeadIncumbentAnnouncesAtOnce527=== RUN TestLeadEndsOnShutdown528=== PAUSE TestLeadEndsOnShutdown529=== RUN TestLeadEndsWhenItsConnectionHangs5302026/10/08 12:58:03 INFO lead: acquired remote=192.0.2.1:12345312026-10-08 12:58:05.368 UTC [381] FATAL: terminating connection due to administrator command5322026/10/08 12:58:05 INFO lead: acquired remote=192.0.2.1:12345332026/10/08 12:58:06 WARN lead: lock connection lost error="timeout: context deadline exceeded"5342026/10/08 12:58:06 INFO lead: released remote=192.0.2.1:12345352026/10/08 12:58:06 INFO lead: released remote=192.0.2.1:1234536--- PASS: TestLeadEndsWhenItsConnectionHangs (3.12s)537=== RUN TestGCAdvisoryLockBlocksConcurrentRun538=== PAUSE TestGCAdvisoryLockBlocksConcurrentRun539=== RUN TestGCBugBareHashReferences540=== PAUSE TestGCBugBareHashReferences541=== RUN TestGCMetrics542=== PAUSE TestGCMetrics543=== RUN TestPushDedupSurvivesConcurrentGC544=== PAUSE TestPushDedupSurvivesConcurrentGC545=== RUN TestDeduplicatedObjectsRecordedAsPending546=== PAUSE TestDeduplicatedObjectsRecordedAsPending547=== RUN TestGCSweepSkipsPendingObjects548=== PAUSE TestGCSweepSkipsPendingObjects549=== RUN TestTombstonedObjectOfferedWithoutWaiting550=== PAUSE TestTombstonedObjectOfferedWithoutWaiting551=== RUN TestGCSweepDeliversEachKeyOnce552=== PAUSE TestGCSweepDeliversEachKeyOnce553=== RUN TestCreatePendingClosureVerifyS3FailureReleasesConnection554=== PAUSE TestCreatePendingClosureVerifyS3FailureReleasesConnection555=== RUN TestForceGCDuringPushOffersSweptObject556=== PAUSE TestForceGCDuringPushOffersSweptObject557=== RUN TestFailedS3DeleteKeepsTombstone558=== PAUSE TestFailedS3DeleteKeepsTombstone559=== RUN TestSweepSkipsRowsLockedByPush560=== PAUSE TestSweepSkipsRowsLockedByPush561=== RUN TestRegisterCompletedObjectNeedsPendingRow562=== PAUSE TestRegisterCompletedObjectNeedsPendingRow563=== RUN TestGetExistingObjectsLocksRows564=== PAUSE TestGetExistingObjectsLocksRows565=== RUN TestSweepRechecksPendingAfterLocking566=== PAUSE TestSweepRechecksPendingAfterLocking567=== RUN TestPushWaitsForSweepHoldingRow568=== PAUSE TestPushWaitsForSweepHoldingRow569=== RUN TestCommitRacingPendingCleanupKeepsObjects570=== PAUSE TestCommitRacingPendingCleanupKeepsObjects571=== RUN TestGCEndsOnShutdown572=== PAUSE TestGCEndsOnShutdown573=== RUN TestGCTaskStore_StartNew574=== PAUSE TestGCTaskStore_StartNew575=== RUN TestGCTaskStore_DeduplicateSameParams576=== PAUSE TestGCTaskStore_DeduplicateSameParams577=== RUN TestGCTaskStore_ConflictDifferentParams578=== PAUSE TestGCTaskStore_ConflictDifferentParams579=== RUN TestGCTaskStore_GetEmpty580=== PAUSE TestGCTaskStore_GetEmpty581=== RUN TestGCTaskStore_GetReturnsLatest582=== PAUSE TestGCTaskStore_GetReturnsLatest583=== RUN TestGCTaskStore_CompletedAllowsNewTask584=== PAUSE TestGCTaskStore_CompletedAllowsNewTask585=== RUN TestGCTaskStore_PhaseUpdates586=== PAUSE TestGCTaskStore_PhaseUpdates587=== RUN TestGCTaskStore_Fail588=== PAUSE TestGCTaskStore_Fail589=== RUN TestGracefulShutdownDrainsInflight590=== PAUSE TestGracefulShutdownDrainsInflight591=== RUN TestService_healthCheckHandler592=== PAUSE TestService_healthCheckHandler593=== RUN TestService_readinessHandler594=== PAUSE TestService_readinessHandler595=== RUN TestGenerateLandingPage596=== PAUSE TestGenerateLandingPage597=== RUN TestCacheConfigHandlerMaxNarSize598=== PAUSE TestCacheConfigHandlerMaxNarSize599=== RUN TestCreatePendingClosureRejectsOversizedNAR600=== PAUSE TestCreatePendingClosureRejectsOversizedNAR601=== RUN TestNARDeduplicationMetadataUploadBug602=== PAUSE TestNARDeduplicationMetadataUploadBug603=== RUN TestMetricsInventory604=== PAUSE TestMetricsInventory605=== RUN TestMetricsCommit606=== PAUSE TestMetricsCommit607=== RUN TestService_NativeMTLS608=== PAUSE TestService_NativeMTLS609=== RUN TestServerTLSConfig610=== PAUSE TestServerTLSConfig611=== RUN TestMultipartCleanup612=== PAUSE TestMultipartCleanup613=== RUN TestMultipartUploadAbortedWhenCancelledBeforeRecorded614=== PAUSE TestMultipartUploadAbortedWhenCancelledBeforeRecorded615=== RUN TestPendingCleanupUsesOneCutoff616=== PAUSE TestPendingCleanupUsesOneCutoff617=== RUN TestObjectStatsTrigger618=== PAUSE TestObjectStatsTrigger619=== RUN TestObjectStatsLargeCommit620=== PAUSE TestObjectStatsLargeCommit621=== RUN TestOrphanedObjectsGC622=== PAUSE TestOrphanedObjectsGC623=== RUN TestOrphanedObjectsGCStressTest624=== PAUSE TestOrphanedObjectsGCStressTest625=== RUN TestCreatePin_ReservedPins626=== PAUSE TestCreatePin_ReservedPins627=== RUN TestPresentReportsOnlyClosureRoots628=== PAUSE TestPresentReportsOnlyClosureRoots629=== RUN TestPresentRefreshesOnlyStaleClosures630=== PAUSE TestPresentRefreshesOnlyStaleClosures631=== RUN TestPresentNotReportedWhileGCDeletesClosure632=== PAUSE TestPresentNotReportedWhileGCDeletesClosure633=== RUN TestParseSingleRange634=== PAUSE TestParseSingleRange635=== RUN TestProxyHeadersOnlyTrustedOnSocket6362026/10/08 12:58:07 INFO Starting HTTP server address=proxy.sock6372026/10/08 12:58:07 INFO Starting HTTP server address=127.0.0.1:457816382026/10/08 12:58:07 WARN mTLS auth: subject not in bound subjects subject="CN=someone"6392026/10/08 12:58:07 INFO Shutdown signal received, draining in-flight requests timeout=10s640--- PASS: TestProxyHeadersOnlyTrustedOnSocket (0.12s)641=== RUN TestIsValidCachePath642=== PAUSE TestIsValidCachePath643=== RUN TestReadProxyNarinfo644=== PAUSE TestReadProxyNarinfo645=== RUN TestReadProxyNarinfoAlreadyDecompressed646=== PAUSE TestReadProxyNarinfoAlreadyDecompressed647=== RUN TestReadProxyContentNegotiation648=== PAUSE TestReadProxyContentNegotiation649=== RUN TestReadProxyNarStreaming650=== PAUSE TestReadProxyNarStreaming651=== RUN TestReadProxy404652=== PAUSE TestReadProxy404653=== RUN TestReadProxyInvalidPath654=== PAUSE TestReadProxyInvalidPath655=== RUN TestReadProxyHead656=== PAUSE TestReadProxyHead657=== RUN TestReadProxyOutlastsServerWriteTimeout658=== PAUSE TestReadProxyOutlastsServerWriteTimeout659=== RUN TestReadProxyConditionalGet660=== PAUSE TestReadProxyConditionalGet661=== RUN TestReadProxyRootRedirectsToIndexHTML662=== PAUSE TestReadProxyRootRedirectsToIndexHTML663=== RUN TestReadProxyDisabled664=== PAUSE TestReadProxyDisabled665=== RUN TestReadRedirectNar666=== PAUSE TestReadRedirectNar667=== RUN TestReadRedirectKeepsNarinfoProxied668=== PAUSE TestReadRedirectKeepsNarinfoProxied669=== RUN TestReadProxyRangeRequest670=== PAUSE TestReadProxyRangeRequest671=== RUN TestReadRedirectUsesPublicS3URL672=== PAUSE TestReadRedirectUsesPublicS3URL673=== RUN TestPush_OverlappingRootsStoreOneRowPerKey674=== PAUSE TestPush_OverlappingRootsStoreOneRowPerKey675=== RUN TestPush_CompleteCommitsEveryRoot676=== PAUSE TestPush_CompleteCommitsEveryRoot677=== RUN TestPush_RepeatedRootCommitsOnce678=== PAUSE TestPush_RepeatedRootCommitsOnce679=== RUN TestPush_CompleteWaitsForCleanupOfThePush680=== PAUSE TestPush_CompleteWaitsForCleanupOfThePush681=== RUN TestPush_RootsAreLockedInByteOrder682=== PAUSE TestPush_RootsAreLockedInByteOrder683=== RUN TestPush_SkippedKeySurvivesGCBeforeCommit684=== PAUSE TestPush_SkippedKeySurvivesGCBeforeCommit685=== RUN TestPush_RejectsBadRequests686=== PAUSE TestPush_RejectsBadRequests687=== RUN TestPush_SignsNarinfosOfItsPendingObjects688=== PAUSE TestPush_SignsNarinfosOfItsPendingObjects689=== RUN TestRedundantMultipartUpload690=== PAUSE TestRedundantMultipartUpload691=== RUN TestCompleteMultipartUpload_ErrorButObjectExists692=== PAUSE TestCompleteMultipartUpload_ErrorButObjectExists693=== RUN TestCompletedNarNotReofferedAcrossClosures694=== PAUSE TestCompletedNarNotReofferedAcrossClosures695=== RUN TestPresignedUploadRegisteredBeforeCommit696=== PAUSE TestPresignedUploadRegisteredBeforeCommit697=== RUN TestService_Rustfstest698=== PAUSE TestService_Rustfstest699=== RUN TestParseSize700=== PAUSE TestParseSize701=== RUN TestSkippedUploadsHandler702=== PAUSE TestSkippedUploadsHandler703=== RUN TestSystemdListenerNotActivated704--- PASS: TestSystemdListenerNotActivated (0.00s)705=== RUN TestWatchdogBeatsWhenHealthy706--- PASS: TestWatchdogBeatsWhenHealthy (0.02s)707=== RUN TestWatchdogSkipsWhenUnhealthy7082026/10/08 12:58:07 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7092026/10/08 12:58:07 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7102026/10/08 12:58:07 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7112026/10/08 12:58:07 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7122026/10/08 12:58:07 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7132026/10/08 12:58:07 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7142026/10/08 12:58:07 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7152026/10/08 12:58:07 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7162026/10/08 12:58:07 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7172026/10/08 12:58:07 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"718--- PASS: TestWatchdogSkipsWhenUnhealthy (0.20s)719=== RUN TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle720=== PAUSE TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle721=== RUN TestProxyWriteTimeout722=== PAUSE TestProxyWriteTimeout723=== RUN TestPendingClosureWriteTimeout724=== PAUSE TestPendingClosureWriteTimeout725=== RUN TestIsValidUploadKey726=== PAUSE TestIsValidUploadKey727=== RUN TestUploadHandlersRejectInvalidKeys728=== PAUSE TestUploadHandlersRejectInvalidKeys729=== RUN TestUploadHandlersRejectOversizedBody730=== PAUSE TestUploadHandlersRejectOversizedBody731=== RUN TestService_cleanupPendingClosuresHandler732=== PAUSE TestService_cleanupPendingClosuresHandler733=== RUN TestService_createPendingClosureHandler734=== PAUSE TestService_createPendingClosureHandler735=== RUN TestService_verifyS3Integrity736=== PAUSE TestService_verifyS3Integrity737=== RUN TestCompleteMultipartUnregistered738=== PAUSE TestCompleteMultipartUnregistered739=== RUN TestCreatePendingClosure_SmallNARUsesSimplePUT740=== PAUSE TestCreatePendingClosure_SmallNARUsesSimplePUT741=== CONT TestSkippedUploadsHandler742=== CONT TestService_AuthMiddleware743=== CONT TestParseSize744--- PASS: TestParseSize (0.00s)745=== CONT TestReadProxyOutlastsServerWriteTimeout746=== CONT TestService_Rustfstest747=== CONT TestPresignedUploadRegisteredBeforeCommit7482026/10/08 12:58:07 INFO Client skipped oversized paths paths=3 nar_bytes=5000000000749=== CONT TestCompletedNarNotReofferedAcrossClosures750=== CONT TestCompleteMultipartUpload_ErrorButObjectExists751=== CONT TestRedundantMultipartUpload752=== CONT TestPush_SignsNarinfosOfItsPendingObjects753=== CONT TestPush_RejectsBadRequests754=== CONT TestPush_SkippedKeySurvivesGCBeforeCommit755=== CONT TestPush_RootsAreLockedInByteOrder756=== CONT TestPush_CompleteWaitsForCleanupOfThePush757=== CONT TestPush_RepeatedRootCommitsOnce758=== CONT TestPush_CompleteCommitsEveryRoot759=== CONT TestPush_OverlappingRootsStoreOneRowPerKey760=== CONT TestReadRedirectUsesPublicS3URL761=== CONT TestReadProxyRangeRequest762=== CONT TestReadRedirectKeepsNarinfoProxied763=== CONT TestReadRedirectNar764=== CONT TestReadProxyDisabled765=== CONT TestReadProxyRootRedirectsToIndexHTML766=== CONT TestReadProxyConditionalGet767=== CONT TestUploadHandlersRejectOversizedBody768--- PASS: TestSkippedUploadsHandler (0.01s)769=== CONT TestReadProxyHead770=== RUN TestUploadHandlersRejectOversizedBody/complete_multipart771=== PAUSE TestUploadHandlersRejectOversizedBody/complete_multipart772=== RUN TestUploadHandlersRejectOversizedBody/request_more_parts773=== PAUSE TestUploadHandlersRejectOversizedBody/request_more_parts774=== RUN TestUploadHandlersRejectOversizedBody/create_pending_closure775=== PAUSE TestUploadHandlersRejectOversizedBody/create_pending_closure776=== CONT TestReadProxyInvalidPath7772026/10/08 12:58:07 INFO Received uploads request method=POST path=/api/pending_closures7782026/10/08 12:58:07 INFO Received uploads request method=POST path=/api/pending_closures7792026/10/08 12:58:07 INFO Received push request method=POST path=/api/pushes7802026/10/08 12:58:07 INFO Received push request method=POST path=/api/pushes7812026/10/08 12:58:07 INFO Received complete push request method=POST path=/api/pushes/1/complete7822026/10/08 12:58:07 INFO Completed push id=1 objects=4 duration=8.586755ms7832026/10/08 12:58:07 INFO Received push request method=POST path=/api/pushes7842026/10/08 12:58:07 WARN Authentication failed token_preview=wrongtoken token_length=10 reason="static API token mismatch"785--- PASS: TestService_AuthMiddleware (0.39s)786=== CONT TestReadProxy4047872026-10-08 12:58:07.710 UTC [483] ERROR: could not obtain lock on row in relation "closures"7882026-10-08 12:58:07.710 UTC [483] STATEMENT: SELECT 1 FROM closures WHERE key = $1 FOR UPDATE NOWAIT7892026-10-08 12:58:07.710 UTC [483] ERROR: could not obtain lock on row in relation "closures"7902026-10-08 12:58:07.710 UTC [483] STATEMENT: SELECT 1 FROM closures WHERE key = $1 FOR UPDATE NOWAIT7912026-10-08 12:58:07.711 UTC [483] ERROR: could not obtain lock on row in relation "closures"7922026-10-08 12:58:07.711 UTC [483] STATEMENT: SELECT 1 FROM closures WHERE key = $1 FOR UPDATE NOWAIT7932026-10-08 12:58:07.711 UTC [483] ERROR: could not obtain lock on row in relation "closures"7942026-10-08 12:58:07.711 UTC [483] STATEMENT: SELECT 1 FROM closures WHERE key = $1 FOR UPDATE NOWAIT7952026-10-08 12:58:07.711 UTC [483] ERROR: could not obtain lock on row in relation "closures"7962026-10-08 12:58:07.711 UTC [483] STATEMENT: SELECT 1 FROM closures WHERE key = $1 FOR UPDATE NOWAIT797--- PASS: TestPush_RootsAreLockedInByteOrder (0.40s)798=== CONT TestReadProxyNarStreaming7992026/10/08 12:58:07 INFO Received uploads request method=POST path=/api/pending_closures800--- PASS: TestService_Rustfstest (0.43s)801=== CONT TestReadProxyContentNegotiation8022026/10/08 12:58:07 INFO Registered completed upload object_key=nar/jjjjjjjjjjjjjjjjjjjjjjjjjjjjjj0100000000000000000000.nar.zst8032026/10/08 12:58:07 INFO Received uploads request method=POST path=/api/pending_closures8042026/10/08 12:58:07 INFO Aborted multipart uploads count=0 kept=0805--- PASS: TestPresignedUploadRegisteredBeforeCommit (0.43s)806=== CONT TestReadProxyNarinfoAlreadyDecompressed8072026/10/08 12:58:07 WARN Force mode enabled - objects will be deleted immediately without grace period808=== RUN TestPush_RejectsBadRequests/bad_root809=== PAUSE TestPush_RejectsBadRequests/bad_root810=== RUN TestPush_RejectsBadRequests/root_not_in_objects811=== PAUSE TestPush_RejectsBadRequests/root_not_in_objects812=== RUN TestPush_RejectsBadRequests/no_roots813=== PAUSE TestPush_RejectsBadRequests/no_roots814=== RUN TestPush_RejectsBadRequests/no_objects815=== PAUSE TestPush_RejectsBadRequests/no_objects816=== CONT TestReadProxyNarinfo8172026/10/08 12:58:07 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=2 objects-deleted-after-grace-period=2 objects-failed-to-delete=08182026/10/08 12:58:07 INFO Vacuumed table table=pending_closures8192026/10/08 12:58:07 INFO Vacuumed table table=pending_objects8202026/10/08 12:58:07 INFO Vacuumed table table=multipart_uploads8212026/10/08 12:58:07 INFO Vacuumed table table=closures8222026/10/08 12:58:07 INFO Vacuumed table table=objects8232026/10/08 12:58:07 INFO Received complete push request method=POST path=/api/pushes/2/complete8242026/10/08 12:58:07 INFO Completed push id=2 objects=4 duration=3.755153ms825--- PASS: TestPush_SkippedKeySurvivesGCBeforeCommit (0.47s)826=== CONT TestIsValidCachePath827=== RUN TestIsValidCachePath/narinfo828=== PAUSE TestIsValidCachePath/narinfo829=== RUN TestIsValidCachePath/narinfo_all_nix_base32_chars830=== PAUSE TestIsValidCachePath/narinfo_all_nix_base32_chars831=== RUN TestIsValidCachePath/nar_zst832=== PAUSE TestIsValidCachePath/nar_zst833=== RUN TestIsValidCachePath/nar_xz834=== PAUSE TestIsValidCachePath/nar_xz835=== RUN TestIsValidCachePath/nar_bz2836=== PAUSE TestIsValidCachePath/nar_bz2837=== RUN TestIsValidCachePath/nar_uncompressed838=== PAUSE TestIsValidCachePath/nar_uncompressed839=== RUN TestIsValidCachePath/ls840=== PAUSE TestIsValidCachePath/ls841=== RUN TestIsValidCachePath/log842=== PAUSE TestIsValidCachePath/log843=== RUN TestIsValidCachePath/realisation844=== PAUSE TestIsValidCachePath/realisation845=== RUN TestIsValidCachePath/nix-cache-info846=== PAUSE TestIsValidCachePath/nix-cache-info847=== RUN TestIsValidCachePath/index.html848=== PAUSE TestIsValidCachePath/index.html849=== RUN TestIsValidCachePath/traversal_parent850=== PAUSE TestIsValidCachePath/traversal_parent851=== RUN TestIsValidCachePath/traversal_in_middle852=== PAUSE TestIsValidCachePath/traversal_in_middle853=== RUN TestIsValidCachePath/invalid_char_e854=== PAUSE TestIsValidCachePath/invalid_char_e855=== RUN TestIsValidCachePath/invalid_char_u856=== PAUSE TestIsValidCachePath/invalid_char_u857=== RUN TestIsValidCachePath/random_path858=== PAUSE TestIsValidCachePath/random_path859=== RUN TestIsValidCachePath/empty860=== PAUSE TestIsValidCachePath/empty861=== RUN TestIsValidCachePath/leading_slash862=== PAUSE TestIsValidCachePath/leading_slash863=== RUN TestIsValidCachePath/wrong_extension864=== PAUSE TestIsValidCachePath/wrong_extension865=== RUN TestIsValidCachePath/short_hash866=== PAUSE TestIsValidCachePath/short_hash867=== CONT TestParseSingleRange868=== RUN TestParseSingleRange/none869=== PAUSE TestParseSingleRange/none870=== RUN TestParseSingleRange/unknown_unit871=== PAUSE TestParseSingleRange/unknown_unit872=== RUN TestParseSingleRange/multi-range_ignored873=== PAUSE TestParseSingleRange/multi-range_ignored874=== RUN TestParseSingleRange/malformed_no_dash875=== PAUSE TestParseSingleRange/malformed_no_dash876=== RUN TestParseSingleRange/malformed_both_empty877=== PAUSE TestParseSingleRange/malformed_both_empty878=== RUN TestParseSingleRange/malformed_end_before_start879=== PAUSE TestParseSingleRange/malformed_end_before_start880=== RUN TestParseSingleRange/closed881=== PAUSE TestParseSingleRange/closed882=== RUN TestParseSingleRange/open-ended883=== PAUSE TestParseSingleRange/open-ended884=== RUN TestParseSingleRange/end_clamped_to_size885=== PAUSE TestParseSingleRange/end_clamped_to_size886=== RUN TestParseSingleRange/suffix887=== PAUSE TestParseSingleRange/suffix888=== RUN TestParseSingleRange/suffix_exceeds_size889=== PAUSE TestParseSingleRange/suffix_exceeds_size890=== RUN TestParseSingleRange/single_byte891=== PAUSE TestParseSingleRange/single_byte892=== RUN TestParseSingleRange/start_past_EOF893=== PAUSE TestParseSingleRange/start_past_EOF894=== RUN TestParseSingleRange/start_far_past_EOF895=== PAUSE TestParseSingleRange/start_far_past_EOF896=== CONT TestPresentNotReportedWhileGCDeletesClosure897=== RUN TestPresentNotReportedWhileGCDeletesClosure/stale898=== PAUSE TestPresentNotReportedWhileGCDeletesClosure/stale899=== RUN TestPresentNotReportedWhileGCDeletesClosure/fresh900=== PAUSE TestPresentNotReportedWhileGCDeletesClosure/fresh901=== CONT TestPresentRefreshesOnlyStaleClosures9022026/10/08 12:58:07 INFO Received uploads request method=POST path=/api/pending_closures9032026/10/08 12:58:07 INFO Received uploads request method=POST path=/api/pending_closures9042026/10/08 12:58:07 INFO Received push request method=POST path=/api/pushes9052026/10/08 12:58:07 INFO Received complete multipart upload request method=POST path=/api/multipart/complete9062026/10/08 12:58:07 WARN CompleteMultipartUpload errored but object exists; treating as success error="The specified key does not exist." object_key=nar/gggggggggggggggggggggggggggggg0300000000000000000000.nar.zst upload_id=NjdiOTM1YWMtNDRlYS00Y2U2LWFjNjAtM2M4MTMwNTk4NmM1LmVkMTMzZjMzLTBlMmQtNDgzZi04MjU5LTg0NWFkOGJhMzAzOXgxNzkxNDY0Mjg3ODE3NjU4NjE09072026/10/08 12:58:07 INFO Received complete push request method=POST path=/api/pushes/1/complete9082026/10/08 12:58:07 INFO Completed multipart upload object_key=nar/gggggggggggggggggggggggggggggg0300000000000000000000.nar.zst upload_id=NjdiOTM1YWMtNDRlYS00Y2U2LWFjNjAtM2M4MTMwNTk4NmM1LmVkMTMzZjMzLTBlMmQtNDgzZi04MjU5LTg0NWFkOGJhMzAzOXgxNzkxNDY0Mjg3ODE3NjU4NjE0 parts=1909--- PASS: TestCompleteMultipartUpload_ErrorButObjectExists (0.55s)910=== CONT TestPresentReportsOnlyClosureRoots9112026/10/08 12:58:07 INFO Completed push id=1 objects=4 duration=9.941088ms912--- PASS: TestPush_RepeatedRootCommitsOnce (0.56s)913=== CONT TestCreatePin_ReservedPins914--- PASS: TestReadProxyConditionalGet (0.56s)915=== CONT TestPendingClosureWriteTimeout916=== RUN TestPendingClosureWriteTimeout/empty917=== PAUSE TestPendingClosureWriteTimeout/empty918=== RUN TestPendingClosureWriteTimeout/400_objects919=== PAUSE TestPendingClosureWriteTimeout/400_objects920=== RUN TestPendingClosureWriteTimeout/670k_objects921=== PAUSE TestPendingClosureWriteTimeout/670k_objects922=== RUN TestPendingClosureWriteTimeout/handler_extends_the_server's_deadline923=== PAUSE TestPendingClosureWriteTimeout/handler_extends_the_server's_deadline924=== CONT TestOrphanedObjectsGCStressTest9252026/10/08 12:58:07 INFO Received push request method=POST path=/api/pushes9262026/10/08 12:58:07 INFO Received complete push request method=POST path=/api/pushes/1/complete927--- PASS: TestReadProxyRootRedirectsToIndexHTML (0.60s)928=== CONT TestUploadHandlersRejectInvalidKeys929=== RUN TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info930=== PAUSE TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info931=== RUN TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal932=== PAUSE TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal933=== RUN TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key934=== PAUSE TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key935=== RUN TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key936=== PAUSE TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key937=== CONT TestOrphanedObjectsGC9382026/10/08 12:58:07 INFO Completed push id=1 objects=6 duration=14.212945ms939--- PASS: TestPush_CompleteCommitsEveryRoot (0.61s)940=== CONT TestIsValidUploadKey941=== RUN TestIsValidUploadKey/narinfo942=== PAUSE TestIsValidUploadKey/narinfo943=== RUN TestIsValidUploadKey/nar_zst944=== PAUSE TestIsValidUploadKey/nar_zst945=== RUN TestIsValidUploadKey/nar_xz946=== PAUSE TestIsValidUploadKey/nar_xz947=== RUN TestIsValidUploadKey/nar_plain948=== PAUSE TestIsValidUploadKey/nar_plain949=== RUN TestIsValidUploadKey/listing950=== PAUSE TestIsValidUploadKey/listing951=== RUN TestIsValidUploadKey/build_log952=== PAUSE TestIsValidUploadKey/build_log953=== RUN TestIsValidUploadKey/build_log_home-manager_file954=== PAUSE TestIsValidUploadKey/build_log_home-manager_file955=== RUN TestIsValidUploadKey/build_log_plus_in_name956=== PAUSE TestIsValidUploadKey/build_log_plus_in_name957=== RUN TestIsValidUploadKey/build_log_question_mark958=== PAUSE TestIsValidUploadKey/build_log_question_mark959=== RUN TestIsValidUploadKey/build_log_equals960=== PAUSE TestIsValidUploadKey/build_log_equals961=== RUN TestIsValidUploadKey/realisation962=== PAUSE TestIsValidUploadKey/realisation963=== RUN TestIsValidUploadKey/realisation_plus_in_output964=== PAUSE TestIsValidUploadKey/realisation_plus_in_output965=== RUN TestIsValidUploadKey/nix-cache-info966=== PAUSE TestIsValidUploadKey/nix-cache-info967=== RUN TestIsValidUploadKey/index.html968=== PAUSE TestIsValidUploadKey/index.html969=== RUN TestIsValidUploadKey/narinfo_key,_nar_type970=== PAUSE TestIsValidUploadKey/narinfo_key,_nar_type971=== RUN TestIsValidUploadKey/nar_key,_narinfo_type972=== PAUSE TestIsValidUploadKey/nar_key,_narinfo_type973=== RUN TestIsValidUploadKey/listing_key,_narinfo_type974=== PAUSE TestIsValidUploadKey/listing_key,_narinfo_type975=== RUN TestIsValidUploadKey/traversal976=== PAUSE TestIsValidUploadKey/traversal977=== RUN TestIsValidUploadKey/traversal_nar978=== PAUSE TestIsValidUploadKey/traversal_nar979=== RUN TestIsValidUploadKey/absolute980=== PAUSE TestIsValidUploadKey/absolute981=== RUN TestIsValidUploadKey/empty_key982=== PAUSE TestIsValidUploadKey/empty_key983=== RUN TestIsValidUploadKey/unknown_type984=== PAUSE TestIsValidUploadKey/unknown_type985=== CONT TestObjectStatsLargeCommit9862026/10/08 12:58:07 INFO Received push request method=POST path=/api/pushes9872026/10/08 12:58:07 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign9882026/10/08 12:58:07 INFO Signed narinfos id=1 count=19892026/10/08 12:58:07 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign9902026/10/08 12:58:07 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign9912026/10/08 12:58:07 ERROR Failed to sign narinfos signer="index 1" error="signing key cannot be nil"9922026/10/08 12:58:07 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign9932026/10/08 12:58:07 ERROR Failed to sign narinfos signer=niks3-test-1 error="signer failed"9942026/10/08 12:58:07 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign9952026/10/08 12:58:07 ERROR Signer returned unexpected signature count signer=niks3-test-1 got=0 want=19962026/10/08 12:58:07 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign9972026/10/08 12:58:07 ERROR Signer returned unexpected object key signer=niks3-test-1 object_key=unexpected.narinfo998--- PASS: TestPush_SignsNarinfosOfItsPendingObjects (0.64s)999=== CONT TestObjectStatsTrigger1000--- PASS: TestReadRedirectNar (0.65s)1001=== CONT TestCreatePendingClosureVerifyS3FailureReleasesConnection1002--- PASS: TestReadProxyRangeRequest (0.67s)1003=== CONT TestCreatePendingClosure_SmallNARUsesSimplePUT10042026/10/08 12:58:08 INFO Received complete multipart upload request method=POST path=/api/multipart/complete1005--- PASS: TestReadRedirectUsesPublicS3URL (0.70s)1006=== CONT TestGCSweepDeliversEachKeyOnce10072026/10/08 12:58:08 INFO Completed multipart upload object_key=nar/gggggggggggggggggggggggggggggg0100000000000000000000.nar.zst upload_id=NjdiOTM1YWMtNDRlYS00Y2U2LWFjNjAtM2M4MTMwNTk4NmM1LmU1ODllYmVhLTNhMjUtNGZiMi05MzliLWVlY2U5NmFjOTg1ZngxNzkxNDY0Mjg3NjQ3NzMyOTUx parts=1210082026/10/08 12:58:08 INFO Received uploads request method=POST path=/api/pending_closures1009--- PASS: TestReadProxyHead (0.72s)1010=== CONT TestCompleteMultipartUnregistered10112026/10/08 12:58:08 INFO Received uploads request method=POST path=/api/pending_closures10122026/10/08 12:58:08 INFO Received push request method=POST path=/api/pushes1013--- PASS: TestReadProxyDisabled (0.76s)1014=== CONT TestPendingCleanupUsesOneCutoff1015--- PASS: TestReadRedirectKeepsNarinfoProxied (0.79s)1016=== CONT TestTombstonedObjectOfferedWithoutWaiting10172026/10/08 12:58:08 INFO Received push request method=POST path=/api/pushes10182026/10/08 12:58:08 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:46089/oidc1019--- PASS: TestPush_OverlappingRootsStoreOneRowPerKey (0.84s)1020=== CONT TestService_verifyS3Integrity1021--- PASS: TestReadProxyInvalidPath (0.69s)1022=== CONT TestMultipartUploadAbortedWhenCancelledBeforeRecorded10232026/10/08 12:58:08 INFO Received complete multipart upload request method=POST path=/api/multipart/complete10242026/10/08 12:58:08 INFO Completed multipart upload object_key=nar/hhhhhhhhhhhhhhhhhhhhhhhhhhhhhh0100000000000000000000.nar.zst upload_id=NjdiOTM1YWMtNDRlYS00Y2U2LWFjNjAtM2M4MTMwNTk4NmM1LjZkZWViM2E0LTNjZmQtNDEyYi04NDVlLTM5M2MzOGI1N2NmNngxNzkxNDY0Mjg3NzkxMzA1MjQx parts=1210252026/10/08 12:58:08 INFO Received uploads request method=POST path=/api/pending_closures1026--- PASS: TestCompletedNarNotReofferedAcrossClosures (0.89s)1027=== CONT TestGCSweepSkipsPendingObjects1028--- PASS: TestReadProxy404 (0.50s)1029=== CONT TestService_createPendingClosureHandler1030--- PASS: TestReadProxyNarStreaming (0.50s)1031=== CONT TestMultipartCleanup1032--- PASS: TestReadProxyNarinfoAlreadyDecompressed (0.49s)1033=== CONT TestDeduplicatedObjectsRecordedAsPending1034--- PASS: TestPresentRefreshesOnlyStaleClosures (0.53s)1035=== CONT TestServerTLSConfig1036=== RUN TestServerTLSConfig/no_client_CA1037=== PAUSE TestServerTLSConfig/no_client_CA1038=== RUN TestServerTLSConfig/missing_CA_file1039=== PAUSE TestServerTLSConfig/missing_CA_file1040=== RUN TestServerTLSConfig/not_a_PEM_file1041=== PAUSE TestServerTLSConfig/not_a_PEM_file1042=== CONT TestPushDedupSurvivesConcurrentGC1043--- PASS: TestReadProxyContentNegotiation (0.57s)1044=== CONT TestService_NativeMTLS1045--- PASS: TestPresentReportsOnlyClosureRoots (0.47s)1046=== CONT TestGCMetrics10472026/10/08 12:58:08 ERROR Failed to decode narinfo key=3hcdxyjf9yiq7qf3i4548drb6sjmwa1v.narinfo limit=16777216 error=<nil>1048--- PASS: TestReadProxyNarinfo (0.60s)1049=== CONT TestService_cleanupPendingClosuresHandler10502026-10-08 12:58:08.367 UTC [549] ERROR: Push does not exist: id=110512026-10-08 12:58:08.367 UTC [549] CONTEXT: PL/pgSQL function commit_push(bigint) line 11 at RAISE10522026-10-08 12:58:08.367 UTC [549] STATEMENT: SELECT commit_push($1)1053--- PASS: TestPush_CompleteWaitsForCleanupOfThePush (1.05s)1054=== CONT TestMetricsCommit10552026/10/08 12:58:08 INFO Received uploads request method=POST path=/api/pending_closures10562026/10/08 12:58:08 INFO Received complete multipart upload request method=POST path=/api/multipart/complete10572026/10/08 12:58:08 WARN Failed to abort redundant multipart upload, keeping its row object_key=nar/gggggggggggggggggggggggggggggg0200000000000000000000.nar.zst upload_id=NjdiOTM1YWMtNDRlYS00Y2U2LWFjNjAtM2M4MTMwNTk4NmM1LmY5OTRhNzQ5LWNkZWQtNDZkZC05ZWFmLTY5NmUwZmQwMTUzMXgxNzkxNDY0Mjg4MDQ2MDYwNTc0 error="Get \"http://127.0.0.1:1/bucket4/?location=\": dial tcp 127.0.0.1:1: connect: connection refused"10582026/10/08 12:58:08 INFO Completed multipart upload object_key=nar/gggggggggggggggggggggggggggggg0200000000000000000000.nar.zst upload_id=NjdiOTM1YWMtNDRlYS00Y2U2LWFjNjAtM2M4MTMwNTk4NmM1LmIwYjNiMjBjLWI5MDEtNDY3NC1iNWEzLWRlOGMzMTI1MjcyYngxNzkxNDY0Mjg4MDM5MzI0MTM0 parts=1210592026/10/08 12:58:08 INFO Received cleanup request method=DELETE path=/api/pending_closures10602026/10/08 12:58:08 INFO Aborted multipart uploads count=1 kept=01061--- PASS: TestRedundantMultipartUpload (1.13s)1062=== CONT TestGCBugBareHashReferences1063--- PASS: TestObjectStatsTrigger (0.50s)1064=== CONT TestMetricsInventory10652026/10/08 12:58:08 INFO Received uploads request method=POST path=/api/pending_closures1066--- PASS: TestCreatePendingClosure_SmallNARUsesSimplePUT (0.47s)1067=== CONT TestClientMultipleUploads10682026/10/08 12:58:08 INFO Received complete multipart upload request method=POST path=/api/multipart/complete10692026/10/08 12:58:08 ERROR Failed to get multipart upload error="no rows in result set" upload_id=does-not-exist object_key=nar/0000000000000000000000000000000000000000000000000000.nar.zst1070--- PASS: TestCompleteMultipartUnregistered (0.46s)1071=== CONT TestNARDeduplicationMetadataUploadBug10722026/10/08 12:58:08 INFO Aborted multipart uploads count=0 kept=010732026/10/08 12:58:08 WARN Force mode enabled - objects will be deleted immediately without grace period10742026/10/08 12:58:08 INFO Received uploads request method=POST path=/api/pending_closures10752026/10/08 12:58:08 INFO Received uploads request method=POST path=/api/pending_closures10762026/10/08 12:58:08 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=3 objects-deleted-after-grace-period=3 objects-failed-to-delete=010772026/10/08 12:58:08 INFO Vacuumed table table=pending_closures10782026/10/08 12:58:08 INFO Vacuumed table table=pending_objects10792026/10/08 12:58:08 INFO Vacuumed table table=multipart_uploads10802026/10/08 12:58:08 INFO Vacuumed table table=closures10812026/10/08 12:58:08 INFO Vacuumed table table=objects1082--- PASS: TestGCSweepDeliversEachKeyOnce (0.51s)1083=== CONT TestClientWithDependencies10842026/10/08 12:58:08 INFO Received cleanup request method=DELETE path=/api/pending_closures10852026/10/08 12:58:08 INFO Received uploads request method=POST path=/api/pending_closures1086--- PASS: TestTombstonedObjectOfferedWithoutWaiting (0.44s)1087=== CONT TestCreatePendingClosureRejectsOversizedNAR10882026/10/08 12:58:08 INFO Received uploads request method=POST path=/api/pending_closures1089--- PASS: TestCreatePendingClosureRejectsOversizedNAR (0.00s)1090=== CONT TestCacheConfigHandlerMaxNarSize1091--- PASS: TestCacheConfigHandlerMaxNarSize (0.00s)1092=== CONT TestClientIntegration10932026/10/08 12:58:08 INFO Received create pin request method=POST path=/api/pins/worker-x86_64-linux10942026/10/08 12:58:08 WARN Refused reserved pin name=worker-x86_64-linux10952026/10/08 12:58:08 INFO Received create pin request method=POST path=/api/pins/worker-x86_64-linux10962026/10/08 12:58:08 INFO Received create pin request method=POST path=/api/pins/my-app10972026/10/08 12:58:08 INFO Received create pin request method=POST path=/api/pins/worker-x86_64-linux1098--- PASS: TestCreatePin_ReservedPins (0.69s)1099=== CONT TestGenerateLandingPage1100--- PASS: TestGenerateLandingPage (0.00s)1101=== CONT TestConcurrentCommitsSharingObjectsDoNotDeadlock11022026/10/08 12:58:08 INFO Received uploads request method=POST path=/api/pending_closures11032026/10/08 12:58:08 INFO Received uploads request method=POST path=/api/pending_closures1104--- PASS: TestMultipartUploadAbortedWhenCancelledBeforeRecorded (0.45s)1105=== CONT TestClientErrorHandling1106=== RUN TestClientErrorHandling/InvalidStorePath1107=== PAUSE TestClientErrorHandling/InvalidStorePath1108=== RUN TestClientErrorHandling/InvalidAuthToken1109=== PAUSE TestClientErrorHandling/InvalidAuthToken1110=== RUN TestClientErrorHandling/ServerNotAvailable1111=== PAUSE TestClientErrorHandling/ServerNotAvailable1112=== CONT TestGCAdvisoryLockBlocksConcurrentRun1113--- PASS: TestCreatePendingClosureVerifyS3FailureReleasesConnection (0.66s)1114=== CONT TestResolveDBConnectionString1115=== RUN TestResolveDBConnectionString/flag_wins1116=== PAUSE TestResolveDBConnectionString/flag_wins1117=== RUN TestResolveDBConnectionString/file_when_flag_empty1118=== PAUSE TestResolveDBConnectionString/file_when_flag_empty1119=== RUN TestResolveDBConnectionString/missing_file_is_an_error1120=== PAUSE TestResolveDBConnectionString/missing_file_is_an_error1121=== RUN TestResolveDBConnectionString/PGHOST_allows_empty1122=== PAUSE TestResolveDBConnectionString/PGHOST_allows_empty1123=== RUN TestResolveDBConnectionString/nothing_configured1124=== PAUSE TestResolveDBConnectionString/nothing_configured1125=== CONT TestService_readinessHandler11262026/10/08 12:58:08 INFO Received uploads request method=POST path=/api/pending_closures11272026/10/08 12:58:08 INFO Aborted multipart uploads count=0 kept=011282026/10/08 12:58:08 INFO Received uploads request method=POST path=/api/pending_closures11292026/10/08 12:58:08 INFO Received uploads request method=POST path=/api/pending_closures11302026/10/08 12:58:08 INFO Received uploads request method=POST path=/api/pending_closures11312026/10/08 12:58:08 WARN Force mode enabled - objects will be deleted immediately without grace period11322026/10/08 12:58:08 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=011332026/10/08 12:58:08 INFO Vacuumed table table=pending_closures11342026/10/08 12:58:08 INFO Vacuumed table table=pending_objects11352026/10/08 12:58:08 INFO Vacuumed table table=multipart_uploads11362026/10/08 12:58:08 INFO Vacuumed table table=closures11372026/10/08 12:58:08 INFO Vacuumed table table=objects1138--- PASS: TestGCSweepSkipsPendingObjects (0.48s)1139=== CONT TestClientCADerivations11402026/10/08 12:58:08 INFO Received uploads request method=POST path=/api/pending_closures1141=== NAME TestOrphanedObjectsGC1142 orphaned_objects_gc_test.go:287: GC Test Summary:1143 orphaned_objects_gc_test.go:288: - Kept: 2 objects from closure A1144 orphaned_objects_gc_test.go:289: - Deleted: 2 objects from closure B1145 orphaned_objects_gc_test.go:290: - Deleted: 6 orphaned chain objects (X1->X2->X3)1146 orphaned_objects_gc_test.go:291: - Deleted: 2 orphaned single objects (Y)1147 orphaned_objects_gc_test.go:292: - Total deleted: 10 objects1148--- PASS: TestOrphanedObjectsGC (0.78s)1149=== CONT TestLeadEndsOnShutdown11502026/10/08 12:58:08 INFO Received uploads request method=POST path=/api/pending_closures1151--- PASS: TestDeduplicatedObjectsRecordedAsPending (0.48s)1152=== CONT TestDeleteClosuresRacingPins11532026/10/08 12:58:08 WARN mTLS auth: subject not in bound subjects subject="CN=reader"11542026/10/08 12:58:08 WARN mTLS auth: subject not in bound subjects subject="CN=reader"1155--- PASS: TestService_NativeMTLS (0.44s)1156=== CONT TestCacheStatsHandler11572026/10/08 12:58:08 INFO Received uploads request method=POST path=/api/pending_closures11582026/10/08 12:58:08 INFO Aborted multipart uploads count=0 kept=011592026/10/08 12:58:08 WARN Force mode enabled - objects will be deleted immediately without grace period11602026/10/08 12:58:08 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=011612026/10/08 12:58:08 INFO Vacuumed table table=pending_closures11622026/10/08 12:58:08 INFO Received cleanup request method=DELETE path=/api/pending_closures11632026/10/08 12:58:08 INFO Received cleanup request method=DELETE path=/api/pending_closures11642026/10/08 12:58:08 INFO Vacuumed table table=pending_objects11652026/10/08 12:58:08 INFO Vacuumed table table=multipart_uploads11662026/10/08 12:58:08 INFO Vacuumed table table=closures11672026/10/08 12:58:08 INFO Vacuumed table table=objects11682026/10/08 12:58:08 WARN Failed to abort upload, keeping its closure key=nar/dadb44fdadb44fdadb44fdadb44f000000000000000000000000.nar.zst error="Get \"http://127.0.0.1:1/bucket50/?location=\": dial tcp 127.0.0.1:1: connect: connection refused" code=""11692026/10/08 12:58:08 INFO Aborted multipart uploads count=0 kept=111702026/10/08 12:58:08 INFO Aborted multipart uploads count=0 kept=01171--- PASS: TestGCMetrics (0.47s)1172=== CONT TestService_healthCheckHandler11732026/10/08 12:58:08 INFO Received uploads request method=POST path=/api/pending_closures11742026/10/08 12:58:08 INFO Received cleanup request method=DELETE path=/api/pending_closures11752026/10/08 12:58:08 INFO Aborted multipart uploads count=1 kept=01176--- PASS: TestMultipartCleanup (0.60s)1177=== CONT TestClientFallsBackToClosures11782026/10/08 12:58:08 INFO Received cleanup request method=DELETE path=/api/pending_closures11792026/10/08 12:58:08 INFO Aborted multipart uploads count=1 kept=011802026/10/08 12:58:08 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete11812026-10-08 12:58:08.819 UTC [594] ERROR: Closure does not exist: id=111822026-10-08 12:58:08.819 UTC [594] CONTEXT: PL/pgSQL function commit_pending_closure(bigint) line 13 at RAISE11832026-10-08 12:58:08.819 UTC [594] STATEMENT: -- name: CommitPendingClosure :one1184 SELECT commit_pending_closure($1::bigint)::bigint1185 1186--- PASS: TestService_cleanupPendingClosuresHandler (0.46s)1187=== CONT TestLeadIncumbentAnnouncesAtOnce11882026/10/08 12:58:08 INFO Received push request method=POST path=/api/pushes11892026/10/08 12:58:08 INFO Aborted multipart uploads count=0 kept=011902026/10/08 12:58:08 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=011912026/10/08 12:58:08 INFO Vacuumed table table=pending_closures11922026/10/08 12:58:08 INFO Received complete push request method=POST path=/api/pushes/1/complete11932026/10/08 12:58:08 INFO Vacuumed table table=pending_objects11942026/10/08 12:58:08 INFO Vacuumed table table=multipart_uploads11952026/10/08 12:58:08 INFO Vacuumed table table=closures11962026/10/08 12:58:08 INFO Vacuumed table table=objects11972026/10/08 12:58:08 INFO Completed push id=1 objects=4 duration=11.979287ms1198--- PASS: TestMetricsInventory (0.42s)1199=== CONT TestGracefulShutdownDrainsInflight12002026/10/08 12:58:08 INFO Starting HTTP server address=127.0.0.1:4658712012026/10/08 12:58:08 INFO Shutdown signal received, draining in-flight requests timeout=10s12022026/10/08 12:58:08 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete12032026/10/08 12:58:08 INFO Aborted multipart uploads count=0 kept=012042026/10/08 12:58:08 WARN Force mode enabled - objects will be deleted immediately without grace period12052026/10/08 12:58:08 INFO Completed upload id=2 objects=2 duration=2.385721ms12062026/10/08 12:58:08 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=01207--- PASS: TestMetricsCommit (0.51s)1208=== CONT TestCacheConfigHandler1209=== RUN TestCacheConfigHandler/full_config,_no_issuer1210=== PAUSE TestCacheConfigHandler/full_config,_no_issuer1211=== RUN TestCacheConfigHandler/no_cache_url_configured1212=== PAUSE TestCacheConfigHandler/no_cache_url_configured1213=== RUN TestCacheConfigHandler/no_signing_keys1214=== PAUSE TestCacheConfigHandler/no_signing_keys1215=== RUN TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator1216=== PAUSE TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator1217=== CONT TestLeadElectsOneAndHandsOver12182026/10/08 12:58:08 INFO Vacuumed table table=pending_closures12192026/10/08 12:58:08 INFO Vacuumed table table=pending_objects12202026/10/08 12:58:08 INFO Vacuumed table table=multipart_uploads12212026/10/08 12:58:08 INFO Vacuumed table table=closures12222026/10/08 12:58:08 INFO Vacuumed table table=objects1223--- PASS: TestPushDedupSurvivesConcurrentGC (0.57s)1224=== CONT TestGCTaskStore_Fail1225--- PASS: TestGCTaskStore_Fail (0.00s)1226=== CONT TestService_ReadScope_PublicByDefault12272026/10/08 12:58:08 INFO Received complete multipart upload request method=POST path=/api/multipart/complete1228--- PASS: TestGracefulShutdownDrainsInflight (0.07s)1229=== CONT TestGCTaskStore_PhaseUpdates1230--- PASS: TestGCTaskStore_PhaseUpdates (0.00s)1231=== CONT TestService_RequireScope_OIDC12322026/10/08 12:58:08 INFO Completed multipart upload object_key=nar/dadb44fdadb44fdadb44fdadb44f000000000000000000000000.nar.zst upload_id=NjdiOTM1YWMtNDRlYS00Y2U2LWFjNjAtM2M4MTMwNTk4NmM1LmM2YWZjMjQzLTc3ZDgtNDI3Ny04ZjQ1LWRmMDUzZTdlNDJhNXgxNzkxNDY0Mjg4NTg1NDg0MjI0 parts=1012332026/10/08 12:58:08 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete1234=== NAME TestClientMultipleUploads1235 client_integration_test.go:358: Created store path 0: /build/TestClientMultipleUploads1412224349/001/store/3a4jnnzk18vygyiabxdwak153lmid6lx-test-file-0.txt12362026/10/08 12:58:08 INFO Completed upload id=1 objects=2 duration=4.294657ms12372026/10/08 12:58:08 INFO Received uploads request method=POST path=/api/pending_closures12382026/10/08 12:58:08 INFO Received uploads request method=POST path=/api/pending_closures12392026/10/08 12:58:08 INFO Object in database but missing from S3 key=dadb44fdadb44fdadb44fdadb44f0000.narinfo12402026/10/08 12:58:08 WARN Found objects in DB but missing from S3, will re-upload count=11241--- PASS: TestService_verifyS3Integrity (0.84s)1242=== CONT TestGCTaskStore_CompletedAllowsNewTask1243--- PASS: TestGCTaskStore_CompletedAllowsNewTask (0.00s)1244=== CONT TestClientPushesUseOnePush12452026/10/08 12:58:09 INFO Received complete multipart upload request method=POST path=/api/multipart/complete1246=== NAME TestClientMultipleUploads1247 client_integration_test.go:358: Created store path 1: /build/TestClientMultipleUploads1412224349/001/store/d6m3jlbsd3f0rg9a891hda1aqxd8zjxc-test-file-1.txt12482026/10/08 12:58:09 INFO Completed multipart upload object_key=nar/0000000000000000000000000000000000000000000000000000.nar.zst upload_id=NjdiOTM1YWMtNDRlYS00Y2U2LWFjNjAtM2M4MTMwNTk4NmM1LjQzNjdmZTg1LTY5M2UtNDdkMy1hZjdjLTAyOTJiN2FkMzZiNngxNzkxNDY0Mjg4NjY1MDY4NjA4 parts=1012492026/10/08 12:58:09 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete12502026/10/08 12:58:09 INFO Completed upload id=1 objects=2 duration=3.228829ms12512026/10/08 12:58:09 INFO Received get closure request method=GET path=/api/closures/0000000000000000000000000000000012522026/10/08 12:58:09 INFO Received uploads request method=POST path=/api/pending_closures12532026/10/08 12:58:09 INFO Starting cleanup of old closures method=DELETE path=/api/closures1254=== NAME TestNARDeduplicationMetadataUploadBug1255 metadata_upload_test.go:48: First store path: /build/TestNARDeduplicationMetadataUploadBug1883138342/001/store/xz8nmmyh0w2bwkw9kdyh0vq0gg109qpd-file1.txt12562026/10/08 12:58:09 INFO Aborted multipart uploads count=0 kept=012572026/10/08 12:58:09 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=012582026/10/08 12:58:09 INFO Vacuumed table table=pending_closures12592026/10/08 12:58:09 INFO Vacuumed table table=pending_objects1260=== NAME TestClientMultipleUploads1261 client_integration_test.go:358: Created store path 2: /build/TestClientMultipleUploads1412224349/001/store/j69sdsl4ksi6i0i7dpp6bki9ybrrn4lc-test-file-2.txt12622026/10/08 12:58:09 INFO Vacuumed table table=multipart_uploads12632026/10/08 12:58:09 INFO Vacuumed table table=closures12642026/10/08 12:58:09 INFO Vacuumed table table=objects1265=== NAME TestClientIntegration1266 client_integration_test.go:286: Created store path: /build/TestClientIntegration618407722/002/store/76ff8ixjpsw799z9i3s3rdx9dfpbfyah-test-file.txt12672026/10/08 12:58:09 INFO Received get closure request method=GET path=/api/closures/0000000000000000000000000000000012682026/10/08 12:58:09 ERROR failed to check GC advisory lock error="query pg_locks: failed to connect to `user=nixbld database=niks3`: /nonexistent/.s.PGSQL.5432 (/nonexistent): dial error: dial unix /nonexistent/.s.PGSQL.5432: connect: no such file or directory"1269--- PASS: TestGCAdvisoryLockBlocksConcurrentRun (0.46s)1270=== CONT TestGCTaskStore_GetReturnsLatest1271--- PASS: TestGCTaskStore_GetReturnsLatest (0.00s)1272=== CONT TestService_AuthMiddleware_OIDC1273--- PASS: TestService_createPendingClosureHandler (0.87s)1274=== CONT TestPinProtectsFromGC12752026/10/08 12:58:09 WARN readiness check failed error="closed pool"1276--- PASS: TestService_readinessHandler (0.46s)1277=== CONT TestGCTaskStore_GetEmpty1278--- PASS: TestGCTaskStore_GetEmpty (0.00s)1279=== CONT TestService_ReadAuthMiddleware1280=== NAME TestClientWithDependencies1281 client_integration_test.go:613: Built derivation: /build/TestClientWithDependencies2577010649/001/store/954vpg1vxqdmqj4g8mnnc3xqyskxd94z-test-script12822026/10/08 12:58:09 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:45387/oidc1283--- PASS: TestGCBugBareHashReferences (0.66s)1284=== CONT TestClientSharedPathCommittedMidPush12852026/10/08 12:58:09 INFO Received push request method=POST path=/api/pushes12862026/10/08 12:58:09 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)12872026/10/08 12:58:09 INFO Uploading xz8nmmyh0w2bwkw9kdyh0vq0gg109qpd-file1.txt (160B)12882026/10/08 12:58:09 WARN Failed to register uploaded object key=nar/1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf.nar.zst error="server returned 404: 404 page not found\n"12892026/10/08 12:58:09 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign12902026/10/08 12:58:09 WARN Failed to register uploaded object key=xz8nmmyh0w2bwkw9kdyh0vq0gg109qpd.ls error="server returned 404: 404 page not found\n"12912026/10/08 12:58:09 INFO Signed narinfos id=1 count=112922026/10/08 12:58:09 INFO Uploading 1 narinfos12932026/10/08 12:58:09 INFO Received complete push request method=POST path=/api/pushes/1/complete12942026/10/08 12:58:09 WARN Failed to register uploaded object key=xz8nmmyh0w2bwkw9kdyh0vq0gg109qpd.narinfo error="server returned 404: 404 page not found\n"12952026/10/08 12:58:09 INFO Completed push id=1 objects=3 duration=6.300836ms12962026/10/08 12:58:09 INFO Upload complete. (61ms)1297=== NAME TestClientWithDependencies1298 client_integration_test.go:615: Found 1 dependencies (including self)12992026/10/08 12:58:09 INFO Received push request method=POST path=/api/pushes1300=== NAME TestNARDeduplicationMetadataUploadBug1301 metadata_upload_test.go:54: Retrieved narinfo from S3:1302 StorePath: /build/TestNARDeduplicationMetadataUploadBug1883138342/001/store/xz8nmmyh0w2bwkw9kdyh0vq0gg109qpd-file1.txt1303 URL: nar/1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf.nar.zst1304 Compression: zstd1305 NarHash: sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf1306 NarSize: 1601307 References: 1308 CA: fixed:r:sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf1309 metadata_upload_test.go:55: Retrieved .ls file from S3 (compressed size: 77 bytes)1310 metadata_upload_test.go:55: Decompressed .ls content (64 bytes):1311 {"version":1,"root":{"type":"regular","size":44,"narOffset":96}}13122026/10/08 12:58:09 INFO Uploading 3 paths to 127.0.0.1 (0 already cached)13132026/10/08 12:58:09 INFO Uploading j69sdsl4ksi6i0i7dpp6bki9ybrrn4lc-test-file-2.txt (160B)13142026/10/08 12:58:09 INFO Uploading d6m3jlbsd3f0rg9a891hda1aqxd8zjxc-test-file-1.txt (160B)13152026/10/08 12:58:09 INFO Uploading 3a4jnnzk18vygyiabxdwak153lmid6lx-test-file-0.txt (160B)13162026/10/08 12:58:09 INFO lead: acquired remote=192.0.2.1:123413172026/10/08 12:58:09 WARN Failed to register uploaded object key=nar/1823g6vx4q5zqvr73m7lkq1wpk40fin7bsc792di430yk7sg4lka.nar.zst error="server returned 404: 404 page not found\n"13182026/10/08 12:58:09 WARN Failed to register uploaded object key=j69sdsl4ksi6i0i7dpp6bki9ybrrn4lc.ls error="server returned 404: 404 page not found\n"13192026/10/08 12:58:09 WARN Failed to register uploaded object key=nar/0ahq3izw3h0b0c08p3xdfclh758fwxnp85ccvflasb4vnfsv50ri.nar.zst error="server returned 404: 404 page not found\n"13202026/10/08 12:58:09 WARN Failed to register uploaded object key=nar/13p9pqi0ga6fx2apcwls9hjnv7nmf740ggpn5zvfzdsp5vz2bbg4.nar.zst error="server returned 404: 404 page not found\n"13212026/10/08 12:58:09 WARN Failed to register uploaded object key=3a4jnnzk18vygyiabxdwak153lmid6lx.ls error="server returned 404: 404 page not found\n"13222026/10/08 12:58:09 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign13232026/10/08 12:58:09 WARN Failed to register uploaded object key=d6m3jlbsd3f0rg9a891hda1aqxd8zjxc.ls error="server returned 404: 404 page not found\n"13242026/10/08 12:58:09 INFO Signed narinfos id=1 count=313252026/10/08 12:58:09 INFO Uploading 3 narinfos13262026/10/08 12:58:09 INFO Received push request method=POST path=/api/pushes13272026/10/08 12:58:09 WARN Failed to register uploaded object key=j69sdsl4ksi6i0i7dpp6bki9ybrrn4lc.narinfo error="server returned 404: 404 page not found\n"13282026/10/08 12:58:09 WARN Failed to register uploaded object key=d6m3jlbsd3f0rg9a891hda1aqxd8zjxc.narinfo error="server returned 404: 404 page not found\n"13292026/10/08 12:58:09 INFO Received complete push request method=POST path=/api/pushes/1/complete13302026/10/08 12:58:09 WARN Failed to register uploaded object key=3a4jnnzk18vygyiabxdwak153lmid6lx.narinfo error="server returned 404: 404 page not found\n"13312026/10/08 12:58:09 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)13322026/10/08 12:58:09 INFO Uploading 76ff8ixjpsw799z9i3s3rdx9dfpbfyah-test-file.txt (152B)13332026/10/08 12:58:09 INFO Completed push id=1 objects=9 duration=7.492246ms13342026/10/08 12:58:09 INFO Upload complete. (64ms)1335=== NAME TestClientMultipleUploads13362026/10/08 12:58:09 WARN Failed to register uploaded object key=nar/11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk1.nar.zst error="server returned 404: 404 page not found\n"1337 client_integration_test.go:369: Uploaded 3 paths in 95.864447ms13382026/10/08 12:58:09 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign13392026/10/08 12:58:09 WARN Failed to register uploaded object key=76ff8ixjpsw799z9i3s3rdx9dfpbfyah.ls error="server returned 404: 404 page not found\n"13402026/10/08 12:58:09 INFO Signed narinfos id=1 count=113412026/10/08 12:58:09 INFO Uploading 1 narinfos13422026/10/08 12:58:09 INFO Received complete push request method=POST path=/api/pushes/1/complete13432026/10/08 12:58:09 WARN Failed to register uploaded object key=76ff8ixjpsw799z9i3s3rdx9dfpbfyah.narinfo error="server returned 404: 404 page not found\n"1344--- PASS: TestClientMultipleUploads (0.70s)1345=== CONT TestService_AuthMiddleware_MTLSBoundSubjects1346=== NAME TestNARDeduplicationMetadataUploadBug1347 metadata_upload_test.go:64: Second store path (same content): /build/TestNARDeduplicationMetadataUploadBug1883138342/001/store/yw5j6k3r4hx8nnbgsnf8wzxkxy3m56gv-file2.txt13482026/10/08 12:58:09 INFO Completed push id=1 objects=3 duration=15.137353ms13492026/10/08 12:58:09 INFO Upload complete. (73ms)1350--- PASS: TestCacheStatsHandler (0.43s)1351=== CONT TestProxyWriteTimeout1352=== RUN TestProxyWriteTimeout/narinfo1353=== PAUSE TestProxyWriteTimeout/narinfo1354=== RUN TestProxyWriteTimeout/1_GiB_nar1355=== PAUSE TestProxyWriteTimeout/1_GiB_nar1356=== RUN TestProxyWriteTimeout/10_GiB_nar1357=== PAUSE TestProxyWriteTimeout/10_GiB_nar1358=== RUN TestProxyWriteTimeout/unknown_size1359=== PAUSE TestProxyWriteTimeout/unknown_size1360=== CONT TestGCTaskStore_ConflictDifferentParams1361--- PASS: TestGCTaskStore_ConflictDifferentParams (0.00s)1362=== CONT TestService_AuthMiddleware_MTLSProxyHeader13632026/10/08 12:58:09 INFO Received push request method=POST path=/api/pushes1364=== NAME TestClientCADerivations1365 client_ca_test.go:136: Built CA derivation: /build/TestClientCADerivations4163219932/001/store/vxm0bx1psmprvxz3kp5syzkkb89b8zly-ca-test1366--- PASS: TestService_healthCheckHandler (0.39s)1367=== CONT TestSweepRechecksPendingAfterLocking13682026/10/08 12:58:09 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)13692026/10/08 12:58:09 INFO Uploading 954vpg1vxqdmqj4g8mnnc3xqyskxd94z-test-script (136B)13702026/10/08 12:58:09 WARN Failed to register uploaded object key=954vpg1vxqdmqj4g8mnnc3xqyskxd94z.ls error="server returned 404: 404 page not found\n"13712026/10/08 12:58:09 WARN Failed to register uploaded object key=nar/1s7yghixzpinyqm7g59kyn3sav81pmnsdi5v63m6x4r2vacy907j.nar.zst error="server returned 404: 404 page not found\n"13722026/10/08 12:58:09 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign13732026/10/08 12:58:09 WARN Failed to register uploaded object key=log/bvqmfl8j69gnzbl5cqlf8dzbfybwr7df-test-script.drv error="server returned 404: 404 page not found\n"13742026/10/08 12:58:09 INFO Signed narinfos id=1 count=113752026/10/08 12:58:09 INFO Uploading 1 narinfos13762026/10/08 12:58:09 INFO Received complete push request method=POST path=/api/pushes/1/complete13772026/10/08 12:58:09 WARN Failed to register uploaded object key=954vpg1vxqdmqj4g8mnnc3xqyskxd94z.narinfo error="server returned 404: 404 page not found\n"13782026/10/08 12:58:09 INFO All 1 paths already cached1379=== NAME TestClientIntegration1380 client_integration_test.go:312: Retrieved narinfo from S3:1381 StorePath: /build/TestClientIntegration618407722/002/store/76ff8ixjpsw799z9i3s3rdx9dfpbfyah-test-file.txt1382 URL: nar/11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk1.nar.zst1383 Compression: zstd1384 NarHash: sha256:11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk11385 NarSize: 1521386 References: 1387 CA: fixed:r:sha256:11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk11388 client_integration_test.go:313: Retrieved .ls file from S3 (compressed size: 77 bytes)13892026/10/08 12:58:09 INFO Completed push id=1 objects=4 duration=8.410875ms1390 client_integration_test.go:313: Decompressed .ls content (64 bytes):1391 {"version":1,"root":{"type":"regular","size":39,"narOffset":96}}1392 client_integration_test.go:316: Testing garbage collection...13932026/10/08 12:58:09 INFO Upload complete. (64ms)1394=== NAME TestClientWithDependencies1395 client_integration_test.go:617: Skipping nix copy test - isolated store (/build/TestClientWithDependencies2577010649/001/store) requires matching store prefix1396--- PASS: TestClientWithDependencies (0.70s)1397=== CONT TestGetExistingObjectsLocksRows1398=== NAME TestClientCADerivations1399 client_ca_test.go:139: Found 1 dependencies (including self)14002026/10/08 12:58:09 INFO Received push request method=POST path=/api/pushes14012026/10/08 12:58:09 INFO Uploading 0 paths to 127.0.0.1 (1 already cached)14022026/10/08 12:58:09 WARN Failed to register uploaded object key=yw5j6k3r4hx8nnbgsnf8wzxkxy3m56gv.ls error="server returned 404: 404 page not found\n"14032026/10/08 12:58:09 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign14042026/10/08 12:58:09 INFO Signed narinfos id=2 count=114052026/10/08 12:58:09 INFO Uploading 1 narinfos14062026/10/08 12:58:09 INFO Received complete push request method=POST path=/api/pushes/2/complete14072026/10/08 12:58:09 WARN Failed to register uploaded object key=yw5j6k3r4hx8nnbgsnf8wzxkxy3m56gv.narinfo error="server returned 404: 404 page not found\n"14082026/10/08 12:58:09 INFO Starting cleanup of old closures method=DELETE path=/api/closures14092026/10/08 12:58:09 INFO Garbage collection started14102026/10/08 12:58:09 INFO lead: acquired remote=192.0.2.1:123414112026/10/08 12:58:09 INFO lead: released remote=192.0.2.1:12341412--- PASS: TestLeadIncumbentAnnouncesAtOnce (0.44s)1413=== CONT TestConnectWaitsForAPeerMigration14142026/10/08 12:58:09 INFO Completed push id=2 objects=3 duration=2.802665ms14152026/10/08 12:58:09 INFO Upload complete. (56ms)1416=== NAME TestNARDeduplicationMetadataUploadBug1417 metadata_upload_test.go:76: Retrieved narinfo from S3:1418 StorePath: /build/TestNARDeduplicationMetadataUploadBug1883138342/001/store/yw5j6k3r4hx8nnbgsnf8wzxkxy3m56gv-file2.txt1419 URL: nar/1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf.nar.zst1420 Compression: zstd1421 NarHash: sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf1422 NarSize: 1601423 References: 1424 CA: fixed:r:sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf1425 metadata_upload_test.go:77: Retrieved .ls file from S3 (compressed size: 62 bytes)1426 metadata_upload_test.go:77: Decompressed .ls content (49 bytes):1427 {"version":1,"root":{"type":"regular","size":44}}14282026/10/08 12:58:09 INFO Aborted multipart uploads count=0 kept=01429--- PASS: TestNARDeduplicationMetadataUploadBug (0.77s)1430=== CONT TestGCTaskStore_DeduplicateSameParams1431--- PASS: TestGCTaskStore_DeduplicateSameParams (0.00s)1432=== CONT TestGCEndsOnShutdown1433=== RUN TestGCEndsOnShutdown/before_the_run1434=== PAUSE TestGCEndsOnShutdown/before_the_run1435=== RUN TestGCEndsOnShutdown/blocked_in_the_sweep's_S3_delete1436=== PAUSE TestGCEndsOnShutdown/blocked_in_the_sweep's_S3_delete1437=== RUN TestGCEndsOnShutdown/blocked_on_a_row_lock_in_the_mark1438=== PAUSE TestGCEndsOnShutdown/blocked_on_a_row_lock_in_the_mark1439=== CONT TestRegisterCompletedObjectNeedsPendingRow14402026/10/08 12:58:09 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:41221/oidc14412026/10/08 12:58:09 WARN Force mode enabled - objects will be deleted immediately without grace period14422026/10/08 12:58:09 INFO lead: acquired remote=192.0.2.1:123414432026/10/08 12:58:09 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=3 objects-deleted-after-grace-period=3 objects-failed-to-delete=014442026/10/08 12:58:09 INFO Vacuumed table table=pending_closures14452026/10/08 12:58:09 INFO Vacuumed table table=pending_objects14462026/10/08 12:58:09 INFO Vacuumed table table=multipart_uploads14472026/10/08 12:58:09 INFO Vacuumed table table=closures1448--- PASS: TestService_ReadScope_PublicByDefault (0.42s)1449=== CONT TestCommitRacingPendingCleanupKeepsObjects14502026/10/08 12:58:09 INFO Vacuumed table table=objects14512026/10/08 12:58:09 INFO Received push request method=POST path=/api/pushes14522026/10/08 12:58:09 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)14532026/10/08 12:58:09 INFO Uploading vxm0bx1psmprvxz3kp5syzkkb89b8zly-ca-test (144B)14542026/10/08 12:58:09 WARN Failed to register uploaded object key=nar/04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n.nar.zst error="server returned 404: 404 page not found\n"14552026/10/08 12:58:09 WARN Failed to register uploaded object key=vxm0bx1psmprvxz3kp5syzkkb89b8zly.ls error="server returned 404: 404 page not found\n"14562026/10/08 12:58:09 WARN Failed to register uploaded object key=log/6p8lvmmhidf5g2rrh2bi91al2fk1ngwx-ca-test.drv error="server returned 404: 404 page not found\n"14572026/10/08 12:58:09 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign14582026/10/08 12:58:09 INFO Signed narinfos id=1 count=114592026/10/08 12:58:09 INFO Uploading 1 narinfos14602026/10/08 12:58:09 INFO Received complete push request method=POST path=/api/pushes/1/complete14612026/10/08 12:58:09 WARN Failed to register uploaded object key=vxm0bx1psmprvxz3kp5syzkkb89b8zly.narinfo error="server returned 404: 404 page not found\n"1462--- PASS: TestConcurrentCommitsSharingObjectsDoNotDeadlock (0.80s)1463=== CONT TestPushWaitsForSweepHoldingRow14642026/10/08 12:58:09 INFO Completed push id=1 objects=4 duration=6.72424ms14652026/10/08 12:58:09 INFO Upload complete. (102ms)1466=== NAME TestClientCADerivations1467 client_ca_test.go:180: Narinfo contains CA field: StorePath: /build/TestClientCADerivations4163219932/001/store/vxm0bx1psmprvxz3kp5syzkkb89b8zly-ca-test1468 URL: nar/04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n.nar.zst1469 Compression: zstd1470 NarHash: sha256:04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n1471 NarSize: 1441472 References: 1473 Deriver: /build/TestClientCADerivations4163219932/001/store/6p8lvmmhidf5g2rrh2bi91al2fk1ngwx-ca-test.drv1474 CA: fixed:r:sha256:04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n1475 client_ca_test.go:185: Checking for realisation files in S3...1476 client_ca_test.go:207: No realisation files uploaded - this is expected for locally built CA derivations1477 client_ca_test.go:208: Locally built CA derivations don't have DrvOutput IDs until they're substituted from a cache1478--- PASS: TestService_ReadAuthMiddleware (0.29s)1479=== CONT TestSweepSkipsRowsLockedByPush14802026/10/08 12:58:09 INFO Received uploads request method=POST path=/api/pending_closures1481=== RUN TestService_RequireScope_OIDC/builder_may_write1482=== PAUSE TestService_RequireScope_OIDC/builder_may_write1483=== RUN TestService_RequireScope_OIDC/builder_may_not_admin1484=== PAUSE TestService_RequireScope_OIDC/builder_may_not_admin1485=== RUN TestService_RequireScope_OIDC/ops_may_admin1486=== PAUSE TestService_RequireScope_OIDC/ops_may_admin1487=== RUN TestService_RequireScope_OIDC/ops_may_not_write1488=== PAUSE TestService_RequireScope_OIDC/ops_may_not_write1489=== RUN TestService_RequireScope_OIDC/reader_may_not_write1490=== PAUSE TestService_RequireScope_OIDC/reader_may_not_write1491=== RUN TestService_RequireScope_OIDC/static_token_may_admin1492=== PAUSE TestService_RequireScope_OIDC/static_token_may_admin1493=== RUN TestService_RequireScope_OIDC/static_token_may_write1494=== PAUSE TestService_RequireScope_OIDC/static_token_may_write1495=== RUN TestService_RequireScope_OIDC/reader_may_read1496=== PAUSE TestService_RequireScope_OIDC/reader_may_read1497=== RUN TestService_RequireScope_OIDC/writer_implies_read1498=== PAUSE TestService_RequireScope_OIDC/writer_implies_read1499=== RUN TestService_RequireScope_OIDC/anonymous_may_not_read1500=== PAUSE TestService_RequireScope_OIDC/anonymous_may_not_read1501=== RUN TestService_RequireScope_OIDC/reader_may_read_with_netrc1502=== PAUSE TestService_RequireScope_OIDC/reader_may_read_with_netrc1503=== RUN TestService_RequireScope_OIDC/static_token_may_admin_with_netrc1504=== PAUSE TestService_RequireScope_OIDC/static_token_may_admin_with_netrc1505=== RUN TestService_RequireScope_OIDC/wrong_netrc_password_may_not_read1506=== PAUSE TestService_RequireScope_OIDC/wrong_netrc_password_may_not_read1507=== RUN TestService_RequireScope_OIDC/empty_netrc_password_may_not_read1508=== PAUSE TestService_RequireScope_OIDC/empty_netrc_password_may_not_read1509=== CONT TestGCTaskStore_StartNew1510--- PASS: TestGCTaskStore_StartNew (0.00s)1511=== CONT TestFailedS3DeleteKeepsTombstone15122026/10/08 12:58:09 INFO Received uploads request method=POST path=/api/pending_closures15132026/10/08 12:58:09 INFO Uploading 2 paths to 127.0.0.1 (1 already cached)15142026/10/08 12:58:09 INFO Uploading 96wi4czafy8xjjz5jjr6hm63rq8r4cgm-shared-dep (136B)15152026/10/08 12:58:09 INFO Uploading 7jymhh0c71q4098dfdv0gwswrrxhdrrl-a (216B)15162026/10/08 12:58:09 WARN Failed to register uploaded object key=0x4bc2n5pnb94zcfvrqzmfzkj9n09nvw.ls error="server returned 404: 404 page not found\n"15172026/10/08 12:58:09 WARN Failed to register uploaded object key=nar/1592vrn16c09vvnabgqdxav4d64rjvxcr6svs00nh6881ml1nmn0.nar.zst error="server returned 404: 404 page not found\n"15182026/10/08 12:58:09 WARN Failed to register uploaded object key=7jymhh0c71q4098dfdv0gwswrrxhdrrl.ls error="server returned 404: 404 page not found\n"15192026/10/08 12:58:09 WARN Failed to register uploaded object key=nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst error="server returned 404: 404 page not found\n"15202026/10/08 12:58:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign15212026/10/08 12:58:09 WARN Failed to register uploaded object key=96wi4czafy8xjjz5jjr6hm63rq8r4cgm.ls error="server returned 404: 404 page not found\n"15222026/10/08 12:58:09 INFO Signed narinfos id=1 count=215232026/10/08 12:58:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign15242026/10/08 12:58:09 INFO Signed narinfos id=2 count=215252026/10/08 12:58:09 INFO Uploading 4 narinfos1526=== NAME TestPinProtectsFromGC1527 client_integration_test.go:731: Pinned store path: /build/TestPinProtectsFromGC4037413024/001/store/j4p4p057rid96jvd104rpnk4jmj86npv-pinned-file.txt1528 client_integration_test.go:732: Unpinned store path: /build/TestPinProtectsFromGC4037413024/001/store/yf5mrpd6rcpqm2xc5i191vgky2pbp5l0-unpinned-file.txt15292026/10/08 12:58:09 WARN Failed to register uploaded object key=96wi4czafy8xjjz5jjr6hm63rq8r4cgm.narinfo error="server returned 404: 404 page not found\n"15302026/10/08 12:58:09 WARN Failed to register uploaded object key=7jymhh0c71q4098dfdv0gwswrrxhdrrl.narinfo error="server returned 404: 404 page not found\n"15312026/10/08 12:58:09 WARN Failed to register uploaded object key=0x4bc2n5pnb94zcfvrqzmfzkj9n09nvw.narinfo error="server returned 404: 404 page not found\n"15322026/10/08 12:58:09 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete15332026/10/08 12:58:09 WARN Failed to register uploaded object key=96wi4czafy8xjjz5jjr6hm63rq8r4cgm.narinfo error="server returned 404: 404 page not found\n"15342026/10/08 12:58:09 WARN mTLS auth: subject not in bound subjects subject="CN=untrusted,O=Other"15352026/10/08 12:58:09 WARN mTLS auth: bound subjects configured but subject DN unavailable15362026/10/08 12:58:09 WARN mTLS auth: subject not in bound subjects subject="CN=untrusted"1537--- PASS: TestService_AuthMiddleware_MTLSBoundSubjects (0.28s)1538=== CONT TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle15392026/10/08 12:58:09 INFO Completed upload id=1 objects=6 duration=6.637398ms15402026/10/08 12:58:09 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete15412026/10/08 12:58:09 INFO Completed upload id=2 objects=6 duration=1.816836ms15422026/10/08 12:58:09 INFO Upload complete. (70ms)1543=== NAME TestClientFallsBackToClosures1544 client_pushes_test.go:112: Retrieved narinfo from S3:1545 StorePath: /build/TestClientFallsBackToClosures930025033/001/store/96wi4czafy8xjjz5jjr6hm63rq8r4cgm-shared-dep1546 URL: nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst1547 Compression: zstd1548 NarHash: sha256:1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y821549 NarSize: 1361550 References: 1551 CA: text:sha256:08nxw05k7b0pzzy0f3swvnw4ldxdbclkdnklpidwmrxdhvfrmv7n1552--- PASS: TestObjectStatsLargeCommit (1.53s)1553=== CONT TestForceGCDuringPushOffersSweptObject1554=== RUN TestForceGCDuringPushOffersSweptObject/before_pending_rows1555=== PAUSE TestForceGCDuringPushOffersSweptObject/before_pending_rows1556=== RUN TestForceGCDuringPushOffersSweptObject/after_presence_check1557=== PAUSE TestForceGCDuringPushOffersSweptObject/after_presence_check1558=== CONT TestUploadHandlersRejectOversizedBody/complete_multipart15592026/10/08 12:58:09 INFO Received complete multipart upload request method=POST path=/1560=== NAME TestClientFallsBackToClosures1561 client_pushes_test.go:112: Retrieved narinfo from S3:1562 StorePath: /build/TestClientFallsBackToClosures930025033/001/store/7jymhh0c71q4098dfdv0gwswrrxhdrrl-a1563 URL: nar/1592vrn16c09vvnabgqdxav4d64rjvxcr6svs00nh6881ml1nmn0.nar.zst1564 Compression: zstd1565 NarHash: sha256:1592vrn16c09vvnabgqdxav4d64rjvxcr6svs00nh6881ml1nmn01566 NarSize: 2161567 References: /build/TestClientFallsBackToClosures930025033/001/store/96wi4czafy8xjjz5jjr6hm63rq8r4cgm-shared-dep1568 CA: text:sha256:1y1czgph3681b9aw7w4wml5mn1mhny871w2pbqm7bzcj0d0lvfik1569 client_pushes_test.go:112: Retrieved narinfo from S3:1570 StorePath: /build/TestClientFallsBackToClosures930025033/001/store/0x4bc2n5pnb94zcfvrqzmfzkj9n09nvw-b1571 URL: nar/1592vrn16c09vvnabgqdxav4d64rjvxcr6svs00nh6881ml1nmn0.nar.zst1572 Compression: zstd1573 NarHash: sha256:1592vrn16c09vvnabgqdxav4d64rjvxcr6svs00nh6881ml1nmn01574 NarSize: 2161575 References: /build/TestClientFallsBackToClosures930025033/001/store/96wi4czafy8xjjz5jjr6hm63rq8r4cgm-shared-dep1576 CA: text:sha256:1y1czgph3681b9aw7w4wml5mn1mhny871w2pbqm7bzcj0d0lvfik1577=== NAME TestClientCADerivations1578 client_ca_test.go:258: nix copy output: warning: you don't have Internet access; disabling some network-dependent features1579 warning: failed to create TLS context for AWS credential providers; SSO, STS WebIdentity, and ECS container authentication will be unavailable1580 error: binary cache 's3://bucket66?endpoint=http://localhost:42861®ion=eu-west-1' is for Nix stores with prefix '/nix/store', not '/build/TestClientCADerivations4163219932/001/store'1581 client_ca_test.go:259: nix copy failed (might be expected with isolated stores): exit status 11582--- PASS: TestClientFallsBackToClosures (0.65s)1583=== CONT TestUploadHandlersRejectOversizedBody/create_pending_closure15842026/10/08 12:58:09 INFO Received uploads request method=POST path=/1585--- PASS: TestClientCADerivations (0.78s)1586=== CONT TestUploadHandlersRejectOversizedBody/request_more_parts15872026/10/08 12:58:09 INFO Received request for more parts method=POST path=/1588--- PASS: TestService_AuthMiddleware_MTLSProxyHeader (0.28s)1589=== CONT TestPush_RejectsBadRequests/bad_root15902026/10/08 12:58:09 INFO Received push request method=POST path=/api/pushes1591=== CONT TestPush_RejectsBadRequests/no_roots15922026/10/08 12:58:09 INFO Received push request method=POST path=/api/pushes1593=== CONT TestPush_RejectsBadRequests/root_not_in_objects15942026/10/08 12:58:09 INFO Received push request method=POST path=/api/pushes1595=== CONT TestPush_RejectsBadRequests/no_objects15962026/10/08 12:58:09 INFO Received push request method=POST path=/api/pushes1597--- PASS: TestPush_RejectsBadRequests (0.45s)1598 --- PASS: TestPush_RejectsBadRequests/bad_root (0.00s)1599 --- PASS: TestPush_RejectsBadRequests/no_roots (0.00s)1600 --- PASS: TestPush_RejectsBadRequests/root_not_in_objects (0.00s)1601 --- PASS: TestPush_RejectsBadRequests/no_objects (0.00s)1602=== CONT TestIsValidCachePath/narinfo1603=== CONT TestIsValidCachePath/index.html1604=== CONT TestIsValidCachePath/short_hash1605=== CONT TestIsValidCachePath/wrong_extension1606=== CONT TestIsValidCachePath/leading_slash1607=== CONT TestIsValidCachePath/empty1608=== CONT TestIsValidCachePath/random_path1609=== CONT TestIsValidCachePath/invalid_char_u1610=== CONT TestIsValidCachePath/invalid_char_e1611=== CONT TestIsValidCachePath/traversal_in_middle1612=== CONT TestIsValidCachePath/traversal_parent1613=== CONT TestIsValidCachePath/nar_uncompressed1614=== CONT TestIsValidCachePath/log1615=== CONT TestIsValidCachePath/realisation1616=== CONT TestIsValidCachePath/ls1617=== CONT TestIsValidCachePath/nix-cache-info1618=== CONT TestIsValidCachePath/nar_xz1619=== CONT TestIsValidCachePath/nar_bz21620=== CONT TestIsValidCachePath/narinfo_all_nix_base32_chars1621=== CONT TestIsValidCachePath/nar_zst1622=== CONT TestParseSingleRange/none1623--- PASS: TestIsValidCachePath (0.00s)1624 --- PASS: TestIsValidCachePath/narinfo (0.00s)1625 --- PASS: TestIsValidCachePath/index.html (0.00s)1626 --- PASS: TestIsValidCachePath/short_hash (0.00s)1627 --- PASS: TestIsValidCachePath/wrong_extension (0.00s)1628 --- PASS: TestIsValidCachePath/leading_slash (0.00s)1629 --- PASS: TestIsValidCachePath/empty (0.00s)1630 --- PASS: TestIsValidCachePath/random_path (0.00s)1631 --- PASS: TestIsValidCachePath/invalid_char_u (0.00s)1632 --- PASS: TestIsValidCachePath/invalid_char_e (0.00s)1633 --- PASS: TestIsValidCachePath/traversal_in_middle (0.00s)1634 --- PASS: TestIsValidCachePath/traversal_parent (0.00s)1635 --- PASS: TestIsValidCachePath/nar_uncompressed (0.00s)1636 --- PASS: TestIsValidCachePath/log (0.00s)1637 --- PASS: TestIsValidCachePath/realisation (0.00s)1638 --- PASS: TestIsValidCachePath/ls (0.00s)1639 --- PASS: TestIsValidCachePath/nix-cache-info (0.00s)1640 --- PASS: TestIsValidCachePath/nar_xz (0.00s)1641 --- PASS: TestIsValidCachePath/nar_bz2 (0.00s)1642 --- PASS: TestIsValidCachePath/narinfo_all_nix_base32_chars (0.00s)1643 --- PASS: TestIsValidCachePath/nar_zst (0.00s)1644=== CONT TestParseSingleRange/open-ended1645=== CONT TestParseSingleRange/start_far_past_EOF1646=== CONT TestParseSingleRange/start_past_EOF1647=== CONT TestParseSingleRange/single_byte1648=== CONT TestParseSingleRange/suffix_exceeds_size1649=== CONT TestParseSingleRange/suffix1650=== CONT TestPresentNotReportedWhileGCDeletesClosure/stale16512026/10/08 12:58:09 INFO Received push request method=POST path=/api/pushes16522026/10/08 12:58:09 INFO Aborted multipart uploads count=0 kept=016532026/10/08 12:58:09 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)16542026/10/08 12:58:09 INFO Uploading j4p4p057rid96jvd104rpnk4jmj86npv-pinned-file.txt (128B)16552026/10/08 12:58:09 WARN Force mode enabled - objects will be deleted immediately without grace period1656=== CONT TestParseSingleRange/end_clamped_to_size1657=== CONT TestParseSingleRange/malformed_no_dash1658=== CONT TestParseSingleRange/multi-range_ignored1659=== CONT TestParseSingleRange/unknown_unit1660=== CONT TestParseSingleRange/closed1661=== CONT TestParseSingleRange/malformed_both_empty1662=== CONT TestParseSingleRange/malformed_end_before_start1663--- PASS: TestParseSingleRange (0.00s)1664 --- PASS: TestParseSingleRange/none (0.00s)1665 --- PASS: TestParseSingleRange/open-ended (0.00s)1666 --- PASS: TestParseSingleRange/start_far_past_EOF (0.00s)1667 --- PASS: TestParseSingleRange/start_past_EOF (0.00s)1668 --- PASS: TestParseSingleRange/single_byte (0.00s)1669 --- PASS: TestParseSingleRange/suffix_exceeds_size (0.00s)1670 --- PASS: TestParseSingleRange/suffix (0.00s)1671 --- PASS: TestParseSingleRange/end_clamped_to_size (0.00s)1672 --- PASS: TestParseSingleRange/malformed_no_dash (0.00s)1673 --- PASS: TestParseSingleRange/multi-range_ignored (0.00s)1674 --- PASS: TestParseSingleRange/unknown_unit (0.00s)1675 --- PASS: TestParseSingleRange/closed (0.00s)1676 --- PASS: TestParseSingleRange/malformed_both_empty (0.00s)1677 --- PASS: TestParseSingleRange/malformed_end_before_start (0.00s)1678=== CONT TestPresentNotReportedWhileGCDeletesClosure/fresh16792026/10/08 12:58:09 WARN Failed to register uploaded object key=nar/0qmhsg42pqsz7x6hh02j8gznnac3yi3qpjhrqbwvz88i194jbb5s.nar.zst error="server returned 404: 404 page not found\n"16802026/10/08 12:58:09 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign16812026/10/08 12:58:09 WARN Failed to register uploaded object key=j4p4p057rid96jvd104rpnk4jmj86npv.ls error="server returned 404: 404 page not found\n"16822026/10/08 12:58:09 INFO Signed narinfos id=1 count=116832026/10/08 12:58:09 INFO Uploading 1 narinfos16842026/10/08 12:58:09 INFO Received complete push request method=POST path=/api/pushes/1/complete16852026/10/08 12:58:09 WARN Failed to register uploaded object key=j4p4p057rid96jvd104rpnk4jmj86npv.narinfo error="server returned 404: 404 page not found\n"16862026/10/08 12:58:09 INFO Received push request method=POST path=/api/pushes1687--- PASS: TestGetExistingObjectsLocksRows (0.30s)1688=== CONT TestPendingClosureWriteTimeout/empty1689=== CONT TestPendingClosureWriteTimeout/670k_objects1690=== CONT TestPendingClosureWriteTimeout/400_objects1691=== CONT TestPendingClosureWriteTimeout/handler_extends_the_server's_deadline16922026/10/08 12:58:09 INFO Completed push id=1 objects=3 duration=6.704679ms16932026/10/08 12:58:09 INFO Upload complete. (59ms)1694=== CONT TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info16952026/10/08 12:58:09 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=016962026/10/08 12:58:09 INFO Uploading 2 paths to 127.0.0.1 (1 already cached)16972026/10/08 12:58:09 INFO Received uploads request method=POST path=/16982026/10/08 12:58:09 INFO Uploading mbs0vgp61y2mlm8gindx643r4w83152q-shared-dep (136B)1699=== CONT TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key17002026/10/08 12:58:09 INFO Received complete multipart upload request method=POST path=/1701=== CONT TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal17022026/10/08 12:58:09 INFO Received uploads request method=POST path=/17032026/10/08 12:58:09 INFO Uploading yh3z8lf2lsrfp1g63j0p9nfkz9gcyc90-a (216B)1704=== CONT TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key17052026/10/08 12:58:09 INFO Received request for more parts method=POST path=/1706--- PASS: TestUploadHandlersRejectInvalidKeys (0.00s)1707 --- PASS: TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info (0.00s)1708 --- PASS: TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key (0.00s)1709 --- PASS: TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal (0.00s)1710 --- PASS: TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key (0.00s)1711=== CONT TestIsValidUploadKey/narinfo1712=== CONT TestIsValidUploadKey/realisation_plus_in_output1713=== CONT TestIsValidUploadKey/unknown_type1714=== CONT TestIsValidUploadKey/empty_key1715=== CONT TestIsValidUploadKey/absolute1716=== CONT TestIsValidUploadKey/traversal_nar1717=== CONT TestIsValidUploadKey/traversal1718=== CONT TestIsValidUploadKey/listing_key,_narinfo_type1719=== CONT TestIsValidUploadKey/nar_key,_narinfo_type1720=== CONT TestIsValidUploadKey/narinfo_key,_nar_type1721=== CONT TestIsValidUploadKey/index.html1722=== CONT TestIsValidUploadKey/nix-cache-info1723=== CONT TestIsValidUploadKey/build_log_equals1724=== CONT TestIsValidUploadKey/realisation1725=== CONT TestIsValidUploadKey/build_log1726=== CONT TestIsValidUploadKey/build_log_home-manager_file1727=== CONT TestIsValidUploadKey/listing1728=== CONT TestIsValidUploadKey/nar_plain1729=== CONT TestIsValidUploadKey/build_log_plus_in_name1730=== CONT TestIsValidUploadKey/build_log_question_mark1731=== CONT TestIsValidUploadKey/nar_zst1732=== CONT TestIsValidUploadKey/nar_xz1733=== CONT TestServerTLSConfig/no_client_CA1734--- PASS: TestIsValidUploadKey (0.00s)1735 --- PASS: TestIsValidUploadKey/narinfo (0.00s)1736 --- PASS: TestIsValidUploadKey/realisation_plus_in_output (0.00s)1737 --- PASS: TestIsValidUploadKey/unknown_type (0.00s)1738 --- PASS: TestIsValidUploadKey/empty_key (0.00s)1739 --- PASS: TestIsValidUploadKey/absolute (0.00s)1740 --- PASS: TestIsValidUploadKey/traversal_nar (0.00s)1741 --- PASS: TestIsValidUploadKey/traversal (0.00s)1742 --- PASS: TestIsValidUploadKey/listing_key,_narinfo_type (0.00s)1743 --- PASS: TestIsValidUploadKey/nar_key,_narinfo_type (0.00s)1744 --- PASS: TestIsValidUploadKey/narinfo_key,_nar_type (0.00s)1745 --- PASS: TestIsValidUploadKey/index.html (0.00s)1746 --- PASS: TestIsValidUploadKey/nix-cache-info (0.00s)1747 --- PASS: TestIsValidUploadKey/build_log_equals (0.00s)1748 --- PASS: TestIsValidUploadKey/realisation (0.00s)1749 --- PASS: TestIsValidUploadKey/build_log (0.00s)1750 --- PASS: TestIsValidUploadKey/build_log_home-manager_file (0.00s)1751 --- PASS: TestIsValidUploadKey/listing (0.00s)1752 --- PASS: TestIsValidUploadKey/nar_plain (0.00s)1753 --- PASS: TestIsValidUploadKey/build_log_plus_in_name (0.00s)1754 --- PASS: TestIsValidUploadKey/build_log_question_mark (0.00s)1755 --- PASS: TestIsValidUploadKey/nar_zst (0.00s)1756 --- PASS: TestIsValidUploadKey/nar_xz (0.00s)1757=== CONT TestServerTLSConfig/not_a_PEM_file1758=== CONT TestServerTLSConfig/missing_CA_file1759--- PASS: TestServerTLSConfig (0.00s)1760 --- PASS: TestServerTLSConfig/no_client_CA (0.00s)1761 --- PASS: TestServerTLSConfig/not_a_PEM_file (0.00s)1762 --- PASS: TestServerTLSConfig/missing_CA_file (0.00s)1763=== CONT TestClientErrorHandling/InvalidStorePath17642026/10/08 12:58:09 INFO Vacuumed table table=pending_closures17652026/10/08 12:58:09 WARN Failed to register uploaded object key=d1sy2m26jabnr5krpmpgw6gjm6dazjcy.ls error="server returned 404: 404 page not found\n"17662026/10/08 12:58:09 WARN Failed to register uploaded object key=mbs0vgp61y2mlm8gindx643r4w83152q.ls error="server returned 404: 404 page not found\n"17672026/10/08 12:58:09 WARN Failed to register uploaded object key=nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst error="server returned 404: 404 page not found\n"17682026/10/08 12:58:09 INFO Vacuumed table table=pending_objects17692026/10/08 12:58:09 WARN Failed to register uploaded object key=yh3z8lf2lsrfp1g63j0p9nfkz9gcyc90.ls error="server returned 404: 404 page not found\n"17702026/10/08 12:58:09 INFO Vacuumed table table=multipart_uploads17712026/10/08 12:58:09 WARN Failed to register uploaded object key=nar/0ig5n0vwwjbihdsl0xdsdb0gbaizjpi1q3wnzy9a6j6id73mp83q.nar.zst error="server returned 404: 404 page not found\n"17722026/10/08 12:58:09 INFO Vacuumed table table=closures17732026/10/08 12:58:09 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign17742026/10/08 12:58:09 INFO Signed narinfos id=1 count=317752026/10/08 12:58:09 INFO Uploading 3 narinfos1776--- PASS: TestRegisterCompletedObjectNeedsPendingRow (0.27s)1777=== CONT TestClientErrorHandling/ServerNotAvailable17782026/10/08 12:58:09 INFO Vacuumed table table=objects1779--- PASS: TestSweepRechecksPendingAfterLocking (0.34s)1780=== CONT TestClientErrorHandling/InvalidAuthToken17812026/10/08 12:58:09 WARN Failed to register uploaded object key=mbs0vgp61y2mlm8gindx643r4w83152q.narinfo error="server returned 404: 404 page not found\n"17822026/10/08 12:58:09 WARN Failed to register uploaded object key=yh3z8lf2lsrfp1g63j0p9nfkz9gcyc90.narinfo error="server returned 404: 404 page not found\n"17832026/10/08 12:58:09 INFO Received complete push request method=POST path=/api/pushes/1/complete17842026/10/08 12:58:09 WARN Failed to register uploaded object key=d1sy2m26jabnr5krpmpgw6gjm6dazjcy.narinfo error="server returned 404: 404 page not found\n"17852026/10/08 12:58:09 INFO Completed push id=1 objects=8 duration=6.706199ms17862026/10/08 12:58:09 INFO Upload complete. (61ms)1787=== NAME TestClientPushesUseOnePush1788 client_pushes_test.go:97: Retrieved narinfo from S3:1789 StorePath: /build/TestClientPushesUseOnePush4236153370/001/store/mbs0vgp61y2mlm8gindx643r4w83152q-shared-dep1790 URL: nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst1791 Compression: zstd1792 NarHash: sha256:1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y821793 NarSize: 1361794 References: 1795 CA: text:sha256:08nxw05k7b0pzzy0f3swvnw4ldxdbclkdnklpidwmrxdhvfrmv7n1796 client_pushes_test.go:97: Retrieved narinfo from S3:1797 StorePath: /build/TestClientPushesUseOnePush4236153370/001/store/yh3z8lf2lsrfp1g63j0p9nfkz9gcyc90-a1798 URL: nar/0ig5n0vwwjbihdsl0xdsdb0gbaizjpi1q3wnzy9a6j6id73mp83q.nar.zst1799 Compression: zstd1800 NarHash: sha256:0ig5n0vwwjbihdsl0xdsdb0gbaizjpi1q3wnzy9a6j6id73mp83q1801 NarSize: 2161802 References: /build/TestClientPushesUseOnePush4236153370/001/store/mbs0vgp61y2mlm8gindx643r4w83152q-shared-dep1803 CA: text:sha256:0f42s60l2lra8caql9zw0piw6mbgha4gyry1mm03ixkkrgyb5xqs1804=== RUN TestService_AuthMiddleware_OIDC/valid_OIDC_token1805=== PAUSE TestService_AuthMiddleware_OIDC/valid_OIDC_token1806=== RUN TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected1807=== PAUSE TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected1808=== RUN TestService_AuthMiddleware_OIDC/malformed_token_rejected1809=== PAUSE TestService_AuthMiddleware_OIDC/malformed_token_rejected1810=== RUN TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured1811=== PAUSE TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured1812=== CONT TestResolveDBConnectionString/flag_wins1813=== CONT TestResolveDBConnectionString/PGHOST_allows_empty1814=== CONT TestResolveDBConnectionString/nothing_configured1815=== CONT TestResolveDBConnectionString/missing_file_is_an_error1816=== CONT TestResolveDBConnectionString/file_when_flag_empty1817=== NAME TestClientPushesUseOnePush1818 client_pushes_test.go:97: Retrieved narinfo from S3:1819 StorePath: /build/TestClientPushesUseOnePush4236153370/001/store/d1sy2m26jabnr5krpmpgw6gjm6dazjcy-b1820 URL: nar/0ig5n0vwwjbihdsl0xdsdb0gbaizjpi1q3wnzy9a6j6id73mp83q.nar.zst1821 Compression: zstd1822 NarHash: sha256:0ig5n0vwwjbihdsl0xdsdb0gbaizjpi1q3wnzy9a6j6id73mp83q1823 NarSize: 2161824 References: /build/TestClientPushesUseOnePush4236153370/001/store/mbs0vgp61y2mlm8gindx643r4w83152q-shared-dep1825 CA: text:sha256:0f42s60l2lra8caql9zw0piw6mbgha4gyry1mm03ixkkrgyb5xqs1826=== CONT TestCacheConfigHandler/full_config,_no_issuer1827=== CONT TestCacheConfigHandler/no_signing_keys1828=== CONT TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator1829=== CONT TestCacheConfigHandler/no_cache_url_configured1830=== CONT TestProxyWriteTimeout/narinfo1831=== CONT TestProxyWriteTimeout/10_GiB_nar1832=== CONT TestProxyWriteTimeout/unknown_size1833=== CONT TestProxyWriteTimeout/1_GiB_nar1834=== CONT TestGCEndsOnShutdown/before_the_run1835--- PASS: TestResolveDBConnectionString (0.00s)1836 --- PASS: TestResolveDBConnectionString/flag_wins (0.00s)1837 --- PASS: TestResolveDBConnectionString/PGHOST_allows_empty (0.00s)1838 --- PASS: TestResolveDBConnectionString/nothing_configured (0.00s)1839 --- PASS: TestResolveDBConnectionString/missing_file_is_an_error (0.00s)1840 --- PASS: TestResolveDBConnectionString/file_when_flag_empty (0.00s)1841--- PASS: TestCacheConfigHandler (0.00s)1842 --- PASS: TestCacheConfigHandler/full_config,_no_issuer (0.00s)1843 --- PASS: TestCacheConfigHandler/no_signing_keys (0.00s)1844 --- PASS: TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator (0.00s)1845 --- PASS: TestCacheConfigHandler/no_cache_url_configured (0.00s)1846--- PASS: TestProxyWriteTimeout (0.00s)1847 --- PASS: TestProxyWriteTimeout/narinfo (0.00s)1848 --- PASS: TestProxyWriteTimeout/10_GiB_nar (0.00s)1849 --- PASS: TestProxyWriteTimeout/unknown_size (0.00s)1850 --- PASS: TestProxyWriteTimeout/1_GiB_nar (0.00s)1851--- PASS: TestClientPushesUseOnePush (0.57s)1852=== CONT TestGCEndsOnShutdown/blocked_on_a_row_lock_in_the_mark18532026/10/08 12:58:09 INFO Received push request method=POST path=/api/pushes18542026/10/08 12:58:09 INFO Uploading 2 paths to 127.0.0.1 (0 already cached)18552026/10/08 12:58:09 INFO Uploading bmp80bjyqq71rhwi14p813mwrlkbf1vk-top (224B)18562026/10/08 12:58:09 INFO Uploading 6f5riz2111lgd5byv5mxai4alnsyf5i5-shared-dep (136B)18572026/10/08 12:58:09 WARN Failed to register uploaded object key=nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst error="server returned 404: 404 page not found\n"18582026/10/08 12:58:09 WARN Failed to register uploaded object key=bmp80bjyqq71rhwi14p813mwrlkbf1vk.ls error="server returned 404: 404 page not found\n"18592026/10/08 12:58:09 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign18602026/10/08 12:58:09 WARN Failed to register uploaded object key=nar/1qq6cpnz9b38idkmb075ljd1c9pfq4mx2z146hh9az86iqypins0.nar.zst error="server returned 404: 404 page not found\n"18612026/10/08 12:58:09 WARN Failed to register uploaded object key=6f5riz2111lgd5byv5mxai4alnsyf5i5.ls error="server returned 404: 404 page not found\n"18622026/10/08 12:58:09 INFO Signed narinfos id=1 count=218632026/10/08 12:58:09 INFO Uploading 2 narinfos18642026/10/08 12:58:09 WARN Failed to register uploaded object key=6f5riz2111lgd5byv5mxai4alnsyf5i5.narinfo error="server returned 404: 404 page not found\n"18652026/10/08 12:58:09 INFO Received complete push request method=POST path=/api/pushes/1/complete18662026/10/08 12:58:09 WARN Failed to register uploaded object key=bmp80bjyqq71rhwi14p813mwrlkbf1vk.narinfo error="server returned 404: 404 page not found\n"18672026/10/08 12:58:09 INFO Completed push id=1 objects=6 duration=8.886359ms18682026/10/08 12:58:09 INFO Upload complete. (63ms)1869=== NAME TestClientSharedPathCommittedMidPush1870 client_integration_test.go:680: Retrieved narinfo from S3:1871 StorePath: /build/TestClientSharedPathCommittedMidPush3544519064/001/store/6f5riz2111lgd5byv5mxai4alnsyf5i5-shared-dep1872 URL: nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst1873 Compression: zstd1874 NarHash: sha256:1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y821875 NarSize: 1361876 References: 1877 CA: text:sha256:08nxw05k7b0pzzy0f3swvnw4ldxdbclkdnklpidwmrxdhvfrmv7n1878 client_integration_test.go:680: Retrieved narinfo from S3:1879 StorePath: /build/TestClientSharedPathCommittedMidPush3544519064/001/store/bmp80bjyqq71rhwi14p813mwrlkbf1vk-top1880 URL: nar/1qq6cpnz9b38idkmb075ljd1c9pfq4mx2z146hh9az86iqypins0.nar.zst1881 Compression: zstd1882 NarHash: sha256:1qq6cpnz9b38idkmb075ljd1c9pfq4mx2z146hh9az86iqypins01883 NarSize: 2241884 References: /build/TestClientSharedPathCommittedMidPush3544519064/001/store/6f5riz2111lgd5byv5mxai4alnsyf5i5-shared-dep1885 CA: text:sha256:0k8nhsrb0i5q37yqscc62kbi2dg5wxlj6bdh2vpbgwh5vdar8szs18862026/10/08 12:58:09 INFO Received push request method=POST path=/api/pushes1887--- PASS: TestClientSharedPathCommittedMidPush (0.50s)1888=== CONT TestGCEndsOnShutdown/blocked_in_the_sweep's_S3_delete18892026/10/08 12:58:09 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)18902026/10/08 12:58:09 INFO Uploading yf5mrpd6rcpqm2xc5i191vgky2pbp5l0-unpinned-file.txt (128B)18912026/10/08 12:58:09 WARN Failed to register uploaded object key=nar/0gh0wdnr6gmk4r5sfzzh12isnl14rgmkrwy1ws41hpsrlndclg5h.nar.zst error="server returned 404: 404 page not found\n"18922026/10/08 12:58:09 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign18932026/10/08 12:58:09 WARN Failed to register uploaded object key=yf5mrpd6rcpqm2xc5i191vgky2pbp5l0.ls error="server returned 404: 404 page not found\n"18942026/10/08 12:58:09 INFO Signed narinfos id=2 count=118952026/10/08 12:58:09 INFO Uploading 1 narinfos18962026/10/08 12:58:09 INFO Received complete push request method=POST path=/api/pushes/2/complete18972026/10/08 12:58:09 WARN Failed to register uploaded object key=yf5mrpd6rcpqm2xc5i191vgky2pbp5l0.narinfo error="server returned 404: 404 page not found\n"18982026/10/08 12:58:09 WARN Request failed, retrying attempt=1 backoff=100ms error="Post \"http://localhost:19999/api/objects/present\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/objects/present18992026/10/08 12:58:09 INFO Completed push id=2 objects=3 duration=3.730193ms19002026/10/08 12:58:09 INFO Upload complete. (54ms)19012026/10/08 12:58:09 INFO Received uploads request method=POST path=/api/pending_closures19022026/10/08 12:58:09 INFO Aborted multipart uploads count=0 kept=019032026/10/08 12:58:09 WARN Force mode enabled - objects will be deleted immediately without grace period19042026/10/08 12:58:09 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=019052026/10/08 12:58:09 INFO Vacuumed table table=pending_closures19062026/10/08 12:58:09 INFO Vacuumed table table=pending_objects19072026/10/08 12:58:09 INFO Vacuumed table table=multipart_uploads19082026/10/08 12:58:09 INFO Vacuumed table table=closures19092026/10/08 12:58:09 INFO Vacuumed table table=objects19102026/10/08 12:58:09 INFO Starting cleanup of old closures method=DELETE path=/api/closures19112026/10/08 12:58:09 INFO Garbage collection started1912--- PASS: TestCommitRacingPendingCleanupKeepsObjects (0.35s)1913=== CONT TestService_RequireScope_OIDC/builder_may_write1914=== CONT TestService_RequireScope_OIDC/reader_may_read_with_netrc1915=== CONT TestService_RequireScope_OIDC/anonymous_may_not_read1916=== CONT TestService_RequireScope_OIDC/static_token_may_admin_with_netrc1917=== CONT TestService_RequireScope_OIDC/writer_implies_read1918=== CONT TestService_RequireScope_OIDC/reader_may_read1919=== CONT TestService_RequireScope_OIDC/static_token_may_write1920=== CONT TestService_RequireScope_OIDC/static_token_may_admin1921=== CONT TestService_RequireScope_OIDC/reader_may_not_write1922=== CONT TestService_RequireScope_OIDC/ops_may_not_write1923=== CONT TestService_RequireScope_OIDC/ops_may_admin1924=== CONT TestService_RequireScope_OIDC/builder_may_not_admin1925=== CONT TestService_RequireScope_OIDC/empty_netrc_password_may_not_read1926=== CONT TestService_RequireScope_OIDC/wrong_netrc_password_may_not_read19272026/10/08 12:58:09 WARN Authentication failed token_preview=wrong token_length=5 oidc_error="no provider could verify the token (signature or issuer mismatch)" oidc_provider="" tried_providers=[test]1928=== CONT TestForceGCDuringPushOffersSweptObject/before_pending_rows1929--- PASS: TestService_RequireScope_OIDC (0.49s)1930 --- PASS: TestService_RequireScope_OIDC/builder_may_write (0.00s)1931 --- PASS: TestService_RequireScope_OIDC/reader_may_read_with_netrc (0.00s)1932 --- PASS: TestService_RequireScope_OIDC/anonymous_may_not_read (0.00s)1933 --- PASS: TestService_RequireScope_OIDC/static_token_may_admin_with_netrc (0.00s)1934 --- PASS: TestService_RequireScope_OIDC/writer_implies_read (0.00s)1935 --- PASS: TestService_RequireScope_OIDC/reader_may_read (0.00s)1936 --- PASS: TestService_RequireScope_OIDC/static_token_may_write (0.00s)1937 --- PASS: TestService_RequireScope_OIDC/static_token_may_admin (0.00s)1938 --- PASS: TestService_RequireScope_OIDC/reader_may_not_write (0.00s)1939 --- PASS: TestService_RequireScope_OIDC/ops_may_not_write (0.00s)1940 --- PASS: TestService_RequireScope_OIDC/ops_may_admin (0.00s)1941 --- PASS: TestService_RequireScope_OIDC/builder_may_not_admin (0.00s)1942 --- PASS: TestService_RequireScope_OIDC/empty_netrc_password_may_not_read (0.00s)1943 --- PASS: TestService_RequireScope_OIDC/wrong_netrc_password_may_not_read (0.00s)19442026/10/08 12:58:09 INFO Received uploads request method=POST path=/api/pending_closures19452026/10/08 12:58:09 INFO Aborted multipart uploads count=0 kept=019462026/10/08 12:58:09 INFO Aborted multipart uploads count=0 kept=019472026/10/08 12:58:09 WARN Force mode enabled - objects will be deleted immediately without grace period19482026/10/08 12:58:09 WARN Force mode enabled - objects will be deleted immediately without grace period19492026/10/08 12:58:09 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=019502026/10/08 12:58:09 INFO Vacuumed table table=pending_closures19512026/10/08 12:58:09 INFO Vacuumed table table=pending_objects19522026/10/08 12:58:09 INFO Vacuumed table table=multipart_uploads19532026/10/08 12:58:09 INFO Vacuumed table table=closures19542026/10/08 12:58:09 INFO Vacuumed table table=objects19552026/10/08 12:58:09 INFO Aborted multipart uploads count=0 kept=019562026/10/08 12:58:09 INFO Received uploads request method=POST path=/api/pending_closures19572026/10/08 12:58:09 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=3 objects-deleted-after-grace-period=3 objects-failed-to-delete=019582026/10/08 12:58:09 WARN Force mode enabled - objects will be deleted immediately without grace period19592026/10/08 12:58:09 INFO Vacuumed table table=pending_closures19602026/10/08 12:58:09 INFO Vacuumed table table=pending_objects19612026/10/08 12:58:09 INFO Vacuumed table table=multipart_uploads19622026/10/08 12:58:09 INFO Vacuumed table table=closures19632026/10/08 12:58:09 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=019642026/10/08 12:58:09 INFO Vacuumed table table=pending_closures19652026/10/08 12:58:09 INFO Vacuumed table table=pending_objects19662026/10/08 12:58:09 INFO Vacuumed table table=objects19672026/10/08 12:58:09 INFO Vacuumed table table=multipart_uploads19682026/10/08 12:58:09 INFO Vacuumed table table=closures19692026/10/08 12:58:09 INFO Vacuumed table table=objects1970--- PASS: TestSweepSkipsRowsLockedByPush (0.34s)1971=== CONT TestForceGCDuringPushOffersSweptObject/after_presence_check19722026/10/08 12:58:09 WARN Request failed, retrying attempt=2 backoff=201.2101ms error="Post \"http://localhost:19999/api/objects/present\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/objects/present19732026/10/08 12:58:09 INFO Aborted multipart uploads count=0 kept=019742026/10/08 12:58:09 WARN Force mode enabled - objects will be deleted immediately without grace period19752026/10/08 12:58:09 INFO Received complete multipart upload request method=POST path=/api/multipart/complete19762026/10/08 12:58:09 ERROR failed to remove object object=nar/dddddddddddddddddddddddddddddddddddddddddddddddddddd.nar.zst error="Access Denied."19772026/10/08 12:58:09 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.narinfo error="Access Denied."1978--- PASS: TestFailedS3DeleteKeepsTombstone (0.35s)1979=== CONT TestService_AuthMiddleware_OIDC/valid_OIDC_token1980=== CONT TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected19812026/10/08 12:58:09 WARN Authentication failed token_preview=eyJhbGciOi...ZyTFJV3lsQ token_length=701 oidc_error="no rule matched: claim \"repository_owner\" value [otherorg] not in allowed patterns [myorg]" oidc_provider=test tried_providers=[test]1982=== CONT TestService_AuthMiddleware_OIDC/malformed_token_rejected19832026/10/08 12:58:09 WARN Authentication failed token_preview=not-a-valid-jwt token_length=15 oidc_error="no provider could verify the token (signature or issuer mismatch)" oidc_provider="" tried_providers=[test]1984=== CONT TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured1985--- PASS: TestService_AuthMiddleware_OIDC (0.48s)1986 --- PASS: TestService_AuthMiddleware_OIDC/valid_OIDC_token (0.00s)1987 --- PASS: TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected (0.00s)1988 --- PASS: TestService_AuthMiddleware_OIDC/malformed_token_rejected (0.00s)1989 --- PASS: TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured (0.00s)19902026/10/08 12:58:09 INFO Received uploads request method=POST path=/api/pending_closures19912026/10/08 12:58:09 INFO Aborted multipart uploads count=0 kept=019922026/10/08 12:58:09 WARN Force mode enabled - objects will be deleted immediately without grace period19932026/10/08 12:58:09 INFO Aborted multipart uploads count=0 kept=019942026/10/08 12:58:09 WARN Force mode enabled - objects will be deleted immediately without grace period19952026/10/08 12:58:09 WARN Authentication failed token_preview=invalid-token token_length=13 reason="static API token mismatch"19962026/10/08 12:58:09 INFO Received uploads request method=POST path=/api/pending_closures19972026/10/08 12:58:09 ERROR failed to remove object object=nar/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa.nar.zst error="Post \"http://localhost:42861/bucket98/?delete=\": context canceled"1998--- PASS: TestGCEndsOnShutdown (0.00s)1999 --- PASS: TestGCEndsOnShutdown/before_the_run (0.27s)2000 --- PASS: TestGCEndsOnShutdown/blocked_in_the_sweep's_S3_delete (0.29s)2001 --- PASS: TestGCEndsOnShutdown/blocked_on_a_row_lock_in_the_mark (0.32s)20022026/10/08 12:58:09 INFO Aborted multipart uploads count=0 kept=020032026/10/08 12:58:09 WARN Force mode enabled - objects will be deleted immediately without grace period20042026/10/08 12:58:09 INFO Received uploads request method=POST path=/api/pending_closures20052026/10/08 12:58:09 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=1 objects-deleted-after-grace-period=1 objects-failed-to-delete=020062026/10/08 12:58:09 INFO Vacuumed table table=pending_closures20072026/10/08 12:58:09 INFO Vacuumed table table=pending_objects20082026/10/08 12:58:09 INFO Vacuumed table table=multipart_uploads20092026/10/08 12:58:09 INFO Vacuumed table table=closures20102026/10/08 12:58:09 INFO Vacuumed table table=objects20112026/10/08 12:58:09 INFO Aborted multipart uploads count=0 kept=020122026/10/08 12:58:09 WARN Authentication failed token_preview=invalid-token token_length=13 reason="static API token mismatch"20132026/10/08 12:58:09 WARN Force mode enabled - objects will be deleted immediately without grace period20142026/10/08 12:58:09 WARN Request failed, retrying attempt=3 backoff=419.088024ms error="Post \"http://localhost:19999/api/objects/present\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/objects/present20152026/10/08 12:58:09 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=020162026/10/08 12:58:09 INFO Vacuumed table table=pending_closures20172026/10/08 12:58:09 INFO Vacuumed table table=pending_objects20182026/10/08 12:58:09 INFO Vacuumed table table=multipart_uploads20192026/10/08 12:58:09 INFO Vacuumed table table=closures20202026/10/08 12:58:09 INFO Vacuumed table table=objects2021--- PASS: TestForceGCDuringPushOffersSweptObject (0.00s)2022 --- PASS: TestForceGCDuringPushOffersSweptObject/before_pending_rows (0.26s)2023 --- PASS: TestForceGCDuringPushOffersSweptObject/after_presence_check (0.22s)2024=== NAME TestOrphanedObjectsGCStressTest2025 orphaned_objects_gc_test.go:422: Created 10 active closures, 5 to-delete closures, 20 orphaned chains2026 orphaned_objects_gc_test.go:440: Marked 210 objects for deletion2027--- PASS: TestPushWaitsForSweepHoldingRow (0.76s)2028=== NAME TestOrphanedObjectsGCStressTest2029 orphaned_objects_gc_test.go:503: Stress test completed successfully:2030 orphaned_objects_gc_test.go:504: - Active objects preserved: 202031 orphaned_objects_gc_test.go:505: - Objects deleted: 2102032 orphaned_objects_gc_test.go:506: - Total GC'd: 2102033--- PASS: TestOrphanedObjectsGCStressTest (2.32s)20342026/10/08 12:58:10 INFO lead: released remote=192.0.2.1:12342035--- PASS: TestLeadEndsOnShutdown (1.53s)2036--- PASS: TestPresentNotReportedWhileGCDeletesClosure (0.00s)2037 --- PASS: TestPresentNotReportedWhileGCDeletesClosure/stale (0.76s)2038 --- PASS: TestPresentNotReportedWhileGCDeletesClosure/fresh (0.73s)20392026/10/08 12:58:10 WARN Request failed, retrying attempt=4 backoff=863.596956ms error="Post \"http://localhost:19999/api/objects/present\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/objects/present2040--- PASS: TestDeleteClosuresRacingPins (1.64s)2041--- PASS: TestUploadHandlersRejectOversizedBody (0.15s)2042 --- PASS: TestUploadHandlersRejectOversizedBody/complete_multipart (0.06s)2043 --- PASS: TestUploadHandlersRejectOversizedBody/request_more_parts (0.07s)2044 --- PASS: TestUploadHandlersRejectOversizedBody/create_pending_closure (1.02s)20452026/10/08 12:58:10 INFO lead: released remote=192.0.2.1:123420462026/10/08 12:58:10 INFO lead: acquired remote=192.0.2.1:12342047--- PASS: TestPendingClosureWriteTimeout (0.00s)2048 --- PASS: TestPendingClosureWriteTimeout/empty (0.00s)2049 --- PASS: TestPendingClosureWriteTimeout/670k_objects (0.00s)2050 --- PASS: TestPendingClosureWriteTimeout/400_objects (0.00s)2051 --- PASS: TestPendingClosureWriteTimeout/handler_extends_the_server's_deadline (1.06s)20522026/10/08 12:58:11 WARN Request failed, retrying attempt=5 backoff=1.548334323s error="Post \"http://localhost:19999/api/objects/present\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/objects/present20532026/10/08 12:58:11 INFO Garbage collection progress phase="" failed_uploads_deleted=0 old_closures_deleted=1 objects_marked=3 objects_deleted=3 objects_failed=02054=== NAME TestClientIntegration2055 client_integration_test.go:323: Objects in database after GC:2056 client_integration_test.go:323: Successfully deleted all objects with GC --force2057--- PASS: TestClientIntegration (2.72s)20582026/10/08 12:58:11 INFO lead: released remote=192.0.2.1:12342059--- PASS: TestLeadElectsOneAndHandsOver (2.72s)20602026/10/08 12:58:11 INFO Garbage collection progress phase="" failed_uploads_deleted=0 old_closures_deleted=1 objects_marked=3 objects_deleted=3 objects_failed=020612026/10/08 12:58:11 INFO Received create pin request method=POST path=/api/pins/myapp20622026/10/08 12:58:11 INFO Created/updated pin name=myapp store_path=/build/TestPinProtectsFromGC4037413024/001/store/j4p4p057rid96jvd104rpnk4jmj86npv-pinned-file.txt narinfo_key=j4p4p057rid96jvd104rpnk4jmj86npv.narinfo20632026/10/08 12:58:11 INFO Starting cleanup of old closures method=DELETE path=/api/closures20642026/10/08 12:58:11 INFO Garbage collection started20652026/10/08 12:58:11 INFO Aborted multipart uploads count=0 kept=020662026/10/08 12:58:11 WARN Force mode enabled - objects will be deleted immediately without grace period20672026/10/08 12:58:11 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=020682026/10/08 12:58:11 INFO Vacuumed table table=pending_closures20692026/10/08 12:58:11 INFO Vacuumed table table=pending_objects20702026/10/08 12:58:11 INFO Vacuumed table table=multipart_uploads20712026/10/08 12:58:11 INFO Vacuumed table table=closures20722026/10/08 12:58:11 INFO Vacuumed table table=objects2073--- PASS: TestReadProxyOutlastsServerWriteTimeout (4.59s)20742026/10/08 12:58:12 WARN Request failed, retrying attempt=1 backoff=100ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config20752026/10/08 12:58:12 WARN Request failed, retrying attempt=2 backoff=209.256467ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config20762026/10/08 12:58:13 WARN Request failed, retrying attempt=3 backoff=376.972343ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config20772026/10/08 12:58:13 WARN Request failed, retrying attempt=4 backoff=789.320488ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config20782026/10/08 12:58:13 WARN Rate limiter enabled after throttle name=s3-test rate=520792026/10/08 12:58:13 WARN S3 rate limit hit operation="complete multipart upload" error="Please reduce your request rate."2080=== NAME TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle2081 throttle_test.go:213: Proxy stats: total=13, throttled=10, completeMultipart=102082 throttle_test.go:215: Rate limiter: enabled=true, rate=5.002083--- PASS: TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle (4.11s)2084=== NAME TestPinProtectsFromGC2085 client_integration_test.go:840: Pin successfully protected closure from garbage collection2086--- PASS: TestPinProtectsFromGC (4.60s)20872026/10/08 12:58:14 WARN Request failed, retrying attempt=5 backoff=1.653717374s error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config2088--- PASS: TestConnectWaitsForAPeerMigration (5.14s)20892026/10/08 12:58:14 INFO Aborted multipart uploads count=1 kept=020902026/10/08 12:58:14 INFO Received cleanup request method=DELETE path=/api/pending_closures20912026/10/08 12:58:14 INFO Aborted multipart uploads count=1 kept=02092--- PASS: TestPendingCleanupUsesOneCutoff (6.47s)20932026/10/08 12:58:15 WARN Failed to fetch cache config, uploading without size limit error="fetching cache config: sending request: request failed after retries: Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused"20942026/10/08 12:58:15 WARN Request failed, retrying attempt=1 backoff=100ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config20952026/10/08 12:58:16 WARN Request failed, retrying attempt=2 backoff=180.529268ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config20962026/10/08 12:58:16 WARN Request failed, retrying attempt=3 backoff=416.852614ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config20972026/10/08 12:58:16 WARN Request failed, retrying attempt=4 backoff=754.49855ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config20982026/10/08 12:58:17 WARN Request failed, retrying attempt=5 backoff=1.69577765s error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config20992026/10/08 12:58:19 WARN Request failed, retrying attempt=1 backoff=100ms error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures21002026/10/08 12:58:19 WARN Request failed, retrying attempt=2 backoff=214.761893ms error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures21012026/10/08 12:58:19 WARN Request failed, retrying attempt=3 backoff=375.643585ms error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures21022026/10/08 12:58:19 WARN Request failed, retrying attempt=4 backoff=783.967243ms error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures21032026/10/08 12:58:20 WARN Request failed, retrying attempt=5 backoff=1.553508693s error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures2104--- PASS: TestClientErrorHandling (0.00s)2105 --- PASS: TestClientErrorHandling/InvalidStorePath (0.26s)2106 --- PASS: TestClientErrorHandling/InvalidAuthToken (0.38s)2107 --- PASS: TestClientErrorHandling/ServerNotAvailable (12.58s)2108PASS21092026-10-08 12:58:22.368 UTC [128] LOG: received smart shutdown request21102026-10-08 12:58:22.372 UTC [128] LOG: background worker "logical replication launcher" (PID 138) exited with exit code 121112026-10-08 12:58:22.385 UTC [133] LOG: shutting down21122026-10-08 12:58:22.385 UTC [133] LOG: checkpoint starting: shutdown immediate21132026-10-08 12:58:23.290 UTC [133] LOG: checkpoint complete: wrote 10459 buffers (63.8%), wrote 5 SLRU buffers; 0 WAL file(s) added, 0 removed, 32 recycled; write=0.181 s, sync=0.689 s, total=0.906 s; sync files=34045, longest=0.003 s, average=0.001 s; distance=531572 kB, estimate=531572 kB; lsn=0/21E82CE0, redo lsn=0/21E82CE021142026-10-08 12:58:23.371 UTC [128] LOG: database system is shut down2115Running OIDC tests...2116=== RUN TestAudienceForIssuer2117=== PAUSE TestAudienceForIssuer2118=== RUN TestGlobMatch2119=== PAUSE TestGlobMatch2120=== RUN TestValidateToken_ValidToken2121=== PAUSE TestValidateToken_ValidToken2122=== RUN TestValidateToken_WrongAudience2123=== PAUSE TestValidateToken_WrongAudience2124=== RUN TestValidateToken_Expired2125=== PAUSE TestValidateToken_Expired2126=== RUN TestValidateToken_BoundClaimsMismatch2127=== PAUSE TestValidateToken_BoundClaimsMismatch2128=== RUN TestValidateToken_BoundSubjectMismatch2129=== PAUSE TestValidateToken_BoundSubjectMismatch2130=== RUN TestValidateToken_MultipleProviders2131=== PAUSE TestValidateToken_MultipleProviders2132=== RUN TestValidateToken_NoMatchingProvider2133=== PAUSE TestValidateToken_NoMatchingProvider2134=== RUN TestValidateToken_KubernetesServiceAccount2135=== PAUSE TestValidateToken_KubernetesServiceAccount2136=== RUN TestNewValidator_KubernetesRequiresCA2137=== PAUSE TestNewValidator_KubernetesRequiresCA2138=== RUN TestValidateToken_KubernetesIssuerFromOwnToken2139=== PAUSE TestValidateToken_KubernetesIssuerFromOwnToken2140=== RUN TestPins_ReservedForMatchingRule2141=== PAUSE TestPins_ReservedForMatchingRule2142=== RUN TestPins_TopLevelShorthand2143=== PAUSE TestPins_TopLevelShorthand2144=== RUN TestPins_ConfigValidation2145=== PAUSE TestPins_ConfigValidation2146=== RUN TestScopes_LegacyProviderDefaultsToWrite2147=== PAUSE TestScopes_LegacyProviderDefaultsToWrite2148=== RUN TestScopes_Rules2149=== PAUSE TestScopes_Rules2150=== RUN TestScopes_ConfigValidation2151=== PAUSE TestScopes_ConfigValidation2152=== CONT TestAudienceForIssuer2153=== CONT TestValidateToken_KubernetesServiceAccount2154--- PASS: TestAudienceForIssuer (0.00s)2155=== CONT TestValidateToken_NoMatchingProvider2156=== CONT TestPins_ConfigValidation2157=== CONT TestPins_ReservedForMatchingRule2158=== CONT TestValidateToken_KubernetesIssuerFromOwnToken2159=== CONT TestPins_TopLevelShorthand2160=== CONT TestValidateToken_Expired2161=== CONT TestValidateToken_BoundSubjectMismatch2162--- PASS: TestPins_ConfigValidation (0.00s)2163=== CONT TestScopes_ConfigValidation2164=== CONT TestValidateToken_MultipleProviders2165=== CONT TestValidateToken_ValidToken2166=== CONT TestValidateToken_BoundClaimsMismatch2167--- PASS: TestScopes_ConfigValidation (0.00s)2168=== CONT TestScopes_Rules2169=== CONT TestNewValidator_KubernetesRequiresCA2170=== CONT TestGlobMatch2171=== RUN TestGlobMatch/foo_foo2172=== PAUSE TestGlobMatch/foo_foo2173=== RUN TestGlobMatch/foo_bar2174=== PAUSE TestGlobMatch/foo_bar2175=== RUN TestGlobMatch/*_2176=== PAUSE TestGlobMatch/*_2177=== RUN TestGlobMatch/*_anything2178=== PAUSE TestGlobMatch/*_anything2179=== RUN TestGlobMatch/foo*_foo2180=== PAUSE TestGlobMatch/foo*_foo2181=== RUN TestGlobMatch/foo*_foobar2182=== CONT TestScopes_LegacyProviderDefaultsToWrite2183=== PAUSE TestGlobMatch/foo*_foobar2184=== RUN TestGlobMatch/foo*_bar2185=== PAUSE TestGlobMatch/foo*_bar2186=== RUN TestGlobMatch/*bar_bar2187=== PAUSE TestGlobMatch/*bar_bar2188=== RUN TestGlobMatch/*bar_foobar2189=== PAUSE TestGlobMatch/*bar_foobar2190=== RUN TestGlobMatch/*bar_foo2191=== PAUSE TestGlobMatch/*bar_foo2192=== RUN TestGlobMatch/foo*bar_foobar2193=== PAUSE TestGlobMatch/foo*bar_foobar2194=== RUN TestGlobMatch/foo*bar_foo123bar2195=== PAUSE TestGlobMatch/foo*bar_foo123bar2196=== RUN TestGlobMatch/foo*bar_foobarbaz2197=== PAUSE TestGlobMatch/foo*bar_foobarbaz2198=== RUN TestGlobMatch/*/*_foo/bar2199=== PAUSE TestGlobMatch/*/*_foo/bar2200=== RUN TestGlobMatch/*/*_foo2201=== PAUSE TestGlobMatch/*/*_foo2202=== RUN TestGlobMatch/refs/heads/*_refs/heads/main2203=== PAUSE TestGlobMatch/refs/heads/*_refs/heads/main2204=== RUN TestGlobMatch/refs/heads/*_refs/tags/v1.02205=== PAUSE TestGlobMatch/refs/heads/*_refs/tags/v1.02206=== RUN TestGlobMatch/refs/*/main_refs/heads/main2207=== PAUSE TestGlobMatch/refs/*/main_refs/heads/main2208=== RUN TestGlobMatch/fo?_foo2209=== PAUSE TestGlobMatch/fo?_foo2210=== RUN TestGlobMatch/fo?_fo2211=== PAUSE TestGlobMatch/fo?_fo2212=== RUN TestGlobMatch/fo?_fooo2213=== CONT TestValidateToken_WrongAudience2214=== PAUSE TestGlobMatch/fo?_fooo2215=== RUN TestGlobMatch/?oo_foo2216=== PAUSE TestGlobMatch/?oo_foo2217=== RUN TestGlobMatch/?oo_boo2218=== PAUSE TestGlobMatch/?oo_boo2219=== RUN TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main2220=== PAUSE TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main2221=== RUN TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main2222=== PAUSE TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main2223=== CONT TestGlobMatch/foo_foo2224=== CONT TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main2225=== CONT TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main2226=== CONT TestGlobMatch/?oo_boo2227=== CONT TestGlobMatch/foo*bar_foobar2228=== CONT TestGlobMatch/*bar_foo2229=== CONT TestGlobMatch/*bar_foobar2230=== CONT TestGlobMatch/*bar_bar2231=== CONT TestGlobMatch/foo*bar_foo123bar2232=== CONT TestGlobMatch/fo?_fo2233=== CONT TestGlobMatch/fo?_foo2234=== CONT TestGlobMatch/*/*_foo2235=== CONT TestGlobMatch/refs/heads/*_refs/tags/v1.02236=== CONT TestGlobMatch/refs/heads/*_refs/heads/main2237=== CONT TestGlobMatch/*/*_foo/bar2238=== CONT TestGlobMatch/foo*bar_foobarbaz2239=== CONT TestGlobMatch/foo*_bar2240=== CONT TestGlobMatch/foo*_foobar2241=== CONT TestGlobMatch/foo*_foo2242=== CONT TestGlobMatch/*_anything2243=== CONT TestGlobMatch/*_2244=== CONT TestGlobMatch/foo_bar2245=== CONT TestGlobMatch/refs/*/main_refs/heads/main2246=== CONT TestGlobMatch/?oo_foo2247=== CONT TestGlobMatch/fo?_fooo2248--- PASS: TestGlobMatch (0.00s)2249 --- PASS: TestGlobMatch/foo_foo (0.00s)2250 --- PASS: TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main (0.00s)2251 --- PASS: TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main (0.00s)2252 --- PASS: TestGlobMatch/?oo_boo (0.00s)2253 --- PASS: TestGlobMatch/foo*bar_foobar (0.00s)2254 --- PASS: TestGlobMatch/*bar_foo (0.00s)2255 --- PASS: TestGlobMatch/*bar_foobar (0.00s)2256 --- PASS: TestGlobMatch/*bar_bar (0.00s)2257 --- PASS: TestGlobMatch/foo*bar_foo123bar (0.00s)2258 --- PASS: TestGlobMatch/fo?_fo (0.00s)2259 --- PASS: TestGlobMatch/fo?_foo (0.00s)2260 --- PASS: TestGlobMatch/*/*_foo (0.00s)2261 --- PASS: TestGlobMatch/refs/heads/*_refs/tags/v1.0 (0.00s)2262 --- PASS: TestGlobMatch/refs/heads/*_refs/heads/main (0.00s)2263 --- PASS: TestGlobMatch/*/*_foo/bar (0.00s)2264 --- PASS: TestGlobMatch/foo*bar_foobarbaz (0.00s)2265 --- PASS: TestGlobMatch/foo*_bar (0.00s)2266 --- PASS: TestGlobMatch/foo*_foobar (0.00s)2267 --- PASS: TestGlobMatch/foo*_foo (0.00s)2268 --- PASS: TestGlobMatch/*_anything (0.00s)2269 --- PASS: TestGlobMatch/*_ (0.00s)2270 --- PASS: TestGlobMatch/foo_bar (0.00s)2271 --- PASS: TestGlobMatch/refs/*/main_refs/heads/main (0.00s)2272 --- PASS: TestGlobMatch/?oo_foo (0.00s)2273 --- PASS: TestGlobMatch/fo?_fooo (0.00s)22742026/10/08 12:58:25 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:40115/oidc2275--- PASS: TestValidateToken_BoundSubjectMismatch (0.05s)22762026/10/08 12:58:25 http: TLS handshake error from 127.0.0.1:53524: remote error: tls: bad certificate2277--- PASS: TestNewValidator_KubernetesRequiresCA (0.08s)22782026/10/08 12:58:25 INFO OIDC provider initialized name=kubernetes issuer=https://oidc.eks.invalid/id/ABC1232279--- PASS: TestValidateToken_KubernetesIssuerFromOwnToken (0.10s)22802026/10/08 12:58:25 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:36031/oidc2281--- PASS: TestValidateToken_WrongAudience (0.10s)22822026/10/08 12:58:25 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:35067/oidc2283--- PASS: TestValidateToken_BoundClaimsMismatch (0.13s)22842026/10/08 12:58:25 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:38105/oidc2285--- PASS: TestPins_TopLevelShorthand (0.16s)22862026/10/08 12:58:25 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:43007/oidc2287--- PASS: TestValidateToken_ValidToken (0.18s)22882026/10/08 12:58:25 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:36219/oidc22892026/10/08 12:58:25 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:45859/oidc2290--- PASS: TestValidateToken_Expired (0.21s)2291--- PASS: TestScopes_LegacyProviderDefaultsToWrite (0.21s)22922026/10/08 12:58:25 INFO OIDC provider initialized name=provider1 issuer=http://127.0.0.1:46845/oidc22932026/10/08 12:58:25 INFO OIDC provider initialized name=provider2 issuer=http://127.0.0.1:38017/oidc2294--- PASS: TestValidateToken_MultipleProviders (0.22s)22952026/10/08 12:58:25 INFO OIDC provider initialized name=kubernetes issuer=https://127.0.0.1:3666922962026/10/08 12:58:25 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:37591/oidc2297--- PASS: TestValidateToken_KubernetesServiceAccount (0.23s)2298--- PASS: TestPins_ReservedForMatchingRule (0.24s)22992026/10/08 12:58:25 INFO OIDC provider initialized name=provider1 issuer=http://127.0.0.1:34883/oidc2300--- PASS: TestValidateToken_NoMatchingProvider (0.28s)23012026/10/08 12:58:25 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:36841/oidc2302--- PASS: TestScopes_Rules (0.32s)2303PASS2304Running hook tests...2305=== RUN TestSendPathsEmpty2306=== PAUSE TestSendPathsEmpty2307=== RUN TestQueueEnqueueAndFetch2308=== PAUSE TestQueueEnqueueAndFetch2309=== RUN TestQueueDeduplication2310=== PAUSE TestQueueDeduplication2311=== RUN TestQueueRemove2312=== PAUSE TestQueueRemove2313=== RUN TestQueueFetchBatchLimit2314=== PAUSE TestQueueFetchBatchLimit2315=== RUN TestQueueRetryMovesToBack2316=== PAUSE TestQueueRetryMovesToBack2317=== RUN TestQueueFetchRemoveLifecycle2318=== PAUSE TestQueueFetchRemoveLifecycle2319=== RUN TestQueueConcurrentWriters2320=== PAUSE TestQueueConcurrentWriters2321=== RUN TestQueueRemoveLargeClosure2322=== PAUSE TestQueueRemoveLargeClosure2323=== RUN TestServerClientIntegration2324--- PASS: TestServerClientIntegration (0.00s)2325=== RUN TestServerQueueError23262026/10/08 12:58:25 ERROR Failed to queue paths error="permission denied" count=12327--- PASS: TestServerQueueError (0.00s)2328=== RUN TestGetListenerSocketActivation2329 server_test.go:219: === RUN TestGetListenerSocketActivation2330 --- PASS: TestGetListenerSocketActivation (0.00s)2331 PASS2332 2333--- PASS: TestGetListenerSocketActivation (0.01s)2334=== RUN TestDrainIsolatesPoisonPath2335=== PAUSE TestDrainIsolatesPoisonPath2336=== RUN TestRunNotBlockedByPoisonHead2337=== PAUSE TestRunNotBlockedByPoisonHead2338=== RUN TestDrainGivesUpWhenServerDown2339=== PAUSE TestDrainGivesUpWhenServerDown2340=== RUN TestFailedPathPrunedByLaterClosure2341=== PAUSE TestFailedPathPrunedByLaterClosure2342=== RUN TestWorkerUploadsAndRemoves2343=== PAUSE TestWorkerUploadsAndRemoves2344=== RUN TestWorkerSkipsGCdPaths2345=== PAUSE TestWorkerSkipsGCdPaths2346=== RUN TestWorkerPrunesClosureDeps2347=== PAUSE TestWorkerPrunesClosureDeps2348=== RUN TestDrainTimeout2349=== PAUSE TestDrainTimeout2350=== CONT TestSendPathsEmpty2351--- PASS: TestSendPathsEmpty (0.00s)2352=== CONT TestDrainGivesUpWhenServerDown2353=== CONT TestQueueFetchBatchLimit2354=== CONT TestDrainTimeout2355=== CONT TestQueueConcurrentWriters2356=== CONT TestWorkerPrunesClosureDeps2357=== CONT TestFailedPathPrunedByLaterClosure2358=== CONT TestWorkerSkipsGCdPaths2359=== CONT TestQueueEnqueueAndFetch2360=== CONT TestWorkerUploadsAndRemoves2361=== CONT TestQueueFetchRemoveLifecycle2362=== CONT TestQueueDeduplication2363=== CONT TestQueueRetryMovesToBack2364=== CONT TestQueueRemove2365=== CONT TestRunNotBlockedByPoisonHead2366=== CONT TestDrainIsolatesPoisonPath2367=== CONT TestQueueRemoveLargeClosure23682026/10/08 12:58:25 INFO Upload queue status pending=223692026/10/08 12:58:25 INFO Uploading batch count=123702026/10/08 12:58:25 INFO Upload queue status pending=223712026/10/08 12:58:25 INFO Uploading batch count=123722026/10/08 12:58:25 ERROR Upload failed error="upload failed" count=123732026/10/08 12:58:25 INFO Uploading batch count=223742026/10/08 12:58:25 INFO Uploading batch count=423752026/10/08 12:58:25 ERROR Upload failed error="upload failed" count=423762026/10/08 12:58:25 INFO Uploading batch count=223772026/10/08 12:58:25 ERROR Upload failed error="upload failed" count=223782026/10/08 12:58:25 ERROR Upload failed, will retry later error="upload failed" path=/build/TestDrainGivesUpWhenServerDown2979164411/002/a23792026/10/08 12:58:25 INFO Uploading batch count=223802026/10/08 12:58:25 INFO Upload queue status pending=223812026/10/08 12:58:25 WARN Store path no longer exists (garbage collected?), removing from queue path=/build/TestWorkerSkipsGCdPaths3545832798/002/nonexistent23822026/10/08 12:58:25 INFO Uploading batch count=123832026/10/08 12:58:25 ERROR Upload failed, will retry later error="upload failed" path=/build/TestDrainIsolatesPoisonPath3132126259/002/bbb2384--- PASS: TestQueueFetchRemoveLifecycle (0.02s)2385--- PASS: TestQueueEnqueueAndFetch (0.02s)23862026/10/08 12:58:25 INFO Uploading batch count=123872026/10/08 12:58:25 INFO Uploading batch count=123882026/10/08 12:58:25 ERROR Upload failed, will retry later error="upload failed" path=/build/TestDrainGivesUpWhenServerDown2979164411/002/b23892026/10/08 12:58:25 INFO Upload queue status pending=323902026/10/08 12:58:25 INFO Uploading batch count=123912026/10/08 12:58:25 ERROR Upload failed error="upload failed" count=12392--- PASS: TestQueueFetchBatchLimit (0.02s)2393--- PASS: TestQueueDeduplication (0.02s)23942026/10/08 12:58:25 INFO Uploading batch count=223952026/10/08 12:58:25 ERROR Upload failed error="upload failed" count=223962026/10/08 12:58:25 ERROR Upload failed, will retry later error="upload failed" path=/build/TestDrainGivesUpWhenServerDown2979164411/002/c2397--- PASS: TestQueueRetryMovesToBack (0.02s)23982026/10/08 12:58:25 ERROR Upload failed, will retry later error="upload failed" path=/build/TestDrainGivesUpWhenServerDown2979164411/002/d2399--- PASS: TestQueueRemove (0.02s)24002026/10/08 12:58:25 INFO Uploading batch count=124012026/10/08 12:58:25 ERROR Upload failed error="upload failed" count=124022026/10/08 12:58:25 INFO Uploading batch count=224032026/10/08 12:58:25 ERROR Upload failed error="upload failed" count=224042026/10/08 12:58:25 ERROR Upload failed, will retry later error="upload failed" path=/build/TestDrainGivesUpWhenServerDown2979164411/002/e24052026/10/08 12:58:25 INFO Uploading batch count=124062026/10/08 12:58:25 ERROR Upload failed error="upload failed" count=12407--- PASS: TestWorkerPrunesClosureDeps (0.02s)2408--- PASS: TestFailedPathPrunedByLaterClosure (0.02s)24092026/10/08 12:58:25 ERROR Upload failed, will retry later error="upload failed" path=/build/TestDrainGivesUpWhenServerDown2979164411/002/f24102026/10/08 12:58:25 INFO Uploading batch count=124112026/10/08 12:58:25 ERROR Upload failed error="upload failed" count=124122026/10/08 12:58:25 ERROR Drain finished with paths left in queue remaining=1024132026/10/08 12:58:25 ERROR Drain finished with paths left in queue remaining=12414--- PASS: TestDrainGivesUpWhenServerDown (0.02s)2415--- PASS: TestDrainIsolatesPoisonPath (0.02s)2416--- PASS: TestWorkerSkipsGCdPaths (0.04s)2417--- PASS: TestWorkerUploadsAndRemoves (0.04s)2418--- PASS: TestQueueRemoveLargeClosure (0.10s)2419--- PASS: TestQueueConcurrentWriters (0.21s)24202026/10/08 12:58:25 ERROR Upload failed error="context deadline exceeded" count=224212026/10/08 12:58:25 ERROR Drain finished with paths left in queue remaining=42422--- PASS: TestDrainTimeout (0.22s)24232026/10/08 12:58:26 INFO Uploading batch count=124242026/10/08 12:58:26 INFO Uploading batch count=124252026/10/08 12:58:26 INFO Uploading batch count=124262026/10/08 12:58:26 ERROR Upload failed error="upload failed" count=124272026/10/08 12:58:26 INFO Uploading batch count=124282026/10/08 12:58:26 ERROR Upload failed error="upload failed" count=124292026/10/08 12:58:26 INFO Uploading batch count=124302026/10/08 12:58:26 ERROR Upload failed error="upload failed" count=124312026/10/08 12:58:26 INFO Uploading batch count=124322026/10/08 12:58:26 ERROR Upload failed error="upload failed" count=124332026/10/08 12:58:26 ERROR Drain finished with paths left in queue remaining=12434--- PASS: TestRunNotBlockedByPoisonHead (1.03s)2435PASS2436Running signing tests...2437=== RUN TestExternalSigner2438=== PAUSE TestExternalSigner2439=== RUN TestExternalSignerWrongPublicKey2440=== PAUSE TestExternalSignerWrongPublicKey2441=== RUN TestExternalSignerErrors2442=== PAUSE TestExternalSignerErrors2443=== RUN TestExternalSignerRestartsAfterCrash2444=== PAUSE TestExternalSignerRestartsAfterCrash2445=== RUN TestExternalSignerProgramErrorKeepsProcess2446=== PAUSE TestExternalSignerProgramErrorKeepsProcess2447=== RUN TestExternalSignerClose2448=== PAUSE TestExternalSignerClose2449=== RUN TestExternalSignerRejectsInvalidPublicKey2450=== PAUSE TestExternalSignerRejectsInvalidPublicKey2451=== RUN TestExternalSignerCancellation2452=== PAUSE TestExternalSignerCancellation2453=== RUN TestGenerateFingerprint2454=== PAUSE TestGenerateFingerprint2455=== RUN TestParseSigningKey2456=== PAUSE TestParseSigningKey2457=== RUN TestSign2458=== PAUSE TestSign2459=== RUN TestSignBatch2460=== PAUSE TestSignBatch2461=== RUN TestNilKeyPublicKey2462=== PAUSE TestNilKeyPublicKey2463=== RUN TestSignErrors2464=== PAUSE TestSignErrors2465=== CONT TestExternalSigner2466=== CONT TestExternalSignerProgramErrorKeepsProcess2467=== CONT TestExternalSignerCancellation2468=== CONT TestSignBatch2469=== CONT TestExternalSignerRestartsAfterCrash2470=== CONT TestExternalSignerErrors2471=== CONT TestExternalSignerWrongPublicKey2472=== CONT TestSignErrors2473=== CONT TestExternalSignerRejectsInvalidPublicKey2474=== RUN TestExternalSignerRejectsInvalidPublicKey/#002475=== PAUSE TestExternalSignerRejectsInvalidPublicKey/#002476=== RUN TestExternalSignerRejectsInvalidPublicKey/no-colon2477=== PAUSE TestExternalSignerRejectsInvalidPublicKey/no-colon2478=== RUN TestExternalSignerRejectsInvalidPublicKey/:AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA=2479=== CONT TestNilKeyPublicKey2480=== CONT TestExternalSignerClose2481=== CONT TestParseSigningKey2482=== CONT TestSign2483=== CONT TestGenerateFingerprint2484=== RUN TestExternalSignerErrors/missing_signatures2485=== PAUSE TestExternalSignerErrors/missing_signatures2486=== RUN TestExternalSignerErrors/too_few_signatures2487--- PASS: TestNilKeyPublicKey (0.00s)2488=== RUN TestGenerateFingerprint/basic_with_references2489=== PAUSE TestGenerateFingerprint/basic_with_references2490=== PAUSE TestExternalSignerErrors/too_few_signatures2491=== RUN TestGenerateFingerprint/no_references2492=== RUN TestExternalSignerErrors/unrequested_key2493=== PAUSE TestExternalSignerErrors/unrequested_key2494=== RUN TestExternalSignerErrors/missing_signature_name2495=== PAUSE TestExternalSignerErrors/missing_signature_name2496=== PAUSE TestExternalSignerRejectsInvalidPublicKey/:AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA=2497=== PAUSE TestGenerateFingerprint/no_references2498=== RUN TestParseSigningKey/valid_32-byte_key2499=== PAUSE TestParseSigningKey/valid_32-byte_key2500=== RUN TestGenerateFingerprint/unsorted_references_get_sorted2501=== RUN TestParseSigningKey/valid_32-byte_key_with_different_name2502=== PAUSE TestParseSigningKey/valid_32-byte_key_with_different_name2503=== RUN TestParseSigningKey/no_colon2504=== PAUSE TestGenerateFingerprint/unsorted_references_get_sorted2505=== PAUSE TestParseSigningKey/no_colon2506=== RUN TestGenerateFingerprint/invalid_nar_hash_prefix2507=== PAUSE TestGenerateFingerprint/invalid_nar_hash_prefix2508=== RUN TestGenerateFingerprint/invalid_nar_hash_length2509=== RUN TestExternalSignerErrors/invalid_signature_base642510=== RUN TestExternalSignerRejectsInvalidPublicKey/test-key:invalid!2511=== PAUSE TestExternalSignerErrors/invalid_signature_base642512=== RUN TestExternalSignerErrors/program_error2513=== PAUSE TestExternalSignerErrors/program_error2514=== RUN TestExternalSignerErrors/invalid_JSON2515=== PAUSE TestExternalSignerErrors/invalid_JSON2516=== RUN TestExternalSignerErrors/wrong_shape2517=== PAUSE TestExternalSignerErrors/wrong_shape2518=== PAUSE TestGenerateFingerprint/invalid_nar_hash_length2519=== PAUSE TestExternalSignerRejectsInvalidPublicKey/test-key:invalid!2520=== RUN TestParseSigningKey/empty_name2521=== RUN TestExternalSignerErrors/wrong_id2522=== RUN TestGenerateFingerprint/invalid_store_path_prefix2523=== PAUSE TestExternalSignerErrors/wrong_id2524=== RUN TestExternalSignerErrors/null_signatures2525=== PAUSE TestExternalSignerErrors/null_signatures2526=== RUN TestExternalSignerErrors/wrong_signatures_shape2527=== PAUSE TestExternalSignerErrors/wrong_signatures_shape2528=== RUN TestExternalSignerRejectsInvalidPublicKey/test-key:YQ==2529=== PAUSE TestGenerateFingerprint/invalid_store_path_prefix2530=== PAUSE TestParseSigningKey/empty_name2531=== RUN TestExternalSignerErrors/wrong_signature_name2532=== PAUSE TestExternalSignerErrors/wrong_signature_name2533=== RUN TestGenerateFingerprint/invalid_reference_prefix2534=== RUN TestParseSigningKey/invalid_base642535=== RUN TestExternalSignerErrors/exit_at_startup2536=== PAUSE TestExternalSignerRejectsInvalidPublicKey/test-key:YQ==2537=== PAUSE TestGenerateFingerprint/invalid_reference_prefix2538=== CONT TestGenerateFingerprint/basic_with_references2539=== CONT TestGenerateFingerprint/no_references2540=== PAUSE TestExternalSignerErrors/exit_at_startup2541=== CONT TestGenerateFingerprint/invalid_nar_hash_prefix2542=== CONT TestExternalSignerRejectsInvalidPublicKey/#002543=== CONT TestExternalSignerRejectsInvalidPublicKey/test-key:invalid!2544=== CONT TestExternalSignerRejectsInvalidPublicKey/:AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA=2545=== CONT TestExternalSignerRejectsInvalidPublicKey/test-key:YQ==2546=== CONT TestExternalSignerRejectsInvalidPublicKey/no-colon2547--- PASS: TestExternalSignerRejectsInvalidPublicKey (0.00s)2548 --- PASS: TestExternalSignerRejectsInvalidPublicKey/#00 (0.00s)2549 --- PASS: TestExternalSignerRejectsInvalidPublicKey/test-key:invalid! (0.00s)2550 --- PASS: TestExternalSignerRejectsInvalidPublicKey/:AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA= (0.00s)2551 --- PASS: TestExternalSignerRejectsInvalidPublicKey/test-key:YQ== (0.00s)2552 --- PASS: TestExternalSignerRejectsInvalidPublicKey/no-colon (0.00s)2553=== CONT TestGenerateFingerprint/invalid_nar_hash_length2554=== CONT TestGenerateFingerprint/invalid_store_path_prefix2555=== CONT TestGenerateFingerprint/invalid_reference_prefix2556=== CONT TestGenerateFingerprint/unsorted_references_get_sorted2557--- PASS: TestGenerateFingerprint (0.00s)2558 --- PASS: TestGenerateFingerprint/basic_with_references (0.00s)2559 --- PASS: TestGenerateFingerprint/no_references (0.00s)2560 --- PASS: TestGenerateFingerprint/invalid_nar_hash_prefix (0.00s)2561 --- PASS: TestGenerateFingerprint/invalid_nar_hash_length (0.00s)2562 --- PASS: TestGenerateFingerprint/invalid_store_path_prefix (0.00s)2563 --- PASS: TestGenerateFingerprint/invalid_reference_prefix (0.00s)2564 --- PASS: TestGenerateFingerprint/unsorted_references_get_sorted (0.00s)2565=== RUN TestExternalSignerErrors/exit_on_request2566=== PAUSE TestExternalSignerErrors/exit_on_request2567=== PAUSE TestParseSigningKey/invalid_base642568=== RUN TestExternalSignerErrors/null2569=== PAUSE TestExternalSignerErrors/null2570=== RUN TestExternalSignerErrors/wrong_signature_length2571=== RUN TestParseSigningKey/wrong_length2572=== PAUSE TestExternalSignerErrors/wrong_signature_length2573=== PAUSE TestParseSigningKey/wrong_length2574=== CONT TestExternalSignerErrors/program_error2575=== CONT TestExternalSignerErrors/exit_on_request2576=== RUN TestSignErrors/nil_key2577=== PAUSE TestSignErrors/nil_key2578=== RUN TestSignErrors/nil_narinfo2579=== PAUSE TestSignErrors/nil_narinfo2580=== RUN TestSignErrors/invalid_narinfo2581=== PAUSE TestSignErrors/invalid_narinfo2582=== CONT TestExternalSignerErrors/wrong_shape2583=== CONT TestExternalSignerErrors/wrong_id2584--- PASS: TestSign (0.00s)2585=== CONT TestParseSigningKey/valid_32-byte_key2586=== CONT TestExternalSignerErrors/invalid_JSON2587=== CONT TestExternalSignerErrors/wrong_signature_length2588=== CONT TestExternalSignerErrors/missing_signature_name2589=== CONT TestExternalSignerErrors/null2590=== CONT TestExternalSignerErrors/unrequested_key2591--- PASS: TestSignBatch (0.00s)2592=== CONT TestParseSigningKey/empty_name2593=== CONT TestParseSigningKey/valid_32-byte_key_with_different_name2594=== CONT TestExternalSignerErrors/wrong_signatures_shape2595=== CONT TestParseSigningKey/wrong_length2596=== CONT TestParseSigningKey/invalid_base642597=== CONT TestExternalSignerErrors/invalid_signature_base642598=== CONT TestExternalSignerErrors/too_few_signatures2599=== CONT TestExternalSignerErrors/null_signatures2600=== CONT TestExternalSignerErrors/wrong_signature_name2601--- PASS: TestExternalSignerProgramErrorKeepsProcess (0.00s)2602=== CONT TestExternalSignerErrors/missing_signatures2603=== CONT TestExternalSignerErrors/exit_at_startup2604=== RUN TestSignErrors/canceled2605=== CONT TestParseSigningKey/no_colon2606--- PASS: TestParseSigningKey (0.00s)2607 --- PASS: TestParseSigningKey/valid_32-byte_key (0.00s)2608 --- PASS: TestParseSigningKey/empty_name (0.00s)2609 --- PASS: TestParseSigningKey/valid_32-byte_key_with_different_name (0.00s)2610 --- PASS: TestParseSigningKey/wrong_length (0.00s)2611 --- PASS: TestParseSigningKey/invalid_base64 (0.00s)2612 --- PASS: TestParseSigningKey/no_colon (0.00s)2613=== PAUSE TestSignErrors/canceled2614=== CONT TestSignErrors/nil_key2615=== CONT TestSignErrors/invalid_narinfo2616=== CONT TestSignErrors/nil_narinfo2617=== CONT TestSignErrors/canceled2618--- PASS: TestSignErrors (0.00s)2619 --- PASS: TestSignErrors/nil_key (0.00s)2620 --- PASS: TestSignErrors/invalid_narinfo (0.00s)2621 --- PASS: TestSignErrors/nil_narinfo (0.00s)2622 --- PASS: TestSignErrors/canceled (0.00s)2623--- PASS: TestExternalSignerWrongPublicKey (0.01s)2624--- PASS: TestExternalSignerClose (0.01s)2625--- PASS: TestExternalSignerRestartsAfterCrash (0.01s)2626--- PASS: TestExternalSigner (0.01s)2627--- PASS: TestExternalSignerErrors (0.00s)2628 --- PASS: TestExternalSignerErrors/exit_on_request (0.00s)2629 --- PASS: TestExternalSignerErrors/program_error (0.00s)2630 --- PASS: TestExternalSignerErrors/invalid_JSON (0.00s)2631 --- PASS: TestExternalSignerErrors/wrong_shape (0.01s)2632 --- PASS: TestExternalSignerErrors/wrong_id (0.01s)2633 --- PASS: TestExternalSignerErrors/null (0.01s)2634 --- PASS: TestExternalSignerErrors/missing_signature_name (0.01s)2635 --- PASS: TestExternalSignerErrors/exit_at_startup (0.01s)2636 --- PASS: TestExternalSignerErrors/wrong_signatures_shape (0.01s)2637 --- PASS: TestExternalSignerErrors/too_few_signatures (0.01s)2638 --- PASS: TestExternalSignerErrors/null_signatures (0.01s)2639 --- PASS: TestExternalSignerErrors/missing_signatures (0.01s)2640 --- PASS: TestExternalSignerErrors/wrong_signature_length (0.01s)2641 --- PASS: TestExternalSignerErrors/unrequested_key (0.01s)2642 --- PASS: TestExternalSignerErrors/wrong_signature_name (0.01s)2643 --- PASS: TestExternalSignerErrors/invalid_signature_base64 (0.01s)2644--- PASS: TestExternalSignerCancellation (0.02s)2645PASS2646Running OpenBao signer tests...2647=== RUN TestSign2648=== PAUSE TestSign2649=== RUN TestSignErrors2650=== PAUSE TestSignErrors2651=== RUN TestServe2652=== PAUSE TestServe2653=== RUN TestServeRejectsGarbage2654=== PAUSE TestServeRejectsGarbage2655=== CONT TestSign2656=== CONT TestServe2657=== CONT TestSignErrors2658=== CONT TestServeRejectsGarbage2659=== RUN TestSignErrors/http_error2660=== PAUSE TestSignErrors/http_error2661=== RUN TestSignErrors/invalid_json2662=== PAUSE TestSignErrors/invalid_json2663--- PASS: TestServeRejectsGarbage (0.00s)2664=== RUN TestSignErrors/no_prefix2665=== PAUSE TestSignErrors/no_prefix2666=== RUN TestSignErrors/invalid_base642667=== PAUSE TestSignErrors/invalid_base642668=== CONT TestSignErrors/http_error2669=== CONT TestSignErrors/no_prefix2670=== CONT TestSignErrors/invalid_base642671=== CONT TestSignErrors/invalid_json2672--- PASS: TestServe (0.00s)2673--- PASS: TestSign (0.01s)2674--- PASS: TestSignErrors (0.00s)2675 --- PASS: TestSignErrors/no_prefix (0.00s)2676 --- PASS: TestSignErrors/invalid_base64 (0.01s)2677 --- PASS: TestSignErrors/invalid_json (0.01s)2678 --- PASS: TestSignErrors/http_error (0.01s)2679PASS