niks3-go-unit-tests
checks.aarch64-darwin.go-unit-tests
· build #304
· raw
1Running client tests...2=== RUN TestDoServerRequestAttachesToken3=== PAUSE TestDoServerRequestAttachesToken4=== RUN TestRegisterUploadedObjectReusesConnections5=== PAUSE TestRegisterUploadedObjectReusesConnections6=== RUN TestCaseHackSuffix7=== PAUSE TestCaseHackSuffix8=== RUN TestFilterOversizedClosures9=== PAUSE TestFilterOversizedClosures10=== RUN TestUploadMultipart_PartsInParallel11=== PAUSE TestUploadMultipart_PartsInParallel12=== RUN TestPartSizeForNAR13=== PAUSE TestPartSizeForNAR14=== RUN TestUploadMultipart_SupersededByPeer15=== PAUSE TestUploadMultipart_SupersededByPeer16=== RUN TestDumpPathCaseHackMatchesNix17--- PASS: TestDumpPathCaseHackMatchesNix (0.06s)18=== RUN TestDumpPathCaseHackCollision19--- PASS: TestDumpPathCaseHackCollision (0.00s)20=== RUN TestDumpPathMatchesNix21=== PAUSE TestDumpPathMatchesNix22=== RUN TestDumpPathSingleFile23=== PAUSE TestDumpPathSingleFile24=== RUN TestDumpPathWriterError25=== PAUSE TestDumpPathWriterError26=== RUN TestEncodeNixBase3227=== PAUSE TestEncodeNixBase3228=== RUN TestEncodeNixBase32WithRealHash29=== PAUSE TestEncodeNixBase32WithRealHash30=== RUN TestConvertHashToNix3231=== PAUSE TestConvertHashToNix3232=== RUN TestGetStorePathHash33=== PAUSE TestGetStorePathHash34=== RUN TestPathInfoHashCompatibility35=== PAUSE TestPathInfoHashCompatibility36=== RUN TestParsePathInfoJSON37=== PAUSE TestParsePathInfoJSON38=== RUN TestParsePathInfoJSONMultiplePaths39=== PAUSE TestParsePathInfoJSONMultiplePaths40=== RUN TestPathInfoCACompatibility41=== PAUSE TestPathInfoCACompatibility42=== RUN TestRateLimiterFeedback43=== PAUSE TestRateLimiterFeedback44=== RUN TestRateLimiterFeedback_400DoesNotCountAsSuccess45=== PAUSE TestRateLimiterFeedback_400DoesNotCountAsSuccess46=== RUN TestResolveStorePath47=== PAUSE TestResolveStorePath48=== RUN TestDoWithRetry_BodyReplayedViaGetBody49=== PAUSE TestDoWithRetry_BodyReplayedViaGetBody50=== RUN TestShellSplit51=== PAUSE TestShellSplit52=== RUN TestShellSplitErrors53=== PAUSE TestShellSplitErrors54=== RUN TestStreamPushReportsEveryPath55=== PAUSE TestStreamPushReportsEveryPath56=== RUN TestStreamPushBatchesUnderLoad57=== PAUSE TestStreamPushBatchesUnderLoad58=== RUN TestStreamPushIsolatesFailures59=== PAUSE TestStreamPushIsolatesFailures60=== RUN TestStreamPushGivesUpOnDeadServer61=== PAUSE TestStreamPushGivesUpOnDeadServer62=== RUN TestStreamPushRequestLine63=== PAUSE TestStreamPushRequestLine64=== RUN TestStreamPushReportsSignatures65=== PAUSE TestStreamPushReportsSignatures66=== RUN TestClientSignaturesByStorePath67=== PAUSE TestClientSignaturesByStorePath68=== RUN TestSetClientTLS69=== PAUSE TestSetClientTLS70=== RUN TestSetClientTLSDoesNotMutateDefaultTransport71=== PAUSE TestSetClientTLSDoesNotMutateDefaultTransport72=== RUN TestSetClientTLSErrors73=== PAUSE TestSetClientTLSErrors74=== RUN TestStaticToken75=== PAUSE TestStaticToken76=== RUN TestFileTokenReadsAndCaches77=== PAUSE TestFileTokenReadsAndCaches78=== RUN TestFileTokenMissing79=== PAUSE TestFileTokenMissing80=== RUN TestFileTokenEmpty81=== PAUSE TestFileTokenEmpty82=== RUN TestScriptTokenNoExpiryRerunsEveryCall83=== PAUSE TestScriptTokenNoExpiryRerunsEveryCall84=== RUN TestScriptTokenCachesUntilRefresh85=== PAUSE TestScriptTokenCachesUntilRefresh86=== RUN TestScriptTokenEmptyToken87=== PAUSE TestScriptTokenEmptyToken88=== RUN TestScriptTokenBadJSON89=== PAUSE TestScriptTokenBadJSON90=== RUN TestScriptTokenScriptFails91=== PAUSE TestScriptTokenScriptFails92=== RUN TestScriptTokenEmptyCommand93=== PAUSE TestScriptTokenEmptyCommand94=== CONT TestDoServerRequestAttachesToken95=== CONT TestShellSplit96=== CONT TestEncodeNixBase32WithRealHash97=== CONT TestGetStorePathHash98=== RUN TestGetStorePathHash/valid_store_path99=== PAUSE TestGetStorePathHash/valid_store_path100=== RUN TestGetStorePathHash/basename_without_hyphen_should_error101=== CONT TestDoWithRetry_BodyReplayedViaGetBody102=== CONT TestResolveStorePath103=== CONT TestRateLimiterFeedback_400DoesNotCountAsSuccess1042026/10/01 08:35:09 WARN Rate limiter enabled after throttle name=server-test rate=5105=== CONT TestRateLimiterFeedback106=== RUN TestRateLimiterFeedback/429_enables_limiter107=== PAUSE TestRateLimiterFeedback/429_enables_limiter108=== RUN TestRateLimiterFeedback/503_enables_limiter109=== PAUSE TestRateLimiterFeedback/503_enables_limiter110=== RUN TestRateLimiterFeedback/200_does_not_enable_limiter111=== PAUSE TestRateLimiterFeedback/200_does_not_enable_limiter112=== RUN TestRateLimiterFeedback/400_does_not_enable_limiter113=== PAUSE TestRateLimiterFeedback/400_does_not_enable_limiter114=== CONT TestPathInfoCACompatibility115=== RUN TestPathInfoCACompatibility/null_ca_field116=== PAUSE TestPathInfoCACompatibility/null_ca_field117=== RUN TestPathInfoCACompatibility/old_string_format_-_text118=== PAUSE TestPathInfoCACompatibility/old_string_format_-_text119=== RUN TestPathInfoCACompatibility/old_string_format_-_fixed_recursive120=== CONT TestConvertHashToNix32121=== PAUSE TestPathInfoCACompatibility/old_string_format_-_fixed_recursive122=== RUN TestPathInfoCACompatibility/new_structured_format_-_text123=== RUN TestConvertHashToNix32/SRI_format_to_Nix32124=== CONT TestParsePathInfoJSON125=== PAUSE TestConvertHashToNix32/SRI_format_to_Nix32126=== CONT TestPathInfoHashCompatibility127=== PAUSE TestPathInfoCACompatibility/new_structured_format_-_text128=== RUN TestConvertHashToNix32/already_Nix32_format129=== PAUSE TestConvertHashToNix32/already_Nix32_format130=== RUN TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)131=== PAUSE TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)132=== CONT TestParsePathInfoJSONMultiplePaths133=== RUN TestConvertHashToNix32/invalid_format134=== RUN TestPathInfoCACompatibility/new_structured_format_-_nar_method135=== RUN TestPathInfoHashCompatibility/old_string_format_with_colon136=== PAUSE TestPathInfoHashCompatibility/old_string_format_with_colon137--- PASS: TestShellSplit (0.00s)138--- PASS: TestEncodeNixBase32WithRealHash (0.00s)139--- PASS: TestResolveStorePath (0.00s)140=== PAUSE TestPathInfoCACompatibility/new_structured_format_-_nar_method141=== RUN TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths142=== CONT TestScriptTokenEmptyCommand143=== PAUSE TestGetStorePathHash/basename_without_hyphen_should_error144=== RUN TestGetStorePathHash/hash_with_invalid_characters_should_error145=== PAUSE TestGetStorePathHash/hash_with_invalid_characters_should_error146=== RUN TestGetStorePathHash/hash_with_wrong_length_should_error147=== PAUSE TestGetStorePathHash/hash_with_wrong_length_should_error148=== PAUSE TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths149=== PAUSE TestConvertHashToNix32/invalid_format150=== CONT TestSetClientTLSErrors151--- PASS: TestScriptTokenEmptyCommand (0.00s)152=== RUN TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI153=== CONT TestScriptTokenBadJSON154=== RUN TestParsePathInfoJSON/Nix_format155=== CONT TestScriptTokenEmptyToken156=== RUN TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths157=== CONT TestScriptTokenScriptFails158=== PAUSE TestParsePathInfoJSON/Nix_format159=== PAUSE TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths160=== RUN TestParsePathInfoJSON/Lix_format1612026/10/01 08:35:09 WARN Rate limiter enabled after throttle name=server-test rate=5162=== PAUSE TestParsePathInfoJSON/Lix_format163=== RUN TestParsePathInfoJSON/empty_input164=== PAUSE TestParsePathInfoJSON/empty_input165=== RUN TestParsePathInfoJSON/whitespace_only166--- PASS: TestDoServerRequestAttachesToken (0.00s)167=== CONT TestScriptTokenNoExpiryRerunsEveryCall1682026/10/01 08:35:09 WARN Request returned retryable status, retrying attempt=1 max_attempts=6 backoff=0s status=503 url=http://127.0.0.1:61439169=== PAUSE TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI170=== PAUSE TestParsePathInfoJSON/whitespace_only171=== RUN TestPathInfoHashCompatibility/new_structured_format_with_sha512172=== RUN TestParsePathInfoJSON/invalid_JSON173=== PAUSE TestPathInfoHashCompatibility/new_structured_format_with_sha512174=== CONT TestScriptTokenCachesUntilRefresh175=== CONT TestFileTokenEmpty176=== PAUSE TestParsePathInfoJSON/invalid_JSON177=== CONT TestFileTokenMissing1782026/10/01 08:35:09 WARN Rate limiter backed off name=server-test rate=51792026/10/01 08:35:09 WARN Request returned retryable status, retrying attempt=2 max_attempts=6 backoff=0s status=503 url=http://127.0.0.1:61439180=== RUN TestSetClientTLSErrors/missing_cert_file181=== PAUSE TestSetClientTLSErrors/missing_cert_file182=== RUN TestSetClientTLSErrors/missing_key_file183=== PAUSE TestSetClientTLSErrors/missing_key_file184=== RUN TestSetClientTLSErrors/missing_ca_file185=== PAUSE TestSetClientTLSErrors/missing_ca_file186=== RUN TestSetClientTLSErrors/invalid_ca_file187=== PAUSE TestSetClientTLSErrors/invalid_ca_file188=== CONT TestFileTokenReadsAndCaches189=== CONT TestStaticToken190=== CONT TestStreamPushBatchesUnderLoad191--- PASS: TestDoWithRetry_BodyReplayedViaGetBody (0.00s)192--- PASS: TestFileTokenMissing (0.00s)193=== CONT TestStreamPushGivesUpOnDeadServer194--- PASS: TestStaticToken (0.00s)195--- PASS: TestFileTokenEmpty (0.00s)196=== CONT TestStreamPushIsolatesFailures197--- PASS: TestFileTokenReadsAndCaches (0.00s)198=== CONT TestUploadMultipart_SupersededByPeer199=== RUN TestUploadMultipart_SupersededByPeer/exists2002026/10/01 08:35:09 ERROR Upload failed error="connection refused" count=20201=== PAUSE TestUploadMultipart_SupersededByPeer/exists2022026/10/01 08:35:09 ERROR Server seems unavailable, giving up on batch untried=17203=== RUN TestUploadMultipart_SupersededByPeer/missing204=== PAUSE TestUploadMultipart_SupersededByPeer/missing2052026/10/01 08:35:09 ERROR Upload failed error="bad path" count=3206=== CONT TestEncodeNixBase32207=== RUN TestEncodeNixBase32/test_string_hash208=== PAUSE TestEncodeNixBase32/test_string_hash209=== RUN TestEncodeNixBase32/empty_input210=== PAUSE TestEncodeNixBase32/empty_input211=== CONT TestDumpPathWriterError212--- PASS: TestStreamPushGivesUpOnDeadServer (0.00s)213--- PASS: TestStreamPushIsolatesFailures (0.00s)214=== CONT TestDumpPathSingleFile215--- PASS: TestScriptTokenScriptFails (0.00s)216=== CONT TestFilterOversizedClosures217=== CONT TestDumpPathMatchesNix218=== RUN TestFilterOversizedClosures/no_limit_keeps_everything219=== PAUSE TestFilterOversizedClosures/no_limit_keeps_everything220=== RUN TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped221=== PAUSE TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped222=== RUN TestFilterOversizedClosures/all_closures_skipped223=== PAUSE TestFilterOversizedClosures/all_closures_skipped224=== CONT TestPartSizeForNAR225=== RUN TestPartSizeForNAR/zero_stays_at_minimum226=== PAUSE TestPartSizeForNAR/zero_stays_at_minimum227=== RUN TestPartSizeForNAR/small_stays_at_minimum228=== PAUSE TestPartSizeForNAR/small_stays_at_minimum229=== RUN TestPartSizeForNAR/80_GiB_fits_at_minimum230=== PAUSE TestPartSizeForNAR/80_GiB_fits_at_minimum231=== RUN TestPartSizeForNAR/115_GiB_needs_larger_parts232=== PAUSE TestPartSizeForNAR/115_GiB_needs_larger_parts233=== RUN TestPartSizeForNAR/1_TiB234=== PAUSE TestPartSizeForNAR/1_TiB235=== RUN TestPartSizeForNAR/5_TiB_S3_max_object236=== PAUSE TestPartSizeForNAR/5_TiB_S3_max_object237=== RUN TestPartSizeForNAR/capped_at_5_GiB238=== PAUSE TestPartSizeForNAR/capped_at_5_GiB239=== CONT TestUploadMultipart_PartsInParallel240--- PASS: TestScriptTokenBadJSON (0.01s)241=== CONT TestSetClientTLS242--- PASS: TestScriptTokenEmptyToken (0.01s)243=== CONT TestSetClientTLSDoesNotMutateDefaultTransport244--- PASS: TestSetClientTLSDoesNotMutateDefaultTransport (0.00s)245=== CONT TestStreamPushRequestLine2462026/10/01 08:35:09 ERROR Upload failed error=boom count=1247=== RUN TestSetClientTLS/rejects_connection_without_client_cert248=== PAUSE TestSetClientTLS/rejects_connection_without_client_cert249=== RUN TestSetClientTLS/succeeds_with_client_cert_and_CA250=== PAUSE TestSetClientTLS/succeeds_with_client_cert_and_CA251=== RUN TestSetClientTLS/preserves_debug_logging_transport252=== PAUSE TestSetClientTLS/preserves_debug_logging_transport253=== CONT TestClientSignaturesByStorePath254--- PASS: TestClientSignaturesByStorePath (0.00s)255=== CONT TestStreamPushReportsEveryPath256--- PASS: TestStreamPushReportsEveryPath (0.00s)257=== CONT TestStreamPushReportsSignatures2582026/10/01 08:35:09 ERROR Upload failed error=boom count=1259--- PASS: TestStreamPushReportsSignatures (0.00s)260=== CONT TestCaseHackSuffix261--- PASS: TestStreamPushRequestLine (0.01s)262=== CONT TestRegisterUploadedObjectReusesConnections263--- PASS: TestScriptTokenCachesUntilRefresh (0.03s)264--- PASS: TestScriptTokenNoExpiryRerunsEveryCall (0.03s)265=== CONT TestRateLimiterFeedback/429_enables_limiter266=== CONT TestShellSplitErrors267--- PASS: TestShellSplitErrors (0.00s)268=== CONT TestRateLimiterFeedback/503_enables_limiter2692026/10/01 08:35:09 WARN Rate limiter enabled after throttle name=server-test rate=52702026/10/01 08:35:09 WARN Request returned retryable status, retrying attempt=1 max_attempts=2 backoff=0s status=429 url=http://127.0.0.1:615152712026/10/01 08:35:09 WARN Rate limiter enabled after throttle name=server-test rate=52722026/10/01 08:35:09 WARN Request returned retryable status, retrying attempt=1 max_attempts=2 backoff=0s status=503 url=http://127.0.0.1:615172732026/10/01 08:35:09 WARN Rate limiter backed off name=server-test rate=5274=== CONT TestRateLimiterFeedback/400_does_not_enable_limiter2752026/10/01 08:35:09 WARN Rate limiter backed off name=server-test rate=5276=== CONT TestRateLimiterFeedback/200_does_not_enable_limiter277=== CONT TestPathInfoCACompatibility/null_ca_field278=== CONT TestPathInfoCACompatibility/new_structured_format_-_text279=== CONT TestPathInfoCACompatibility/new_structured_format_-_nar_method280=== CONT TestPathInfoCACompatibility/old_string_format_-_fixed_recursive281=== CONT TestPathInfoCACompatibility/old_string_format_-_text282--- PASS: TestPathInfoCACompatibility (0.00s)283 --- PASS: TestPathInfoCACompatibility/null_ca_field (0.00s)284 --- PASS: TestPathInfoCACompatibility/new_structured_format_-_text (0.00s)285 --- PASS: TestPathInfoCACompatibility/new_structured_format_-_nar_method (0.00s)286 --- PASS: TestPathInfoCACompatibility/old_string_format_-_fixed_recursive (0.00s)287 --- PASS: TestPathInfoCACompatibility/old_string_format_-_text (0.00s)288=== CONT TestConvertHashToNix32/SRI_format_to_Nix32289=== CONT TestConvertHashToNix32/invalid_format290=== CONT TestConvertHashToNix32/already_Nix32_format291=== CONT TestGetStorePathHash/hash_with_invalid_characters_should_error292=== CONT TestGetStorePathHash/basename_without_hyphen_should_error293=== CONT TestGetStorePathHash/hash_with_wrong_length_should_error294=== CONT TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths295=== CONT TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths296=== CONT TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)297=== CONT TestPathInfoHashCompatibility/new_structured_format_with_sha512298=== CONT TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI299=== CONT TestGetStorePathHash/valid_store_path300=== CONT TestPathInfoHashCompatibility/old_string_format_with_colon301=== CONT TestParsePathInfoJSON/Nix_format302=== CONT TestParsePathInfoJSON/whitespace_only303=== CONT TestParsePathInfoJSON/invalid_JSON304=== CONT TestParsePathInfoJSON/empty_input305=== CONT TestParsePathInfoJSON/Lix_format306=== CONT TestSetClientTLSErrors/missing_cert_file307=== CONT TestSetClientTLSErrors/missing_ca_file308=== CONT TestSetClientTLSErrors/invalid_ca_file309--- PASS: TestRateLimiterFeedback (0.00s)310 --- PASS: TestRateLimiterFeedback/429_enables_limiter (0.00s)311 --- PASS: TestRateLimiterFeedback/503_enables_limiter (0.00s)312 --- PASS: TestRateLimiterFeedback/400_does_not_enable_limiter (0.00s)313 --- PASS: TestRateLimiterFeedback/200_does_not_enable_limiter (0.00s)314--- PASS: TestConvertHashToNix32 (0.00s)315 --- PASS: TestConvertHashToNix32/SRI_format_to_Nix32 (0.00s)316 --- PASS: TestConvertHashToNix32/invalid_format (0.00s)317 --- PASS: TestConvertHashToNix32/already_Nix32_format (0.00s)318--- PASS: TestParsePathInfoJSONMultiplePaths (0.00s)319 --- PASS: TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths (0.00s)320 --- PASS: TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths (0.00s)321--- PASS: TestGetStorePathHash (0.00s)322 --- PASS: TestGetStorePathHash/hash_with_invalid_characters_should_error (0.00s)323 --- PASS: TestGetStorePathHash/basename_without_hyphen_should_error (0.00s)324 --- PASS: TestGetStorePathHash/hash_with_wrong_length_should_error (0.00s)325 --- PASS: TestGetStorePathHash/valid_store_path (0.00s)326--- PASS: TestPathInfoHashCompatibility (0.00s)327 --- PASS: TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI) (0.00s)328 --- PASS: TestPathInfoHashCompatibility/new_structured_format_with_sha512 (0.00s)329 --- PASS: TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI (0.00s)330 --- PASS: TestPathInfoHashCompatibility/old_string_format_with_colon (0.00s)331=== CONT TestSetClientTLSErrors/missing_key_file332=== CONT TestUploadMultipart_SupersededByPeer/exists333=== CONT TestUploadMultipart_SupersededByPeer/missing334--- PASS: TestParsePathInfoJSON (0.00s)335 --- PASS: TestParsePathInfoJSON/whitespace_only (0.00s)336 --- PASS: TestParsePathInfoJSON/invalid_JSON (0.00s)337 --- PASS: TestParsePathInfoJSON/empty_input (0.00s)338 --- PASS: TestParsePathInfoJSON/Nix_format (0.00s)339 --- PASS: TestParsePathInfoJSON/Lix_format (0.00s)340--- PASS: TestSetClientTLSErrors (0.00s)341 --- PASS: TestSetClientTLSErrors/missing_cert_file (0.00s)342 --- PASS: TestSetClientTLSErrors/invalid_ca_file (0.00s)343 --- PASS: TestSetClientTLSErrors/missing_ca_file (0.00s)344 --- PASS: TestSetClientTLSErrors/missing_key_file (0.00s)345--- PASS: TestDumpPathWriterError (0.03s)346=== CONT TestEncodeNixBase32/test_string_hash347=== CONT TestEncodeNixBase32/empty_input348--- PASS: TestEncodeNixBase32 (0.00s)349 --- PASS: TestEncodeNixBase32/test_string_hash (0.00s)350 --- PASS: TestEncodeNixBase32/empty_input (0.00s)351=== CONT TestFilterOversizedClosures/no_limit_keeps_everything352=== CONT TestPartSizeForNAR/zero_stays_at_minimum353=== CONT TestFilterOversizedClosures/all_closures_skipped3542026/10/01 08:35:09 WARN Skipping closure: path exceeds server max NAR size top_level_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper oversized_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper nar_size=100 max_nar_size=50355=== CONT TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped3562026/10/01 08:35:09 WARN Skipping closure: path exceeds server max NAR size top_level_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper oversized_path=/nix/store/bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb-vm-image nar_size=5000 max_nar_size=2000357--- PASS: TestFilterOversizedClosures (0.00s)358 --- PASS: TestFilterOversizedClosures/no_limit_keeps_everything (0.00s)359 --- PASS: TestFilterOversizedClosures/all_closures_skipped (0.00s)360 --- PASS: TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped (0.00s)361=== CONT TestPartSizeForNAR/1_TiB362=== CONT TestPartSizeForNAR/capped_at_5_GiB363=== CONT TestPartSizeForNAR/5_TiB_S3_max_object364=== CONT TestPartSizeForNAR/80_GiB_fits_at_minimum365=== CONT TestPartSizeForNAR/small_stays_at_minimum366=== CONT TestPartSizeForNAR/115_GiB_needs_larger_parts367--- PASS: TestPartSizeForNAR (0.00s)368 --- PASS: TestPartSizeForNAR/zero_stays_at_minimum (0.00s)369 --- PASS: TestPartSizeForNAR/1_TiB (0.00s)370 --- PASS: TestPartSizeForNAR/capped_at_5_GiB (0.00s)371 --- PASS: TestPartSizeForNAR/5_TiB_S3_max_object (0.00s)372 --- PASS: TestPartSizeForNAR/80_GiB_fits_at_minimum (0.00s)373 --- PASS: TestPartSizeForNAR/small_stays_at_minimum (0.00s)374 --- PASS: TestPartSizeForNAR/115_GiB_needs_larger_parts (0.00s)375=== CONT TestSetClientTLS/rejects_connection_without_client_cert376=== CONT TestSetClientTLS/preserves_debug_logging_transport377--- PASS: TestUploadMultipart_SupersededByPeer (0.00s)378 --- PASS: TestUploadMultipart_SupersededByPeer/missing (0.00s)379 --- PASS: TestUploadMultipart_SupersededByPeer/exists (0.00s)380=== CONT TestSetClientTLS/succeeds_with_client_cert_and_CA381--- PASS: TestRegisterUploadedObjectReusesConnections (0.02s)3822026/10/01 08:35:09 http: TLS handshake error from 127.0.0.1:61527: remote error: tls: bad certificate383--- PASS: TestSetClientTLS (0.00s)384 --- PASS: TestSetClientTLS/succeeds_with_client_cert_and_CA (0.00s)385 --- PASS: TestSetClientTLS/preserves_debug_logging_transport (0.00s)386 --- PASS: TestSetClientTLS/rejects_connection_without_client_cert (0.01s)387--- PASS: TestDumpPathSingleFile (0.05s)388--- PASS: TestCaseHackSuffix (0.04s)389--- PASS: TestDumpPathMatchesNix (0.07s)390--- PASS: TestStreamPushBatchesUnderLoad (0.10s)391--- PASS: TestUploadMultipart_PartsInParallel (0.61s)392--- PASS: TestRateLimiterFeedback_400DoesNotCountAsSuccess (1.00s)393PASS394Running server tests...395The files belonging to this database system will be owned by user "_nixbld1".396This user must also own the server process.397398The database cluster will be initialized with locale "C".399The default database encoding has accordingly been set to "SQL_ASCII".400The default text search configuration will be set to "english".401402Data page checksums are enabled.403404creating directory /nix/var/nix/builds/nix-98979-578903465/postgres2887540844/data ... ok405creating subdirectories ... ok406selecting dynamic shared memory implementation ... posix407selecting default "max_connections" ... 100408selecting default "shared_buffers" ... 128MB409selecting default time zone ... UTC410creating configuration files ... ok411running bootstrap script ... ok412performing post-bootstrap initialization ... ok413syncing data to disk ... ok414415initdb: warning: enabling "trust" authentication for local connections416initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.417418Success. You can now start the database server using:419420 pg_ctl -D /nix/var/nix/builds/nix-98979-578903465/postgres2887540844/data -l logfile start421422/nix/var/nix/builds/nix-98979-578903465/postgres2887540844:5432 - no response4232026-10-01 08:35:11.388 UTC [99016] LOG: starting PostgreSQL 18.6 on aarch64-apple-darwin25.6.0, compiled by clang version 21.1.8, 64-bit4242026-10-01 08:35:11.388 UTC [99016] LOG: listening on Unix socket "/nix/var/nix/builds/nix-98979-578903465/postgres2887540844/.s.PGSQL.5432"4252026-10-01 08:35:11.390 UTC [99023] LOG: database system was shut down at 2026-10-01 08:35:11 UTC4262026-10-01 08:35:11.391 UTC [99016] LOG: database system is ready to accept connections427/nix/var/nix/builds/nix-98979-578903465/postgres2887540844:5432 - accepting connections428{"timestamp":"2026-10-01T08:35:11.60619Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"792ccd36-a4b5-4b5f-bd19-117e4f500d90","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"GET","uri":"/health/ready","status_code":503,"suppressed_errors":0,"duration_ms":0,"result":"server_error","target":"rustfs::server::http","filename":"rustfs/src/server/layer.rs","line_number":501,"threadName":"rustfs-worker","threadId":"ThreadId(2)"}429{"timestamp":"2026-10-01T08:35:11.709902Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"cb86abf5-77dc-4040-ab1b-9c38dcdc15ca","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"GET","uri":"/health/ready","status_code":503,"suppressed_errors":0,"duration_ms":0,"result":"server_error","target":"rustfs::server::http","filename":"rustfs/src/server/layer.rs","line_number":501,"threadName":"rustfs-worker","threadId":"ThreadId(5)"}430=== RUN TestService_AuthMiddleware431=== PAUSE TestService_AuthMiddleware432=== RUN TestService_AuthMiddleware_MTLSProxyHeader433=== PAUSE TestService_AuthMiddleware_MTLSProxyHeader434=== RUN TestService_AuthMiddleware_MTLSBoundSubjects435=== PAUSE TestService_AuthMiddleware_MTLSBoundSubjects436=== RUN TestService_ReadAuthMiddleware437=== PAUSE TestService_ReadAuthMiddleware438=== RUN TestService_AuthMiddleware_OIDC439=== PAUSE TestService_AuthMiddleware_OIDC440=== RUN TestService_RequireScope_OIDC441=== PAUSE TestService_RequireScope_OIDC442=== RUN TestService_ReadScope_PublicByDefault443=== PAUSE TestService_ReadScope_PublicByDefault444=== RUN TestCacheConfigHandler445=== PAUSE TestCacheConfigHandler446=== RUN TestCacheStatsHandler447=== PAUSE TestCacheStatsHandler448=== RUN TestClientCADerivations449=== PAUSE TestClientCADerivations450=== RUN TestClientErrorHandling451=== PAUSE TestClientErrorHandling452=== RUN TestClientIntegration453=== PAUSE TestClientIntegration454=== RUN TestClientMultipleUploads455=== PAUSE TestClientMultipleUploads456=== RUN TestClientWithDependencies457=== PAUSE TestClientWithDependencies458=== RUN TestClientSharedPathCommittedMidPush459=== PAUSE TestClientSharedPathCommittedMidPush460=== RUN TestPinProtectsFromGC461=== PAUSE TestPinProtectsFromGC462=== RUN TestClientPushesUseOnePush463=== PAUSE TestClientPushesUseOnePush464=== RUN TestClientFallsBackToClosures465=== PAUSE TestClientFallsBackToClosures466=== RUN TestResolveDBConnectionString467=== PAUSE TestResolveDBConnectionString468=== RUN TestLeadElectsOneAndHandsOver469=== PAUSE TestLeadElectsOneAndHandsOver470=== RUN TestLeadIncumbentWinsAfterRestart4712026-10-01 08:35:11.878 UTC [99053] ERROR: relation "goose_db_version" does not exist at character 364722026-10-01 08:35:11.878 UTC [99053] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4732026/10/01 08:35:11 OK 20241026095416_initial_model.sql (3.26ms)4742026/10/01 08:35:11 OK 20251210153512_drop_unused_gin_index.sql (484.13µs)4752026/10/01 08:35:11 OK 20251218171726_add_pins.sql (856.08µs)4762026/10/01 08:35:11 OK 20260628120000_add_object_size_and_stats.sql (799.54µs)4772026/10/01 08:35:11 OK 20260905000000_add_claims.sql (863.58µs)4782026/10/01 08:35:11 OK 20260920000000_drop_claims.sql (549.04µs)4792026/10/01 08:35:11 OK 20260923120000_add_pushes.sql (358.25µs)4802026/10/01 08:35:11 goose: successfully migrated database to version: 202609231200004812026/10/01 08:35:11 OK 1_commit_pending_closure.sql (821.88µs)4822026/10/01 08:35:11 OK 2_object_stats_trigger.sql (210.5µs)4832026/10/01 08:35:11 OK 3_commit_push.sql (183.08µs)4842026/10/01 08:35:11 goose: up to current file version: 34852026/10/01 08:35:11 INFO lead: acquired remote=192.0.2.1:12344862026/10/01 08:35:12 INFO lead: released remote=192.0.2.1:12344872026/10/01 08:35:12 INFO lead: acquired remote=192.0.2.1:12344882026/10/01 08:35:12 INFO lead: released remote=192.0.2.1:1234489--- PASS: TestLeadIncumbentWinsAfterRestart (0.79s)490=== RUN TestLeadEndsOnShutdown491=== PAUSE TestLeadEndsOnShutdown492=== RUN TestGCAdvisoryLockBlocksConcurrentRun4932026-10-01 08:35:12.688 UTC [99057] ERROR: relation "goose_db_version" does not exist at character 364942026-10-01 08:35:12.688 UTC [99057] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4952026/10/01 08:35:12 OK 20241026095416_initial_model.sql (3.35ms)4962026/10/01 08:35:12 OK 20251210153512_drop_unused_gin_index.sql (506.04µs)4972026/10/01 08:35:12 OK 20251218171726_add_pins.sql (798.38µs)4982026/10/01 08:35:12 OK 20260628120000_add_object_size_and_stats.sql (827.17µs)4992026/10/01 08:35:12 OK 20260905000000_add_claims.sql (1.03ms)5002026/10/01 08:35:12 OK 20260920000000_drop_claims.sql (595.13µs)5012026/10/01 08:35:12 OK 20260923120000_add_pushes.sql (399.08µs)5022026/10/01 08:35:12 goose: successfully migrated database to version: 202609231200005032026/10/01 08:35:12 OK 1_commit_pending_closure.sql (881.92µs)5042026/10/01 08:35:12 OK 2_object_stats_trigger.sql (223.33µs)5052026/10/01 08:35:12 OK 3_commit_push.sql (183.25µs)5062026/10/01 08:35:12 goose: up to current file version: 3507--- PASS: TestGCAdvisoryLockBlocksConcurrentRun (0.16s)508=== RUN TestGCBugBareHashReferences509=== PAUSE TestGCBugBareHashReferences510=== RUN TestGCMetrics511=== PAUSE TestGCMetrics512=== RUN TestPushDedupSurvivesConcurrentGC513=== PAUSE TestPushDedupSurvivesConcurrentGC514=== RUN TestDeduplicatedObjectsRecordedAsPending515=== PAUSE TestDeduplicatedObjectsRecordedAsPending516=== RUN TestGCSweepSkipsPendingObjects517=== PAUSE TestGCSweepSkipsPendingObjects518=== RUN TestTombstonedObjectOfferedWithoutWaiting519=== PAUSE TestTombstonedObjectOfferedWithoutWaiting520=== RUN TestGCSweepDeliversEachKeyOnce521=== PAUSE TestGCSweepDeliversEachKeyOnce522=== RUN TestCreatePendingClosureVerifyS3FailureReleasesConnection523=== PAUSE TestCreatePendingClosureVerifyS3FailureReleasesConnection524=== RUN TestForceGCDuringPushOffersSweptObject525=== PAUSE TestForceGCDuringPushOffersSweptObject526=== RUN TestFailedS3DeleteKeepsTombstone527=== PAUSE TestFailedS3DeleteKeepsTombstone528=== RUN TestSweepSkipsRowsLockedByPush529=== PAUSE TestSweepSkipsRowsLockedByPush530=== RUN TestRegisterCompletedObjectNeedsPendingRow531=== PAUSE TestRegisterCompletedObjectNeedsPendingRow532=== RUN TestGetExistingObjectsLocksRows533=== PAUSE TestGetExistingObjectsLocksRows534=== RUN TestSweepRechecksPendingAfterLocking535=== PAUSE TestSweepRechecksPendingAfterLocking536=== RUN TestPushWaitsForSweepHoldingRow537=== PAUSE TestPushWaitsForSweepHoldingRow538=== RUN TestCommitRacingPendingCleanupKeepsObjects539=== PAUSE TestCommitRacingPendingCleanupKeepsObjects540=== RUN TestGCTaskStore_StartNew541=== PAUSE TestGCTaskStore_StartNew542=== RUN TestGCTaskStore_DeduplicateSameParams543=== PAUSE TestGCTaskStore_DeduplicateSameParams544=== RUN TestGCTaskStore_ConflictDifferentParams545=== PAUSE TestGCTaskStore_ConflictDifferentParams546=== RUN TestGCTaskStore_GetEmpty547=== PAUSE TestGCTaskStore_GetEmpty548=== RUN TestGCTaskStore_GetReturnsLatest549=== PAUSE TestGCTaskStore_GetReturnsLatest550=== RUN TestGCTaskStore_CompletedAllowsNewTask551=== PAUSE TestGCTaskStore_CompletedAllowsNewTask552=== RUN TestGCTaskStore_PhaseUpdates553=== PAUSE TestGCTaskStore_PhaseUpdates554=== RUN TestGCTaskStore_Fail555=== PAUSE TestGCTaskStore_Fail556=== RUN TestGracefulShutdownDrainsInflight557=== PAUSE TestGracefulShutdownDrainsInflight558=== RUN TestService_healthCheckHandler559=== PAUSE TestService_healthCheckHandler560=== RUN TestService_readinessHandler561=== PAUSE TestService_readinessHandler562=== RUN TestGenerateLandingPage563=== PAUSE TestGenerateLandingPage564=== RUN TestCacheConfigHandlerMaxNarSize565=== PAUSE TestCacheConfigHandlerMaxNarSize566=== RUN TestCreatePendingClosureRejectsOversizedNAR567=== PAUSE TestCreatePendingClosureRejectsOversizedNAR568=== RUN TestNARDeduplicationMetadataUploadBug569=== PAUSE TestNARDeduplicationMetadataUploadBug570=== RUN TestMetricsInventory571=== PAUSE TestMetricsInventory572=== RUN TestService_NativeMTLS573=== PAUSE TestService_NativeMTLS574=== RUN TestServerTLSConfig575=== PAUSE TestServerTLSConfig576=== RUN TestMultipartCleanup577=== PAUSE TestMultipartCleanup578=== RUN TestObjectStatsTrigger579=== PAUSE TestObjectStatsTrigger580=== RUN TestOrphanedObjectsGC581=== PAUSE TestOrphanedObjectsGC582=== RUN TestOrphanedObjectsGCStressTest583=== PAUSE TestOrphanedObjectsGCStressTest584=== RUN TestCreatePin_ReservedPins585=== PAUSE TestCreatePin_ReservedPins586=== RUN TestParseSingleRange587=== PAUSE TestParseSingleRange588=== RUN TestProxyHeadersOnlyTrustedOnSocket589=== PAUSE TestProxyHeadersOnlyTrustedOnSocket590=== RUN TestIsValidCachePath591=== PAUSE TestIsValidCachePath592=== RUN TestReadProxyNarinfo593=== PAUSE TestReadProxyNarinfo594=== RUN TestReadProxyNarinfoAlreadyDecompressed595=== PAUSE TestReadProxyNarinfoAlreadyDecompressed596=== RUN TestReadProxyNarStreaming597=== PAUSE TestReadProxyNarStreaming598=== RUN TestReadProxy404599=== PAUSE TestReadProxy404600=== RUN TestReadProxyInvalidPath601=== PAUSE TestReadProxyInvalidPath602=== RUN TestReadProxyHead603=== PAUSE TestReadProxyHead604=== RUN TestReadProxyConditionalGet605=== PAUSE TestReadProxyConditionalGet606=== RUN TestReadProxyRootRedirectsToIndexHTML607=== PAUSE TestReadProxyRootRedirectsToIndexHTML608=== RUN TestReadProxyDisabled609=== PAUSE TestReadProxyDisabled610=== RUN TestReadRedirectNar611=== PAUSE TestReadRedirectNar612=== RUN TestReadRedirectKeepsNarinfoProxied613=== PAUSE TestReadRedirectKeepsNarinfoProxied614=== RUN TestReadProxyRangeRequest615=== PAUSE TestReadProxyRangeRequest616=== RUN TestReadRedirectUsesPublicS3URL617=== PAUSE TestReadRedirectUsesPublicS3URL618=== RUN TestPush_OverlappingRootsStoreOneRowPerKey619=== PAUSE TestPush_OverlappingRootsStoreOneRowPerKey620=== RUN TestPush_CompleteCommitsEveryRoot621=== PAUSE TestPush_CompleteCommitsEveryRoot622=== RUN TestPush_SkippedKeySurvivesGCBeforeCommit623=== PAUSE TestPush_SkippedKeySurvivesGCBeforeCommit624=== RUN TestPush_RejectsBadRequests625=== PAUSE TestPush_RejectsBadRequests626=== RUN TestPush_SignsNarinfosOfItsPendingObjects627=== PAUSE TestPush_SignsNarinfosOfItsPendingObjects628=== RUN TestRedundantMultipartUpload629=== PAUSE TestRedundantMultipartUpload630=== RUN TestCompleteMultipartUpload_ErrorButObjectExists631=== PAUSE TestCompleteMultipartUpload_ErrorButObjectExists632=== RUN TestCompletedNarNotReofferedAcrossClosures633=== PAUSE TestCompletedNarNotReofferedAcrossClosures634=== RUN TestPresignedUploadRegisteredBeforeCommit635=== PAUSE TestPresignedUploadRegisteredBeforeCommit636=== RUN TestService_Rustfstest637=== PAUSE TestService_Rustfstest638=== RUN TestParseSize639=== PAUSE TestParseSize640=== RUN TestSkippedUploadsHandler641=== PAUSE TestSkippedUploadsHandler642=== RUN TestSystemdListenerNotActivated643--- PASS: TestSystemdListenerNotActivated (0.00s)644=== RUN TestWatchdogBeatsWhenHealthy645--- PASS: TestWatchdogBeatsWhenHealthy (0.03s)646=== RUN TestWatchdogSkipsWhenUnhealthy6472026/10/01 08:35:12 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"6482026/10/01 08:35:12 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"6492026/10/01 08:35:12 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"6502026/10/01 08:35:12 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"6512026/10/01 08:35:12 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"6522026/10/01 08:35:12 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"6532026/10/01 08:35:12 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"6542026/10/01 08:35:12 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"6552026/10/01 08:35:12 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"656--- PASS: TestWatchdogSkipsWhenUnhealthy (0.21s)657=== RUN TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle658=== PAUSE TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle659=== RUN TestProxyWriteTimeout660=== PAUSE TestProxyWriteTimeout661=== RUN TestIsValidUploadKey662=== PAUSE TestIsValidUploadKey663=== RUN TestUploadHandlersRejectInvalidKeys664=== PAUSE TestUploadHandlersRejectInvalidKeys665=== RUN TestUploadHandlersRejectOversizedBody666=== PAUSE TestUploadHandlersRejectOversizedBody667=== RUN TestService_cleanupPendingClosuresHandler668=== PAUSE TestService_cleanupPendingClosuresHandler669=== RUN TestService_createPendingClosureHandler670=== PAUSE TestService_createPendingClosureHandler671=== RUN TestService_verifyS3Integrity672=== PAUSE TestService_verifyS3Integrity673=== RUN TestCompleteMultipartUnregistered674=== PAUSE TestCompleteMultipartUnregistered675=== RUN TestCreatePendingClosure_SmallNARUsesSimplePUT676=== PAUSE TestCreatePendingClosure_SmallNARUsesSimplePUT677=== CONT TestCompletedNarNotReofferedAcrossClosures678=== CONT TestPush_SignsNarinfosOfItsPendingObjects679=== CONT TestUploadHandlersRejectInvalidKeys680=== RUN TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info681=== PAUSE TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info682=== CONT TestSkippedUploadsHandler683=== RUN TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal684=== CONT TestService_AuthMiddleware685=== CONT TestRedundantMultipartUpload686=== CONT TestIsValidUploadKey687=== RUN TestIsValidUploadKey/narinfo688=== PAUSE TestIsValidUploadKey/narinfo689=== RUN TestIsValidUploadKey/nar_zst690=== PAUSE TestIsValidUploadKey/nar_zst691=== RUN TestIsValidUploadKey/nar_xz692=== CONT TestProxyWriteTimeout693=== RUN TestProxyWriteTimeout/narinfo694=== CONT TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle695=== PAUSE TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal696=== CONT TestCompleteMultipartUpload_ErrorButObjectExists697=== PAUSE TestIsValidUploadKey/nar_xz6982026/10/01 08:35:13 INFO Client skipped oversized paths paths=3 nar_bytes=5000000000699=== PAUSE TestProxyWriteTimeout/narinfo700=== RUN TestIsValidUploadKey/nar_plain701=== RUN TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key702=== RUN TestProxyWriteTimeout/1_GiB_nar703=== PAUSE TestProxyWriteTimeout/1_GiB_nar704=== RUN TestProxyWriteTimeout/10_GiB_nar705=== PAUSE TestProxyWriteTimeout/10_GiB_nar706=== RUN TestProxyWriteTimeout/unknown_size707=== PAUSE TestProxyWriteTimeout/unknown_size708=== CONT TestService_Rustfstest709=== PAUSE TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key710=== RUN TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key711=== PAUSE TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key712=== CONT TestParseSize713=== PAUSE TestIsValidUploadKey/nar_plain714--- PASS: TestParseSize (0.00s)715=== CONT TestService_verifyS3Integrity716=== RUN TestIsValidUploadKey/listing717=== PAUSE TestIsValidUploadKey/listing718=== RUN TestIsValidUploadKey/build_log719=== PAUSE TestIsValidUploadKey/build_log720=== RUN TestIsValidUploadKey/build_log_home-manager_file721=== PAUSE TestIsValidUploadKey/build_log_home-manager_file722=== RUN TestIsValidUploadKey/build_log_plus_in_name723=== PAUSE TestIsValidUploadKey/build_log_plus_in_name724=== RUN TestIsValidUploadKey/build_log_question_mark725=== PAUSE TestIsValidUploadKey/build_log_question_mark726=== RUN TestIsValidUploadKey/build_log_equals727=== PAUSE TestIsValidUploadKey/build_log_equals728=== RUN TestIsValidUploadKey/realisation729=== PAUSE TestIsValidUploadKey/realisation730=== RUN TestIsValidUploadKey/realisation_plus_in_output731=== PAUSE TestIsValidUploadKey/realisation_plus_in_output732=== RUN TestIsValidUploadKey/nix-cache-info733=== PAUSE TestIsValidUploadKey/nix-cache-info734=== RUN TestIsValidUploadKey/index.html735=== PAUSE TestIsValidUploadKey/index.html736=== RUN TestIsValidUploadKey/narinfo_key,_nar_type737=== PAUSE TestIsValidUploadKey/narinfo_key,_nar_type738=== RUN TestIsValidUploadKey/nar_key,_narinfo_type739=== PAUSE TestIsValidUploadKey/nar_key,_narinfo_type740=== RUN TestIsValidUploadKey/listing_key,_narinfo_type741=== PAUSE TestIsValidUploadKey/listing_key,_narinfo_type742=== RUN TestIsValidUploadKey/traversal743=== PAUSE TestIsValidUploadKey/traversal744=== RUN TestIsValidUploadKey/traversal_nar745--- PASS: TestSkippedUploadsHandler (0.01s)746=== PAUSE TestIsValidUploadKey/traversal_nar747=== RUN TestIsValidUploadKey/absolute748=== PAUSE TestIsValidUploadKey/absolute749=== RUN TestIsValidUploadKey/empty_key750=== PAUSE TestIsValidUploadKey/empty_key751=== CONT TestCreatePendingClosure_SmallNARUsesSimplePUT752=== RUN TestIsValidUploadKey/unknown_type753=== PAUSE TestIsValidUploadKey/unknown_type754=== CONT TestCompleteMultipartUnregistered7552026-10-01 08:35:13.309 UTC [99079] ERROR: relation "goose_db_version" does not exist at character 367562026-10-01 08:35:13.309 UTC [99079] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7572026-10-01 08:35:13.316 UTC [99080] ERROR: relation "goose_db_version" does not exist at character 367582026-10-01 08:35:13.316 UTC [99080] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7592026-10-01 08:35:13.318 UTC [99081] ERROR: relation "goose_db_version" does not exist at character 367602026-10-01 08:35:13.318 UTC [99081] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7612026-10-01 08:35:13.318 UTC [99083] ERROR: relation "goose_db_version" does not exist at character 367622026-10-01 08:35:13.318 UTC [99083] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7632026-10-01 08:35:13.319 UTC [99086] ERROR: relation "goose_db_version" does not exist at character 367642026-10-01 08:35:13.319 UTC [99086] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7652026-10-01 08:35:13.319 UTC [99082] ERROR: relation "goose_db_version" does not exist at character 367662026-10-01 08:35:13.319 UTC [99082] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7672026-10-01 08:35:13.319 UTC [99084] ERROR: relation "goose_db_version" does not exist at character 367682026-10-01 08:35:13.319 UTC [99084] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7692026-10-01 08:35:13.319 UTC [99085] ERROR: relation "goose_db_version" does not exist at character 367702026-10-01 08:35:13.319 UTC [99085] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7712026-10-01 08:35:13.320 UTC [99087] ERROR: relation "goose_db_version" does not exist at character 367722026-10-01 08:35:13.320 UTC [99087] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7732026-10-01 08:35:13.321 UTC [99088] ERROR: relation "goose_db_version" does not exist at character 367742026-10-01 08:35:13.321 UTC [99088] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7752026/10/01 08:35:13 OK 20241026095416_initial_model.sql (7.54ms)7762026/10/01 08:35:13 OK 20251210153512_drop_unused_gin_index.sql (984.38µs)7772026/10/01 08:35:13 OK 20251218171726_add_pins.sql (2.1ms)7782026/10/01 08:35:13 OK 20241026095416_initial_model.sql (7.32ms)7792026/10/01 08:35:13 OK 20251210153512_drop_unused_gin_index.sql (1.13ms)7802026/10/01 08:35:13 OK 20260628120000_add_object_size_and_stats.sql (2.48ms)7812026/10/01 08:35:13 OK 20241026095416_initial_model.sql (8.63ms)7822026/10/01 08:35:13 OK 20241026095416_initial_model.sql (7.73ms)7832026/10/01 08:35:13 OK 20241026095416_initial_model.sql (7.74ms)7842026/10/01 08:35:13 OK 20241026095416_initial_model.sql (8.04ms)7852026/10/01 08:35:13 OK 20251218171726_add_pins.sql (1.54ms)7862026/10/01 08:35:13 OK 20251210153512_drop_unused_gin_index.sql (820.63µs)7872026/10/01 08:35:13 OK 20251210153512_drop_unused_gin_index.sql (664.71µs)7882026/10/01 08:35:13 OK 20241026095416_initial_model.sql (8.17ms)7892026/10/01 08:35:13 OK 20251210153512_drop_unused_gin_index.sql (996.96µs)7902026/10/01 08:35:13 OK 20251210153512_drop_unused_gin_index.sql (806.5µs)7912026/10/01 08:35:13 OK 20260905000000_add_claims.sql (1.67ms)7922026/10/01 08:35:13 OK 20251210153512_drop_unused_gin_index.sql (891.21µs)7932026/10/01 08:35:13 OK 20251218171726_add_pins.sql (1.54ms)7942026/10/01 08:35:13 OK 20251218171726_add_pins.sql (1.53ms)7952026/10/01 08:35:13 OK 20241026095416_initial_model.sql (9.66ms)7962026/10/01 08:35:13 OK 20251218171726_add_pins.sql (1.87ms)7972026/10/01 08:35:13 OK 20260628120000_add_object_size_and_stats.sql (1.99ms)7982026/10/01 08:35:13 OK 20260920000000_drop_claims.sql (1.63ms)7992026/10/01 08:35:13 OK 20241026095416_initial_model.sql (9.52ms)8002026/10/01 08:35:13 OK 20251218171726_add_pins.sql (1.27ms)8012026/10/01 08:35:13 OK 20251218171726_add_pins.sql (2.24ms)8022026/10/01 08:35:13 OK 20251210153512_drop_unused_gin_index.sql (745.71µs)8032026/10/01 08:35:13 OK 20260628120000_add_object_size_and_stats.sql (1.16ms)8042026/10/01 08:35:13 OK 20251210153512_drop_unused_gin_index.sql (797.42µs)8052026/10/01 08:35:13 OK 20260923120000_add_pushes.sql (964.88µs)8062026/10/01 08:35:13 goose: successfully migrated database to version: 202609231200008072026/10/01 08:35:13 OK 20260628120000_add_object_size_and_stats.sql (1.8ms)8082026/10/01 08:35:13 OK 20260628120000_add_object_size_and_stats.sql (1.54ms)8092026/10/01 08:35:13 OK 20260628120000_add_object_size_and_stats.sql (1.91ms)8102026/10/01 08:35:13 OK 20260628120000_add_object_size_and_stats.sql (1.68ms)8112026/10/01 08:35:13 OK 20241026095416_initial_model.sql (9.48ms)8122026/10/01 08:35:13 OK 20260905000000_add_claims.sql (2.26ms)8132026/10/01 08:35:13 OK 20251218171726_add_pins.sql (1.8ms)8142026/10/01 08:35:13 OK 1_commit_pending_closure.sql (1.71ms)8152026/10/01 08:35:13 OK 20251218171726_add_pins.sql (2.02ms)8162026/10/01 08:35:13 OK 20251210153512_drop_unused_gin_index.sql (850.04µs)8172026/10/01 08:35:13 OK 2_object_stats_trigger.sql (549.38µs)8182026/10/01 08:35:13 OK 20260905000000_add_claims.sql (2.7ms)8192026/10/01 08:35:13 OK 20260920000000_drop_claims.sql (1.42ms)8202026/10/01 08:35:13 OK 20260905000000_add_claims.sql (2.08ms)8212026/10/01 08:35:13 OK 3_commit_push.sql (454.04µs)8222026/10/01 08:35:13 goose: up to current file version: 38232026/10/01 08:35:13 OK 20260905000000_add_claims.sql (2.25ms)8242026/10/01 08:35:13 OK 20260628120000_add_object_size_and_stats.sql (1.62ms)8252026/10/01 08:35:13 OK 20260905000000_add_claims.sql (2.47ms)8262026/10/01 08:35:13 OK 20260905000000_add_claims.sql (2.56ms)8272026/10/01 08:35:13 OK 20260923120000_add_pushes.sql (985.67µs)8282026/10/01 08:35:13 goose: successfully migrated database to version: 202609231200008292026/10/01 08:35:13 OK 20260628120000_add_object_size_and_stats.sql (1.83ms)8302026/10/01 08:35:13 OK 20260920000000_drop_claims.sql (1.17ms)8312026/10/01 08:35:13 OK 20251218171726_add_pins.sql (1.9ms)8322026/10/01 08:35:13 OK 20260920000000_drop_claims.sql (1.2ms)8332026/10/01 08:35:13 OK 20260920000000_drop_claims.sql (1.28ms)8342026/10/01 08:35:13 OK 20260923120000_add_pushes.sql (709.46µs)8352026/10/01 08:35:13 goose: successfully migrated database to version: 202609231200008362026/10/01 08:35:13 OK 20260920000000_drop_claims.sql (1.5ms)8372026/10/01 08:35:13 OK 20260923120000_add_pushes.sql (1.08ms)8382026/10/01 08:35:13 goose: successfully migrated database to version: 202609231200008392026/10/01 08:35:13 OK 20260920000000_drop_claims.sql (1.4ms)8402026/10/01 08:35:13 OK 1_commit_pending_closure.sql (1.43ms)8412026/10/01 08:35:13 OK 20260905000000_add_claims.sql (2.22ms)8422026/10/01 08:35:13 OK 20260923120000_add_pushes.sql (1.02ms)8432026/10/01 08:35:13 goose: successfully migrated database to version: 202609231200008442026/10/01 08:35:13 OK 20260923120000_add_pushes.sql (850.83µs)8452026/10/01 08:35:13 goose: successfully migrated database to version: 202609231200008462026/10/01 08:35:13 OK 2_object_stats_trigger.sql (541.92µs)8472026/10/01 08:35:13 OK 20260628120000_add_object_size_and_stats.sql (1.8ms)8482026/10/01 08:35:13 OK 20260905000000_add_claims.sql (2.01ms)8492026/10/01 08:35:13 OK 1_commit_pending_closure.sql (1.05ms)8502026/10/01 08:35:13 OK 3_commit_push.sql (504.63µs)8512026/10/01 08:35:13 goose: up to current file version: 38522026/10/01 08:35:13 OK 20260923120000_add_pushes.sql (1.34ms)8532026/10/01 08:35:13 goose: successfully migrated database to version: 202609231200008542026/10/01 08:35:13 OK 1_commit_pending_closure.sql (1.61ms)8552026/10/01 08:35:13 OK 20260920000000_drop_claims.sql (1.06ms)8562026/10/01 08:35:13 OK 2_object_stats_trigger.sql (407.04µs)8572026/10/01 08:35:13 OK 1_commit_pending_closure.sql (1.11ms)8582026/10/01 08:35:13 OK 1_commit_pending_closure.sql (973.38µs)8592026/10/01 08:35:13 OK 3_commit_push.sql (306.79µs)8602026/10/01 08:35:13 goose: up to current file version: 38612026/10/01 08:35:13 OK 2_object_stats_trigger.sql (360.13µs)8622026/10/01 08:35:13 OK 2_object_stats_trigger.sql (336.29µs)8632026/10/01 08:35:13 OK 2_object_stats_trigger.sql (231.08µs)8642026/10/01 08:35:13 OK 3_commit_push.sql (189.25µs)8652026/10/01 08:35:13 goose: up to current file version: 38662026/10/01 08:35:13 OK 3_commit_push.sql (163.71µs)8672026/10/01 08:35:13 goose: up to current file version: 38682026/10/01 08:35:13 OK 3_commit_push.sql (144.29µs)8692026/10/01 08:35:13 goose: up to current file version: 38702026/10/01 08:35:13 OK 1_commit_pending_closure.sql (973.54µs)8712026/10/01 08:35:13 OK 2_object_stats_trigger.sql (191.83µs)8722026/10/01 08:35:13 OK 3_commit_push.sql (146.58µs)8732026/10/01 08:35:13 goose: up to current file version: 38742026/10/01 08:35:13 OK 20260923120000_add_pushes.sql (12.14ms)8752026/10/01 08:35:13 goose: successfully migrated database to version: 202609231200008762026/10/01 08:35:13 OK 20260920000000_drop_claims.sql (13.55ms)8772026/10/01 08:35:13 OK 1_commit_pending_closure.sql (847.88µs)8782026/10/01 08:35:13 OK 2_object_stats_trigger.sql (184.42µs)8792026/10/01 08:35:13 OK 20260905000000_add_claims.sql (13.94ms)8802026/10/01 08:35:13 OK 3_commit_push.sql (172.33µs)8812026/10/01 08:35:13 goose: up to current file version: 38822026/10/01 08:35:13 OK 20260923120000_add_pushes.sql (454.75µs)8832026/10/01 08:35:13 goose: successfully migrated database to version: 202609231200008842026/10/01 08:35:13 OK 1_commit_pending_closure.sql (660.33µs)8852026/10/01 08:35:13 OK 2_object_stats_trigger.sql (181.25µs)8862026/10/01 08:35:13 OK 3_commit_push.sql (156µs)8872026/10/01 08:35:13 goose: up to current file version: 38882026/10/01 08:35:13 OK 20260920000000_drop_claims.sql (9.22ms)8892026/10/01 08:35:13 OK 20260923120000_add_pushes.sql (3.77ms)8902026/10/01 08:35:13 goose: successfully migrated database to version: 202609231200008912026/10/01 08:35:13 OK 1_commit_pending_closure.sql (659.83µs)8922026/10/01 08:35:13 OK 2_object_stats_trigger.sql (178.42µs)8932026/10/01 08:35:13 OK 3_commit_push.sql (139.04µs)8942026/10/01 08:35:13 goose: up to current file version: 38952026/10/01 08:35:13 INFO Received uploads request method=POST path=/api/pending_closures8962026/10/01 08:35:13 WARN Authentication failed token_preview=wrongtoken token_length=10 reason="static API token mismatch"897--- PASS: TestService_AuthMiddleware (0.55s)898=== CONT TestGCTaskStore_GetEmpty899--- PASS: TestGCTaskStore_GetEmpty (0.00s)900=== CONT TestPush_RejectsBadRequests9012026/10/01 08:35:13 INFO Received uploads request method=POST path=/api/pending_closures9022026/10/01 08:35:13 INFO Received uploads request method=POST path=/api/pending_closures9032026/10/01 08:35:13 INFO Received push request method=POST path=/api/pushes9042026/10/01 08:35:14 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign9052026/10/01 08:35:14 INFO Signed narinfos id=1 count=1906--- PASS: TestPush_SignsNarinfosOfItsPendingObjects (1.03s)907=== CONT TestPush_SkippedKeySurvivesGCBeforeCommit9082026/10/01 08:35:14 INFO Received complete multipart upload request method=POST path=/api/multipart/complete9092026/10/01 08:35:14 ERROR Failed to get multipart upload error="no rows in result set" upload_id=does-not-exist object_key=nar/0000000000000000000000000000000000000000000000000000.nar.zst910--- PASS: TestCompleteMultipartUnregistered (1.20s)911=== CONT TestPush_CompleteCommitsEveryRoot912--- PASS: TestService_Rustfstest (1.44s)913=== CONT TestPush_OverlappingRootsStoreOneRowPerKey9142026/10/01 08:35:14 INFO Received uploads request method=POST path=/api/pending_closures9152026/10/01 08:35:14 INFO Received complete multipart upload request method=POST path=/api/multipart/complete9162026/10/01 08:35:14 INFO Completed multipart upload object_key=nar/hhhhhhhhhhhhhhhhhhhhhhhhhhhhhh0100000000000000000000.nar.zst upload_id=OWE1N2RiOTAtN2U4Ni00ZmYzLThkMjItYmRiYjBlOTY2ZmUzLmM1ZjFiNDczLTc5ZTctNDNmMS1iNzRhLWU3YWI5ZThmZGE1MXgxNzkwODQzNzEzNDIzMzE2MDAw parts=129172026/10/01 08:35:14 INFO Received uploads request method=POST path=/api/pending_closures918--- PASS: TestCompletedNarNotReofferedAcrossClosures (1.89s)919=== CONT TestReadRedirectUsesPublicS3URL9202026/10/01 08:35:14 INFO Received complete multipart upload request method=POST path=/api/multipart/complete9212026/10/01 08:35:14 WARN CompleteMultipartUpload errored but object exists; treating as success error="The specified key does not exist." object_key=nar/gggggggggggggggggggggggggggggg0300000000000000000000.nar.zst upload_id=OWE1N2RiOTAtN2U4Ni00ZmYzLThkMjItYmRiYjBlOTY2ZmUzLjhmMDBkMDY0LWI1MjAtNDkxYS04NmExLWY5YTFiODRjZWM1YXgxNzkwODQzNzE0NzE5NzE1MDAw9222026/10/01 08:35:14 INFO Completed multipart upload object_key=nar/gggggggggggggggggggggggggggggg0300000000000000000000.nar.zst upload_id=OWE1N2RiOTAtN2U4Ni00ZmYzLThkMjItYmRiYjBlOTY2ZmUzLjhmMDBkMDY0LWI1MjAtNDkxYS04NmExLWY5YTFiODRjZWM1YXgxNzkwODQzNzE0NzE5NzE1MDAw parts=1923--- PASS: TestCompleteMultipartUpload_ErrorButObjectExists (1.99s)924=== CONT TestReadProxyRangeRequest9252026/10/01 08:35:15 INFO Received uploads request method=POST path=/api/pending_closures9262026-10-01 08:35:15.104 UTC [99099] ERROR: relation "goose_db_version" does not exist at character 369272026-10-01 08:35:15.104 UTC [99099] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC9282026/10/01 08:35:15 INFO Received uploads request method=POST path=/api/pending_closures9292026/10/01 08:35:15 INFO Received complete multipart upload request method=POST path=/api/multipart/complete9302026/10/01 08:35:15 OK 20241026095416_initial_model.sql (284.1ms)9312026/10/01 08:35:15 OK 20251210153512_drop_unused_gin_index.sql (3.38ms)932--- PASS: TestCreatePendingClosure_SmallNARUsesSimplePUT (2.47s)933=== CONT TestReadRedirectKeepsNarinfoProxied9342026/10/01 08:35:15 OK 20251218171726_add_pins.sql (62.69ms)9352026-10-01 08:35:15.489 UTC [99102] ERROR: relation "goose_db_version" does not exist at character 369362026-10-01 08:35:15.489 UTC [99102] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC9372026/10/01 08:35:15 INFO Completed multipart upload object_key=nar/gggggggggggggggggggggggggggggg0100000000000000000000.nar.zst upload_id=OWE1N2RiOTAtN2U4Ni00ZmYzLThkMjItYmRiYjBlOTY2ZmUzLmQ5Y2MwOTk1LTA1NWItNDU5My1hMjViLTMyNTkzOTU2MDE2YXgxNzkwODQzNzEzNzMyMDgwMDAw parts=12938--- PASS: TestRedundantMultipartUpload (2.50s)939=== CONT TestReadRedirectNar9402026/10/01 08:35:15 OK 20260628120000_add_object_size_and_stats.sql (42.71ms)9412026/10/01 08:35:15 OK 20260905000000_add_claims.sql (50.62ms)9422026/10/01 08:35:15 OK 20260920000000_drop_claims.sql (41.57ms)9432026/10/01 08:35:15 INFO Received uploads request method=POST path=/api/pending_closures9442026/10/01 08:35:15 OK 20260923120000_add_pushes.sql (17.86ms)9452026/10/01 08:35:15 goose: successfully migrated database to version: 202609231200009462026/10/01 08:35:15 OK 1_commit_pending_closure.sql (2.87ms)9472026/10/01 08:35:15 OK 2_object_stats_trigger.sql (601.54µs)9482026/10/01 08:35:15 OK 3_commit_push.sql (323.63µs)9492026/10/01 08:35:15 goose: up to current file version: 39502026/10/01 08:35:15 OK 20241026095416_initial_model.sql (194.09ms)9512026/10/01 08:35:15 OK 20251210153512_drop_unused_gin_index.sql (12.74ms)9522026/10/01 08:35:15 OK 20251218171726_add_pins.sql (30.15ms)9532026/10/01 08:35:15 OK 20260628120000_add_object_size_and_stats.sql (51.34ms)9542026/10/01 08:35:15 OK 20260905000000_add_claims.sql (69.48ms)9552026/10/01 08:35:15 OK 20260920000000_drop_claims.sql (31.79ms)956=== RUN TestPush_RejectsBadRequests/no_roots957=== PAUSE TestPush_RejectsBadRequests/no_roots958=== RUN TestPush_RejectsBadRequests/no_objects959=== PAUSE TestPush_RejectsBadRequests/no_objects960=== RUN TestPush_RejectsBadRequests/bad_root961=== PAUSE TestPush_RejectsBadRequests/bad_root962=== RUN TestPush_RejectsBadRequests/root_not_in_objects963=== PAUSE TestPush_RejectsBadRequests/root_not_in_objects964=== CONT TestReadProxyDisabled9652026-10-01 08:35:15.943 UTC [99107] ERROR: relation "goose_db_version" does not exist at character 369662026-10-01 08:35:15.943 UTC [99107] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC9672026/10/01 08:35:15 OK 20260923120000_add_pushes.sql (6.06ms)9682026/10/01 08:35:15 goose: successfully migrated database to version: 202609231200009692026/10/01 08:35:15 OK 1_commit_pending_closure.sql (2.52ms)9702026/10/01 08:35:15 OK 2_object_stats_trigger.sql (552.5µs)9712026/10/01 08:35:15 OK 3_commit_push.sql (400.92µs)9722026/10/01 08:35:15 goose: up to current file version: 39732026/10/01 08:35:15 INFO Received complete multipart upload request method=POST path=/api/multipart/complete9742026/10/01 08:35:16 OK 20241026095416_initial_model.sql (100.62ms)9752026-10-01 08:35:16.114 UTC [99110] ERROR: relation "goose_db_version" does not exist at character 369762026-10-01 08:35:16.114 UTC [99110] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC9772026/10/01 08:35:16 OK 20251210153512_drop_unused_gin_index.sql (12.95ms)9782026/10/01 08:35:16 OK 20251218171726_add_pins.sql (22.03ms)9792026/10/01 08:35:16 OK 20260628120000_add_object_size_and_stats.sql (32.31ms)9802026/10/01 08:35:16 INFO Received push request method=POST path=/api/pushes9812026/10/01 08:35:16 OK 20260905000000_add_claims.sql (52.07ms)9822026/10/01 08:35:16 OK 20260920000000_drop_claims.sql (25.4ms)9832026/10/01 08:35:16 INFO Received complete push request method=POST path=/api/pushes/1/complete9842026/10/01 08:35:16 OK 20260923120000_add_pushes.sql (8.11ms)9852026/10/01 08:35:16 goose: successfully migrated database to version: 202609231200009862026/10/01 08:35:16 OK 1_commit_pending_closure.sql (3.81ms)9872026/10/01 08:35:16 OK 2_object_stats_trigger.sql (3.02ms)9882026/10/01 08:35:16 OK 20241026095416_initial_model.sql (118.09ms)9892026/10/01 08:35:16 OK 3_commit_push.sql (1.91ms)9902026/10/01 08:35:16 goose: up to current file version: 39912026/10/01 08:35:16 INFO Received push request method=POST path=/api/pushes9922026/10/01 08:35:16 OK 20251210153512_drop_unused_gin_index.sql (4.71ms)9932026/10/01 08:35:16 OK 20251218171726_add_pins.sql (4.59ms)9942026/10/01 08:35:16 INFO Aborted multipart uploads count=09952026/10/01 08:35:16 WARN Force mode enabled - objects will be deleted immediately without grace period9962026/10/01 08:35:16 OK 20260628120000_add_object_size_and_stats.sql (103.91ms)9972026/10/01 08:35:16 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=2 objects-deleted-after-grace-period=2 objects-failed-to-delete=09982026/10/01 08:35:16 INFO Received complete multipart upload request method=POST path=/api/multipart/complete9992026/10/01 08:35:16 INFO Vacuumed table table=pending_closures10002026/10/01 08:35:16 INFO Vacuumed table table=pending_objects10012026/10/01 08:35:16 OK 20260905000000_add_claims.sql (78.8ms)10022026/10/01 08:35:16 INFO Vacuumed table table=multipart_uploads10032026/10/01 08:35:16 INFO Completed multipart upload object_key=nar/dadb44fdadb44fdadb44fdadb44f000000000000000000000000.nar.zst upload_id=OWE1N2RiOTAtN2U4Ni00ZmYzLThkMjItYmRiYjBlOTY2ZmUzLmFjNjQ2Njg5LWExOWEtNDhhNC05ZjYxLWM5YzQxNjEzMmJmZXgxNzkwODQzNzE1MDQ1MjgyMDAw parts=1010042026/10/01 08:35:16 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete10052026/10/01 08:35:16 INFO Completed upload id=110062026/10/01 08:35:16 INFO Received uploads request method=POST path=/api/pending_closures10072026/10/01 08:35:16 INFO Received uploads request method=POST path=/api/pending_closures10082026/10/01 08:35:16 INFO Object in database but missing from S3 key=dadb44fdadb44fdadb44fdadb44f0000.narinfo10092026/10/01 08:35:16 WARN Found objects in DB but missing from S3, will re-upload count=11010--- PASS: TestService_verifyS3Integrity (3.51s)1011=== CONT TestReadProxyRootRedirectsToIndexHTML10122026/10/01 08:35:16 OK 20260920000000_drop_claims.sql (57.3ms)10132026/10/01 08:35:16 INFO Vacuumed table table=closures10142026/10/01 08:35:16 OK 20260923120000_add_pushes.sql (10.26ms)10152026/10/01 08:35:16 goose: successfully migrated database to version: 2026092312000010162026/10/01 08:35:16 OK 1_commit_pending_closure.sql (2.16ms)10172026/10/01 08:35:16 OK 2_object_stats_trigger.sql (460.17µs)10182026/10/01 08:35:16 OK 3_commit_push.sql (382.38µs)10192026/10/01 08:35:16 goose: up to current file version: 310202026/10/01 08:35:16 INFO Vacuumed table table=objects10212026/10/01 08:35:16 INFO Received complete push request method=POST path=/api/pushes/2/complete1022--- PASS: TestPush_SkippedKeySurvivesGCBeforeCommit (2.52s)1023=== CONT TestReadProxyConditionalGet10242026-10-01 08:35:16.565 UTC [99112] ERROR: relation "goose_db_version" does not exist at character 3610252026-10-01 08:35:16.565 UTC [99112] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC10262026/10/01 08:35:16 INFO Received push request method=POST path=/api/pushes10272026/10/01 08:35:16 INFO Received complete push request method=POST path=/api/pushes/1/complete1028--- PASS: TestPush_CompleteCommitsEveryRoot (2.48s)1029=== CONT TestReadProxyHead10302026-10-01 08:35:16.702 UTC [99118] ERROR: relation "goose_db_version" does not exist at character 3610312026-10-01 08:35:16.702 UTC [99118] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC10322026/10/01 08:35:16 OK 20241026095416_initial_model.sql (68.61ms)10332026/10/01 08:35:16 OK 20251210153512_drop_unused_gin_index.sql (8.78ms)10342026/10/01 08:35:16 OK 20251218171726_add_pins.sql (14.03ms)10352026/10/01 08:35:16 OK 20260628120000_add_object_size_and_stats.sql (14.5ms)10362026/10/01 08:35:16 OK 20260905000000_add_claims.sql (27.71ms)10372026/10/01 08:35:16 OK 20260920000000_drop_claims.sql (25.65ms)10382026/10/01 08:35:16 INFO Received push request method=POST path=/api/pushes10392026/10/01 08:35:16 OK 20260923120000_add_pushes.sql (10.5ms)10402026/10/01 08:35:16 goose: successfully migrated database to version: 2026092312000010412026/10/01 08:35:16 OK 1_commit_pending_closure.sql (4.6ms)10422026/10/01 08:35:16 OK 2_object_stats_trigger.sql (618.38µs)10432026/10/01 08:35:16 OK 3_commit_push.sql (513.92µs)10442026/10/01 08:35:16 goose: up to current file version: 310452026/10/01 08:35:16 OK 20241026095416_initial_model.sql (105.43ms)10462026/10/01 08:35:16 OK 20251210153512_drop_unused_gin_index.sql (27.04ms)10472026/10/01 08:35:16 OK 20251218171726_add_pins.sql (39.87ms)1048--- PASS: TestPush_OverlappingRootsStoreOneRowPerKey (2.47s)1049=== CONT TestReadProxyInvalidPath10502026/10/01 08:35:16 OK 20260628120000_add_object_size_and_stats.sql (29.55ms)10512026/10/01 08:35:16 OK 20260905000000_add_claims.sql (17.45ms)10522026/10/01 08:35:16 OK 20260920000000_drop_claims.sql (11.14ms)10532026/10/01 08:35:16 OK 20260923120000_add_pushes.sql (14.64ms)10542026/10/01 08:35:16 goose: successfully migrated database to version: 2026092312000010552026/10/01 08:35:16 OK 1_commit_pending_closure.sql (2.39ms)10562026/10/01 08:35:16 OK 2_object_stats_trigger.sql (722.42µs)10572026/10/01 08:35:16 OK 3_commit_push.sql (345.71µs)10582026/10/01 08:35:16 goose: up to current file version: 310592026-10-01 08:35:17.059 UTC [99124] ERROR: relation "goose_db_version" does not exist at character 3610602026-10-01 08:35:17.059 UTC [99124] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC1061--- PASS: TestReadRedirectUsesPublicS3URL (2.21s)1062=== CONT TestReadProxy40410632026-10-01 08:35:17.095 UTC [99125] ERROR: relation "goose_db_version" does not exist at character 3610642026-10-01 08:35:17.095 UTC [99125] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC10652026-10-01 08:35:17.222 UTC [99129] ERROR: relation "goose_db_version" does not exist at character 3610662026-10-01 08:35:17.222 UTC [99129] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC10672026/10/01 08:35:17 OK 20241026095416_initial_model.sql (135.35ms)10682026/10/01 08:35:17 OK 20251210153512_drop_unused_gin_index.sql (11.96ms)10692026/10/01 08:35:17 OK 20251218171726_add_pins.sql (10.37ms)10702026/10/01 08:35:17 OK 20241026095416_initial_model.sql (128.42ms)10712026/10/01 08:35:17 OK 20251210153512_drop_unused_gin_index.sql (8.3ms)10722026/10/01 08:35:17 OK 20260628120000_add_object_size_and_stats.sql (29.83ms)10732026/10/01 08:35:17 OK 20251218171726_add_pins.sql (17.29ms)1074--- PASS: TestReadProxyRangeRequest (2.32s)1075=== CONT TestReadProxyNarStreaming10762026/10/01 08:35:17 OK 20260905000000_add_claims.sql (30.35ms)10772026/10/01 08:35:17 OK 20260628120000_add_object_size_and_stats.sql (17.62ms)10782026/10/01 08:35:17 OK 20260920000000_drop_claims.sql (16.23ms)10792026/10/01 08:35:17 OK 20260923120000_add_pushes.sql (8.62ms)10802026/10/01 08:35:17 goose: successfully migrated database to version: 2026092312000010812026/10/01 08:35:17 OK 1_commit_pending_closure.sql (1.59ms)10822026/10/01 08:35:17 OK 2_object_stats_trigger.sql (361.13µs)10832026/10/01 08:35:17 OK 3_commit_push.sql (297.92µs)10842026/10/01 08:35:17 goose: up to current file version: 310852026/10/01 08:35:17 OK 20241026095416_initial_model.sql (72.46ms)10862026/10/01 08:35:17 OK 20260905000000_add_claims.sql (29.79ms)10872026/10/01 08:35:17 OK 20251210153512_drop_unused_gin_index.sql (6.75ms)10882026/10/01 08:35:17 OK 20260920000000_drop_claims.sql (14.44ms)10892026/10/01 08:35:17 OK 20251218171726_add_pins.sql (8.21ms)10902026/10/01 08:35:17 OK 20260923120000_add_pushes.sql (11.97ms)10912026/10/01 08:35:17 goose: successfully migrated database to version: 2026092312000010922026/10/01 08:35:17 OK 1_commit_pending_closure.sql (2.47ms)10932026/10/01 08:35:17 OK 2_object_stats_trigger.sql (383.38µs)10942026/10/01 08:35:17 OK 3_commit_push.sql (435.33µs)10952026/10/01 08:35:17 goose: up to current file version: 310962026/10/01 08:35:17 OK 20260628120000_add_object_size_and_stats.sql (19.73ms)10972026/10/01 08:35:17 OK 20260905000000_add_claims.sql (20.97ms)10982026/10/01 08:35:17 OK 20260920000000_drop_claims.sql (13.64ms)10992026/10/01 08:35:17 OK 20260923120000_add_pushes.sql (13.8ms)11002026/10/01 08:35:17 goose: successfully migrated database to version: 2026092312000011012026/10/01 08:35:17 OK 1_commit_pending_closure.sql (2.95ms)11022026/10/01 08:35:17 OK 2_object_stats_trigger.sql (551.13µs)11032026/10/01 08:35:17 OK 3_commit_push.sql (322.96µs)11042026/10/01 08:35:17 goose: up to current file version: 31105--- PASS: TestReadRedirectNar (2.03s)1106=== CONT TestReadProxyNarinfoAlreadyDecompressed1107--- PASS: TestReadRedirectKeepsNarinfoProxied (2.30s)1108=== CONT TestReadProxyNarinfo11092026-10-01 08:35:17.787 UTC [99135] ERROR: relation "goose_db_version" does not exist at character 3611102026-10-01 08:35:17.787 UTC [99135] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC11112026-10-01 08:35:17.802 UTC [99134] ERROR: relation "goose_db_version" does not exist at character 3611122026-10-01 08:35:17.802 UTC [99134] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC11132026/10/01 08:35:17 OK 20241026095416_initial_model.sql (88.45ms)11142026/10/01 08:35:17 OK 20241026095416_initial_model.sql (81.36ms)11152026-10-01 08:35:17.942 UTC [99138] ERROR: relation "goose_db_version" does not exist at character 3611162026-10-01 08:35:17.942 UTC [99138] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC11172026/10/01 08:35:17 OK 20251210153512_drop_unused_gin_index.sql (11.11ms)11182026/10/01 08:35:17 OK 20251210153512_drop_unused_gin_index.sql (11.01ms)11192026/10/01 08:35:17 OK 20251218171726_add_pins.sql (27.57ms)11202026/10/01 08:35:17 OK 20251218171726_add_pins.sql (27.69ms)1121--- PASS: TestReadProxyDisabled (2.04s)1122=== CONT TestIsValidCachePath1123=== RUN TestIsValidCachePath/narinfo1124=== PAUSE TestIsValidCachePath/narinfo1125=== RUN TestIsValidCachePath/narinfo_all_nix_base32_chars1126=== PAUSE TestIsValidCachePath/narinfo_all_nix_base32_chars1127=== RUN TestIsValidCachePath/nar_zst1128=== PAUSE TestIsValidCachePath/nar_zst1129=== RUN TestIsValidCachePath/nar_xz1130=== PAUSE TestIsValidCachePath/nar_xz1131=== RUN TestIsValidCachePath/nar_bz21132=== PAUSE TestIsValidCachePath/nar_bz21133=== RUN TestIsValidCachePath/nar_uncompressed1134=== PAUSE TestIsValidCachePath/nar_uncompressed1135=== RUN TestIsValidCachePath/ls1136=== PAUSE TestIsValidCachePath/ls1137=== RUN TestIsValidCachePath/log1138=== PAUSE TestIsValidCachePath/log1139=== RUN TestIsValidCachePath/realisation1140=== PAUSE TestIsValidCachePath/realisation1141=== RUN TestIsValidCachePath/nix-cache-info1142=== PAUSE TestIsValidCachePath/nix-cache-info1143=== RUN TestIsValidCachePath/index.html1144=== PAUSE TestIsValidCachePath/index.html1145=== RUN TestIsValidCachePath/traversal_parent1146=== PAUSE TestIsValidCachePath/traversal_parent1147=== RUN TestIsValidCachePath/traversal_in_middle1148=== PAUSE TestIsValidCachePath/traversal_in_middle1149=== RUN TestIsValidCachePath/invalid_char_e1150=== PAUSE TestIsValidCachePath/invalid_char_e1151=== RUN TestIsValidCachePath/invalid_char_u1152=== PAUSE TestIsValidCachePath/invalid_char_u1153=== RUN TestIsValidCachePath/random_path1154=== PAUSE TestIsValidCachePath/random_path1155=== RUN TestIsValidCachePath/empty1156=== PAUSE TestIsValidCachePath/empty1157=== RUN TestIsValidCachePath/leading_slash1158=== PAUSE TestIsValidCachePath/leading_slash1159=== RUN TestIsValidCachePath/wrong_extension1160=== PAUSE TestIsValidCachePath/wrong_extension1161=== RUN TestIsValidCachePath/short_hash1162=== PAUSE TestIsValidCachePath/short_hash1163=== CONT TestProxyHeadersOnlyTrustedOnSocket11642026/10/01 08:35:17 OK 20260628120000_add_object_size_and_stats.sql (15.44ms)11652026/10/01 08:35:17 OK 20260628120000_add_object_size_and_stats.sql (22.24ms)11662026/10/01 08:35:18 OK 20260905000000_add_claims.sql (25.69ms)11672026/10/01 08:35:18 OK 20260905000000_add_claims.sql (32.54ms)11682026/10/01 08:35:18 OK 20260920000000_drop_claims.sql (3.44ms)11692026/10/01 08:35:18 OK 20260920000000_drop_claims.sql (3.48ms)11702026/10/01 08:35:18 OK 20260923120000_add_pushes.sql (1.97ms)11712026/10/01 08:35:18 goose: successfully migrated database to version: 2026092312000011722026/10/01 08:35:18 OK 20260923120000_add_pushes.sql (2.09ms)11732026/10/01 08:35:18 goose: successfully migrated database to version: 2026092312000011742026/10/01 08:35:18 OK 1_commit_pending_closure.sql (2.07ms)11752026/10/01 08:35:18 OK 1_commit_pending_closure.sql (1.78ms)11762026/10/01 08:35:18 OK 2_object_stats_trigger.sql (461.67µs)11772026/10/01 08:35:18 OK 2_object_stats_trigger.sql (495.04µs)11782026/10/01 08:35:18 OK 3_commit_push.sql (523.96µs)11792026/10/01 08:35:18 goose: up to current file version: 311802026/10/01 08:35:18 OK 3_commit_push.sql (599.71µs)11812026/10/01 08:35:18 goose: up to current file version: 311822026/10/01 08:35:18 OK 20241026095416_initial_model.sql (45.51ms)11832026/10/01 08:35:18 OK 20251210153512_drop_unused_gin_index.sql (831.63µs)11842026-10-01 08:35:18.040 UTC [99141] ERROR: relation "goose_db_version" does not exist at character 3611852026-10-01 08:35:18.040 UTC [99141] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC11862026/10/01 08:35:18 OK 20251218171726_add_pins.sql (15.85ms)11872026/10/01 08:35:18 OK 20260628120000_add_object_size_and_stats.sql (27.94ms)11882026/10/01 08:35:18 OK 20260905000000_add_claims.sql (19.84ms)11892026/10/01 08:35:18 OK 20260920000000_drop_claims.sql (16.01ms)11902026/10/01 08:35:18 OK 20260923120000_add_pushes.sql (2.77ms)11912026/10/01 08:35:18 goose: successfully migrated database to version: 2026092312000011922026/10/01 08:35:18 OK 1_commit_pending_closure.sql (3.08ms)11932026/10/01 08:35:18 OK 2_object_stats_trigger.sql (472.17µs)11942026/10/01 08:35:18 OK 3_commit_push.sql (375.13µs)11952026/10/01 08:35:18 goose: up to current file version: 311962026/10/01 08:35:18 OK 20241026095416_initial_model.sql (71.12ms)11972026/10/01 08:35:18 OK 20251210153512_drop_unused_gin_index.sql (9.39ms)11982026-10-01 08:35:18.164 UTC [99142] ERROR: relation "goose_db_version" does not exist at character 3611992026-10-01 08:35:18.164 UTC [99142] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC12002026/10/01 08:35:18 OK 20251218171726_add_pins.sql (20.08ms)12012026/10/01 08:35:18 OK 20260628120000_add_object_size_and_stats.sql (16.59ms)12022026/10/01 08:35:18 OK 20260905000000_add_claims.sql (28.6ms)1203--- PASS: TestReadProxyRootRedirectsToIndexHTML (1.72s)1204=== CONT TestParseSingleRange1205=== RUN TestParseSingleRange/none1206=== PAUSE TestParseSingleRange/none1207=== RUN TestParseSingleRange/unknown_unit1208=== PAUSE TestParseSingleRange/unknown_unit1209=== RUN TestParseSingleRange/multi-range_ignored1210=== PAUSE TestParseSingleRange/multi-range_ignored1211=== RUN TestParseSingleRange/malformed_no_dash1212=== PAUSE TestParseSingleRange/malformed_no_dash1213=== RUN TestParseSingleRange/malformed_both_empty1214=== PAUSE TestParseSingleRange/malformed_both_empty1215=== RUN TestParseSingleRange/malformed_end_before_start1216=== PAUSE TestParseSingleRange/malformed_end_before_start1217=== RUN TestParseSingleRange/closed1218=== PAUSE TestParseSingleRange/closed1219=== RUN TestParseSingleRange/open-ended1220=== PAUSE TestParseSingleRange/open-ended1221=== RUN TestParseSingleRange/end_clamped_to_size1222=== PAUSE TestParseSingleRange/end_clamped_to_size1223=== RUN TestParseSingleRange/suffix1224=== PAUSE TestParseSingleRange/suffix1225=== RUN TestParseSingleRange/suffix_exceeds_size1226=== PAUSE TestParseSingleRange/suffix_exceeds_size1227=== RUN TestParseSingleRange/single_byte1228=== PAUSE TestParseSingleRange/single_byte1229=== RUN TestParseSingleRange/start_past_EOF1230=== PAUSE TestParseSingleRange/start_past_EOF1231=== RUN TestParseSingleRange/start_far_past_EOF1232=== PAUSE TestParseSingleRange/start_far_past_EOF1233=== CONT TestCreatePin_ReservedPins12342026/10/01 08:35:18 OK 20260920000000_drop_claims.sql (23.79ms)12352026/10/01 08:35:18 OK 20260923120000_add_pushes.sql (17.09ms)12362026/10/01 08:35:18 goose: successfully migrated database to version: 2026092312000012372026/10/01 08:35:18 OK 1_commit_pending_closure.sql (1.95ms)12382026/10/01 08:35:18 OK 2_object_stats_trigger.sql (400.75µs)12392026/10/01 08:35:18 OK 3_commit_push.sql (330.17µs)12402026/10/01 08:35:18 goose: up to current file version: 312412026/10/01 08:35:18 OK 20241026095416_initial_model.sql (102.46ms)12422026/10/01 08:35:18 OK 20251210153512_drop_unused_gin_index.sql (7.01ms)12432026/10/01 08:35:18 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:61624/oidc12442026/10/01 08:35:18 OK 20251218171726_add_pins.sql (7.27ms)12452026/10/01 08:35:18 OK 20260628120000_add_object_size_and_stats.sql (12.89ms)12462026/10/01 08:35:18 OK 20260905000000_add_claims.sql (17.56ms)12472026/10/01 08:35:18 OK 20260920000000_drop_claims.sql (8.34ms)12482026/10/01 08:35:18 OK 20260923120000_add_pushes.sql (2.65ms)12492026/10/01 08:35:18 goose: successfully migrated database to version: 2026092312000012502026/10/01 08:35:18 OK 1_commit_pending_closure.sql (895.92µs)12512026/10/01 08:35:18 OK 2_object_stats_trigger.sql (218.92µs)12522026/10/01 08:35:18 OK 3_commit_push.sql (158.5µs)12532026/10/01 08:35:18 goose: up to current file version: 312542026-10-01 08:35:18.382 UTC [99145] ERROR: relation "goose_db_version" does not exist at character 3612552026-10-01 08:35:18.382 UTC [99145] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC1256--- PASS: TestReadProxyConditionalGet (1.89s)1257=== CONT TestOrphanedObjectsGCStressTest12582026-10-01 08:35:18.556 UTC [99148] ERROR: relation "goose_db_version" does not exist at character 3612592026-10-01 08:35:18.556 UTC [99148] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC12602026/10/01 08:35:18 OK 20241026095416_initial_model.sql (148.74ms)12612026/10/01 08:35:18 OK 20251210153512_drop_unused_gin_index.sql (1.56ms)12622026/10/01 08:35:18 OK 20251218171726_add_pins.sql (12.7ms)12632026/10/01 08:35:18 OK 20260628120000_add_object_size_and_stats.sql (49.62ms)12642026/10/01 08:35:18 OK 20260905000000_add_claims.sql (38.69ms)1265--- PASS: TestReadProxyHead (2.03s)1266=== CONT TestOrphanedObjectsGC12672026/10/01 08:35:18 OK 20260920000000_drop_claims.sql (61.83ms)12682026/10/01 08:35:18 OK 20260923120000_add_pushes.sql (27.3ms)12692026/10/01 08:35:18 goose: successfully migrated database to version: 2026092312000012702026/10/01 08:35:18 OK 1_commit_pending_closure.sql (2.12ms)12712026/10/01 08:35:18 OK 2_object_stats_trigger.sql (457.17µs)12722026/10/01 08:35:18 OK 3_commit_push.sql (409.17µs)12732026/10/01 08:35:18 goose: up to current file version: 312742026/10/01 08:35:18 OK 20241026095416_initial_model.sql (208.67ms)12752026/10/01 08:35:18 OK 20251210153512_drop_unused_gin_index.sql (7.95ms)12762026/10/01 08:35:18 OK 20251218171726_add_pins.sql (24.21ms)12772026/10/01 08:35:18 OK 20260628120000_add_object_size_and_stats.sql (45.75ms)12782026/10/01 08:35:18 OK 20260905000000_add_claims.sql (62.62ms)1279--- PASS: TestReadProxyInvalidPath (2.09s)1280=== CONT TestObjectStatsTrigger12812026/10/01 08:35:19 OK 20260920000000_drop_claims.sql (35.73ms)12822026/10/01 08:35:19 OK 20260923120000_add_pushes.sql (35.19ms)12832026/10/01 08:35:19 goose: successfully migrated database to version: 2026092312000012842026/10/01 08:35:19 OK 1_commit_pending_closure.sql (3.86ms)12852026/10/01 08:35:19 OK 2_object_stats_trigger.sql (687.04µs)12862026/10/01 08:35:19 OK 3_commit_push.sql (399.33µs)12872026/10/01 08:35:19 goose: up to current file version: 31288--- PASS: TestReadProxy404 (2.22s)1289=== CONT TestMultipartCleanup12902026-10-01 08:35:19.397 UTC [99153] ERROR: relation "goose_db_version" does not exist at character 3612912026-10-01 08:35:19.397 UTC [99153] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC12922026-10-01 08:35:19.590 UTC [99156] ERROR: relation "goose_db_version" does not exist at character 3612932026-10-01 08:35:19.590 UTC [99156] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC1294--- PASS: TestReadProxyNarStreaming (2.31s)1295=== CONT TestServerTLSConfig1296=== RUN TestServerTLSConfig/no_client_CA1297=== PAUSE TestServerTLSConfig/no_client_CA1298=== RUN TestServerTLSConfig/missing_CA_file1299=== PAUSE TestServerTLSConfig/missing_CA_file1300=== RUN TestServerTLSConfig/not_a_PEM_file1301=== PAUSE TestServerTLSConfig/not_a_PEM_file1302=== CONT TestService_NativeMTLS13032026/10/01 08:35:19 OK 20241026095416_initial_model.sql (191.42ms)13042026/10/01 08:35:19 OK 20251210153512_drop_unused_gin_index.sql (13.56ms)13052026/10/01 08:35:19 OK 20251218171726_add_pins.sql (31.24ms)13062026/10/01 08:35:19 OK 20260628120000_add_object_size_and_stats.sql (39.33ms)13072026/10/01 08:35:19 OK 20260905000000_add_claims.sql (53.33ms)13082026/10/01 08:35:19 OK 20260920000000_drop_claims.sql (34.96ms)13092026/10/01 08:35:19 OK 20260923120000_add_pushes.sql (29.02ms)13102026/10/01 08:35:19 goose: successfully migrated database to version: 2026092312000013112026/10/01 08:35:19 OK 1_commit_pending_closure.sql (6.64ms)13122026/10/01 08:35:19 OK 2_object_stats_trigger.sql (1.05ms)13132026/10/01 08:35:19 OK 3_commit_push.sql (739.29µs)13142026/10/01 08:35:19 goose: up to current file version: 313152026/10/01 08:35:19 OK 20241026095416_initial_model.sql (214.88ms)13162026/10/01 08:35:19 OK 20251210153512_drop_unused_gin_index.sql (7.99ms)13172026/10/01 08:35:19 OK 20251218171726_add_pins.sql (21.12ms)13182026/10/01 08:35:19 OK 20260628120000_add_object_size_and_stats.sql (33.33ms)13192026/10/01 08:35:19 WARN Rate limiter enabled after throttle name=s3-test rate=513202026/10/01 08:35:19 WARN S3 rate limit hit operation="complete multipart upload" error="Please reduce your request rate."1321=== NAME TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle1322 throttle_test.go:213: Proxy stats: total=13, throttled=10, completeMultipart=101323 throttle_test.go:215: Rate limiter: enabled=true, rate=5.001324--- PASS: TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle (6.94s)1325=== CONT TestMetricsInventory1326--- PASS: TestReadProxyNarinfoAlreadyDecompressed (2.42s)1327=== CONT TestNARDeduplicationMetadataUploadBug13282026/10/01 08:35:20 OK 20260905000000_add_claims.sql (177.86ms)13292026/10/01 08:35:20 OK 20260920000000_drop_claims.sql (65.07ms)13302026/10/01 08:35:20 OK 20260923120000_add_pushes.sql (16.09ms)13312026/10/01 08:35:20 goose: successfully migrated database to version: 2026092312000013322026/10/01 08:35:20 OK 1_commit_pending_closure.sql (5.18ms)13332026/10/01 08:35:20 OK 2_object_stats_trigger.sql (1.17ms)13342026/10/01 08:35:20 OK 3_commit_push.sql (698.08µs)13352026/10/01 08:35:20 goose: up to current file version: 31336--- PASS: TestReadProxyNarinfo (2.52s)1337=== CONT TestCreatePendingClosureRejectsOversizedNAR13382026/10/01 08:35:20 INFO Received uploads request method=POST path=/api/pending_closures1339--- PASS: TestCreatePendingClosureRejectsOversizedNAR (0.00s)1340=== CONT TestCacheConfigHandlerMaxNarSize1341--- PASS: TestCacheConfigHandlerMaxNarSize (0.00s)1342=== CONT TestGenerateLandingPage1343--- PASS: TestGenerateLandingPage (0.00s)1344=== CONT TestService_readinessHandler13452026-10-01 08:35:20.394 UTC [99164] ERROR: relation "goose_db_version" does not exist at character 3613462026-10-01 08:35:20.394 UTC [99164] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC13472026-10-01 08:35:20.573 UTC [99166] ERROR: relation "goose_db_version" does not exist at character 3613482026-10-01 08:35:20.573 UTC [99166] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC13492026/10/01 08:35:20 OK 20241026095416_initial_model.sql (152.49ms)13502026/10/01 08:35:20 INFO Starting HTTP server address=127.0.0.1:6165613512026/10/01 08:35:20 INFO Starting HTTP server address=/nix/var/nix/builds/nix-98979-578903465/TestProxyHeadersOnlyTrustedOnSocket2183922736/001/proxy.sock13522026/10/01 08:35:20 WARN mTLS auth: subject not in bound subjects subject="CN=someone"13532026/10/01 08:35:20 INFO Shutdown signal received, draining in-flight requests timeout=10s13542026/10/01 08:35:20 OK 20251210153512_drop_unused_gin_index.sql (17.12ms)1355--- PASS: TestProxyHeadersOnlyTrustedOnSocket (2.67s)1356=== CONT TestService_healthCheckHandler13572026/10/01 08:35:20 OK 20251218171726_add_pins.sql (30.17ms)13582026/10/01 08:35:20 OK 20260628120000_add_object_size_and_stats.sql (41.61ms)13592026/10/01 08:35:20 OK 20260905000000_add_claims.sql (12.38ms)13602026/10/01 08:35:20 OK 20260920000000_drop_claims.sql (2.93ms)13612026/10/01 08:35:20 OK 20241026095416_initial_model.sql (110.49ms)13622026/10/01 08:35:20 OK 20251210153512_drop_unused_gin_index.sql (1.08ms)13632026/10/01 08:35:20 OK 20260923120000_add_pushes.sql (6.83ms)13642026/10/01 08:35:20 goose: successfully migrated database to version: 2026092312000013652026/10/01 08:35:20 OK 20251218171726_add_pins.sql (2.25ms)13662026-10-01 08:35:20.740 UTC [99169] ERROR: relation "goose_db_version" does not exist at character 3613672026-10-01 08:35:20.740 UTC [99169] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC13682026/10/01 08:35:20 OK 1_commit_pending_closure.sql (1.98ms)13692026/10/01 08:35:20 OK 2_object_stats_trigger.sql (377.58µs)13702026/10/01 08:35:20 OK 3_commit_push.sql (351.79µs)13712026/10/01 08:35:20 goose: up to current file version: 313722026/10/01 08:35:20 OK 20260628120000_add_object_size_and_stats.sql (15.3ms)13732026/10/01 08:35:20 OK 20260905000000_add_claims.sql (54.01ms)13742026/10/01 08:35:20 OK 20260920000000_drop_claims.sql (25.08ms)13752026/10/01 08:35:20 OK 20260923120000_add_pushes.sql (8.67ms)13762026/10/01 08:35:20 goose: successfully migrated database to version: 2026092312000013772026/10/01 08:35:20 OK 1_commit_pending_closure.sql (2.8ms)13782026/10/01 08:35:20 OK 2_object_stats_trigger.sql (583.5µs)13792026/10/01 08:35:20 OK 3_commit_push.sql (424.96µs)13802026/10/01 08:35:20 goose: up to current file version: 313812026-10-01 08:35:20.973 UTC [99170] ERROR: relation "goose_db_version" does not exist at character 3613822026-10-01 08:35:20.973 UTC [99170] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC13832026/10/01 08:35:20 OK 20241026095416_initial_model.sql (195.62ms)13842026/10/01 08:35:21 OK 20251210153512_drop_unused_gin_index.sql (9.85ms)13852026/10/01 08:35:21 OK 20251218171726_add_pins.sql (27.71ms)13862026/10/01 08:35:21 INFO Received create pin request method=POST path=/api/pins/worker-x86_64-linux13872026/10/01 08:35:21 WARN Refused reserved pin name=worker-x86_64-linux13882026/10/01 08:35:21 INFO Received create pin request method=POST path=/api/pins/worker-x86_64-linux13892026/10/01 08:35:21 INFO Received create pin request method=POST path=/api/pins/my-app13902026/10/01 08:35:21 INFO Received create pin request method=POST path=/api/pins/worker-x86_64-linux1391--- PASS: TestCreatePin_ReservedPins (2.81s)1392=== CONT TestGracefulShutdownDrainsInflight13932026/10/01 08:35:21 INFO Starting HTTP server address=127.0.0.1:6166313942026/10/01 08:35:21 INFO Shutdown signal received, draining in-flight requests timeout=10s13952026/10/01 08:35:21 OK 20260628120000_add_object_size_and_stats.sql (44.16ms)13962026/10/01 08:35:21 OK 20260905000000_add_claims.sql (50.07ms)1397--- PASS: TestGracefulShutdownDrainsInflight (0.07s)1398=== CONT TestGCTaskStore_Fail1399--- PASS: TestGCTaskStore_Fail (0.00s)1400=== CONT TestGCTaskStore_PhaseUpdates1401--- PASS: TestGCTaskStore_PhaseUpdates (0.00s)1402=== CONT TestGCTaskStore_CompletedAllowsNewTask1403--- PASS: TestGCTaskStore_CompletedAllowsNewTask (0.00s)1404=== CONT TestGCTaskStore_GetReturnsLatest1405--- PASS: TestGCTaskStore_GetReturnsLatest (0.00s)1406=== CONT TestLeadEndsOnShutdown14072026/10/01 08:35:21 OK 20260920000000_drop_claims.sql (39.81ms)14082026/10/01 08:35:21 OK 20260923120000_add_pushes.sql (9.15ms)14092026/10/01 08:35:21 goose: successfully migrated database to version: 2026092312000014102026/10/01 08:35:21 OK 1_commit_pending_closure.sql (3.23ms)14112026/10/01 08:35:21 OK 2_object_stats_trigger.sql (533.54µs)14122026/10/01 08:35:21 OK 3_commit_push.sql (615.13µs)14132026/10/01 08:35:21 goose: up to current file version: 314142026/10/01 08:35:21 OK 20241026095416_initial_model.sql (176.75ms)14152026/10/01 08:35:21 OK 20251210153512_drop_unused_gin_index.sql (13.91ms)14162026/10/01 08:35:21 OK 20251218171726_add_pins.sql (35.63ms)14172026/10/01 08:35:21 OK 20260628120000_add_object_size_and_stats.sql (35.68ms)14182026/10/01 08:35:21 OK 20260905000000_add_claims.sql (74.63ms)14192026/10/01 08:35:21 OK 20260920000000_drop_claims.sql (45.38ms)14202026-10-01 08:35:21.440 UTC [99173] ERROR: relation "goose_db_version" does not exist at character 3614212026-10-01 08:35:21.440 UTC [99173] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC14222026/10/01 08:35:21 OK 20260923120000_add_pushes.sql (48.55ms)14232026/10/01 08:35:21 goose: successfully migrated database to version: 2026092312000014242026/10/01 08:35:21 OK 1_commit_pending_closure.sql (4.18ms)14252026/10/01 08:35:21 OK 2_object_stats_trigger.sql (904.71µs)14262026/10/01 08:35:21 OK 3_commit_push.sql (698.83µs)14272026/10/01 08:35:21 goose: up to current file version: 314282026/10/01 08:35:21 OK 20241026095416_initial_model.sql (203.69ms)14292026/10/01 08:35:21 OK 20251210153512_drop_unused_gin_index.sql (11.78ms)14302026/10/01 08:35:21 OK 20251218171726_add_pins.sql (32.42ms)14312026/10/01 08:35:21 OK 20260628120000_add_object_size_and_stats.sql (40.01ms)14322026/10/01 08:35:21 OK 20260905000000_add_claims.sql (62.08ms)14332026/10/01 08:35:21 OK 20260920000000_drop_claims.sql (39.47ms)14342026/10/01 08:35:21 OK 20260923120000_add_pushes.sql (14.53ms)14352026/10/01 08:35:21 goose: successfully migrated database to version: 2026092312000014362026/10/01 08:35:21 OK 1_commit_pending_closure.sql (5.44ms)14372026/10/01 08:35:21 OK 2_object_stats_trigger.sql (1.41ms)14382026/10/01 08:35:21 OK 3_commit_push.sql (585.33µs)14392026/10/01 08:35:21 goose: up to current file version: 314402026-10-01 08:35:22.017 UTC [99174] ERROR: relation "goose_db_version" does not exist at character 3614412026-10-01 08:35:22.017 UTC [99174] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC1442--- PASS: TestObjectStatsTrigger (3.11s)1443=== CONT TestGCTaskStore_ConflictDifferentParams1444--- PASS: TestGCTaskStore_ConflictDifferentParams (0.00s)1445=== CONT TestGCTaskStore_DeduplicateSameParams1446--- PASS: TestGCTaskStore_DeduplicateSameParams (0.00s)1447=== CONT TestGCTaskStore_StartNew1448--- PASS: TestGCTaskStore_StartNew (0.00s)1449=== CONT TestCommitRacingPendingCleanupKeepsObjects14502026-10-01 08:35:22.196 UTC [99177] ERROR: relation "goose_db_version" does not exist at character 3614512026-10-01 08:35:22.196 UTC [99177] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC14522026-10-01 08:35:22.252 UTC [99178] ERROR: relation "goose_db_version" does not exist at character 3614532026-10-01 08:35:22.252 UTC [99178] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC14542026/10/01 08:35:22 OK 20241026095416_initial_model.sql (179.68ms)14552026/10/01 08:35:22 OK 20251210153512_drop_unused_gin_index.sql (15.6ms)14562026/10/01 08:35:22 OK 20251218171726_add_pins.sql (92.25ms)14572026/10/01 08:35:22 INFO Received uploads request method=POST path=/api/pending_closures14582026/10/01 08:35:22 OK 20260628120000_add_object_size_and_stats.sql (34.79ms)14592026/10/01 08:35:22 OK 20260905000000_add_claims.sql (34.5ms)14602026/10/01 08:35:22 OK 20241026095416_initial_model.sql (176.02ms)14612026/10/01 08:35:22 OK 20251210153512_drop_unused_gin_index.sql (9ms)14622026/10/01 08:35:22 OK 20260920000000_drop_claims.sql (16.6ms)14632026/10/01 08:35:22 OK 20260923120000_add_pushes.sql (9.05ms)14642026/10/01 08:35:22 goose: successfully migrated database to version: 2026092312000014652026/10/01 08:35:22 OK 1_commit_pending_closure.sql (3.27ms)14662026/10/01 08:35:22 OK 2_object_stats_trigger.sql (2ms)14672026/10/01 08:35:22 OK 20251218171726_add_pins.sql (16.65ms)14682026/10/01 08:35:22 OK 3_commit_push.sql (2.08ms)14692026/10/01 08:35:22 goose: up to current file version: 314702026-10-01 08:35:22.468 UTC [99179] ERROR: relation "goose_db_version" does not exist at character 3614712026-10-01 08:35:22.468 UTC [99179] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC14722026/10/01 08:35:22 OK 20241026095416_initial_model.sql (96.36ms)14732026/10/01 08:35:22 OK 20251210153512_drop_unused_gin_index.sql (7.03ms)14742026/10/01 08:35:22 OK 20260628120000_add_object_size_and_stats.sql (21.03ms)14752026/10/01 08:35:22 OK 20251218171726_add_pins.sql (35.13ms)1476=== NAME TestOrphanedObjectsGC1477 orphaned_objects_gc_test.go:290: GC Test Summary:1478 orphaned_objects_gc_test.go:291: - Kept: 2 objects from closure A1479 orphaned_objects_gc_test.go:292: - Deleted: 2 objects from closure B1480 orphaned_objects_gc_test.go:293: - Deleted: 6 orphaned chain objects (X1->X2->X3)1481 orphaned_objects_gc_test.go:294: - Deleted: 2 orphaned single objects (Y)1482 orphaned_objects_gc_test.go:295: - Total deleted: 10 objects1483--- PASS: TestOrphanedObjectsGC (3.80s)1484=== CONT TestPushWaitsForSweepHoldingRow14852026/10/01 08:35:22 OK 20260905000000_add_claims.sql (53.74ms)14862026/10/01 08:35:22 INFO Received cleanup request method=DELETE path=/api/pending_closures14872026/10/01 08:35:22 OK 20260628120000_add_object_size_and_stats.sql (28.73ms)14882026/10/01 08:35:22 INFO Aborted multipart uploads count=114892026/10/01 08:35:22 OK 20260920000000_drop_claims.sql (31.33ms)1490--- PASS: TestMultipartCleanup (3.26s)1491=== CONT TestSweepRechecksPendingAfterLocking14922026/10/01 08:35:22 OK 20260923120000_add_pushes.sql (10.17ms)14932026/10/01 08:35:22 goose: successfully migrated database to version: 2026092312000014942026/10/01 08:35:22 OK 1_commit_pending_closure.sql (1.44ms)14952026/10/01 08:35:22 OK 2_object_stats_trigger.sql (340.21µs)14962026/10/01 08:35:22 OK 3_commit_push.sql (286.75µs)14972026/10/01 08:35:22 goose: up to current file version: 314982026/10/01 08:35:22 OK 20260905000000_add_claims.sql (60.85ms)14992026/10/01 08:35:22 OK 20260920000000_drop_claims.sql (36.62ms)15002026/10/01 08:35:22 OK 20260923120000_add_pushes.sql (17.05ms)15012026/10/01 08:35:22 goose: successfully migrated database to version: 2026092312000015022026/10/01 08:35:22 OK 1_commit_pending_closure.sql (2.64ms)15032026/10/01 08:35:22 OK 2_object_stats_trigger.sql (444.79µs)15042026/10/01 08:35:22 OK 3_commit_push.sql (414.5µs)15052026/10/01 08:35:22 goose: up to current file version: 315062026-10-01 08:35:22.708 UTC [99184] ERROR: relation "goose_db_version" does not exist at character 3615072026-10-01 08:35:22.708 UTC [99184] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC15082026/10/01 08:35:22 OK 20241026095416_initial_model.sql (183.02ms)15092026/10/01 08:35:22 OK 20251210153512_drop_unused_gin_index.sql (14.94ms)15102026/10/01 08:35:22 WARN mTLS auth: subject not in bound subjects subject="CN=reader"15112026/10/01 08:35:22 WARN mTLS auth: subject not in bound subjects subject="CN=reader"1512--- PASS: TestService_NativeMTLS (3.14s)1513=== CONT TestGetExistingObjectsLocksRows15142026/10/01 08:35:22 OK 20251218171726_add_pins.sql (23.5ms)15152026/10/01 08:35:22 OK 20260628120000_add_object_size_and_stats.sql (37.68ms)15162026/10/01 08:35:22 OK 20260905000000_add_claims.sql (43.9ms)15172026/10/01 08:35:22 OK 20260920000000_drop_claims.sql (26.23ms)15182026/10/01 08:35:22 OK 20260923120000_add_pushes.sql (16.83ms)15192026/10/01 08:35:22 goose: successfully migrated database to version: 2026092312000015202026/10/01 08:35:22 OK 1_commit_pending_closure.sql (4.32ms)15212026/10/01 08:35:22 OK 2_object_stats_trigger.sql (814.13µs)15222026/10/01 08:35:22 OK 3_commit_push.sql (574.46µs)15232026/10/01 08:35:22 goose: up to current file version: 315242026/10/01 08:35:22 OK 20241026095416_initial_model.sql (172.18ms)15252026/10/01 08:35:22 OK 20251210153512_drop_unused_gin_index.sql (16.5ms)15262026/10/01 08:35:22 OK 20251218171726_add_pins.sql (29.68ms)15272026/10/01 08:35:23 OK 20260628120000_add_object_size_and_stats.sql (41.29ms)15282026/10/01 08:35:23 OK 20260905000000_add_claims.sql (56.56ms)1529--- PASS: TestMetricsInventory (3.16s)1530=== CONT TestRegisterCompletedObjectNeedsPendingRow15312026/10/01 08:35:23 OK 20260920000000_drop_claims.sql (41.63ms)15322026/10/01 08:35:23 OK 20260923120000_add_pushes.sql (11.57ms)15332026/10/01 08:35:23 goose: successfully migrated database to version: 2026092312000015342026-10-01 08:35:23.129 UTC [99188] ERROR: relation "goose_db_version" does not exist at character 3615352026-10-01 08:35:23.129 UTC [99188] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC15362026/10/01 08:35:23 OK 1_commit_pending_closure.sql (3.46ms)15372026/10/01 08:35:23 OK 2_object_stats_trigger.sql (629.92µs)15382026/10/01 08:35:23 OK 3_commit_push.sql (386.67µs)15392026/10/01 08:35:23 goose: up to current file version: 315402026/10/01 08:35:23 OK 20241026095416_initial_model.sql (148.05ms)15412026/10/01 08:35:23 OK 20251210153512_drop_unused_gin_index.sql (14.53ms)15422026/10/01 08:35:23 OK 20251218171726_add_pins.sql (18.09ms)15432026/10/01 08:35:23 OK 20260628120000_add_object_size_and_stats.sql (33.46ms)15442026/10/01 08:35:23 OK 20260905000000_add_claims.sql (51.9ms)15452026/10/01 08:35:23 OK 20260920000000_drop_claims.sql (21.48ms)15462026/10/01 08:35:23 OK 20260923120000_add_pushes.sql (22.38ms)15472026/10/01 08:35:23 goose: successfully migrated database to version: 2026092312000015482026/10/01 08:35:23 OK 1_commit_pending_closure.sql (1.24ms)15492026/10/01 08:35:23 OK 2_object_stats_trigger.sql (265.75µs)15502026/10/01 08:35:23 OK 3_commit_push.sql (251.46µs)15512026/10/01 08:35:23 goose: up to current file version: 315522026/10/01 08:35:23 WARN readiness check failed error="closed pool"1553--- PASS: TestService_readinessHandler (3.29s)1554=== CONT TestSweepSkipsRowsLockedByPush1555=== NAME TestNARDeduplicationMetadataUploadBug1556 metadata_upload_test.go:48: First store path: /nix/var/nix/builds/nix-98979-578903465/TestNARDeduplicationMetadataUploadBug3764765549/001/store/bm5ma29pjghg567vbr4nj189i3f328dx-file1.txt15572026/10/01 08:35:23 INFO Received push request method=POST path=/api/pushes15582026/10/01 08:35:23 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)15592026/10/01 08:35:23 INFO Uploading bm5ma29pjghg567vbr4nj189i3f328dx-file1.txt (160B)15602026/10/01 08:35:23 WARN Failed to register uploaded object key=bm5ma29pjghg567vbr4nj189i3f328dx.ls error="server returned 404: 404 page not found\n"15612026/10/01 08:35:23 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign15622026/10/01 08:35:23 WARN Failed to register uploaded object key=nar/1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf.nar.zst error="server returned 404: 404 page not found\n"15632026/10/01 08:35:23 INFO Signed narinfos id=1 count=115642026/10/01 08:35:23 INFO Uploading 1 narinfos15652026/10/01 08:35:23 INFO Received complete push request method=POST path=/api/pushes/1/complete15662026/10/01 08:35:23 WARN Failed to register uploaded object key=bm5ma29pjghg567vbr4nj189i3f328dx.narinfo error="server returned 404: 404 page not found\n"15672026/10/01 08:35:23 INFO Upload complete. (146ms)1568 metadata_upload_test.go:54: Retrieved narinfo from S3:1569 StorePath: /nix/var/nix/builds/nix-98979-578903465/TestNARDeduplicationMetadataUploadBug3764765549/001/store/bm5ma29pjghg567vbr4nj189i3f328dx-file1.txt1570 URL: nar/1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf.nar.zst1571 Compression: zstd1572 NarHash: sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf1573 NarSize: 1601574 References: 1575 CA: fixed:r:sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf1576 metadata_upload_test.go:55: Retrieved .ls file from S3 (compressed size: 77 bytes)1577 metadata_upload_test.go:55: Decompressed .ls content (64 bytes):1578 {"version":1,"root":{"type":"regular","size":44,"narOffset":96}}15792026-10-01 08:35:23.826 UTC [99198] ERROR: relation "goose_db_version" does not exist at character 3615802026-10-01 08:35:23.826 UTC [99198] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC1581--- PASS: TestService_healthCheckHandler (3.21s)1582=== CONT TestFailedS3DeleteKeepsTombstone1583=== NAME TestNARDeduplicationMetadataUploadBug1584 metadata_upload_test.go:64: Second store path (same content): /nix/var/nix/builds/nix-98979-578903465/TestNARDeduplicationMetadataUploadBug3764765549/001/store/ckxgxj7xyyp38z51j23y4ihfsi4fd75w-file2.txt15852026/10/01 08:35:23 INFO Received push request method=POST path=/api/pushes15862026/10/01 08:35:23 INFO Uploading 0 paths to 127.0.0.1 (1 already cached)15872026/10/01 08:35:23 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign15882026/10/01 08:35:23 INFO Signed narinfos id=2 count=115892026/10/01 08:35:23 INFO Uploading 1 narinfos15902026/10/01 08:35:23 WARN Failed to register uploaded object key=ckxgxj7xyyp38z51j23y4ihfsi4fd75w.ls error="server returned 404: 404 page not found\n"15912026/10/01 08:35:24 INFO Received complete push request method=POST path=/api/pushes/2/complete15922026/10/01 08:35:24 WARN Failed to register uploaded object key=ckxgxj7xyyp38z51j23y4ihfsi4fd75w.narinfo error="server returned 404: 404 page not found\n"15932026/10/01 08:35:24 INFO Upload complete. (116ms)1594 metadata_upload_test.go:76: Retrieved narinfo from S3:1595 StorePath: /nix/var/nix/builds/nix-98979-578903465/TestNARDeduplicationMetadataUploadBug3764765549/001/store/ckxgxj7xyyp38z51j23y4ihfsi4fd75w-file2.txt1596 URL: nar/1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf.nar.zst1597 Compression: zstd1598 NarHash: sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf1599 NarSize: 1601600 References: 1601 CA: fixed:r:sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf1602 metadata_upload_test.go:77: Retrieved .ls file from S3 (compressed size: 62 bytes)1603 metadata_upload_test.go:77: Decompressed .ls content (49 bytes):1604 {"version":1,"root":{"type":"regular","size":44}}16052026/10/01 08:35:24 OK 20241026095416_initial_model.sql (193.62ms)16062026/10/01 08:35:24 OK 20251210153512_drop_unused_gin_index.sql (15.47ms)16072026/10/01 08:35:24 OK 20251218171726_add_pins.sql (36.36ms)1608--- PASS: TestNARDeduplicationMetadataUploadBug (4.19s)1609=== CONT TestForceGCDuringPushOffersSweptObject1610=== RUN TestForceGCDuringPushOffersSweptObject/before_pending_rows1611=== PAUSE TestForceGCDuringPushOffersSweptObject/before_pending_rows1612=== RUN TestForceGCDuringPushOffersSweptObject/after_presence_check1613=== PAUSE TestForceGCDuringPushOffersSweptObject/after_presence_check1614=== CONT TestCreatePendingClosureVerifyS3FailureReleasesConnection16152026/10/01 08:35:24 INFO lead: acquired remote=192.0.2.1:123416162026/10/01 08:35:24 INFO lead: released remote=192.0.2.1:12341617--- PASS: TestLeadEndsOnShutdown (3.03s)1618=== CONT TestGCSweepDeliversEachKeyOnce16192026/10/01 08:35:24 OK 20260628120000_add_object_size_and_stats.sql (44.25ms)16202026/10/01 08:35:24 OK 20260905000000_add_claims.sql (28.52ms)16212026/10/01 08:35:24 OK 20260920000000_drop_claims.sql (19.23ms)16222026/10/01 08:35:24 OK 20260923120000_add_pushes.sql (8.9ms)16232026/10/01 08:35:24 goose: successfully migrated database to version: 2026092312000016242026/10/01 08:35:24 OK 1_commit_pending_closure.sql (1.58ms)16252026/10/01 08:35:24 OK 2_object_stats_trigger.sql (301.21µs)16262026/10/01 08:35:24 OK 3_commit_push.sql (245.25µs)16272026/10/01 08:35:24 goose: up to current file version: 316282026-10-01 08:35:24.228 UTC [99211] ERROR: relation "goose_db_version" does not exist at character 3616292026-10-01 08:35:24.228 UTC [99211] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC16302026-10-01 08:35:24.339 UTC [99212] ERROR: relation "goose_db_version" does not exist at character 3616312026-10-01 08:35:24.339 UTC [99212] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC16322026/10/01 08:35:24 OK 20241026095416_initial_model.sql (137.84ms)16332026/10/01 08:35:24 OK 20251210153512_drop_unused_gin_index.sql (15.09ms)16342026/10/01 08:35:24 OK 20251218171726_add_pins.sql (30.42ms)16352026/10/01 08:35:24 OK 20260628120000_add_object_size_and_stats.sql (31.96ms)16362026-10-01 08:35:24.512 UTC [99213] ERROR: relation "goose_db_version" does not exist at character 3616372026-10-01 08:35:24.512 UTC [99213] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC16382026/10/01 08:35:24 OK 20260905000000_add_claims.sql (24.87ms)16392026/10/01 08:35:24 OK 20241026095416_initial_model.sql (135.45ms)16402026/10/01 08:35:24 OK 20260920000000_drop_claims.sql (17.63ms)16412026/10/01 08:35:24 OK 20251210153512_drop_unused_gin_index.sql (3.02ms)16422026/10/01 08:35:24 OK 20260923120000_add_pushes.sql (27.87ms)16432026/10/01 08:35:24 goose: successfully migrated database to version: 2026092312000016442026/10/01 08:35:24 OK 20251218171726_add_pins.sql (25.08ms)16452026/10/01 08:35:24 OK 1_commit_pending_closure.sql (2.7ms)16462026/10/01 08:35:24 OK 2_object_stats_trigger.sql (548.79µs)16472026/10/01 08:35:24 OK 3_commit_push.sql (408.38µs)16482026/10/01 08:35:24 goose: up to current file version: 316492026/10/01 08:35:24 INFO Aborted multipart uploads count=016502026/10/01 08:35:24 WARN Force mode enabled - objects will be deleted immediately without grace period16512026/10/01 08:35:24 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=016522026/10/01 08:35:24 OK 20260628120000_add_object_size_and_stats.sql (43.79ms)16532026/10/01 08:35:24 INFO Vacuumed table table=pending_closures16542026/10/01 08:35:24 INFO Vacuumed table table=pending_objects16552026/10/01 08:35:24 INFO Vacuumed table table=multipart_uploads16562026/10/01 08:35:24 INFO Vacuumed table table=closures16572026/10/01 08:35:24 INFO Vacuumed table table=objects16582026/10/01 08:35:24 OK 20260905000000_add_claims.sql (44.62ms)1659--- PASS: TestCommitRacingPendingCleanupKeepsObjects (2.56s)1660=== CONT TestTombstonedObjectOfferedWithoutWaiting16612026/10/01 08:35:24 OK 20241026095416_initial_model.sql (128.73ms)16622026/10/01 08:35:24 OK 20251210153512_drop_unused_gin_index.sql (6.41ms)16632026/10/01 08:35:24 OK 20260920000000_drop_claims.sql (31.28ms)16642026/10/01 08:35:24 OK 20260923120000_add_pushes.sql (14.45ms)16652026/10/01 08:35:24 goose: successfully migrated database to version: 2026092312000016662026/10/01 08:35:24 OK 1_commit_pending_closure.sql (1.83ms)16672026/10/01 08:35:24 OK 2_object_stats_trigger.sql (399.46µs)16682026/10/01 08:35:24 OK 3_commit_push.sql (330.75µs)16692026/10/01 08:35:24 goose: up to current file version: 316702026/10/01 08:35:24 OK 20251218171726_add_pins.sql (33.62ms)16712026/10/01 08:35:24 OK 20260628120000_add_object_size_and_stats.sql (40.54ms)16722026/10/01 08:35:24 OK 20260905000000_add_claims.sql (48.86ms)16732026-10-01 08:35:24.836 UTC [99219] ERROR: relation "goose_db_version" does not exist at character 3616742026-10-01 08:35:24.836 UTC [99219] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC16752026/10/01 08:35:24 OK 20260920000000_drop_claims.sql (34.1ms)16762026/10/01 08:35:24 OK 20260923120000_add_pushes.sql (5.75ms)16772026/10/01 08:35:24 goose: successfully migrated database to version: 2026092312000016782026/10/01 08:35:24 OK 1_commit_pending_closure.sql (4.28ms)16792026/10/01 08:35:24 OK 2_object_stats_trigger.sql (717.96µs)16802026/10/01 08:35:24 OK 3_commit_push.sql (429.67µs)16812026/10/01 08:35:24 goose: up to current file version: 316822026/10/01 08:35:24 INFO Received uploads request method=POST path=/api/pending_closures16832026/10/01 08:35:25 OK 20241026095416_initial_model.sql (204.29ms)16842026/10/01 08:35:25 OK 20251210153512_drop_unused_gin_index.sql (7.57ms)16852026/10/01 08:35:25 OK 20251218171726_add_pins.sql (55.47ms)16862026/10/01 08:35:25 OK 20260628120000_add_object_size_and_stats.sql (34.83ms)16872026/10/01 08:35:25 INFO Aborted multipart uploads count=016882026/10/01 08:35:25 WARN Force mode enabled - objects will be deleted immediately without grace period16892026/10/01 08:35:25 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=016902026/10/01 08:35:25 OK 20260905000000_add_claims.sql (51.27ms)16912026/10/01 08:35:25 INFO Vacuumed table table=pending_closures16922026/10/01 08:35:25 OK 20260920000000_drop_claims.sql (31.19ms)16932026/10/01 08:35:25 INFO Vacuumed table table=pending_objects16942026/10/01 08:35:25 INFO Vacuumed table table=multipart_uploads16952026/10/01 08:35:25 INFO Vacuumed table table=closures16962026/10/01 08:35:25 OK 20260923120000_add_pushes.sql (13.67ms)16972026/10/01 08:35:25 goose: successfully migrated database to version: 2026092312000016982026/10/01 08:35:25 OK 1_commit_pending_closure.sql (3.65ms)16992026/10/01 08:35:25 OK 2_object_stats_trigger.sql (788.42µs)17002026/10/01 08:35:25 OK 3_commit_push.sql (575µs)17012026/10/01 08:35:25 goose: up to current file version: 317022026/10/01 08:35:25 INFO Vacuumed table table=objects1703--- PASS: TestSweepRechecksPendingAfterLocking (2.75s)1704=== CONT TestGCSweepSkipsPendingObjects1705--- PASS: TestPushWaitsForSweepHoldingRow (2.84s)1706=== CONT TestDeduplicatedObjectsRecordedAsPending1707--- PASS: TestGetExistingObjectsLocksRows (2.71s)1708=== CONT TestPushDedupSurvivesConcurrentGC17092026-10-01 08:35:25.545 UTC [99230] ERROR: relation "goose_db_version" does not exist at character 3617102026-10-01 08:35:25.545 UTC [99230] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC1711--- PASS: TestRegisterCompletedObjectNeedsPendingRow (2.70s)1712=== CONT TestGCMetrics17132026-10-01 08:35:25.820 UTC [99231] ERROR: relation "goose_db_version" does not exist at character 3617142026-10-01 08:35:25.820 UTC [99231] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC17152026/10/01 08:35:25 OK 20241026095416_initial_model.sql (219.98ms)17162026/10/01 08:35:25 OK 20251210153512_drop_unused_gin_index.sql (2.71ms)17172026/10/01 08:35:25 OK 20251218171726_add_pins.sql (20.67ms)17182026/10/01 08:35:25 OK 20260628120000_add_object_size_and_stats.sql (21.31ms)17192026-10-01 08:35:25.916 UTC [99234] ERROR: relation "goose_db_version" does not exist at character 3617202026-10-01 08:35:25.916 UTC [99234] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC17212026/10/01 08:35:25 OK 20260905000000_add_claims.sql (32.45ms)17222026/10/01 08:35:25 OK 20241026095416_initial_model.sql (59.11ms)17232026/10/01 08:35:25 OK 20251210153512_drop_unused_gin_index.sql (6.97ms)17242026/10/01 08:35:25 OK 20260920000000_drop_claims.sql (20.6ms)17252026/10/01 08:35:25 OK 20251218171726_add_pins.sql (12.25ms)17262026/10/01 08:35:25 OK 20260923120000_add_pushes.sql (9.8ms)17272026/10/01 08:35:25 goose: successfully migrated database to version: 2026092312000017282026-10-01 08:35:25.949 UTC [99235] ERROR: relation "goose_db_version" does not exist at character 3617292026-10-01 08:35:25.949 UTC [99235] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC17302026/10/01 08:35:25 OK 1_commit_pending_closure.sql (3.2ms)17312026/10/01 08:35:25 OK 2_object_stats_trigger.sql (446.38µs)17322026/10/01 08:35:25 OK 3_commit_push.sql (416.54µs)17332026/10/01 08:35:25 goose: up to current file version: 317342026/10/01 08:35:25 OK 20260628120000_add_object_size_and_stats.sql (24.39ms)17352026/10/01 08:35:26 OK 20260905000000_add_claims.sql (45.94ms)17362026/10/01 08:35:26 OK 20260920000000_drop_claims.sql (33.18ms)17372026/10/01 08:35:26 OK 20241026095416_initial_model.sql (109.95ms)17382026/10/01 08:35:26 OK 20260923120000_add_pushes.sql (14.72ms)17392026/10/01 08:35:26 goose: successfully migrated database to version: 2026092312000017402026/10/01 08:35:26 OK 1_commit_pending_closure.sql (3.54ms)17412026/10/01 08:35:26 OK 2_object_stats_trigger.sql (652.5µs)17422026/10/01 08:35:26 OK 3_commit_push.sql (404.79µs)17432026/10/01 08:35:26 goose: up to current file version: 317442026/10/01 08:35:26 OK 20251210153512_drop_unused_gin_index.sql (8.85ms)17452026/10/01 08:35:26 OK 20251218171726_add_pins.sql (34.5ms)17462026/10/01 08:35:26 OK 20260628120000_add_object_size_and_stats.sql (24.12ms)17472026/10/01 08:35:26 OK 20241026095416_initial_model.sql (141.74ms)17482026/10/01 08:35:26 OK 20251210153512_drop_unused_gin_index.sql (17.81ms)17492026/10/01 08:35:26 OK 20260905000000_add_claims.sql (54.42ms)17502026/10/01 08:35:26 OK 20260920000000_drop_claims.sql (16.13ms)17512026/10/01 08:35:26 OK 20251218171726_add_pins.sql (38.92ms)17522026/10/01 08:35:26 OK 20260923120000_add_pushes.sql (22.25ms)17532026/10/01 08:35:26 goose: successfully migrated database to version: 2026092312000017542026/10/01 08:35:26 OK 1_commit_pending_closure.sql (3.75ms)17552026/10/01 08:35:26 OK 2_object_stats_trigger.sql (679.13µs)17562026/10/01 08:35:26 OK 3_commit_push.sql (1.26ms)17572026/10/01 08:35:26 goose: up to current file version: 317582026/10/01 08:35:26 OK 20260628120000_add_object_size_and_stats.sql (44.15ms)17592026/10/01 08:35:26 INFO Aborted multipart uploads count=017602026/10/01 08:35:26 WARN Force mode enabled - objects will be deleted immediately without grace period17612026/10/01 08:35:26 OK 20260905000000_add_claims.sql (55.3ms)17622026/10/01 08:35:26 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=017632026/10/01 08:35:26 INFO Vacuumed table table=pending_closures17642026/10/01 08:35:26 INFO Vacuumed table table=pending_objects17652026/10/01 08:35:26 INFO Vacuumed table table=multipart_uploads17662026/10/01 08:35:26 INFO Vacuumed table table=closures17672026/10/01 08:35:26 OK 20260920000000_drop_claims.sql (33.88ms)17682026/10/01 08:35:26 INFO Vacuumed table table=objects17692026/10/01 08:35:26 INFO Aborted multipart uploads count=017702026/10/01 08:35:26 WARN Force mode enabled - objects will be deleted immediately without grace period17712026/10/01 08:35:26 OK 20260923120000_add_pushes.sql (28.6ms)17722026/10/01 08:35:26 goose: successfully migrated database to version: 2026092312000017732026/10/01 08:35:26 OK 1_commit_pending_closure.sql (3.14ms)17742026/10/01 08:35:26 OK 2_object_stats_trigger.sql (654.88µs)17752026/10/01 08:35:26 OK 3_commit_push.sql (736.96µs)17762026/10/01 08:35:26 goose: up to current file version: 317772026/10/01 08:35:26 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=017782026/10/01 08:35:26 INFO Vacuumed table table=pending_closures17792026/10/01 08:35:26 INFO Vacuumed table table=pending_objects17802026/10/01 08:35:26 INFO Vacuumed table table=multipart_uploads17812026/10/01 08:35:26 INFO Vacuumed table table=closures17822026/10/01 08:35:26 INFO Vacuumed table table=objects1783--- PASS: TestSweepSkipsRowsLockedByPush (2.78s)1784=== CONT TestGCBugBareHashReferences17852026/10/01 08:35:26 INFO Received uploads request method=POST path=/api/pending_closures17862026/10/01 08:35:26 INFO Aborted multipart uploads count=017872026/10/01 08:35:26 WARN Force mode enabled - objects will be deleted immediately without grace period17882026-10-01 08:35:26.685 UTC [99240] ERROR: relation "goose_db_version" does not exist at character 3617892026-10-01 08:35:26.685 UTC [99240] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC17902026/10/01 08:35:26 ERROR failed to remove object object=nar/dddddddddddddddddddddddddddddddddddddddddddddddddddd.nar.zst error="Access Denied."17912026/10/01 08:35:26 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.narinfo error="Access Denied."1792--- PASS: TestFailedS3DeleteKeepsTombstone (2.83s)1793=== CONT TestPresignedUploadRegisteredBeforeCommit17942026/10/01 08:35:26 INFO Received uploads request method=POST path=/api/pending_closures1795--- PASS: TestCreatePendingClosureVerifyS3FailureReleasesConnection (2.92s)1796=== CONT TestService_cleanupPendingClosuresHandler17972026/10/01 08:35:27 OK 20241026095416_initial_model.sql (322.49ms)17982026/10/01 08:35:27 OK 20251210153512_drop_unused_gin_index.sql (12.27ms)17992026/10/01 08:35:27 OK 20251218171726_add_pins.sql (41.98ms)18002026/10/01 08:35:27 OK 20260628120000_add_object_size_and_stats.sql (47.12ms)18012026/10/01 08:35:27 OK 20260905000000_add_claims.sql (56.05ms)1802=== NAME TestOrphanedObjectsGCStressTest1803 orphaned_objects_gc_test.go:425: Created 10 active closures, 5 to-delete closures, 20 orphaned chains18042026/10/01 08:35:27 OK 20260920000000_drop_claims.sql (55.5ms)18052026/10/01 08:35:27 INFO Aborted multipart uploads count=018062026/10/01 08:35:27 WARN Force mode enabled - objects will be deleted immediately without grace period18072026/10/01 08:35:27 OK 20260923120000_add_pushes.sql (24.5ms)18082026/10/01 08:35:27 goose: successfully migrated database to version: 2026092312000018092026/10/01 08:35:27 OK 1_commit_pending_closure.sql (2.07ms)18102026/10/01 08:35:27 OK 2_object_stats_trigger.sql (519.96µs)18112026/10/01 08:35:27 OK 3_commit_push.sql (413.58µs)18122026/10/01 08:35:27 goose: up to current file version: 31813 orphaned_objects_gc_test.go:446: Marked 210 objects for deletion18142026/10/01 08:35:27 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=3 objects-deleted-after-grace-period=3 objects-failed-to-delete=018152026/10/01 08:35:27 INFO Vacuumed table table=pending_closures18162026/10/01 08:35:27 INFO Vacuumed table table=pending_objects18172026/10/01 08:35:27 INFO Vacuumed table table=multipart_uploads18182026/10/01 08:35:27 INFO Vacuumed table table=closures18192026/10/01 08:35:27 INFO Vacuumed table table=objects1820--- PASS: TestGCSweepDeliversEachKeyOnce (3.31s)1821=== CONT TestService_createPendingClosureHandler18222026-10-01 08:35:27.575 UTC [99249] ERROR: relation "goose_db_version" does not exist at character 3618232026-10-01 08:35:27.575 UTC [99249] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC18242026/10/01 08:35:27 INFO Received uploads request method=POST path=/api/pending_closures1825--- PASS: TestTombstonedObjectOfferedWithoutWaiting (3.06s)1826=== CONT TestClientErrorHandling1827=== RUN TestClientErrorHandling/InvalidStorePath1828=== PAUSE TestClientErrorHandling/InvalidStorePath1829=== RUN TestClientErrorHandling/InvalidAuthToken1830=== PAUSE TestClientErrorHandling/InvalidAuthToken1831=== RUN TestClientErrorHandling/ServerNotAvailable1832=== PAUSE TestClientErrorHandling/ServerNotAvailable1833=== CONT TestLeadElectsOneAndHandsOver18342026-10-01 08:35:27.769 UTC [99250] ERROR: relation "goose_db_version" does not exist at character 3618352026-10-01 08:35:27.769 UTC [99250] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC18362026-10-01 08:35:27.770 UTC [99251] ERROR: relation "goose_db_version" does not exist at character 3618372026-10-01 08:35:27.770 UTC [99251] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC18382026/10/01 08:35:27 OK 20241026095416_initial_model.sql (133.42ms)18392026/10/01 08:35:27 OK 20251210153512_drop_unused_gin_index.sql (963.96µs)18402026/10/01 08:35:27 OK 20251218171726_add_pins.sql (1.81ms)18412026-10-01 08:35:27.800 UTC [99254] ERROR: relation "goose_db_version" does not exist at character 3618422026-10-01 08:35:27.800 UTC [99254] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC18432026/10/01 08:35:27 OK 20260628120000_add_object_size_and_stats.sql (27.3ms)18442026/10/01 08:35:27 OK 20260905000000_add_claims.sql (23.48ms)18452026/10/01 08:35:27 OK 20260920000000_drop_claims.sql (12.85ms)18462026/10/01 08:35:27 OK 20260923120000_add_pushes.sql (3.35ms)18472026/10/01 08:35:27 goose: successfully migrated database to version: 2026092312000018482026/10/01 08:35:27 OK 1_commit_pending_closure.sql (3.44ms)18492026/10/01 08:35:27 OK 2_object_stats_trigger.sql (602.08µs)18502026/10/01 08:35:27 OK 20241026095416_initial_model.sql (57.5ms)18512026/10/01 08:35:27 OK 20241026095416_initial_model.sql (57.66ms)18522026/10/01 08:35:27 OK 3_commit_push.sql (518.75µs)18532026/10/01 08:35:27 goose: up to current file version: 318542026/10/01 08:35:27 OK 20251210153512_drop_unused_gin_index.sql (904.79µs)18552026/10/01 08:35:27 OK 20251210153512_drop_unused_gin_index.sql (1.16ms)18562026/10/01 08:35:27 OK 20251218171726_add_pins.sql (4.35ms)18572026/10/01 08:35:27 OK 20251218171726_add_pins.sql (4.07ms)18582026/10/01 08:35:27 OK 20260628120000_add_object_size_and_stats.sql (32.95ms)18592026/10/01 08:35:27 OK 20260628120000_add_object_size_and_stats.sql (33.73ms)18602026/10/01 08:35:27 OK 20241026095416_initial_model.sql (59.46ms)18612026/10/01 08:35:27 OK 20251210153512_drop_unused_gin_index.sql (5.7ms)18622026/10/01 08:35:27 OK 20251218171726_add_pins.sql (22.9ms)18632026/10/01 08:35:27 OK 20260905000000_add_claims.sql (43.2ms)18642026/10/01 08:35:27 OK 20260905000000_add_claims.sql (48.97ms)18652026/10/01 08:35:27 OK 20260920000000_drop_claims.sql (20.44ms)18662026/10/01 08:35:27 OK 20260628120000_add_object_size_and_stats.sql (38.44ms)18672026/10/01 08:35:27 OK 20260920000000_drop_claims.sql (20.16ms)18682026/10/01 08:35:27 OK 20260923120000_add_pushes.sql (7.88ms)18692026/10/01 08:35:27 goose: successfully migrated database to version: 2026092312000018702026/10/01 08:35:27 OK 1_commit_pending_closure.sql (3.59ms)18712026/10/01 08:35:27 OK 2_object_stats_trigger.sql (673.96µs)18722026/10/01 08:35:27 OK 3_commit_push.sql (373.38µs)18732026/10/01 08:35:27 goose: up to current file version: 318742026/10/01 08:35:27 OK 20260923120000_add_pushes.sql (10.71ms)18752026/10/01 08:35:27 goose: successfully migrated database to version: 2026092312000018762026/10/01 08:35:27 OK 1_commit_pending_closure.sql (2.35ms)18772026/10/01 08:35:27 OK 2_object_stats_trigger.sql (554.96µs)18782026/10/01 08:35:27 OK 3_commit_push.sql (390.42µs)18792026/10/01 08:35:27 goose: up to current file version: 318802026/10/01 08:35:27 OK 20260905000000_add_claims.sql (29.63ms)18812026/10/01 08:35:28 OK 20260920000000_drop_claims.sql (71ms)18822026/10/01 08:35:28 OK 20260923120000_add_pushes.sql (26ms)18832026/10/01 08:35:28 goose: successfully migrated database to version: 2026092312000018842026/10/01 08:35:28 OK 1_commit_pending_closure.sql (3.65ms)18852026/10/01 08:35:28 OK 2_object_stats_trigger.sql (1.05ms)18862026/10/01 08:35:28 OK 3_commit_push.sql (805.33µs)18872026/10/01 08:35:28 goose: up to current file version: 318882026/10/01 08:35:28 INFO Received uploads request method=POST path=/api/pending_closures1889--- PASS: TestDeduplicatedObjectsRecordedAsPending (2.81s)1890=== CONT TestResolveDBConnectionString1891=== RUN TestResolveDBConnectionString/flag_wins1892=== PAUSE TestResolveDBConnectionString/flag_wins1893=== RUN TestResolveDBConnectionString/file_when_flag_empty1894=== PAUSE TestResolveDBConnectionString/file_when_flag_empty1895=== RUN TestResolveDBConnectionString/missing_file_is_an_error1896=== PAUSE TestResolveDBConnectionString/missing_file_is_an_error1897=== RUN TestResolveDBConnectionString/PGHOST_allows_empty1898=== PAUSE TestResolveDBConnectionString/PGHOST_allows_empty1899=== RUN TestResolveDBConnectionString/nothing_configured1900=== PAUSE TestResolveDBConnectionString/nothing_configured1901=== CONT TestClientFallsBackToClosures19022026/10/01 08:35:28 INFO Received uploads request method=POST path=/api/pending_closures19032026/10/01 08:35:28 INFO Aborted multipart uploads count=019042026/10/01 08:35:28 WARN Force mode enabled - objects will be deleted immediately without grace period19052026/10/01 08:35:28 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=019062026/10/01 08:35:28 INFO Vacuumed table table=pending_closures19072026/10/01 08:35:28 INFO Vacuumed table table=pending_objects19082026/10/01 08:35:28 INFO Vacuumed table table=multipart_uploads19092026/10/01 08:35:28 INFO Vacuumed table table=closures19102026/10/01 08:35:28 INFO Vacuumed table table=objects1911--- PASS: TestGCSweepSkipsPendingObjects (3.32s)1912=== CONT TestClientPushesUseOnePush19132026-10-01 08:35:28.643 UTC [99258] ERROR: relation "goose_db_version" does not exist at character 3619142026-10-01 08:35:28.643 UTC [99258] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC19152026/10/01 08:35:28 INFO Received uploads request method=POST path=/api/pending_closures19162026/10/01 08:35:28 OK 20241026095416_initial_model.sql (219.89ms)19172026/10/01 08:35:28 OK 20251210153512_drop_unused_gin_index.sql (16.16ms)19182026/10/01 08:35:29 OK 20251218171726_add_pins.sql (60.71ms)19192026/10/01 08:35:29 INFO Aborted multipart uploads count=019202026-10-01 08:35:29.033 UTC [99261] ERROR: relation "goose_db_version" does not exist at character 3619212026-10-01 08:35:29.033 UTC [99261] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC19222026/10/01 08:35:29 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=019232026/10/01 08:35:29 OK 20260628120000_add_object_size_and_stats.sql (38.62ms)19242026/10/01 08:35:29 INFO Vacuumed table table=pending_closures19252026/10/01 08:35:29 INFO Vacuumed table table=pending_objects19262026/10/01 08:35:29 INFO Vacuumed table table=multipart_uploads19272026/10/01 08:35:29 OK 20260905000000_add_claims.sql (104.36ms)19282026/10/01 08:35:29 INFO Vacuumed table table=closures19292026/10/01 08:35:29 INFO Aborted multipart uploads count=019302026/10/01 08:35:29 OK 20260920000000_drop_claims.sql (30.04ms)19312026/10/01 08:35:29 WARN Force mode enabled - objects will be deleted immediately without grace period19322026/10/01 08:35:29 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=019332026/10/01 08:35:29 INFO Vacuumed table table=pending_closures19342026/10/01 08:35:29 INFO Vacuumed table table=pending_objects19352026/10/01 08:35:29 INFO Vacuumed table table=multipart_uploads19362026/10/01 08:35:29 INFO Vacuumed table table=closures19372026/10/01 08:35:29 INFO Vacuumed table table=objects19382026/10/01 08:35:29 INFO Vacuumed table table=objects19392026/10/01 08:35:29 OK 20260923120000_add_pushes.sql (12.1ms)19402026/10/01 08:35:29 goose: successfully migrated database to version: 202609231200001941--- PASS: TestGCMetrics (3.39s)1942=== CONT TestPinProtectsFromGC19432026/10/01 08:35:29 OK 1_commit_pending_closure.sql (4.08ms)19442026/10/01 08:35:29 OK 2_object_stats_trigger.sql (1.17ms)19452026/10/01 08:35:29 OK 3_commit_push.sql (959.38µs)19462026/10/01 08:35:29 goose: up to current file version: 319472026/10/01 08:35:29 INFO Aborted multipart uploads count=019482026/10/01 08:35:29 WARN Force mode enabled - objects will be deleted immediately without grace period19492026/10/01 08:35:29 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=019502026/10/01 08:35:29 INFO Vacuumed table table=pending_closures19512026/10/01 08:35:29 INFO Vacuumed table table=pending_objects19522026/10/01 08:35:29 INFO Vacuumed table table=multipart_uploads19532026/10/01 08:35:29 INFO Vacuumed table table=closures19542026/10/01 08:35:29 INFO Vacuumed table table=objects1955--- PASS: TestPushDedupSurvivesConcurrentGC (3.79s)1956=== CONT TestClientSharedPathCommittedMidPush19572026/10/01 08:35:29 OK 20241026095416_initial_model.sql (222.16ms)19582026/10/01 08:35:29 OK 20251210153512_drop_unused_gin_index.sql (15.31ms)19592026/10/01 08:35:29 OK 20251218171726_add_pins.sql (29.2ms)19602026-10-01 08:35:29.404 UTC [99268] ERROR: relation "goose_db_version" does not exist at character 3619612026-10-01 08:35:29.404 UTC [99268] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC19622026/10/01 08:35:29 OK 20260628120000_add_object_size_and_stats.sql (29.27ms)19632026/10/01 08:35:29 OK 20260905000000_add_claims.sql (54.24ms)19642026/10/01 08:35:29 OK 20260920000000_drop_claims.sql (41.3ms)19652026/10/01 08:35:29 OK 20260923120000_add_pushes.sql (39.8ms)19662026/10/01 08:35:29 goose: successfully migrated database to version: 2026092312000019672026/10/01 08:35:29 OK 1_commit_pending_closure.sql (5.55ms)19682026/10/01 08:35:29 OK 2_object_stats_trigger.sql (851.42µs)19692026/10/01 08:35:29 OK 3_commit_push.sql (589.08µs)19702026/10/01 08:35:29 goose: up to current file version: 319712026-10-01 08:35:29.629 UTC [99269] ERROR: relation "goose_db_version" does not exist at character 3619722026-10-01 08:35:29.629 UTC [99269] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC19732026/10/01 08:35:29 OK 20241026095416_initial_model.sql (206.57ms)19742026/10/01 08:35:29 OK 20251210153512_drop_unused_gin_index.sql (10.72ms)19752026/10/01 08:35:29 OK 20251218171726_add_pins.sql (45.41ms)19762026/10/01 08:35:29 OK 20260628120000_add_object_size_and_stats.sql (37.45ms)1977--- PASS: TestGCBugBareHashReferences (3.42s)1978=== CONT TestClientWithDependencies19792026/10/01 08:35:29 OK 20260905000000_add_claims.sql (64.19ms)19802026/10/01 08:35:29 INFO Received uploads request method=POST path=/api/pending_closures19812026/10/01 08:35:29 OK 20260920000000_drop_claims.sql (40.9ms)19822026-10-01 08:35:29.889 UTC [99272] ERROR: relation "goose_db_version" does not exist at character 3619832026-10-01 08:35:29.889 UTC [99272] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC19842026/10/01 08:35:29 OK 20241026095416_initial_model.sql (201.07ms)19852026/10/01 08:35:29 OK 20251210153512_drop_unused_gin_index.sql (9.26ms)19862026/10/01 08:35:29 OK 20260923120000_add_pushes.sql (23.18ms)19872026/10/01 08:35:29 goose: successfully migrated database to version: 2026092312000019882026/10/01 08:35:29 OK 1_commit_pending_closure.sql (3.02ms)19892026/10/01 08:35:29 OK 2_object_stats_trigger.sql (597.79µs)19902026/10/01 08:35:29 OK 3_commit_push.sql (467.83µs)19912026/10/01 08:35:29 goose: up to current file version: 319922026/10/01 08:35:29 INFO Registered completed upload object_key=nar/jjjjjjjjjjjjjjjjjjjjjjjjjjjjjj0100000000000000000000.nar.zst19932026/10/01 08:35:29 INFO Received uploads request method=POST path=/api/pending_closures1994--- PASS: TestPresignedUploadRegisteredBeforeCommit (3.25s)1995=== CONT TestClientMultipleUploads19962026/10/01 08:35:29 OK 20251218171726_add_pins.sql (50.2ms)19972026/10/01 08:35:29 OK 20260628120000_add_object_size_and_stats.sql (38.68ms)19982026/10/01 08:35:30 OK 20260905000000_add_claims.sql (18.04ms)19992026/10/01 08:35:30 OK 20260920000000_drop_claims.sql (15.44ms)20002026/10/01 08:35:30 OK 20260923120000_add_pushes.sql (2.58ms)20012026/10/01 08:35:30 goose: successfully migrated database to version: 2026092312000020022026/10/01 08:35:30 OK 1_commit_pending_closure.sql (2.25ms)20032026/10/01 08:35:30 OK 2_object_stats_trigger.sql (435.04µs)20042026/10/01 08:35:30 OK 3_commit_push.sql (344.46µs)20052026/10/01 08:35:30 goose: up to current file version: 320062026/10/01 08:35:30 OK 20241026095416_initial_model.sql (85.93ms)20072026/10/01 08:35:30 OK 20251210153512_drop_unused_gin_index.sql (7.32ms)20082026/10/01 08:35:30 OK 20251218171726_add_pins.sql (10.56ms)20092026/10/01 08:35:30 OK 20260628120000_add_object_size_and_stats.sql (32.9ms)20102026/10/01 08:35:30 OK 20260905000000_add_claims.sql (44.77ms)20112026/10/01 08:35:30 INFO Received cleanup request method=DELETE path=/api/pending_closures20122026/10/01 08:35:30 INFO Aborted multipart uploads count=020132026/10/01 08:35:30 INFO Received uploads request method=POST path=/api/pending_closures20142026/10/01 08:35:30 OK 20260920000000_drop_claims.sql (11.97ms)20152026/10/01 08:35:30 OK 20260923120000_add_pushes.sql (16.06ms)20162026/10/01 08:35:30 goose: successfully migrated database to version: 2026092312000020172026/10/01 08:35:30 OK 1_commit_pending_closure.sql (3.26ms)20182026/10/01 08:35:30 OK 2_object_stats_trigger.sql (617.04µs)20192026/10/01 08:35:30 OK 3_commit_push.sql (390.42µs)20202026/10/01 08:35:30 goose: up to current file version: 320212026/10/01 08:35:30 INFO Received cleanup request method=DELETE path=/api/pending_closures20222026/10/01 08:35:30 INFO Aborted multipart uploads count=120232026/10/01 08:35:30 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete20242026-10-01 08:35:30.251 UTC [99268] ERROR: Closure does not exist: id=120252026-10-01 08:35:30.251 UTC [99268] CONTEXT: PL/pgSQL function commit_pending_closure(bigint) line 12 at RAISE20262026-10-01 08:35:30.251 UTC [99268] STATEMENT: -- name: CommitPendingClosure :exec2027 SELECT commit_pending_closure($1::bigint)2028 2029--- PASS: TestService_cleanupPendingClosuresHandler (3.19s)2030=== CONT TestClientIntegration20312026-10-01 08:35:30.267 UTC [99275] ERROR: relation "goose_db_version" does not exist at character 3620322026-10-01 08:35:30.267 UTC [99275] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC20332026/10/01 08:35:30 INFO Received uploads request method=POST path=/api/pending_closures20342026/10/01 08:35:30 INFO Received uploads request method=POST path=/api/pending_closures20352026/10/01 08:35:30 INFO Received uploads request method=POST path=/api/pending_closures20362026/10/01 08:35:30 OK 20241026095416_initial_model.sql (119.14ms)20372026/10/01 08:35:30 OK 20251210153512_drop_unused_gin_index.sql (12.97ms)20382026-10-01 08:35:30.488 UTC [99278] ERROR: relation "goose_db_version" does not exist at character 3620392026-10-01 08:35:30.488 UTC [99278] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC20402026/10/01 08:35:30 OK 20251218171726_add_pins.sql (34.55ms)20412026/10/01 08:35:30 OK 20260628120000_add_object_size_and_stats.sql (28.41ms)2042=== NAME TestOrphanedObjectsGCStressTest2043 orphaned_objects_gc_test.go:509: Stress test completed successfully:2044 orphaned_objects_gc_test.go:510: - Active objects preserved: 202045 orphaned_objects_gc_test.go:511: - Objects deleted: 2102046 orphaned_objects_gc_test.go:512: - Total GC'd: 2102047--- PASS: TestOrphanedObjectsGCStressTest (12.14s)2048=== CONT TestUploadHandlersRejectOversizedBody20492026/10/01 08:35:30 OK 20260905000000_add_claims.sql (63.6ms)2050=== RUN TestUploadHandlersRejectOversizedBody/create_pending_closure2051=== PAUSE TestUploadHandlersRejectOversizedBody/create_pending_closure2052=== RUN TestUploadHandlersRejectOversizedBody/complete_multipart2053=== PAUSE TestUploadHandlersRejectOversizedBody/complete_multipart2054=== RUN TestUploadHandlersRejectOversizedBody/request_more_parts2055=== PAUSE TestUploadHandlersRejectOversizedBody/request_more_parts2056=== CONT TestService_ReadAuthMiddleware20572026/10/01 08:35:30 OK 20260920000000_drop_claims.sql (48.83ms)20582026/10/01 08:35:30 OK 20260923120000_add_pushes.sql (5.81ms)20592026/10/01 08:35:30 goose: successfully migrated database to version: 2026092312000020602026/10/01 08:35:30 OK 1_commit_pending_closure.sql (1.17ms)20612026/10/01 08:35:30 OK 2_object_stats_trigger.sql (263.83µs)20622026/10/01 08:35:30 OK 3_commit_push.sql (182.17µs)20632026/10/01 08:35:30 goose: up to current file version: 320642026/10/01 08:35:30 INFO lead: acquired remote=192.0.2.1:123420652026/10/01 08:35:30 OK 20241026095416_initial_model.sql (160.67ms)20662026/10/01 08:35:30 OK 20251210153512_drop_unused_gin_index.sql (16.64ms)20672026/10/01 08:35:30 OK 20251218171726_add_pins.sql (21.87ms)20682026/10/01 08:35:30 OK 20260628120000_add_object_size_and_stats.sql (42.21ms)20692026/10/01 08:35:30 INFO lead: released remote=192.0.2.1:123420702026/10/01 08:35:30 OK 20260905000000_add_claims.sql (52.14ms)20712026/10/01 08:35:30 OK 20260920000000_drop_claims.sql (10.82ms)20722026/10/01 08:35:30 OK 20260923120000_add_pushes.sql (20.98ms)20732026/10/01 08:35:30 goose: successfully migrated database to version: 2026092312000020742026/10/01 08:35:30 OK 1_commit_pending_closure.sql (2.22ms)20752026/10/01 08:35:30 OK 2_object_stats_trigger.sql (707.88µs)20762026/10/01 08:35:30 OK 3_commit_push.sql (758.33µs)20772026/10/01 08:35:30 goose: up to current file version: 320782026/10/01 08:35:30 INFO lead: acquired remote=192.0.2.1:123420792026/10/01 08:35:30 INFO lead: released remote=192.0.2.1:12342080--- PASS: TestLeadElectsOneAndHandsOver (3.20s)2081=== CONT TestService_AuthMiddleware_OIDC20822026-10-01 08:35:30.927 UTC [99282] ERROR: relation "goose_db_version" does not exist at character 3620832026-10-01 08:35:30.927 UTC [99282] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC20842026/10/01 08:35:31 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:61744/oidc20852026-10-01 08:35:31.009 UTC [99284] ERROR: relation "goose_db_version" does not exist at character 3620862026-10-01 08:35:31.009 UTC [99284] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC20872026/10/01 08:35:31 OK 20241026095416_initial_model.sql (146.29ms)20882026/10/01 08:35:31 OK 20251210153512_drop_unused_gin_index.sql (7.73ms)20892026/10/01 08:35:31 OK 20251218171726_add_pins.sql (25.17ms)20902026/10/01 08:35:31 OK 20260628120000_add_object_size_and_stats.sql (29.5ms)20912026/10/01 08:35:31 OK 20241026095416_initial_model.sql (122.3ms)20922026/10/01 08:35:31 OK 20251210153512_drop_unused_gin_index.sql (8.36ms)20932026/10/01 08:35:31 OK 20251218171726_add_pins.sql (19.86ms)20942026/10/01 08:35:31 OK 20260905000000_add_claims.sql (35.66ms)20952026/10/01 08:35:31 OK 20260920000000_drop_claims.sql (3.18ms)20962026/10/01 08:35:31 OK 20260923120000_add_pushes.sql (14.03ms)20972026/10/01 08:35:31 goose: successfully migrated database to version: 2026092312000020982026/10/01 08:35:31 OK 1_commit_pending_closure.sql (810.25µs)20992026/10/01 08:35:31 OK 2_object_stats_trigger.sql (265.13µs)21002026/10/01 08:35:31 OK 3_commit_push.sql (198.46µs)21012026/10/01 08:35:31 goose: up to current file version: 321022026/10/01 08:35:31 OK 20260628120000_add_object_size_and_stats.sql (51.33ms)21032026/10/01 08:35:31 OK 20260905000000_add_claims.sql (69.32ms)21042026/10/01 08:35:31 OK 20260920000000_drop_claims.sql (27.07ms)21052026/10/01 08:35:31 OK 20260923120000_add_pushes.sql (14.99ms)21062026/10/01 08:35:31 goose: successfully migrated database to version: 2026092312000021072026/10/01 08:35:31 OK 1_commit_pending_closure.sql (864.5µs)21082026/10/01 08:35:31 OK 2_object_stats_trigger.sql (238.88µs)21092026/10/01 08:35:31 OK 3_commit_push.sql (179.17µs)21102026/10/01 08:35:31 goose: up to current file version: 321112026-10-01 08:35:31.433 UTC [99295] ERROR: relation "goose_db_version" does not exist at character 3621122026-10-01 08:35:31.433 UTC [99295] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC21132026-10-01 08:35:31.463 UTC [99298] ERROR: relation "goose_db_version" does not exist at character 3621142026-10-01 08:35:31.463 UTC [99298] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC21152026/10/01 08:35:31 INFO Received uploads request method=POST path=/api/pending_closures21162026/10/01 08:35:31 INFO Received uploads request method=POST path=/api/pending_closures21172026/10/01 08:35:31 INFO Uploading 2 paths to 127.0.0.1 (1 already cached)21182026/10/01 08:35:31 INFO Uploading rrd3xjqq7swis34hcr187phawa0sf7vi-b (248B)21192026/10/01 08:35:31 INFO Uploading avy5llifhd2pg57lj89qvkc2r34fhdn1-shared-dep (136B)21202026/10/01 08:35:31 WARN Failed to register uploaded object key=rrd3xjqq7swis34hcr187phawa0sf7vi.ls error="server returned 404: 404 page not found\n"21212026/10/01 08:35:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign21222026/10/01 08:35:31 WARN Failed to register uploaded object key=avy5llifhd2pg57lj89qvkc2r34fhdn1.ls error="server returned 404: 404 page not found\n"21232026/10/01 08:35:31 WARN Failed to register uploaded object key=0mxys1v9abb2h0b6bxa566yms2z7iznv.ls error="server returned 404: 404 page not found\n"21242026/10/01 08:35:31 WARN Failed to register uploaded object key=nar/1zbhhschi0d67af67jd4nnnkda1nhdvzy9kpnz49yplwv4innyn5.nar.zst error="server returned 404: 404 page not found\n"21252026/10/01 08:35:31 WARN Failed to register uploaded object key=nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst error="server returned 404: 404 page not found\n"21262026/10/01 08:35:31 INFO Signed narinfos id=1 count=221272026/10/01 08:35:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign21282026/10/01 08:35:31 INFO Signed narinfos id=2 count=221292026/10/01 08:35:31 INFO Uploading 4 narinfos21302026/10/01 08:35:31 WARN Failed to register uploaded object key=0mxys1v9abb2h0b6bxa566yms2z7iznv.narinfo error="server returned 404: 404 page not found\n"21312026/10/01 08:35:31 WARN Failed to register uploaded object key=avy5llifhd2pg57lj89qvkc2r34fhdn1.narinfo error="server returned 404: 404 page not found\n"21322026/10/01 08:35:31 WARN Failed to register uploaded object key=rrd3xjqq7swis34hcr187phawa0sf7vi.narinfo error="server returned 404: 404 page not found\n"21332026/10/01 08:35:31 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete21342026/10/01 08:35:31 WARN Failed to register uploaded object key=avy5llifhd2pg57lj89qvkc2r34fhdn1.narinfo error="server returned 404: 404 page not found\n"21352026/10/01 08:35:31 OK 20241026095416_initial_model.sql (164.85ms)21362026/10/01 08:35:31 INFO Completed upload id=121372026/10/01 08:35:31 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete21382026/10/01 08:35:31 INFO Completed upload id=221392026/10/01 08:35:31 INFO Upload complete. (173ms)2140=== NAME TestClientFallsBackToClosures2141 client_pushes_test.go:112: Retrieved narinfo from S3:2142 StorePath: /nix/var/nix/builds/nix-98979-578903465/TestClientFallsBackToClosures3145581572/001/store/avy5llifhd2pg57lj89qvkc2r34fhdn1-shared-dep2143 URL: nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst2144 Compression: zstd2145 NarHash: sha256:1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y822146 NarSize: 1362147 References: 2148 CA: text:sha256:08nxw05k7b0pzzy0f3swvnw4ldxdbclkdnklpidwmrxdhvfrmv7n2149 client_pushes_test.go:112: Retrieved narinfo from S3:2150 StorePath: /nix/var/nix/builds/nix-98979-578903465/TestClientFallsBackToClosures3145581572/001/store/0mxys1v9abb2h0b6bxa566yms2z7iznv-a2151 URL: nar/1zbhhschi0d67af67jd4nnnkda1nhdvzy9kpnz49yplwv4innyn5.nar.zst2152 Compression: zstd2153 NarHash: sha256:1zbhhschi0d67af67jd4nnnkda1nhdvzy9kpnz49yplwv4innyn52154 NarSize: 2482155 References: /nix/var/nix/builds/nix-98979-578903465/TestClientFallsBackToClosures3145581572/001/store/avy5llifhd2pg57lj89qvkc2r34fhdn1-shared-dep2156 CA: text:sha256:0czs62fj8hp388hi3qv1v7849jw78gbfwpwh8zzpgik5m5by71cw2157 client_pushes_test.go:112: Retrieved narinfo from S3:2158 StorePath: /nix/var/nix/builds/nix-98979-578903465/TestClientFallsBackToClosures3145581572/001/store/rrd3xjqq7swis34hcr187phawa0sf7vi-b2159 URL: nar/1zbhhschi0d67af67jd4nnnkda1nhdvzy9kpnz49yplwv4innyn5.nar.zst2160 Compression: zstd2161 NarHash: sha256:1zbhhschi0d67af67jd4nnnkda1nhdvzy9kpnz49yplwv4innyn52162 NarSize: 2482163 References: /nix/var/nix/builds/nix-98979-578903465/TestClientFallsBackToClosures3145581572/001/store/avy5llifhd2pg57lj89qvkc2r34fhdn1-shared-dep2164 CA: text:sha256:0czs62fj8hp388hi3qv1v7849jw78gbfwpwh8zzpgik5m5by71cw21652026/10/01 08:35:31 OK 20251210153512_drop_unused_gin_index.sql (15.75ms)21662026/10/01 08:35:31 INFO Received push request method=POST path=/api/pushes21672026/10/01 08:35:31 OK 20251218171726_add_pins.sql (28.91ms)21682026/10/01 08:35:31 OK 20241026095416_initial_model.sql (174.69ms)21692026/10/01 08:35:31 INFO Received complete multipart upload request method=POST path=/api/multipart/complete21702026/10/01 08:35:31 OK 20251210153512_drop_unused_gin_index.sql (6.64ms)21712026/10/01 08:35:31 INFO Uploading 2 paths to 127.0.0.1 (1 already cached)21722026/10/01 08:35:31 INFO Uploading np8diq2xrky1107g4svpg7rl5ql7h1hj-a (248B)21732026/10/01 08:35:31 INFO Uploading rgw23b3hmbrs1vxr4rrjjy15yi4c1m97-shared-dep (136B)21742026/10/01 08:35:31 OK 20260628120000_add_object_size_and_stats.sql (56.31ms)21752026/10/01 08:35:31 OK 20251218171726_add_pins.sql (49.67ms)2176--- PASS: TestClientFallsBackToClosures (3.55s)2177=== CONT TestService_RequireScope_OIDC21782026/10/01 08:35:31 WARN Failed to register uploaded object key=nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst error="server returned 404: 404 page not found\n"21792026/10/01 08:35:31 WARN Failed to register uploaded object key=68cxq41h55qw5a0iqh722mc1wx8jjwr2.ls error="server returned 404: 404 page not found\n"21802026/10/01 08:35:31 WARN Failed to register uploaded object key=nar/019pq6mi8im4hq2w7hyp5xvx9igckj9fpp4lzqmib70wj215nfjl.nar.zst error="server returned 404: 404 page not found\n"21812026/10/01 08:35:31 WARN Failed to register uploaded object key=rgw23b3hmbrs1vxr4rrjjy15yi4c1m97.ls error="server returned 404: 404 page not found\n"21822026/10/01 08:35:31 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign21832026/10/01 08:35:31 WARN Failed to register uploaded object key=np8diq2xrky1107g4svpg7rl5ql7h1hj.ls error="server returned 404: 404 page not found\n"21842026/10/01 08:35:31 INFO Signed narinfos id=1 count=321852026/10/01 08:35:31 INFO Uploading 3 narinfos21862026/10/01 08:35:31 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:61781/oidc21872026/10/01 08:35:31 INFO Completed multipart upload object_key=nar/0000000000000000000000000000000000000000000000000000.nar.zst upload_id=OWE1N2RiOTAtN2U4Ni00ZmYzLThkMjItYmRiYjBlOTY2ZmUzLmJkZWUxYjhjLTIyOTItNDZlZi1hNzcyLWE1MDkyNjAwYzRiYXgxNzkwODQzNzMwNDU3MTYxMDAw parts=1021882026/10/01 08:35:31 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete21892026/10/01 08:35:31 WARN Failed to register uploaded object key=68cxq41h55qw5a0iqh722mc1wx8jjwr2.narinfo error="server returned 404: 404 page not found\n"21902026/10/01 08:35:31 OK 20260628120000_add_object_size_and_stats.sql (40.75ms)21912026/10/01 08:35:31 WARN Failed to register uploaded object key=rgw23b3hmbrs1vxr4rrjjy15yi4c1m97.narinfo error="server returned 404: 404 page not found\n"21922026/10/01 08:35:31 INFO Completed upload id=121932026/10/01 08:35:31 INFO Received get closure request method=GET path=/api/closures/0000000000000000000000000000000021942026/10/01 08:35:31 INFO Received uploads request method=POST path=/api/pending_closures21952026/10/01 08:35:31 INFO Starting cleanup of old closures method=DELETE path=/api/closures21962026/10/01 08:35:31 INFO Aborted multipart uploads count=021972026/10/01 08:35:31 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=021982026/10/01 08:35:31 INFO Received complete push request method=POST path=/api/pushes/1/complete21992026/10/01 08:35:31 WARN Failed to register uploaded object key=np8diq2xrky1107g4svpg7rl5ql7h1hj.narinfo error="server returned 404: 404 page not found\n"22002026/10/01 08:35:31 INFO Vacuumed table table=pending_closures22012026/10/01 08:35:31 INFO Upload complete. (184ms)22022026/10/01 08:35:31 OK 20260905000000_add_claims.sql (73.37ms)2203=== NAME TestClientPushesUseOnePush2204 client_pushes_test.go:97: Retrieved narinfo from S3:2205 StorePath: /nix/var/nix/builds/nix-98979-578903465/TestClientPushesUseOnePush2670157142/001/store/rgw23b3hmbrs1vxr4rrjjy15yi4c1m97-shared-dep2206 URL: nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst2207 Compression: zstd2208 NarHash: sha256:1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y822209 NarSize: 1362210 References: 2211 CA: text:sha256:08nxw05k7b0pzzy0f3swvnw4ldxdbclkdnklpidwmrxdhvfrmv7n2212 client_pushes_test.go:97: Retrieved narinfo from S3:2213 StorePath: /nix/var/nix/builds/nix-98979-578903465/TestClientPushesUseOnePush2670157142/001/store/np8diq2xrky1107g4svpg7rl5ql7h1hj-a2214 URL: nar/019pq6mi8im4hq2w7hyp5xvx9igckj9fpp4lzqmib70wj215nfjl.nar.zst2215 Compression: zstd2216 NarHash: sha256:019pq6mi8im4hq2w7hyp5xvx9igckj9fpp4lzqmib70wj215nfjl2217 NarSize: 2482218 References: /nix/var/nix/builds/nix-98979-578903465/TestClientPushesUseOnePush2670157142/001/store/rgw23b3hmbrs1vxr4rrjjy15yi4c1m97-shared-dep2219 CA: text:sha256:067mkfiiqjv7bivh1nbhfn0psrapdsr4s7nyafzvvnig4bg3iawx2220 client_pushes_test.go:97: Retrieved narinfo from S3:2221 StorePath: /nix/var/nix/builds/nix-98979-578903465/TestClientPushesUseOnePush2670157142/001/store/68cxq41h55qw5a0iqh722mc1wx8jjwr2-b2222 URL: nar/019pq6mi8im4hq2w7hyp5xvx9igckj9fpp4lzqmib70wj215nfjl.nar.zst2223 Compression: zstd2224 NarHash: sha256:019pq6mi8im4hq2w7hyp5xvx9igckj9fpp4lzqmib70wj215nfjl2225 NarSize: 2482226 References: /nix/var/nix/builds/nix-98979-578903465/TestClientPushesUseOnePush2670157142/001/store/rgw23b3hmbrs1vxr4rrjjy15yi4c1m97-shared-dep2227 CA: text:sha256:067mkfiiqjv7bivh1nbhfn0psrapdsr4s7nyafzvvnig4bg3iawx22282026/10/01 08:35:31 INFO Vacuumed table table=pending_objects22292026/10/01 08:35:31 OK 20260905000000_add_claims.sql (50.77ms)22302026/10/01 08:35:31 OK 20260920000000_drop_claims.sql (32.31ms)22312026/10/01 08:35:31 INFO Vacuumed table table=multipart_uploads22322026/10/01 08:35:31 OK 20260920000000_drop_claims.sql (12.7ms)22332026/10/01 08:35:31 OK 20260923120000_add_pushes.sql (5.11ms)22342026/10/01 08:35:31 goose: successfully migrated database to version: 2026092312000022352026/10/01 08:35:31 OK 1_commit_pending_closure.sql (892.04µs)22362026/10/01 08:35:31 OK 2_object_stats_trigger.sql (246.25µs)22372026/10/01 08:35:31 OK 3_commit_push.sql (217.5µs)22382026/10/01 08:35:31 goose: up to current file version: 322392026/10/01 08:35:31 INFO Vacuumed table table=closures2240--- PASS: TestClientPushesUseOnePush (3.23s)2241=== CONT TestClientCADerivations22422026/10/01 08:35:31 OK 20260923120000_add_pushes.sql (17.68ms)22432026/10/01 08:35:31 goose: successfully migrated database to version: 202609231200002244=== NAME TestPinProtectsFromGC2245 client_integration_test.go:731: Pinned store path: /nix/var/nix/builds/nix-98979-578903465/TestPinProtectsFromGC3469811374/001/store/3c9k4xgj6hxr7nxvvigz6hqnj0wav9sh-pinned-file.txt2246 client_integration_test.go:732: Unpinned store path: /nix/var/nix/builds/nix-98979-578903465/TestPinProtectsFromGC3469811374/001/store/9g0dij9g041sacyf2kn89v0000780r2d-unpinned-file.txt22472026/10/01 08:35:31 OK 1_commit_pending_closure.sql (46.48ms)22482026/10/01 08:35:31 INFO Vacuumed table table=objects22492026/10/01 08:35:31 OK 2_object_stats_trigger.sql (398.58µs)22502026/10/01 08:35:31 OK 3_commit_push.sql (201.25µs)22512026/10/01 08:35:31 goose: up to current file version: 322522026/10/01 08:35:31 INFO Received get closure request method=GET path=/api/closures/000000000000000000000000000000002253--- PASS: TestService_createPendingClosureHandler (4.47s)2254=== CONT TestCacheStatsHandler22552026/10/01 08:35:31 INFO Received push request method=POST path=/api/pushes22562026-10-01 08:35:32.000 UTC [99323] ERROR: relation "goose_db_version" does not exist at character 3622572026-10-01 08:35:32.000 UTC [99323] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC22582026/10/01 08:35:32 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)22592026/10/01 08:35:32 INFO Uploading 3c9k4xgj6hxr7nxvvigz6hqnj0wav9sh-pinned-file.txt (128B)22602026/10/01 08:35:32 WARN Failed to register uploaded object key=nar/0qmhsg42pqsz7x6hh02j8gznnac3yi3qpjhrqbwvz88i194jbb5s.nar.zst error="server returned 404: 404 page not found\n"22612026/10/01 08:35:32 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign22622026/10/01 08:35:32 WARN Failed to register uploaded object key=3c9k4xgj6hxr7nxvvigz6hqnj0wav9sh.ls error="server returned 404: 404 page not found\n"22632026/10/01 08:35:32 INFO Signed narinfos id=1 count=122642026/10/01 08:35:32 INFO Uploading 1 narinfos22652026/10/01 08:35:32 INFO Received complete push request method=POST path=/api/pushes/1/complete22662026/10/01 08:35:32 WARN Failed to register uploaded object key=3c9k4xgj6hxr7nxvvigz6hqnj0wav9sh.narinfo error="server returned 404: 404 page not found\n"22672026/10/01 08:35:32 INFO Upload complete. (164ms)22682026/10/01 08:35:32 INFO Received push request method=POST path=/api/pushes22692026/10/01 08:35:32 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)22702026/10/01 08:35:32 INFO Uploading 9g0dij9g041sacyf2kn89v0000780r2d-unpinned-file.txt (128B)22712026/10/01 08:35:32 WARN Failed to register uploaded object key=9g0dij9g041sacyf2kn89v0000780r2d.ls error="server returned 404: 404 page not found\n"22722026/10/01 08:35:32 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign22732026/10/01 08:35:32 INFO Signed narinfos id=2 count=122742026/10/01 08:35:32 INFO Uploading 1 narinfos22752026/10/01 08:35:32 WARN Failed to register uploaded object key=nar/0gh0wdnr6gmk4r5sfzzh12isnl14rgmkrwy1ws41hpsrlndclg5h.nar.zst error="server returned 404: 404 page not found\n"22762026/10/01 08:35:32 INFO Received complete push request method=POST path=/api/pushes/2/complete22772026/10/01 08:35:32 WARN Failed to register uploaded object key=9g0dij9g041sacyf2kn89v0000780r2d.narinfo error="server returned 404: 404 page not found\n"22782026/10/01 08:35:32 INFO Upload complete. (81ms)22792026/10/01 08:35:32 INFO Received push request method=POST path=/api/pushes22802026/10/01 08:35:32 INFO Received create pin request method=POST path=/api/pins/myapp22812026/10/01 08:35:32 OK 20241026095416_initial_model.sql (220.29ms)22822026/10/01 08:35:32 INFO Uploading 2 paths to 127.0.0.1 (0 already cached)22832026/10/01 08:35:32 INFO Uploading 7d99jnzsyljypcy4h5pnpdz7l5bvv1ni-shared-dep (136B)22842026/10/01 08:35:32 INFO Uploading mqp8z9dawddf0ayqh15mxancf1a7iay4-top (256B)22852026/10/01 08:35:32 OK 20251210153512_drop_unused_gin_index.sql (12.28ms)22862026/10/01 08:35:32 INFO Created/updated pin name=myapp store_path=/nix/var/nix/builds/nix-98979-578903465/TestPinProtectsFromGC3469811374/001/store/3c9k4xgj6hxr7nxvvigz6hqnj0wav9sh-pinned-file.txt narinfo_key=3c9k4xgj6hxr7nxvvigz6hqnj0wav9sh.narinfo22872026/10/01 08:35:32 INFO Starting cleanup of old closures method=DELETE path=/api/closures22882026/10/01 08:35:32 INFO Garbage collection started22892026/10/01 08:35:32 INFO Aborted multipart uploads count=022902026/10/01 08:35:32 WARN Force mode enabled - objects will be deleted immediately without grace period22912026/10/01 08:35:32 WARN Failed to register uploaded object key=7d99jnzsyljypcy4h5pnpdz7l5bvv1ni.ls error="server returned 404: 404 page not found\n"22922026/10/01 08:35:32 WARN Failed to register uploaded object key=mqp8z9dawddf0ayqh15mxancf1a7iay4.ls error="server returned 404: 404 page not found\n"22932026/10/01 08:35:32 WARN Failed to register uploaded object key=nar/1l6ndp3890yqyq35rsm9hgimf4hnh01ah8jy9bm8mfmva0mlxm46.nar.zst error="server returned 404: 404 page not found\n"22942026/10/01 08:35:32 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign22952026/10/01 08:35:32 WARN Failed to register uploaded object key=nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst error="server returned 404: 404 page not found\n"22962026/10/01 08:35:32 INFO Signed narinfos id=1 count=222972026/10/01 08:35:32 INFO Uploading 2 narinfos22982026/10/01 08:35:32 OK 20251218171726_add_pins.sql (35.33ms)22992026/10/01 08:35:32 WARN Failed to register uploaded object key=mqp8z9dawddf0ayqh15mxancf1a7iay4.narinfo error="server returned 404: 404 page not found\n"23002026/10/01 08:35:32 INFO Received complete push request method=POST path=/api/pushes/1/complete23012026/10/01 08:35:32 WARN Failed to register uploaded object key=7d99jnzsyljypcy4h5pnpdz7l5bvv1ni.narinfo error="server returned 404: 404 page not found\n"23022026/10/01 08:35:32 OK 20260628120000_add_object_size_and_stats.sql (17.98ms)23032026/10/01 08:35:32 INFO Upload complete. (157ms)2304=== NAME TestClientSharedPathCommittedMidPush2305 client_integration_test.go:680: Retrieved narinfo from S3:2306 StorePath: /nix/var/nix/builds/nix-98979-578903465/TestClientSharedPathCommittedMidPush4228752628/001/store/7d99jnzsyljypcy4h5pnpdz7l5bvv1ni-shared-dep2307 URL: nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst2308 Compression: zstd2309 NarHash: sha256:1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y822310 NarSize: 1362311 References: 2312 CA: text:sha256:08nxw05k7b0pzzy0f3swvnw4ldxdbclkdnklpidwmrxdhvfrmv7n2313 client_integration_test.go:680: Retrieved narinfo from S3:2314 StorePath: /nix/var/nix/builds/nix-98979-578903465/TestClientSharedPathCommittedMidPush4228752628/001/store/mqp8z9dawddf0ayqh15mxancf1a7iay4-top2315 URL: nar/1l6ndp3890yqyq35rsm9hgimf4hnh01ah8jy9bm8mfmva0mlxm46.nar.zst2316 Compression: zstd2317 NarHash: sha256:1l6ndp3890yqyq35rsm9hgimf4hnh01ah8jy9bm8mfmva0mlxm462318 NarSize: 2562319 References: /nix/var/nix/builds/nix-98979-578903465/TestClientSharedPathCommittedMidPush4228752628/001/store/7d99jnzsyljypcy4h5pnpdz7l5bvv1ni-shared-dep2320 CA: text:sha256:1zfbfxgbnv28926r42gnk91zknhjcp7177n5ld14bayih0imzvsd23212026/10/01 08:35:32 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=3 objects-deleted-after-grace-period=3 objects-failed-to-delete=023222026/10/01 08:35:32 INFO Vacuumed table table=pending_closures23232026/10/01 08:35:32 OK 20260905000000_add_claims.sql (80.57ms)2324=== NAME TestClientMultipleUploads2325 client_integration_test.go:358: Created store path 0: /nix/var/nix/builds/nix-98979-578903465/TestClientMultipleUploads3212323632/001/store/sw4mx0ffg52lnmklshndir3gjhi7q2py-test-file-0.txt23262026/10/01 08:35:32 INFO Vacuumed table table=pending_objects23272026/10/01 08:35:32 INFO Vacuumed table table=multipart_uploads23282026/10/01 08:35:32 OK 20260920000000_drop_claims.sql (49.53ms)2329--- PASS: TestClientSharedPathCommittedMidPush (3.20s)2330=== CONT TestCacheConfigHandler2331=== RUN TestCacheConfigHandler/full_config,_no_issuer2332=== PAUSE TestCacheConfigHandler/full_config,_no_issuer2333=== RUN TestCacheConfigHandler/no_cache_url_configured2334=== PAUSE TestCacheConfigHandler/no_cache_url_configured2335=== RUN TestCacheConfigHandler/no_signing_keys2336=== PAUSE TestCacheConfigHandler/no_signing_keys2337=== RUN TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator2338=== PAUSE TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator2339=== CONT TestService_ReadScope_PublicByDefault23402026/10/01 08:35:32 INFO Vacuumed table table=closures23412026/10/01 08:35:32 OK 20260923120000_add_pushes.sql (13.58ms)23422026/10/01 08:35:32 goose: successfully migrated database to version: 2026092312000023432026/10/01 08:35:32 OK 1_commit_pending_closure.sql (909.92µs)23442026/10/01 08:35:32 OK 2_object_stats_trigger.sql (241.46µs)23452026/10/01 08:35:32 OK 3_commit_push.sql (176.42µs)23462026/10/01 08:35:32 goose: up to current file version: 323472026/10/01 08:35:32 INFO Vacuumed table table=objects2348=== NAME TestClientMultipleUploads2349 client_integration_test.go:358: Created store path 1: /nix/var/nix/builds/nix-98979-578903465/TestClientMultipleUploads3212323632/001/store/a12f450ss5daamy541alqwwd3y456ly9-test-file-1.txt23502026-10-01 08:35:32.570 UTC [99348] ERROR: relation "goose_db_version" does not exist at character 3623512026-10-01 08:35:32.570 UTC [99348] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC2352 client_integration_test.go:358: Created store path 2: /nix/var/nix/builds/nix-98979-578903465/TestClientMultipleUploads3212323632/001/store/i08sj3041v6gr4kahjlikv80gav3wb7j-test-file-2.txt23532026/10/01 08:35:32 INFO Received push request method=POST path=/api/pushes23542026/10/01 08:35:32 OK 20241026095416_initial_model.sql (110.77ms)23552026/10/01 08:35:32 INFO Uploading 3 paths to 127.0.0.1 (0 already cached)23562026/10/01 08:35:32 INFO Uploading sw4mx0ffg52lnmklshndir3gjhi7q2py-test-file-0.txt (160B)23572026/10/01 08:35:32 INFO Uploading a12f450ss5daamy541alqwwd3y456ly9-test-file-1.txt (160B)23582026/10/01 08:35:32 INFO Uploading i08sj3041v6gr4kahjlikv80gav3wb7j-test-file-2.txt (160B)23592026/10/01 08:35:32 OK 20251210153512_drop_unused_gin_index.sql (14.13ms)23602026/10/01 08:35:32 WARN Failed to register uploaded object key=a12f450ss5daamy541alqwwd3y456ly9.ls error="server returned 404: 404 page not found\n"23612026/10/01 08:35:32 WARN Failed to register uploaded object key=nar/13p9pqi0ga6fx2apcwls9hjnv7nmf740ggpn5zvfzdsp5vz2bbg4.nar.zst error="server returned 404: 404 page not found\n"23622026/10/01 08:35:32 WARN Failed to register uploaded object key=sw4mx0ffg52lnmklshndir3gjhi7q2py.ls error="server returned 404: 404 page not found\n"23632026/10/01 08:35:32 WARN Failed to register uploaded object key=nar/1823g6vx4q5zqvr73m7lkq1wpk40fin7bsc792di430yk7sg4lka.nar.zst error="server returned 404: 404 page not found\n"23642026/10/01 08:35:32 WARN Failed to register uploaded object key=i08sj3041v6gr4kahjlikv80gav3wb7j.ls error="server returned 404: 404 page not found\n"23652026/10/01 08:35:32 OK 20251218171726_add_pins.sql (19.45ms)23662026/10/01 08:35:32 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign23672026/10/01 08:35:32 WARN Failed to register uploaded object key=nar/0ahq3izw3h0b0c08p3xdfclh758fwxnp85ccvflasb4vnfsv50ri.nar.zst error="server returned 404: 404 page not found\n"23682026/10/01 08:35:32 INFO Signed narinfos id=1 count=323692026/10/01 08:35:32 INFO Uploading 3 narinfos23702026/10/01 08:35:32 WARN Failed to register uploaded object key=sw4mx0ffg52lnmklshndir3gjhi7q2py.narinfo error="server returned 404: 404 page not found\n"23712026/10/01 08:35:32 WARN Failed to register uploaded object key=i08sj3041v6gr4kahjlikv80gav3wb7j.narinfo error="server returned 404: 404 page not found\n"23722026/10/01 08:35:32 INFO Received complete push request method=POST path=/api/pushes/1/complete23732026/10/01 08:35:32 WARN Failed to register uploaded object key=a12f450ss5daamy541alqwwd3y456ly9.narinfo error="server returned 404: 404 page not found\n"2374=== NAME TestClientWithDependencies2375 client_integration_test.go:613: Built derivation: /nix/var/nix/builds/nix-98979-578903465/TestClientWithDependencies1351644133/001/store/is4zga6v62vipczskj0xl62bgghhq7nc-test-script23762026/10/01 08:35:32 OK 20260628120000_add_object_size_and_stats.sql (44.85ms)23772026/10/01 08:35:32 INFO Upload complete. (149ms)2378=== NAME TestClientMultipleUploads2379 client_integration_test.go:369: Uploaded 3 paths in 183.712083ms23802026-10-01 08:35:32.805 UTC [99360] ERROR: relation "goose_db_version" does not exist at character 3623812026-10-01 08:35:32.805 UTC [99360] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC2382=== NAME TestClientWithDependencies2383 client_integration_test.go:615: Found 1 dependencies (including self)23842026/10/01 08:35:32 OK 20260905000000_add_claims.sql (51.51ms)2385--- PASS: TestClientMultipleUploads (2.93s)2386=== CONT TestService_AuthMiddleware_MTLSBoundSubjects23872026/10/01 08:35:32 OK 20260920000000_drop_claims.sql (18.5ms)23882026/10/01 08:35:32 OK 20260923120000_add_pushes.sql (7.03ms)23892026/10/01 08:35:32 goose: successfully migrated database to version: 202609231200002390=== NAME TestClientIntegration2391 client_integration_test.go:286: Created store path: /nix/var/nix/builds/nix-98979-578903465/TestClientIntegration1530556555/002/store/5c61y98sakd21bvycfxpl64hvd55gii9-test-file.txt23922026/10/01 08:35:32 OK 1_commit_pending_closure.sql (1.55ms)23932026/10/01 08:35:32 OK 2_object_stats_trigger.sql (668.96µs)23942026/10/01 08:35:32 OK 3_commit_push.sql (303.13µs)23952026/10/01 08:35:32 goose: up to current file version: 323962026/10/01 08:35:32 INFO Received push request method=POST path=/api/pushes23972026/10/01 08:35:32 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)23982026/10/01 08:35:32 INFO Uploading is4zga6v62vipczskj0xl62bgghhq7nc-test-script (136B)23992026/10/01 08:35:32 WARN Failed to register uploaded object key=is4zga6v62vipczskj0xl62bgghhq7nc.ls error="server returned 404: 404 page not found\n"24002026/10/01 08:35:32 WARN Failed to register uploaded object key=nar/1s7yghixzpinyqm7g59kyn3sav81pmnsdi5v63m6x4r2vacy907j.nar.zst error="server returned 404: 404 page not found\n"24012026/10/01 08:35:32 WARN Failed to register uploaded object key=log/jh3rzw4miczxzf2866d0wiwj9v0b1jd2-test-script.drv error="server returned 404: 404 page not found\n"24022026/10/01 08:35:32 INFO Received push request method=POST path=/api/pushes24032026/10/01 08:35:32 OK 20241026095416_initial_model.sql (106.15ms)24042026/10/01 08:35:32 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign24052026/10/01 08:35:32 INFO Signed narinfos id=1 count=124062026/10/01 08:35:32 INFO Uploading 1 narinfos24072026/10/01 08:35:32 OK 20251210153512_drop_unused_gin_index.sql (6.32ms)24082026/10/01 08:35:32 INFO Received complete push request method=POST path=/api/pushes/1/complete24092026/10/01 08:35:32 WARN Failed to register uploaded object key=is4zga6v62vipczskj0xl62bgghhq7nc.narinfo error="server returned 404: 404 page not found\n"24102026/10/01 08:35:32 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)24112026/10/01 08:35:32 INFO Uploading 5c61y98sakd21bvycfxpl64hvd55gii9-test-file.txt (152B)24122026/10/01 08:35:33 OK 20251218171726_add_pins.sql (39.49ms)24132026/10/01 08:35:33 WARN Failed to register uploaded object key=5c61y98sakd21bvycfxpl64hvd55gii9.ls error="server returned 404: 404 page not found\n"24142026/10/01 08:35:33 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign24152026/10/01 08:35:33 INFO Signed narinfos id=1 count=124162026/10/01 08:35:33 WARN Failed to register uploaded object key=nar/11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk1.nar.zst error="server returned 404: 404 page not found\n"24172026/10/01 08:35:33 INFO Uploading 1 narinfos24182026/10/01 08:35:33 INFO Received complete push request method=POST path=/api/pushes/1/complete24192026/10/01 08:35:33 WARN Failed to register uploaded object key=5c61y98sakd21bvycfxpl64hvd55gii9.narinfo error="server returned 404: 404 page not found\n"24202026/10/01 08:35:33 OK 20260628120000_add_object_size_and_stats.sql (84.2ms)24212026/10/01 08:35:33 INFO Upload complete. (187ms)24222026/10/01 08:35:33 INFO Upload complete. (229ms)2423=== NAME TestClientWithDependencies2424 client_integration_test.go:617: Skipping nix copy test - isolated store (/nix/var/nix/builds/nix-98979-578903465/TestClientWithDependencies1351644133/001/store) requires matching store prefix24252026/10/01 08:35:33 INFO All 1 paths already cached2426=== NAME TestClientIntegration2427 client_integration_test.go:312: Retrieved narinfo from S3:2428 StorePath: /nix/var/nix/builds/nix-98979-578903465/TestClientIntegration1530556555/002/store/5c61y98sakd21bvycfxpl64hvd55gii9-test-file.txt2429 URL: nar/11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk1.nar.zst2430 Compression: zstd2431 NarHash: sha256:11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk12432 NarSize: 1522433 References: 2434 CA: fixed:r:sha256:11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk12435 client_integration_test.go:313: Retrieved .ls file from S3 (compressed size: 77 bytes)2436 client_integration_test.go:313: Decompressed .ls content (64 bytes):2437 {"version":1,"root":{"type":"regular","size":39,"narOffset":96}}2438 client_integration_test.go:316: Testing garbage collection...2439--- PASS: TestService_ReadAuthMiddleware (2.53s)2440=== CONT TestService_AuthMiddleware_MTLSProxyHeader24412026/10/01 08:35:33 OK 20260905000000_add_claims.sql (65.8ms)24422026/10/01 08:35:33 INFO Starting cleanup of old closures method=DELETE path=/api/closures24432026/10/01 08:35:33 INFO Garbage collection started24442026/10/01 08:35:33 INFO Aborted multipart uploads count=024452026/10/01 08:35:33 WARN Force mode enabled - objects will be deleted immediately without grace period2446--- PASS: TestClientWithDependencies (3.39s)2447=== CONT TestProxyWriteTimeout/narinfo2448=== CONT TestProxyWriteTimeout/unknown_size2449=== CONT TestProxyWriteTimeout/10_GiB_nar2450=== CONT TestProxyWriteTimeout/1_GiB_nar2451--- PASS: TestProxyWriteTimeout (0.00s)2452 --- PASS: TestProxyWriteTimeout/narinfo (0.00s)2453 --- PASS: TestProxyWriteTimeout/unknown_size (0.00s)2454 --- PASS: TestProxyWriteTimeout/10_GiB_nar (0.00s)2455 --- PASS: TestProxyWriteTimeout/1_GiB_nar (0.00s)2456=== CONT TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info24572026/10/01 08:35:33 INFO Received uploads request method=POST path=/2458=== CONT TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key24592026/10/01 08:35:33 INFO Received complete multipart upload request method=POST path=/2460=== CONT TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key24612026/10/01 08:35:33 INFO Received request for more parts method=POST path=/2462=== CONT TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal24632026/10/01 08:35:33 INFO Received uploads request method=POST path=/2464--- PASS: TestUploadHandlersRejectInvalidKeys (0.01s)2465 --- PASS: TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info (0.00s)2466 --- PASS: TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key (0.00s)2467 --- PASS: TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key (0.00s)2468 --- PASS: TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal (0.00s)2469=== CONT TestIsValidUploadKey/narinfo2470=== CONT TestIsValidUploadKey/nix-cache-info2471=== CONT TestIsValidUploadKey/realisation_plus_in_output2472=== CONT TestIsValidUploadKey/realisation2473=== CONT TestIsValidUploadKey/build_log_equals2474=== CONT TestIsValidUploadKey/build_log_question_mark2475=== CONT TestIsValidUploadKey/build_log_plus_in_name2476=== CONT TestIsValidUploadKey/build_log_home-manager_file2477=== CONT TestIsValidUploadKey/build_log2478=== CONT TestIsValidUploadKey/nar_xz2479=== CONT TestIsValidUploadKey/nar_zst2480=== CONT TestIsValidUploadKey/nar_plain2481=== CONT TestIsValidUploadKey/listing2482=== CONT TestIsValidUploadKey/traversal2483=== CONT TestIsValidUploadKey/unknown_type2484=== CONT TestIsValidUploadKey/nar_key,_narinfo_type2485=== CONT TestIsValidUploadKey/listing_key,_narinfo_type2486=== CONT TestIsValidUploadKey/empty_key2487=== CONT TestIsValidUploadKey/absolute2488=== CONT TestIsValidUploadKey/traversal_nar2489=== CONT TestIsValidUploadKey/index.html2490=== CONT TestIsValidUploadKey/narinfo_key,_nar_type2491--- PASS: TestIsValidUploadKey (0.01s)2492 --- PASS: TestIsValidUploadKey/narinfo (0.00s)2493 --- PASS: TestIsValidUploadKey/nix-cache-info (0.00s)2494 --- PASS: TestIsValidUploadKey/realisation_plus_in_output (0.00s)2495 --- PASS: TestIsValidUploadKey/realisation (0.00s)2496 --- PASS: TestIsValidUploadKey/build_log_equals (0.00s)2497 --- PASS: TestIsValidUploadKey/build_log_question_mark (0.00s)2498 --- PASS: TestIsValidUploadKey/build_log_plus_in_name (0.00s)2499 --- PASS: TestIsValidUploadKey/build_log_home-manager_file (0.00s)2500 --- PASS: TestIsValidUploadKey/build_log (0.00s)2501 --- PASS: TestIsValidUploadKey/nar_xz (0.00s)2502 --- PASS: TestIsValidUploadKey/nar_zst (0.00s)2503 --- PASS: TestIsValidUploadKey/nar_plain (0.00s)2504 --- PASS: TestIsValidUploadKey/listing (0.00s)2505 --- PASS: TestIsValidUploadKey/traversal (0.00s)2506 --- PASS: TestIsValidUploadKey/unknown_type (0.00s)2507 --- PASS: TestIsValidUploadKey/nar_key,_narinfo_type (0.00s)2508 --- PASS: TestIsValidUploadKey/listing_key,_narinfo_type (0.00s)2509 --- PASS: TestIsValidUploadKey/empty_key (0.00s)2510 --- PASS: TestIsValidUploadKey/absolute (0.00s)2511 --- PASS: TestIsValidUploadKey/traversal_nar (0.00s)2512 --- PASS: TestIsValidUploadKey/index.html (0.00s)2513 --- PASS: TestIsValidUploadKey/narinfo_key,_nar_type (0.00s)2514=== CONT TestPush_RejectsBadRequests/no_roots25152026/10/01 08:35:33 INFO Received push request method=POST path=/api/pushes2516=== CONT TestPush_RejectsBadRequests/bad_root25172026/10/01 08:35:33 INFO Received push request method=POST path=/api/pushes2518=== CONT TestPush_RejectsBadRequests/root_not_in_objects25192026/10/01 08:35:33 INFO Received push request method=POST path=/api/pushes2520=== CONT TestPush_RejectsBadRequests/no_objects25212026/10/01 08:35:33 INFO Received push request method=POST path=/api/pushes2522=== CONT TestIsValidCachePath/narinfo2523=== CONT TestIsValidCachePath/invalid_char_e2524=== CONT TestIsValidCachePath/traversal_in_middle2525=== CONT TestIsValidCachePath/traversal_parent2526=== CONT TestIsValidCachePath/index.html2527=== CONT TestIsValidCachePath/nix-cache-info2528=== CONT TestIsValidCachePath/realisation2529=== CONT TestIsValidCachePath/log2530--- PASS: TestPush_RejectsBadRequests (2.39s)2531 --- PASS: TestPush_RejectsBadRequests/no_roots (0.00s)2532 --- PASS: TestPush_RejectsBadRequests/bad_root (0.00s)2533 --- PASS: TestPush_RejectsBadRequests/root_not_in_objects (0.00s)2534 --- PASS: TestPush_RejectsBadRequests/no_objects (0.00s)2535=== CONT TestIsValidCachePath/ls2536=== CONT TestIsValidCachePath/nar_uncompressed2537=== CONT TestIsValidCachePath/nar_bz22538=== CONT TestIsValidCachePath/nar_xz2539=== CONT TestIsValidCachePath/nar_zst2540=== CONT TestIsValidCachePath/narinfo_all_nix_base32_chars2541=== CONT TestIsValidCachePath/wrong_extension2542=== CONT TestIsValidCachePath/short_hash2543=== CONT TestIsValidCachePath/empty2544=== CONT TestIsValidCachePath/leading_slash2545=== CONT TestIsValidCachePath/random_path2546=== CONT TestIsValidCachePath/invalid_char_u2547--- PASS: TestIsValidCachePath (0.00s)2548 --- PASS: TestIsValidCachePath/narinfo (0.00s)2549 --- PASS: TestIsValidCachePath/invalid_char_e (0.00s)2550 --- PASS: TestIsValidCachePath/traversal_in_middle (0.00s)2551 --- PASS: TestIsValidCachePath/traversal_parent (0.00s)2552 --- PASS: TestIsValidCachePath/index.html (0.00s)2553 --- PASS: TestIsValidCachePath/nix-cache-info (0.00s)2554 --- PASS: TestIsValidCachePath/realisation (0.00s)2555 --- PASS: TestIsValidCachePath/log (0.00s)2556 --- PASS: TestIsValidCachePath/ls (0.00s)2557 --- PASS: TestIsValidCachePath/nar_uncompressed (0.00s)2558 --- PASS: TestIsValidCachePath/nar_bz2 (0.00s)2559 --- PASS: TestIsValidCachePath/nar_xz (0.00s)2560 --- PASS: TestIsValidCachePath/nar_zst (0.00s)2561 --- PASS: TestIsValidCachePath/narinfo_all_nix_base32_chars (0.00s)2562 --- PASS: TestIsValidCachePath/wrong_extension (0.00s)2563 --- PASS: TestIsValidCachePath/short_hash (0.00s)2564 --- PASS: TestIsValidCachePath/empty (0.00s)2565 --- PASS: TestIsValidCachePath/leading_slash (0.00s)2566 --- PASS: TestIsValidCachePath/random_path (0.00s)2567 --- PASS: TestIsValidCachePath/invalid_char_u (0.00s)2568=== CONT TestParseSingleRange/none2569=== CONT TestParseSingleRange/single_byte2570=== CONT TestParseSingleRange/suffix_exceeds_size2571=== CONT TestParseSingleRange/suffix2572=== CONT TestParseSingleRange/end_clamped_to_size2573=== CONT TestParseSingleRange/open-ended2574=== CONT TestParseSingleRange/closed2575=== CONT TestParseSingleRange/malformed_end_before_start2576=== CONT TestParseSingleRange/malformed_both_empty2577=== CONT TestParseSingleRange/malformed_no_dash2578=== CONT TestParseSingleRange/multi-range_ignored2579=== CONT TestParseSingleRange/start_past_EOF2580=== CONT TestParseSingleRange/unknown_unit2581=== CONT TestParseSingleRange/start_far_past_EOF2582--- PASS: TestParseSingleRange (0.00s)2583 --- PASS: TestParseSingleRange/none (0.00s)2584 --- PASS: TestParseSingleRange/single_byte (0.00s)2585 --- PASS: TestParseSingleRange/suffix_exceeds_size (0.00s)2586 --- PASS: TestParseSingleRange/suffix (0.00s)2587 --- PASS: TestParseSingleRange/end_clamped_to_size (0.00s)2588 --- PASS: TestParseSingleRange/open-ended (0.00s)2589 --- PASS: TestParseSingleRange/closed (0.00s)2590 --- PASS: TestParseSingleRange/malformed_end_before_start (0.00s)2591 --- PASS: TestParseSingleRange/malformed_both_empty (0.00s)2592 --- PASS: TestParseSingleRange/malformed_no_dash (0.00s)2593 --- PASS: TestParseSingleRange/multi-range_ignored (0.00s)2594 --- PASS: TestParseSingleRange/start_past_EOF (0.00s)2595 --- PASS: TestParseSingleRange/unknown_unit (0.00s)2596 --- PASS: TestParseSingleRange/start_far_past_EOF (0.00s)2597=== CONT TestServerTLSConfig/no_client_CA2598=== CONT TestServerTLSConfig/not_a_PEM_file25992026/10/01 08:35:33 OK 20260920000000_drop_claims.sql (36.64ms)2600=== CONT TestServerTLSConfig/missing_CA_file2601--- PASS: TestServerTLSConfig (0.00s)2602 --- PASS: TestServerTLSConfig/no_client_CA (0.00s)2603 --- PASS: TestServerTLSConfig/not_a_PEM_file (0.02s)2604 --- PASS: TestServerTLSConfig/missing_CA_file (0.00s)2605=== CONT TestForceGCDuringPushOffersSweptObject/before_pending_rows26062026/10/01 08:35:33 OK 20260923120000_add_pushes.sql (12.69ms)26072026/10/01 08:35:33 goose: successfully migrated database to version: 2026092312000026082026/10/01 08:35:33 OK 1_commit_pending_closure.sql (2.76ms)26092026/10/01 08:35:33 OK 2_object_stats_trigger.sql (411.79µs)26102026/10/01 08:35:33 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=3 objects-deleted-after-grace-period=3 objects-failed-to-delete=026112026/10/01 08:35:33 OK 3_commit_push.sql (200.29µs)26122026/10/01 08:35:33 goose: up to current file version: 326132026/10/01 08:35:33 INFO Vacuumed table table=pending_closures26142026/10/01 08:35:33 INFO Vacuumed table table=pending_objects26152026/10/01 08:35:33 INFO Vacuumed table table=multipart_uploads26162026/10/01 08:35:33 INFO Vacuumed table table=closures26172026/10/01 08:35:33 INFO Vacuumed table table=objects2618=== RUN TestService_AuthMiddleware_OIDC/valid_OIDC_token2619=== PAUSE TestService_AuthMiddleware_OIDC/valid_OIDC_token2620=== RUN TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected2621=== PAUSE TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected2622=== RUN TestService_AuthMiddleware_OIDC/malformed_token_rejected2623=== PAUSE TestService_AuthMiddleware_OIDC/malformed_token_rejected2624=== RUN TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured2625=== PAUSE TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured2626=== CONT TestForceGCDuringPushOffersSweptObject/after_presence_check26272026-10-01 08:35:33.621 UTC [99384] ERROR: relation "goose_db_version" does not exist at character 3626282026-10-01 08:35:33.621 UTC [99384] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC26292026-10-01 08:35:33.638 UTC [99385] ERROR: relation "goose_db_version" does not exist at character 3626302026-10-01 08:35:33.638 UTC [99385] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC26312026-10-01 08:35:33.639 UTC [99386] ERROR: relation "goose_db_version" does not exist at character 3626322026-10-01 08:35:33.639 UTC [99386] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC26332026/10/01 08:35:33 OK 20241026095416_initial_model.sql (84.54ms)26342026/10/01 08:35:33 OK 20251210153512_drop_unused_gin_index.sql (1.49ms)26352026/10/01 08:35:33 OK 20241026095416_initial_model.sql (53.19ms)26362026/10/01 08:35:33 OK 20241026095416_initial_model.sql (53.34ms)26372026/10/01 08:35:33 OK 20251210153512_drop_unused_gin_index.sql (1.21ms)26382026/10/01 08:35:33 OK 20251210153512_drop_unused_gin_index.sql (1.09ms)26392026/10/01 08:35:33 OK 20251218171726_add_pins.sql (4.25ms)26402026/10/01 08:35:33 OK 20251218171726_add_pins.sql (2.1ms)26412026/10/01 08:35:33 OK 20251218171726_add_pins.sql (2.17ms)26422026-10-01 08:35:33.745 UTC [99387] ERROR: relation "goose_db_version" does not exist at character 3626432026-10-01 08:35:33.745 UTC [99387] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC26442026/10/01 08:35:33 OK 20260628120000_add_object_size_and_stats.sql (19.03ms)26452026/10/01 08:35:33 OK 20260628120000_add_object_size_and_stats.sql (19.9ms)26462026/10/01 08:35:33 OK 20260628120000_add_object_size_and_stats.sql (20.5ms)26472026/10/01 08:35:33 OK 20260905000000_add_claims.sql (4.97ms)26482026/10/01 08:35:33 OK 20260920000000_drop_claims.sql (1.89ms)26492026/10/01 08:35:33 OK 20260905000000_add_claims.sql (3.92ms)26502026/10/01 08:35:33 OK 20260905000000_add_claims.sql (4.66ms)26512026/10/01 08:35:33 OK 20260920000000_drop_claims.sql (1.22ms)26522026/10/01 08:35:33 OK 20260920000000_drop_claims.sql (1.2ms)26532026/10/01 08:35:33 OK 20260923120000_add_pushes.sql (851µs)26542026/10/01 08:35:33 goose: successfully migrated database to version: 2026092312000026552026/10/01 08:35:33 OK 20260923120000_add_pushes.sql (965.79µs)26562026/10/01 08:35:33 goose: successfully migrated database to version: 2026092312000026572026/10/01 08:35:33 OK 20260923120000_add_pushes.sql (2.64ms)26582026/10/01 08:35:33 goose: successfully migrated database to version: 2026092312000026592026/10/01 08:35:33 OK 1_commit_pending_closure.sql (2.22ms)26602026/10/01 08:35:33 OK 1_commit_pending_closure.sql (2.24ms)26612026/10/01 08:35:33 OK 1_commit_pending_closure.sql (1.97ms)26622026/10/01 08:35:33 OK 2_object_stats_trigger.sql (520.79µs)26632026/10/01 08:35:33 OK 2_object_stats_trigger.sql (605.42µs)26642026/10/01 08:35:33 OK 2_object_stats_trigger.sql (603.08µs)26652026/10/01 08:35:33 OK 3_commit_push.sql (525.79µs)26662026/10/01 08:35:33 goose: up to current file version: 326672026/10/01 08:35:33 OK 3_commit_push.sql (365.04µs)26682026/10/01 08:35:33 goose: up to current file version: 326692026/10/01 08:35:33 OK 3_commit_push.sql (402.63µs)26702026/10/01 08:35:33 goose: up to current file version: 326712026/10/01 08:35:33 OK 20241026095416_initial_model.sql (29.81ms)26722026/10/01 08:35:33 OK 20251210153512_drop_unused_gin_index.sql (12.37ms)26732026/10/01 08:35:33 OK 20251218171726_add_pins.sql (2.29ms)26742026/10/01 08:35:33 OK 20260628120000_add_object_size_and_stats.sql (28.24ms)26752026/10/01 08:35:33 OK 20260905000000_add_claims.sql (110.5ms)26762026/10/01 08:35:33 OK 20260920000000_drop_claims.sql (45.61ms)26772026/10/01 08:35:33 OK 20260923120000_add_pushes.sql (9.84ms)26782026/10/01 08:35:33 goose: successfully migrated database to version: 2026092312000026792026/10/01 08:35:33 OK 1_commit_pending_closure.sql (3.99ms)26802026/10/01 08:35:34 OK 2_object_stats_trigger.sql (807.67µs)26812026/10/01 08:35:34 OK 3_commit_push.sql (642.46µs)26822026/10/01 08:35:34 goose: up to current file version: 32683--- PASS: TestCacheStatsHandler (2.12s)2684=== CONT TestClientErrorHandling/InvalidStorePath26852026/10/01 08:35:34 INFO Garbage collection progress phase="" failed_uploads_deleted=0 old_closures_deleted=1 objects_marked=3 objects_deleted=3 objects_failed=02686=== NAME TestPinProtectsFromGC2687 client_integration_test.go:794: Pin successfully protected closure from garbage collection2688--- PASS: TestPinProtectsFromGC (5.22s)2689=== CONT TestClientErrorHandling/ServerNotAvailable2690{"timestamp":"2026-10-01T08:35:34.42168Z","level":"ERROR","message":"Scanner cycle completed without a durable data usage snapshot","event":"scanner_persist_state","component":"scanner","subsystem":"runtime","cycle":4,"outcome":"NoUpdate","state":"usage_not_durable","target":"rustfs::scanner","filename":"crates/scanner/src/scanner.rs","line_number":2350,"threadName":"rustfs-worker","threadId":"ThreadId(2)"}2691=== RUN TestService_RequireScope_OIDC/builder_may_write2692=== PAUSE TestService_RequireScope_OIDC/builder_may_write2693=== RUN TestService_RequireScope_OIDC/builder_may_not_admin2694=== PAUSE TestService_RequireScope_OIDC/builder_may_not_admin2695=== RUN TestService_RequireScope_OIDC/ops_may_admin2696=== PAUSE TestService_RequireScope_OIDC/ops_may_admin2697=== RUN TestService_RequireScope_OIDC/ops_may_not_write2698=== PAUSE TestService_RequireScope_OIDC/ops_may_not_write2699=== RUN TestService_RequireScope_OIDC/reader_may_not_write2700=== PAUSE TestService_RequireScope_OIDC/reader_may_not_write2701=== RUN TestService_RequireScope_OIDC/static_token_may_admin2702=== PAUSE TestService_RequireScope_OIDC/static_token_may_admin2703=== RUN TestService_RequireScope_OIDC/static_token_may_write2704=== PAUSE TestService_RequireScope_OIDC/static_token_may_write2705=== RUN TestService_RequireScope_OIDC/reader_may_read2706=== PAUSE TestService_RequireScope_OIDC/reader_may_read2707=== RUN TestService_RequireScope_OIDC/writer_implies_read2708=== PAUSE TestService_RequireScope_OIDC/writer_implies_read2709=== RUN TestService_RequireScope_OIDC/anonymous_may_not_read2710=== PAUSE TestService_RequireScope_OIDC/anonymous_may_not_read2711=== CONT TestClientErrorHandling/InvalidAuthToken27122026/10/01 08:35:34 WARN Request failed, retrying attempt=1 max_attempts=6 backoff=100ms error="Post \"http://localhost:19999/api/objects/present\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/objects/present27132026-10-01 08:35:34.655 UTC [99397] ERROR: relation "goose_db_version" does not exist at character 3627142026-10-01 08:35:34.655 UTC [99397] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC27152026/10/01 08:35:34 WARN Request failed, retrying attempt=2 max_attempts=6 backoff=198.01477ms error="Post \"http://localhost:19999/api/objects/present\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/objects/present27162026-10-01 08:35:34.761 UTC [99402] ERROR: relation "goose_db_version" does not exist at character 3627172026-10-01 08:35:34.761 UTC [99402] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC27182026-10-01 08:35:34.794 UTC [99403] ERROR: relation "goose_db_version" does not exist at character 3627192026-10-01 08:35:34.794 UTC [99403] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC2720=== NAME TestClientCADerivations2721 client_ca_test.go:136: Built CA derivation: /nix/var/nix/builds/nix-98979-578903465/TestClientCADerivations1280321261/001/store/4y144fiyl854aldb54nxfb3hpi3bivxs-ca-test2722--- PASS: TestService_ReadScope_PublicByDefault (2.37s)2723=== CONT TestResolveDBConnectionString/flag_wins2724=== CONT TestResolveDBConnectionString/PGHOST_allows_empty2725=== CONT TestResolveDBConnectionString/nothing_configured2726=== CONT TestResolveDBConnectionString/missing_file_is_an_error2727=== CONT TestResolveDBConnectionString/file_when_flag_empty2728=== CONT TestUploadHandlersRejectOversizedBody/create_pending_closure27292026/10/01 08:35:34 INFO Received uploads request method=POST path=/2730--- PASS: TestResolveDBConnectionString (0.03s)2731 --- PASS: TestResolveDBConnectionString/flag_wins (0.00s)2732 --- PASS: TestResolveDBConnectionString/PGHOST_allows_empty (0.00s)2733 --- PASS: TestResolveDBConnectionString/nothing_configured (0.00s)2734 --- PASS: TestResolveDBConnectionString/missing_file_is_an_error (0.00s)2735 --- PASS: TestResolveDBConnectionString/file_when_flag_empty (0.00s)27362026/10/01 08:35:34 OK 20241026095416_initial_model.sql (126.48ms)27372026/10/01 08:35:34 OK 20251210153512_drop_unused_gin_index.sql (10.17ms)2738=== NAME TestClientCADerivations2739 client_ca_test.go:139: Found 1 dependencies (including self)27402026/10/01 08:35:34 OK 20251218171726_add_pins.sql (22.58ms)27412026/10/01 08:35:34 OK 20260628120000_add_object_size_and_stats.sql (18.59ms)27422026/10/01 08:35:34 OK 20241026095416_initial_model.sql (81.7ms)27432026/10/01 08:35:34 OK 20251210153512_drop_unused_gin_index.sql (880.25µs)27442026/10/01 08:35:34 OK 20260905000000_add_claims.sql (3.79ms)27452026/10/01 08:35:34 OK 20251218171726_add_pins.sql (3.64ms)27462026/10/01 08:35:34 OK 20260920000000_drop_claims.sql (8.01ms)27472026-10-01 08:35:34.897 UTC [99409] ERROR: relation "goose_db_version" does not exist at character 3627482026-10-01 08:35:34.897 UTC [99409] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC27492026/10/01 08:35:34 OK 20260923120000_add_pushes.sql (6.16ms)27502026/10/01 08:35:34 goose: successfully migrated database to version: 2026092312000027512026/10/01 08:35:34 OK 1_commit_pending_closure.sql (1.21ms)27522026/10/01 08:35:34 OK 2_object_stats_trigger.sql (218.25µs)27532026/10/01 08:35:34 OK 3_commit_push.sql (179.54µs)27542026/10/01 08:35:34 goose: up to current file version: 327552026/10/01 08:35:34 OK 20260628120000_add_object_size_and_stats.sql (18.02ms)27562026/10/01 08:35:34 OK 20241026095416_initial_model.sql (84.47ms)27572026/10/01 08:35:34 WARN Request failed, retrying attempt=3 max_attempts=6 backoff=372.229499ms error="Post \"http://localhost:19999/api/objects/present\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/objects/present27582026/10/01 08:35:34 OK 20251210153512_drop_unused_gin_index.sql (10.65ms)27592026/10/01 08:35:34 OK 20260905000000_add_claims.sql (41.59ms)27602026/10/01 08:35:34 OK 20251218171726_add_pins.sql (12.99ms)27612026/10/01 08:35:34 OK 20260920000000_drop_claims.sql (1.5ms)27622026/10/01 08:35:34 OK 20260628120000_add_object_size_and_stats.sql (8.66ms)27632026/10/01 08:35:34 OK 20260923120000_add_pushes.sql (8.48ms)27642026/10/01 08:35:34 goose: successfully migrated database to version: 2026092312000027652026/10/01 08:35:34 OK 1_commit_pending_closure.sql (1.09ms)27662026/10/01 08:35:34 OK 2_object_stats_trigger.sql (211.67µs)27672026/10/01 08:35:34 OK 3_commit_push.sql (162.29µs)27682026/10/01 08:35:34 goose: up to current file version: 327692026/10/01 08:35:34 INFO Received push request method=POST path=/api/pushes27702026/10/01 08:35:34 OK 20260905000000_add_claims.sql (32.02ms)27712026/10/01 08:35:34 OK 20241026095416_initial_model.sql (52.01ms)27722026/10/01 08:35:35 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)27732026/10/01 08:35:35 INFO Uploading 4y144fiyl854aldb54nxfb3hpi3bivxs-ca-test (144B)27742026/10/01 08:35:35 OK 20251210153512_drop_unused_gin_index.sql (13.31ms)27752026/10/01 08:35:35 OK 20260920000000_drop_claims.sql (30.27ms)27762026/10/01 08:35:35 WARN Failed to register uploaded object key=4y144fiyl854aldb54nxfb3hpi3bivxs.ls error="server returned 404: 404 page not found\n"27772026/10/01 08:35:35 OK 20260923120000_add_pushes.sql (6.52ms)27782026/10/01 08:35:35 goose: successfully migrated database to version: 2026092312000027792026/10/01 08:35:35 WARN Failed to register uploaded object key=nar/04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n.nar.zst error="server returned 404: 404 page not found\n"27802026/10/01 08:35:35 OK 20251218171726_add_pins.sql (16.71ms)27812026/10/01 08:35:35 OK 1_commit_pending_closure.sql (1.14ms)27822026/10/01 08:35:35 OK 2_object_stats_trigger.sql (213.29µs)27832026/10/01 08:35:35 OK 3_commit_push.sql (175.75µs)27842026/10/01 08:35:35 goose: up to current file version: 327852026/10/01 08:35:35 WARN Failed to register uploaded object key=log/ab636hqv02v1bnfiw2jaaw3xz35p237g-ca-test.drv error="server returned 404: 404 page not found\n"27862026/10/01 08:35:35 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign27872026/10/01 08:35:35 INFO Signed narinfos id=1 count=127882026/10/01 08:35:35 INFO Uploading 1 narinfos27892026/10/01 08:35:35 OK 20260628120000_add_object_size_and_stats.sql (45.33ms)27902026/10/01 08:35:35 INFO Received complete push request method=POST path=/api/pushes/1/complete27912026/10/01 08:35:35 WARN Failed to register uploaded object key=4y144fiyl854aldb54nxfb3hpi3bivxs.narinfo error="server returned 404: 404 page not found\n"27922026/10/01 08:35:35 INFO Upload complete. (214ms)2793 client_ca_test.go:180: Narinfo contains CA field: StorePath: /nix/var/nix/builds/nix-98979-578903465/TestClientCADerivations1280321261/001/store/4y144fiyl854aldb54nxfb3hpi3bivxs-ca-test2794 URL: nar/04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n.nar.zst2795 Compression: zstd2796 NarHash: sha256:04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n2797 NarSize: 1442798 References: 2799 Deriver: /nix/var/nix/builds/nix-98979-578903465/TestClientCADerivations1280321261/001/store/ab636hqv02v1bnfiw2jaaw3xz35p237g-ca-test.drv2800 CA: fixed:r:sha256:04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n2801 client_ca_test.go:185: Checking for realisation files in S3...2802 client_ca_test.go:207: No realisation files uploaded - this is expected for locally built CA derivations2803 client_ca_test.go:208: Locally built CA derivations don't have DrvOutput IDs until they're substituted from a cache2804=== CONT TestUploadHandlersRejectOversizedBody/request_more_parts28052026/10/01 08:35:35 INFO Received request for more parts method=POST path=/28062026/10/01 08:35:35 OK 20260905000000_add_claims.sql (44.13ms)28072026/10/01 08:35:35 WARN mTLS auth: subject not in bound subjects subject="CN=untrusted,O=Other"28082026/10/01 08:35:35 WARN mTLS auth: bound subjects configured but subject DN unavailable28092026/10/01 08:35:35 WARN mTLS auth: subject not in bound subjects subject="CN=untrusted"2810--- PASS: TestService_AuthMiddleware_MTLSBoundSubjects (2.25s)2811=== CONT TestUploadHandlersRejectOversizedBody/complete_multipart28122026/10/01 08:35:35 INFO Received complete multipart upload request method=POST path=/2813=== CONT TestCacheConfigHandler/full_config,_no_issuer2814=== CONT TestCacheConfigHandler/no_signing_keys2815=== CONT TestCacheConfigHandler/no_cache_url_configured2816=== CONT TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator2817--- PASS: TestCacheConfigHandler (0.00s)2818 --- PASS: TestCacheConfigHandler/full_config,_no_issuer (0.00s)2819 --- PASS: TestCacheConfigHandler/no_signing_keys (0.00s)2820 --- PASS: TestCacheConfigHandler/no_cache_url_configured (0.00s)2821 --- PASS: TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator (0.00s)2822=== CONT TestService_AuthMiddleware_OIDC/valid_OIDC_token2823=== CONT TestService_AuthMiddleware_OIDC/malformed_token_rejected28242026/10/01 08:35:35 WARN Authentication failed token_preview=not-a-valid-jwt token_length=15 oidc_error="no provider could verify the token (signature or issuer mismatch)" oidc_provider="" tried_providers=[test]2825=== CONT TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured2826=== CONT TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected28272026/10/01 08:35:35 WARN Authentication failed token_preview=eyJhbGciOi...UYG5ggBh4A token_length=701 oidc_error="no rule matched: claim \"repository_owner\" value [otherorg] not in allowed patterns [myorg]" oidc_provider=test tried_providers=[test]2828=== CONT TestService_RequireScope_OIDC/builder_may_write2829=== CONT TestService_RequireScope_OIDC/static_token_may_admin2830=== CONT TestService_RequireScope_OIDC/anonymous_may_not_read2831=== CONT TestService_RequireScope_OIDC/writer_implies_read2832=== CONT TestService_RequireScope_OIDC/reader_may_read2833=== CONT TestService_RequireScope_OIDC/static_token_may_write2834=== CONT TestService_RequireScope_OIDC/ops_may_admin2835=== CONT TestService_RequireScope_OIDC/ops_may_not_write2836=== CONT TestService_RequireScope_OIDC/reader_may_not_write2837=== CONT TestService_RequireScope_OIDC/builder_may_not_admin2838--- PASS: TestUploadHandlersRejectOversizedBody (0.03s)2839 --- PASS: TestUploadHandlersRejectOversizedBody/create_pending_closure (0.29s)2840 --- PASS: TestUploadHandlersRejectOversizedBody/request_more_parts (0.02s)2841 --- PASS: TestUploadHandlersRejectOversizedBody/complete_multipart (0.02s)2842--- PASS: TestService_RequireScope_OIDC (2.86s)2843 --- PASS: TestService_RequireScope_OIDC/builder_may_write (0.00s)2844 --- PASS: TestService_RequireScope_OIDC/static_token_may_admin (0.00s)2845 --- PASS: TestService_RequireScope_OIDC/anonymous_may_not_read (0.00s)2846 --- PASS: TestService_RequireScope_OIDC/writer_implies_read (0.00s)2847 --- PASS: TestService_RequireScope_OIDC/reader_may_read (0.00s)2848 --- PASS: TestService_RequireScope_OIDC/static_token_may_write (0.00s)2849 --- PASS: TestService_RequireScope_OIDC/ops_may_admin (0.00s)2850 --- PASS: TestService_RequireScope_OIDC/ops_may_not_write (0.00s)2851 --- PASS: TestService_RequireScope_OIDC/reader_may_not_write (0.00s)2852 --- PASS: TestService_RequireScope_OIDC/builder_may_not_admin (0.00s)2853--- PASS: TestService_AuthMiddleware_OIDC (2.58s)2854 --- PASS: TestService_AuthMiddleware_OIDC/valid_OIDC_token (0.00s)2855 --- PASS: TestService_AuthMiddleware_OIDC/malformed_token_rejected (0.00s)2856 --- PASS: TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured (0.00s)2857 --- PASS: TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected (0.00s)28582026/10/01 08:35:35 OK 20260920000000_drop_claims.sql (29.37ms)28592026/10/01 08:35:35 OK 20260923120000_add_pushes.sql (21.9ms)28602026/10/01 08:35:35 goose: successfully migrated database to version: 2026092312000028612026/10/01 08:35:35 OK 1_commit_pending_closure.sql (897.71µs)28622026/10/01 08:35:35 OK 2_object_stats_trigger.sql (220.46µs)28632026/10/01 08:35:35 OK 3_commit_push.sql (193.92µs)28642026/10/01 08:35:35 goose: up to current file version: 328652026/10/01 08:35:35 INFO Garbage collection progress phase="" failed_uploads_deleted=0 old_closures_deleted=1 objects_marked=3 objects_deleted=3 objects_failed=02866=== NAME TestClientIntegration2867 client_integration_test.go:323: Objects in database after GC:2868 client_integration_test.go:323: Successfully deleted all objects with GC --force2869=== NAME TestClientCADerivations2870 client_ca_test.go:258: nix copy output: error: binary cache 's3://bucket71?endpoint=http://localhost:61532®ion=eu-west-1' is for Nix stores with prefix '/nix/store', not '/nix/var/nix/builds/nix-98979-578903465/TestClientCADerivations1280321261/001/store'2871 client_ca_test.go:259: nix copy failed (might be expected with isolated stores): exit status 12872--- PASS: TestClientIntegration (4.97s)2873--- PASS: TestClientCADerivations (3.37s)28742026/10/01 08:35:35 WARN Request failed, retrying attempt=4 max_attempts=6 backoff=833.257201ms error="Post \"http://localhost:19999/api/objects/present\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/objects/present2875--- PASS: TestService_AuthMiddleware_MTLSProxyHeader (2.22s)28762026-10-01 08:35:35.589 UTC [99415] ERROR: relation "goose_db_version" does not exist at character 3628772026-10-01 08:35:35.589 UTC [99415] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC28782026/10/01 08:35:35 INFO Received uploads request method=POST path=/api/pending_closures28792026/10/01 08:35:35 INFO Aborted multipart uploads count=028802026/10/01 08:35:35 WARN Force mode enabled - objects will be deleted immediately without grace period28812026/10/01 08:35:35 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=1 objects-deleted-after-grace-period=1 objects-failed-to-delete=028822026/10/01 08:35:35 INFO Vacuumed table table=pending_closures28832026/10/01 08:35:35 INFO Vacuumed table table=pending_objects28842026/10/01 08:35:35 INFO Vacuumed table table=multipart_uploads28852026/10/01 08:35:35 INFO Vacuumed table table=closures28862026/10/01 08:35:35 INFO Vacuumed table table=objects28872026/10/01 08:35:35 OK 20241026095416_initial_model.sql (217.04ms)28882026/10/01 08:35:35 OK 20251210153512_drop_unused_gin_index.sql (10.56ms)28892026/10/01 08:35:35 OK 20251218171726_add_pins.sql (27.29ms)28902026/10/01 08:35:35 INFO Received uploads request method=POST path=/api/pending_closures28912026/10/01 08:35:35 OK 20260628120000_add_object_size_and_stats.sql (20.56ms)28922026/10/01 08:35:35 INFO Aborted multipart uploads count=028932026/10/01 08:35:35 WARN Force mode enabled - objects will be deleted immediately without grace period28942026/10/01 08:35:35 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=028952026/10/01 08:35:35 INFO Vacuumed table table=pending_closures28962026/10/01 08:35:35 OK 20260905000000_add_claims.sql (48.74ms)28972026/10/01 08:35:36 INFO Vacuumed table table=pending_objects28982026/10/01 08:35:36 INFO Vacuumed table table=multipart_uploads28992026/10/01 08:35:36 INFO Vacuumed table table=closures29002026/10/01 08:35:36 OK 20260920000000_drop_claims.sql (10.6ms)29012026/10/01 08:35:36 INFO Vacuumed table table=objects29022026/10/01 08:35:36 OK 20260923120000_add_pushes.sql (8.4ms)29032026/10/01 08:35:36 goose: successfully migrated database to version: 2026092312000029042026/10/01 08:35:36 OK 1_commit_pending_closure.sql (3.47ms)29052026/10/01 08:35:36 OK 2_object_stats_trigger.sql (678.83µs)29062026/10/01 08:35:36 OK 3_commit_push.sql (530.46µs)29072026/10/01 08:35:36 goose: up to current file version: 32908--- PASS: TestForceGCDuringPushOffersSweptObject (0.00s)2909 --- PASS: TestForceGCDuringPushOffersSweptObject/before_pending_rows (2.59s)2910 --- PASS: TestForceGCDuringPushOffersSweptObject/after_presence_check (2.53s)29112026/10/01 08:35:36 WARN Request failed, retrying attempt=5 max_attempts=6 backoff=1.473419123s error="Post \"http://localhost:19999/api/objects/present\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/objects/present29122026-10-01 08:35:36.175 UTC [99418] ERROR: relation "goose_db_version" does not exist at character 3629132026-10-01 08:35:36.175 UTC [99418] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC29142026/10/01 08:35:36 OK 20241026095416_initial_model.sql (72ms)29152026/10/01 08:35:36 OK 20251210153512_drop_unused_gin_index.sql (6.26ms)29162026/10/01 08:35:36 OK 20251218171726_add_pins.sql (4.69ms)29172026/10/01 08:35:36 OK 20260628120000_add_object_size_and_stats.sql (9.04ms)29182026/10/01 08:35:36 OK 20260905000000_add_claims.sql (1.18ms)29192026/10/01 08:35:36 OK 20260920000000_drop_claims.sql (796.38µs)29202026/10/01 08:35:36 OK 20260923120000_add_pushes.sql (516.54µs)29212026/10/01 08:35:36 goose: successfully migrated database to version: 2026092312000029222026/10/01 08:35:36 OK 1_commit_pending_closure.sql (978.29µs)29232026/10/01 08:35:36 OK 2_object_stats_trigger.sql (230.83µs)29242026/10/01 08:35:36 OK 3_commit_push.sql (184.71µs)29252026/10/01 08:35:36 goose: up to current file version: 329262026/10/01 08:35:36 WARN Authentication failed token_preview=invalid-token token_length=13 reason="static API token mismatch"29272026/10/01 08:35:36 WARN Authentication failed token_preview=invalid-token token_length=13 reason="static API token mismatch"29282026/10/01 08:35:37 WARN Request failed, retrying attempt=1 max_attempts=6 backoff=100ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config29292026/10/01 08:35:37 WARN Request failed, retrying attempt=2 max_attempts=6 backoff=215.465102ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config29302026/10/01 08:35:38 WARN Request failed, retrying attempt=3 max_attempts=6 backoff=394.478343ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config29312026/10/01 08:35:38 WARN Request failed, retrying attempt=4 max_attempts=6 backoff=766.663549ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config29322026/10/01 08:35:39 WARN Request failed, retrying attempt=5 max_attempts=6 backoff=1.444974832s error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config2933{"timestamp":"2026-10-01T08:35:39.514505Z","level":"ERROR","message":"Scanner cycle completed without a durable data usage snapshot","event":"scanner_persist_state","component":"scanner","subsystem":"runtime","cycle":4,"outcome":"NoUpdate","state":"usage_not_durable","target":"rustfs::scanner","filename":"crates/scanner/src/scanner.rs","line_number":2350,"threadName":"rustfs-worker","threadId":"ThreadId(2)"}29342026/10/01 08:35:40 WARN Failed to fetch cache config, uploading without size limit error="fetching cache config: sending request: request failed after retries: Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused"29352026/10/01 08:35:40 WARN Request failed, retrying attempt=1 max_attempts=6 backoff=100ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config29362026/10/01 08:35:40 WARN Request failed, retrying attempt=2 max_attempts=6 backoff=213.868444ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config29372026/10/01 08:35:40 WARN Request failed, retrying attempt=3 max_attempts=6 backoff=360.186378ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config29382026/10/01 08:35:41 WARN Request failed, retrying attempt=4 max_attempts=6 backoff=777.694037ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config29392026/10/01 08:35:42 WARN Request failed, retrying attempt=5 max_attempts=6 backoff=1.727144826s error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config29402026/10/01 08:35:43 WARN Request failed, retrying attempt=1 max_attempts=6 backoff=100ms error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures29412026/10/01 08:35:43 WARN Request failed, retrying attempt=2 max_attempts=6 backoff=205.893516ms error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures29422026/10/01 08:35:44 WARN Request failed, retrying attempt=3 max_attempts=6 backoff=377.899047ms error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures29432026/10/01 08:35:44 WARN Request failed, retrying attempt=4 max_attempts=6 backoff=868.88228ms error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures2944{"timestamp":"2026-10-01T08:35:44.747807Z","level":"ERROR","message":"Scanner cycle completed without a durable data usage snapshot","event":"scanner_persist_state","component":"scanner","subsystem":"runtime","cycle":4,"outcome":"NoUpdate","state":"usage_not_durable","target":"rustfs::scanner","filename":"crates/scanner/src/scanner.rs","line_number":2350,"threadName":"rustfs-worker","threadId":"ThreadId(4)"}29452026/10/01 08:35:45 WARN Request failed, retrying attempt=5 max_attempts=6 backoff=1.495925861s error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures2946--- PASS: TestClientErrorHandling (0.00s)2947 --- PASS: TestClientErrorHandling/InvalidStorePath (2.27s)2948 --- PASS: TestClientErrorHandling/InvalidAuthToken (2.09s)2949 --- PASS: TestClientErrorHandling/ServerNotAvailable (12.48s)2950PASS2951{"timestamp":"2026-10-01T08:35:46.898279Z","level":"ERROR","message":"HTTP transport failed","event":"http_transport_failed","component":"server","subsystem":"transport","peer_addr":"127.0.0.1:61584","error_kind":"io_error","error":"Cancelled","result":"transport_error","target":"rustfs::server::http","filename":"rustfs/src/server/http.rs","line_number":2354,"threadName":"rustfs-worker","threadId":"ThreadId(4)"}29522026-10-01 08:35:47.038 UTC [99016] LOG: received smart shutdown request29532026-10-01 08:35:47.039 UTC [99016] LOG: background worker "logical replication launcher" (PID 99026) exited with exit code 129542026-10-01 08:35:47.042 UTC [99021] LOG: shutting down29552026-10-01 08:35:47.042 UTC [99021] LOG: checkpoint starting: shutdown immediate29562026-10-01 08:35:48.200 UTC [99021] LOG: checkpoint complete: wrote 12482 buffers (76.2%), wrote 4 SLRU buffers; 0 WAL file(s) added, 0 removed, 22 recycled; write=0.650 s, sync=0.454 s, total=1.159 s; sync files=26626, longest=0.001 s, average=0.001 s; distance=368520 kB, estimate=368520 kB; lsn=0/17F6F1F0, redo lsn=0/17F6F1F029572026-10-01 08:35:48.205 UTC [99016] LOG: database system is shut down2958Running OIDC tests...2959=== RUN TestAudienceForIssuer2960=== PAUSE TestAudienceForIssuer2961=== RUN TestGlobMatch2962=== PAUSE TestGlobMatch2963=== RUN TestValidateToken_ValidToken2964=== PAUSE TestValidateToken_ValidToken2965=== RUN TestValidateToken_WrongAudience2966=== PAUSE TestValidateToken_WrongAudience2967=== RUN TestValidateToken_Expired2968=== PAUSE TestValidateToken_Expired2969=== RUN TestValidateToken_BoundClaimsMismatch2970=== PAUSE TestValidateToken_BoundClaimsMismatch2971=== RUN TestValidateToken_BoundSubjectMismatch2972=== PAUSE TestValidateToken_BoundSubjectMismatch2973=== RUN TestValidateToken_MultipleProviders2974=== PAUSE TestValidateToken_MultipleProviders2975=== RUN TestValidateToken_NoMatchingProvider2976=== PAUSE TestValidateToken_NoMatchingProvider2977=== RUN TestValidateToken_KubernetesServiceAccount2978=== PAUSE TestValidateToken_KubernetesServiceAccount2979=== RUN TestNewValidator_KubernetesRequiresCA2980=== PAUSE TestNewValidator_KubernetesRequiresCA2981=== RUN TestValidateToken_KubernetesIssuerFromOwnToken2982=== PAUSE TestValidateToken_KubernetesIssuerFromOwnToken2983=== RUN TestPins_ReservedForMatchingRule2984=== PAUSE TestPins_ReservedForMatchingRule2985=== RUN TestPins_TopLevelShorthand2986=== PAUSE TestPins_TopLevelShorthand2987=== RUN TestPins_ConfigValidation2988=== PAUSE TestPins_ConfigValidation2989=== RUN TestScopes_LegacyProviderDefaultsToWrite2990=== PAUSE TestScopes_LegacyProviderDefaultsToWrite2991=== RUN TestScopes_Rules2992=== PAUSE TestScopes_Rules2993=== RUN TestScopes_ConfigValidation2994=== PAUSE TestScopes_ConfigValidation2995=== CONT TestAudienceForIssuer2996--- PASS: TestAudienceForIssuer (0.00s)2997=== CONT TestValidateToken_KubernetesServiceAccount2998=== CONT TestValidateToken_NoMatchingProvider2999=== CONT TestPins_ConfigValidation3000=== CONT TestScopes_Rules3001=== CONT TestScopes_LegacyProviderDefaultsToWrite3002=== CONT TestScopes_ConfigValidation3003=== CONT TestPins_ReservedForMatchingRule3004=== CONT TestValidateToken_KubernetesIssuerFromOwnToken3005=== CONT TestValidateToken_Expired3006=== CONT TestPins_TopLevelShorthand3007--- PASS: TestPins_ConfigValidation (0.01s)3008=== CONT TestNewValidator_KubernetesRequiresCA3009--- PASS: TestScopes_ConfigValidation (0.01s)3010=== CONT TestValidateToken_ValidToken30112026/10/01 08:35:49 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:61938/oidc3012--- PASS: TestPins_ReservedForMatchingRule (0.03s)3013=== CONT TestGlobMatch3014=== RUN TestGlobMatch/foo_foo3015=== PAUSE TestGlobMatch/foo_foo3016=== RUN TestGlobMatch/foo_bar3017=== PAUSE TestGlobMatch/foo_bar3018=== RUN TestGlobMatch/*_3019=== PAUSE TestGlobMatch/*_3020=== RUN TestGlobMatch/*_anything3021=== PAUSE TestGlobMatch/*_anything3022=== RUN TestGlobMatch/foo*_foo3023=== PAUSE TestGlobMatch/foo*_foo3024=== RUN TestGlobMatch/foo*_foobar3025=== PAUSE TestGlobMatch/foo*_foobar3026=== RUN TestGlobMatch/foo*_bar3027=== PAUSE TestGlobMatch/foo*_bar3028=== RUN TestGlobMatch/*bar_bar3029=== PAUSE TestGlobMatch/*bar_bar3030=== RUN TestGlobMatch/*bar_foobar3031=== PAUSE TestGlobMatch/*bar_foobar3032=== RUN TestGlobMatch/*bar_foo3033=== PAUSE TestGlobMatch/*bar_foo3034=== RUN TestGlobMatch/foo*bar_foobar3035=== PAUSE TestGlobMatch/foo*bar_foobar3036=== RUN TestGlobMatch/foo*bar_foo123bar3037=== PAUSE TestGlobMatch/foo*bar_foo123bar3038=== RUN TestGlobMatch/foo*bar_foobarbaz3039=== PAUSE TestGlobMatch/foo*bar_foobarbaz3040=== RUN TestGlobMatch/*/*_foo/bar3041=== PAUSE TestGlobMatch/*/*_foo/bar3042=== RUN TestGlobMatch/*/*_foo3043=== PAUSE TestGlobMatch/*/*_foo3044=== RUN TestGlobMatch/refs/heads/*_refs/heads/main3045=== PAUSE TestGlobMatch/refs/heads/*_refs/heads/main3046=== RUN TestGlobMatch/refs/heads/*_refs/tags/v1.03047=== PAUSE TestGlobMatch/refs/heads/*_refs/tags/v1.03048=== RUN TestGlobMatch/refs/*/main_refs/heads/main3049=== PAUSE TestGlobMatch/refs/*/main_refs/heads/main3050=== RUN TestGlobMatch/fo?_foo3051=== PAUSE TestGlobMatch/fo?_foo3052=== RUN TestGlobMatch/fo?_fo3053=== PAUSE TestGlobMatch/fo?_fo3054=== RUN TestGlobMatch/fo?_fooo3055=== PAUSE TestGlobMatch/fo?_fooo3056=== RUN TestGlobMatch/?oo_foo3057=== PAUSE TestGlobMatch/?oo_foo3058=== RUN TestGlobMatch/?oo_boo3059=== PAUSE TestGlobMatch/?oo_boo3060=== RUN TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main3061=== PAUSE TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main3062=== RUN TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main3063=== PAUSE TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main3064=== CONT TestValidateToken_MultipleProviders30652026/10/01 08:35:49 INFO OIDC provider initialized name=kubernetes issuer=https://oidc.eks.invalid/id/ABC1233066--- PASS: TestValidateToken_KubernetesIssuerFromOwnToken (0.05s)3067=== CONT TestValidateToken_BoundSubjectMismatch30682026/10/01 08:35:49 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:61942/oidc3069--- PASS: TestValidateToken_ValidToken (0.06s)3070=== CONT TestValidateToken_BoundClaimsMismatch30712026/10/01 08:35:49 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:61944/oidc3072--- PASS: TestPins_TopLevelShorthand (0.07s)3073=== CONT TestValidateToken_WrongAudience30742026/10/01 08:35:49 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:61947/oidc3075--- PASS: TestScopes_LegacyProviderDefaultsToWrite (0.09s)3076=== CONT TestGlobMatch/foo_foo3077=== CONT TestGlobMatch/*/*_foo/bar3078=== CONT TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main3079=== CONT TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main3080=== CONT TestGlobMatch/?oo_boo3081=== CONT TestGlobMatch/?oo_foo3082=== CONT TestGlobMatch/fo?_fooo3083=== CONT TestGlobMatch/fo?_fo3084=== CONT TestGlobMatch/fo?_foo3085=== CONT TestGlobMatch/refs/*/main_refs/heads/main3086=== CONT TestGlobMatch/refs/heads/*_refs/tags/v1.03087=== CONT TestGlobMatch/refs/heads/*_refs/heads/main3088=== CONT TestGlobMatch/*/*_foo3089=== CONT TestGlobMatch/foo*bar_foobarbaz3090=== CONT TestGlobMatch/foo*bar_foo123bar3091=== CONT TestGlobMatch/foo*bar_foobar3092=== CONT TestGlobMatch/*bar_foo3093=== CONT TestGlobMatch/*bar_foobar3094=== CONT TestGlobMatch/*bar_bar3095=== CONT TestGlobMatch/foo*_bar3096=== CONT TestGlobMatch/foo*_foobar3097=== CONT TestGlobMatch/foo*_foo3098=== CONT TestGlobMatch/*_anything3099=== CONT TestGlobMatch/*_3100=== CONT TestGlobMatch/foo_bar3101--- PASS: TestGlobMatch (0.00s)3102 --- PASS: TestGlobMatch/foo_foo (0.00s)3103 --- PASS: TestGlobMatch/*/*_foo/bar (0.00s)3104 --- PASS: TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main (0.00s)3105 --- PASS: TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main (0.00s)3106 --- PASS: TestGlobMatch/?oo_boo (0.00s)3107 --- PASS: TestGlobMatch/?oo_foo (0.00s)3108 --- PASS: TestGlobMatch/fo?_fooo (0.00s)3109 --- PASS: TestGlobMatch/fo?_fo (0.00s)3110 --- PASS: TestGlobMatch/fo?_foo (0.00s)3111 --- PASS: TestGlobMatch/refs/*/main_refs/heads/main (0.00s)3112 --- PASS: TestGlobMatch/refs/heads/*_refs/tags/v1.0 (0.00s)3113 --- PASS: TestGlobMatch/refs/heads/*_refs/heads/main (0.00s)3114 --- PASS: TestGlobMatch/*/*_foo (0.00s)3115 --- PASS: TestGlobMatch/foo*bar_foobarbaz (0.00s)3116 --- PASS: TestGlobMatch/foo*bar_foo123bar (0.00s)3117 --- PASS: TestGlobMatch/foo*bar_foobar (0.00s)3118 --- PASS: TestGlobMatch/*bar_foo (0.00s)3119 --- PASS: TestGlobMatch/*bar_foobar (0.00s)3120 --- PASS: TestGlobMatch/*bar_bar (0.00s)3121 --- PASS: TestGlobMatch/foo*_bar (0.00s)3122 --- PASS: TestGlobMatch/foo*_foobar (0.00s)3123 --- PASS: TestGlobMatch/foo*_foo (0.00s)3124 --- PASS: TestGlobMatch/*_anything (0.00s)3125 --- PASS: TestGlobMatch/*_ (0.00s)3126 --- PASS: TestGlobMatch/foo_bar (0.00s)31272026/10/01 08:35:49 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:61949/oidc31282026/10/01 08:35:49 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:61951/oidc3129--- PASS: TestValidateToken_BoundSubjectMismatch (0.05s)3130--- PASS: TestScopes_Rules (0.10s)31312026/10/01 08:35:49 http: TLS handshake error from 127.0.0.1:61954: remote error: tls: bad certificate3132--- PASS: TestNewValidator_KubernetesRequiresCA (0.10s)31332026/10/01 08:35:49 INFO OIDC provider initialized name=kubernetes issuer=https://127.0.0.1:6195531342026/10/01 08:35:49 INFO OIDC provider initialized name=provider1 issuer=http://127.0.0.1:61946/oidc3135--- PASS: TestValidateToken_KubernetesServiceAccount (0.12s)3136--- PASS: TestValidateToken_NoMatchingProvider (0.12s)31372026/10/01 08:35:49 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:61960/oidc3138--- PASS: TestValidateToken_Expired (0.14s)31392026/10/01 08:35:49 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:61962/oidc3140--- PASS: TestValidateToken_WrongAudience (0.08s)31412026/10/01 08:35:49 INFO OIDC provider initialized name=provider1 issuer=http://127.0.0.1:61959/oidc31422026/10/01 08:35:49 INFO OIDC provider initialized name=provider2 issuer=http://127.0.0.1:61964/oidc3143--- PASS: TestValidateToken_MultipleProviders (0.12s)31442026/10/01 08:35:49 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:61967/oidc3145--- PASS: TestValidateToken_BoundClaimsMismatch (0.10s)3146PASS3147Running hook tests...3148=== RUN TestSendPathsEmpty3149=== PAUSE TestSendPathsEmpty3150=== RUN TestQueueEnqueueAndFetch3151=== PAUSE TestQueueEnqueueAndFetch3152=== RUN TestQueueDeduplication3153=== PAUSE TestQueueDeduplication3154=== RUN TestQueueRemove3155=== PAUSE TestQueueRemove3156=== RUN TestQueueFetchBatchLimit3157=== PAUSE TestQueueFetchBatchLimit3158=== RUN TestQueueRetryMovesToBack3159=== PAUSE TestQueueRetryMovesToBack3160=== RUN TestQueueFetchRemoveLifecycle3161=== PAUSE TestQueueFetchRemoveLifecycle3162=== RUN TestQueueConcurrentWriters3163=== PAUSE TestQueueConcurrentWriters3164=== RUN TestQueueRemoveLargeClosure3165=== PAUSE TestQueueRemoveLargeClosure3166=== RUN TestServerClientIntegration3167=== PAUSE TestServerClientIntegration3168=== RUN TestServerQueueError3169=== PAUSE TestServerQueueError3170=== RUN TestGetListenerSocketActivation3171 server_test.go:210: === RUN TestGetListenerSocketActivation3172 --- PASS: TestGetListenerSocketActivation (0.00s)3173 PASS3174 3175--- PASS: TestGetListenerSocketActivation (0.01s)3176=== RUN TestDrainIsolatesPoisonPath3177=== PAUSE TestDrainIsolatesPoisonPath3178=== RUN TestRunNotBlockedByPoisonHead3179=== PAUSE TestRunNotBlockedByPoisonHead3180=== RUN TestDrainGivesUpWhenServerDown3181=== PAUSE TestDrainGivesUpWhenServerDown3182=== RUN TestFailedPathPrunedByLaterClosure3183=== PAUSE TestFailedPathPrunedByLaterClosure3184=== RUN TestWorkerUploadsAndRemoves3185=== PAUSE TestWorkerUploadsAndRemoves3186=== RUN TestWorkerSkipsGCdPaths3187=== PAUSE TestWorkerSkipsGCdPaths3188=== RUN TestWorkerPrunesClosureDeps3189=== PAUSE TestWorkerPrunesClosureDeps3190=== RUN TestDrainTimeout3191=== PAUSE TestDrainTimeout3192=== CONT TestSendPathsEmpty3193=== CONT TestServerQueueError3194--- PASS: TestSendPathsEmpty (0.00s)3195=== CONT TestQueueFetchBatchLimit3196=== CONT TestQueueRetryMovesToBack3197=== CONT TestQueueRemoveLargeClosure3198=== CONT TestWorkerUploadsAndRemoves3199=== CONT TestDrainGivesUpWhenServerDown3200=== CONT TestServerClientIntegration3201=== CONT TestQueueConcurrentWriters3202=== CONT TestQueueFetchRemoveLifecycle3203=== CONT TestWorkerSkipsGCdPaths32042026/10/01 08:35:49 ERROR Failed to queue paths error="permission denied" count=13205--- PASS: TestServerQueueError (0.00s)3206=== CONT TestDrainIsolatesPoisonPath3207--- PASS: TestServerClientIntegration (0.00s)3208=== CONT TestRunNotBlockedByPoisonHead3209--- PASS: TestQueueFetchBatchLimit (0.01s)3210=== CONT TestQueueEnqueueAndFetch32112026/10/01 08:35:49 INFO Uploading batch count=432122026/10/01 08:35:49 ERROR Upload failed error="upload failed" count=432132026/10/01 08:35:49 INFO Upload queue status pending=332142026/10/01 08:35:49 INFO Uploading batch count=13215--- PASS: TestQueueRetryMovesToBack (0.01s)3216=== CONT TestQueueRemove32172026/10/01 08:35:49 ERROR Upload failed error="upload failed" count=132182026/10/01 08:35:49 INFO Upload queue status pending=232192026/10/01 08:35:49 INFO Uploading batch count=232202026/10/01 08:35:49 INFO Uploading batch count=232212026/10/01 08:35:49 ERROR Upload failed error="upload failed" count=232222026/10/01 08:35:49 ERROR Upload failed, will retry later error="upload failed" path=/nix/var/nix/builds/nix-98979-578903465/TestDrainGivesUpWhenServerDown2595621273/002/a32232026/10/01 08:35:49 ERROR Upload failed, will retry later error="upload failed" path=/nix/var/nix/builds/nix-98979-578903465/TestDrainIsolatesPoisonPath3509226910/002/bbb32242026/10/01 08:35:49 INFO Upload queue status pending=232252026/10/01 08:35:49 WARN Store path no longer exists (garbage collected?), removing from queue path=/nix/var/nix/builds/nix-98979-578903465/TestWorkerSkipsGCdPaths697477696/002/nonexistent32262026/10/01 08:35:49 ERROR Upload failed, will retry later error="upload failed" path=/nix/var/nix/builds/nix-98979-578903465/TestDrainGivesUpWhenServerDown2595621273/002/b32272026/10/01 08:35:49 INFO Uploading batch count=132282026/10/01 08:35:49 INFO Uploading batch count=232292026/10/01 08:35:49 ERROR Upload failed error="upload failed" count=232302026/10/01 08:35:49 ERROR Upload failed, will retry later error="upload failed" path=/nix/var/nix/builds/nix-98979-578903465/TestDrainGivesUpWhenServerDown2595621273/002/c3231--- PASS: TestQueueFetchRemoveLifecycle (0.01s)3232=== CONT TestQueueDeduplication32332026/10/01 08:35:49 ERROR Upload failed, will retry later error="upload failed" path=/nix/var/nix/builds/nix-98979-578903465/TestDrainGivesUpWhenServerDown2595621273/002/d32342026/10/01 08:35:49 INFO Uploading batch count=132352026/10/01 08:35:49 ERROR Upload failed error="upload failed" count=132362026/10/01 08:35:49 INFO Uploading batch count=132372026/10/01 08:35:49 ERROR Upload failed error="upload failed" count=132382026/10/01 08:35:49 INFO Uploading batch count=232392026/10/01 08:35:49 ERROR Upload failed error="upload failed" count=232402026/10/01 08:35:49 ERROR Upload failed, will retry later error="upload failed" path=/nix/var/nix/builds/nix-98979-578903465/TestDrainGivesUpWhenServerDown2595621273/002/e32412026/10/01 08:35:49 INFO Uploading batch count=132422026/10/01 08:35:49 ERROR Upload failed error="upload failed" count=132432026/10/01 08:35:49 ERROR Upload failed, will retry later error="upload failed" path=/nix/var/nix/builds/nix-98979-578903465/TestDrainGivesUpWhenServerDown2595621273/002/f32442026/10/01 08:35:49 ERROR Drain finished with paths left in queue remaining=132452026/10/01 08:35:49 ERROR Drain finished with paths left in queue remaining=103246--- PASS: TestQueueEnqueueAndFetch (0.00s)3247=== CONT TestDrainTimeout3248--- PASS: TestDrainIsolatesPoisonPath (0.01s)3249=== CONT TestFailedPathPrunedByLaterClosure3250--- PASS: TestQueueRemove (0.00s)3251=== CONT TestWorkerPrunesClosureDeps3252--- PASS: TestQueueDeduplication (0.00s)3253--- PASS: TestDrainGivesUpWhenServerDown (0.02s)32542026/10/01 08:35:49 INFO Uploading batch count=232552026/10/01 08:35:49 INFO Uploading batch count=132562026/10/01 08:35:49 ERROR Upload failed error="upload failed" count=132572026/10/01 08:35:49 INFO Uploading batch count=132582026/10/01 08:35:49 INFO Upload queue status pending=232592026/10/01 08:35:49 INFO Uploading batch count=132602026/10/01 08:35:49 INFO Uploading batch count=13261--- PASS: TestFailedPathPrunedByLaterClosure (0.00s)3262--- PASS: TestWorkerSkipsGCdPaths (0.03s)3263--- PASS: TestWorkerUploadsAndRemoves (0.03s)3264--- PASS: TestWorkerPrunesClosureDeps (0.02s)3265--- PASS: TestQueueRemoveLargeClosure (0.05s)3266--- PASS: TestQueueConcurrentWriters (0.16s)32672026/10/01 08:35:49 ERROR Upload failed error="context deadline exceeded" count=232682026/10/01 08:35:49 ERROR Drain finished with paths left in queue remaining=43269--- PASS: TestDrainTimeout (0.21s)32702026/10/01 08:35:50 INFO Uploading batch count=132712026/10/01 08:35:50 INFO Uploading batch count=132722026/10/01 08:35:50 INFO Uploading batch count=132732026/10/01 08:35:50 ERROR Upload failed error="upload failed" count=132742026/10/01 08:35:50 INFO Uploading batch count=132752026/10/01 08:35:50 ERROR Upload failed error="upload failed" count=132762026/10/01 08:35:50 INFO Uploading batch count=132772026/10/01 08:35:50 ERROR Upload failed error="upload failed" count=132782026/10/01 08:35:50 INFO Uploading batch count=132792026/10/01 08:35:50 ERROR Upload failed error="upload failed" count=132802026/10/01 08:35:50 ERROR Drain finished with paths left in queue remaining=13281--- PASS: TestRunNotBlockedByPoisonHead (1.02s)3282PASS