niks3-go-unit-tests
checks.aarch64-darwin.go-unit-tests
· build #492
· raw
1tribuchet: building on mac022Running client tests...3=== RUN TestDoServerRequestAttachesToken4=== PAUSE TestDoServerRequestAttachesToken5=== RUN TestUploadBuildLog_FileBodyReplayedOnRetry6=== PAUSE TestUploadBuildLog_FileBodyReplayedOnRetry7=== RUN TestRegisterUploadedObjectReusesConnections8=== PAUSE TestRegisterUploadedObjectReusesConnections9=== RUN TestRunGarbageCollection_FinishedOnAnotherReplica10=== PAUSE TestRunGarbageCollection_FinishedOnAnotherReplica11=== RUN TestRunGarbageCollection_NotFoundAfterLocalRun12=== PAUSE TestRunGarbageCollection_NotFoundAfterLocalRun13=== RUN TestCaseHackSuffix14=== PAUSE TestCaseHackSuffix15=== RUN TestFilterOversizedClosures16=== PAUSE TestFilterOversizedClosures17=== RUN TestUploadMultipart_PartsInParallel18=== PAUSE TestUploadMultipart_PartsInParallel19=== RUN TestUploadMultipart_ReturnsAfterDroppedBody20=== PAUSE TestUploadMultipart_ReturnsAfterDroppedBody21=== RUN TestPartSizeForNAR22=== PAUSE TestPartSizeForNAR23=== RUN TestDumpPathCaseHackMatchesNix24--- PASS: TestDumpPathCaseHackMatchesNix (0.06s)25=== RUN TestDumpPathCaseHackCollision26--- PASS: TestDumpPathCaseHackCollision (0.00s)27=== RUN TestDumpPathMatchesNix28=== PAUSE TestDumpPathMatchesNix29=== RUN TestDumpPathSingleFile30=== PAUSE TestDumpPathSingleFile31=== RUN TestDumpPathWriterError32=== PAUSE TestDumpPathWriterError33=== RUN TestEncodeNixBase3234=== PAUSE TestEncodeNixBase3235=== RUN TestEncodeNixBase32WithRealHash36=== PAUSE TestEncodeNixBase32WithRealHash37=== RUN TestConvertHashToNix3238=== PAUSE TestConvertHashToNix3239=== RUN TestGetStorePathHash40=== PAUSE TestGetStorePathHash41=== RUN TestPathInfoHashCompatibility42=== PAUSE TestPathInfoHashCompatibility43=== RUN TestParsePathInfoJSON44=== PAUSE TestParsePathInfoJSON45=== RUN TestParsePathInfoJSONMultiplePaths46=== PAUSE TestParsePathInfoJSONMultiplePaths47=== RUN TestPathInfoCACompatibility48=== PAUSE TestPathInfoCACompatibility49=== RUN TestRateLimiterFeedback50=== PAUSE TestRateLimiterFeedback51=== RUN TestRateLimiterFeedback_400DoesNotCountAsSuccess52=== PAUSE TestRateLimiterFeedback_400DoesNotCountAsSuccess53=== RUN TestRegisterUploadedObject_BoundedAgainstSilentServer54=== PAUSE TestRegisterUploadedObject_BoundedAgainstSilentServer55=== RUN TestRegisterUploadedObject_OutlivesPush56=== PAUSE TestRegisterUploadedObject_OutlivesPush57=== RUN TestResolveStorePath58=== PAUSE TestResolveStorePath59=== RUN TestDoWithRetry_BodyReplayedViaGetBody60=== PAUSE TestDoWithRetry_BodyReplayedViaGetBody61=== RUN TestRetryTimeoutOutlastsMaxRetries62=== PAUSE TestRetryTimeoutOutlastsMaxRetries63=== RUN TestDoWithRetry_FinalResponseBodyReadable64=== PAUSE TestDoWithRetry_FinalResponseBodyReadable65=== RUN TestShellSplit66=== PAUSE TestShellSplit67=== RUN TestShellSplitErrors68=== PAUSE TestShellSplitErrors69=== RUN TestStreamPushReportsEveryPath70=== PAUSE TestStreamPushReportsEveryPath71=== RUN TestStreamPushBatchesUnderLoad72=== PAUSE TestStreamPushBatchesUnderLoad73=== RUN TestStreamPushIsolatesFailures74=== PAUSE TestStreamPushIsolatesFailures75=== RUN TestStreamPushGivesUpOnDeadServer76=== PAUSE TestStreamPushGivesUpOnDeadServer77=== RUN TestStreamPushRequestLine78=== PAUSE TestStreamPushRequestLine79=== RUN TestStreamPushReportsSignatures80=== PAUSE TestStreamPushReportsSignatures81=== RUN TestStreamPushReportsSkippedPaths82=== PAUSE TestStreamPushReportsSkippedPaths83=== RUN TestClientSignaturesByStorePath84=== PAUSE TestClientSignaturesByStorePath85=== RUN TestStreamPushAnswersEveryLineWhenCanceled86=== PAUSE TestStreamPushAnswersEveryLineWhenCanceled87=== RUN TestStreamPushStopsWhenCanceled88=== PAUSE TestStreamPushStopsWhenCanceled89=== RUN TestSetClientTLS90=== PAUSE TestSetClientTLS91=== RUN TestSetClientTLSDoesNotMutateDefaultTransport92=== PAUSE TestSetClientTLSDoesNotMutateDefaultTransport93=== RUN TestSetClientTLSErrors94=== PAUSE TestSetClientTLSErrors95=== RUN TestStaticToken96=== PAUSE TestStaticToken97=== RUN TestFileTokenReadsAndCaches98=== PAUSE TestFileTokenReadsAndCaches99=== RUN TestFileTokenMissing100=== PAUSE TestFileTokenMissing101=== RUN TestFileTokenEmpty102=== PAUSE TestFileTokenEmpty103=== RUN TestScriptTokenNoExpiryRerunsEveryCall104=== PAUSE TestScriptTokenNoExpiryRerunsEveryCall105=== RUN TestScriptTokenCachesUntilRefresh106=== PAUSE TestScriptTokenCachesUntilRefresh107=== RUN TestScriptTokenEmptyToken108=== PAUSE TestScriptTokenEmptyToken109=== RUN TestScriptTokenBadJSON110=== PAUSE TestScriptTokenBadJSON111=== RUN TestScriptTokenScriptFails112=== PAUSE TestScriptTokenScriptFails113=== RUN TestScriptTokenEmptyCommand114=== PAUSE TestScriptTokenEmptyCommand115=== CONT TestDoServerRequestAttachesToken116=== CONT TestStreamPushStopsWhenCanceled117=== CONT TestFileTokenEmpty118=== CONT TestScriptTokenEmptyCommand119--- PASS: TestScriptTokenEmptyCommand (0.00s)120=== CONT TestFileTokenReadsAndCaches121=== CONT TestScriptTokenScriptFails122=== CONT TestScriptTokenBadJSON123=== CONT TestScriptTokenEmptyToken124=== CONT TestScriptTokenCachesUntilRefresh125=== CONT TestScriptTokenNoExpiryRerunsEveryCall126=== CONT TestPathInfoCACompatibility127=== RUN TestPathInfoCACompatibility/null_ca_field128=== PAUSE TestPathInfoCACompatibility/null_ca_field129=== RUN TestPathInfoCACompatibility/old_string_format_-_text130=== PAUSE TestPathInfoCACompatibility/old_string_format_-_text131=== RUN TestPathInfoCACompatibility/old_string_format_-_fixed_recursive132=== PAUSE TestPathInfoCACompatibility/old_string_format_-_fixed_recursive133=== RUN TestPathInfoCACompatibility/new_structured_format_-_text134=== CONT TestStreamPushGivesUpOnDeadServer135=== PAUSE TestPathInfoCACompatibility/new_structured_format_-_text1362026/11/11 23:54:26 ERROR Upload failed error="connection refused" count=201372026/11/11 23:54:26 ERROR Server seems unavailable, giving up on batch untried=17138=== CONT TestClientSignaturesByStorePath139=== CONT TestStreamPushReportsSkippedPaths140=== CONT TestStreamPushReportsSignatures141=== CONT TestStreamPushRequestLine142=== CONT TestDoWithRetry_FinalResponseBodyReadable143=== CONT TestRetryTimeoutOutlastsMaxRetries144=== CONT TestStreamPushReportsEveryPath1452026/11/11 23:54:26 ERROR Upload failed error=boom count=1146=== CONT TestDoWithRetry_BodyReplayedViaGetBody147=== CONT TestResolveStorePath148=== CONT TestRegisterUploadedObject_OutlivesPush149=== CONT TestRegisterUploadedObject_BoundedAgainstSilentServer150=== CONT TestRateLimiterFeedback_400DoesNotCountAsSuccess151=== CONT TestRateLimiterFeedback152=== CONT TestStaticToken153=== CONT TestFileTokenMissing154--- PASS: TestStreamPushStopsWhenCanceled (0.00s)155--- PASS: TestFileTokenReadsAndCaches (0.00s)156--- PASS: TestFileTokenEmpty (0.00s)157--- PASS: TestClientSignaturesByStorePath (0.00s)1582026/11/11 23:54:26 ERROR Upload failed error=boom count=11592026/11/11 23:54:26 WARN Rate limiter enabled after throttle name=server-test rate=5160=== CONT TestStreamPushBatchesUnderLoad161=== RUN TestStreamPushBatchesUnderLoad/oneAtATime=false162=== CONT TestStreamPushAnswersEveryLineWhenCanceled163=== CONT TestStreamPushIsolatesFailures164=== RUN TestPathInfoCACompatibility/new_structured_format_-_nar_method165=== PAUSE TestPathInfoCACompatibility/new_structured_format_-_nar_method1662000/01/01 00:00:00 ERROR Upload failed error="context canceled" count=2167=== CONT TestDumpPathMatchesNix168=== CONT TestPathInfoHashCompatibility169=== RUN TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)170=== PAUSE TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)171=== RUN TestPathInfoHashCompatibility/old_string_format_with_colon172=== PAUSE TestPathInfoHashCompatibility/old_string_format_with_colon173=== RUN TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI174=== PAUSE TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI175=== RUN TestPathInfoHashCompatibility/new_structured_format_with_sha512176=== PAUSE TestPathInfoHashCompatibility/new_structured_format_with_sha512177=== CONT TestGetStorePathHash178=== RUN TestGetStorePathHash/valid_store_path179=== PAUSE TestGetStorePathHash/valid_store_path180=== RUN TestGetStorePathHash/basename_without_hyphen_should_error181=== PAUSE TestGetStorePathHash/basename_without_hyphen_should_error182=== RUN TestGetStorePathHash/hash_with_invalid_characters_should_error183=== PAUSE TestGetStorePathHash/hash_with_invalid_characters_should_error184=== RUN TestGetStorePathHash/hash_with_wrong_length_should_error185=== CONT TestParsePathInfoJSON186--- PASS: TestStreamPushGivesUpOnDeadServer (0.00s)187=== CONT TestShellSplit188=== CONT TestShellSplitErrors189=== CONT TestSetClientTLSDoesNotMutateDefaultTransport190=== CONT TestSetClientTLSErrors191=== RUN TestRateLimiterFeedback/429_enables_limiter1922026/11/11 23:54:26 ERROR Upload failed error="bad path" count=31932026/11/11 23:54:26 WARN Rate limiter enabled after throttle name=server-test rate=51942026/11/11 23:54:26 WARN Request returned retryable status, retrying attempt=1 backoff=0s status=503 url=http://127.0.0.1:602561952026/11/11 23:54:26 WARN Request returned retryable status, retrying attempt=1 backoff=1ms status=502 url=http://127.0.0.1:60257196=== CONT TestConvertHashToNix32197=== RUN TestConvertHashToNix32/SRI_format_to_Nix32198=== PAUSE TestConvertHashToNix32/SRI_format_to_Nix32199=== RUN TestConvertHashToNix32/already_Nix32_format200=== PAUSE TestConvertHashToNix32/already_Nix32_format201=== RUN TestConvertHashToNix32/invalid_format202=== PAUSE TestConvertHashToNix32/invalid_format203=== PAUSE TestStreamPushBatchesUnderLoad/oneAtATime=false204=== RUN TestStreamPushBatchesUnderLoad/oneAtATime=true205=== PAUSE TestStreamPushBatchesUnderLoad/oneAtATime=true206=== CONT TestDumpPathWriterError207=== PAUSE TestGetStorePathHash/hash_with_wrong_length_should_error208=== RUN TestParsePathInfoJSON/Nix_format209=== PAUSE TestParsePathInfoJSON/Nix_format210=== RUN TestParsePathInfoJSON/Lix_format211=== PAUSE TestParsePathInfoJSON/Lix_format212=== RUN TestParsePathInfoJSON/empty_input213=== PAUSE TestParsePathInfoJSON/empty_input214=== RUN TestParsePathInfoJSON/whitespace_only215=== PAUSE TestParsePathInfoJSON/whitespace_only216=== CONT TestDumpPathSingleFile217=== CONT TestCaseHackSuffix2182026/11/11 23:54:26 WARN Rate limiter backed off name=server-test rate=5219=== RUN TestParsePathInfoJSON/invalid_JSON220=== PAUSE TestParsePathInfoJSON/invalid_JSON221=== CONT TestUploadMultipart_PartsInParallel222=== CONT TestEncodeNixBase32223=== CONT TestSetClientTLS224=== PAUSE TestRateLimiterFeedback/429_enables_limiter225=== CONT TestEncodeNixBase32WithRealHash226=== CONT TestPartSizeForNAR227=== RUN TestPartSizeForNAR/zero_stays_at_minimum228=== PAUSE TestPartSizeForNAR/zero_stays_at_minimum229=== RUN TestPartSizeForNAR/small_stays_at_minimum230=== PAUSE TestPartSizeForNAR/small_stays_at_minimum231=== RUN TestPartSizeForNAR/80_GiB_fits_at_minimum232=== PAUSE TestPartSizeForNAR/80_GiB_fits_at_minimum233=== RUN TestPartSizeForNAR/115_GiB_needs_larger_parts234=== PAUSE TestPartSizeForNAR/115_GiB_needs_larger_parts2352026/11/11 23:54:26 WARN Rate limiter enabled after throttle name=server-test rate=52362026/11/11 23:54:26 WARN Request returned retryable status, retrying attempt=2 backoff=1ms status=502 url=http://127.0.0.1:60257237=== RUN TestPartSizeForNAR/1_TiB238=== PAUSE TestPartSizeForNAR/1_TiB239--- PASS: TestStreamPushReportsSkippedPaths (0.00s)240--- PASS: TestStreamPushReportsSignatures (0.00s)241--- PASS: TestStreamPushReportsEveryPath (0.00s)2422026/11/11 23:54:26 WARN Request returned retryable status, retrying attempt=1 backoff=0s status=503 url=http://127.0.0.1:60259243=== CONT TestUploadMultipart_ReturnsAfterDroppedBody244=== RUN TestRateLimiterFeedback/503_enables_limiter245=== CONT TestFilterOversizedClosures246=== RUN TestEncodeNixBase32/test_string_hash247=== PAUSE TestEncodeNixBase32/test_string_hash248=== RUN TestEncodeNixBase32/empty_input249=== PAUSE TestEncodeNixBase32/empty_input250=== RUN TestFilterOversizedClosures/no_limit_keeps_everything251--- PASS: TestScriptTokenScriptFails (0.00s)252=== PAUSE TestFilterOversizedClosures/no_limit_keeps_everything253=== RUN TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped254=== PAUSE TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped255=== RUN TestFilterOversizedClosures/all_closures_skipped256=== PAUSE TestFilterOversizedClosures/all_closures_skipped257--- PASS: TestDoServerRequestAttachesToken (0.00s)258=== PAUSE TestRateLimiterFeedback/503_enables_limiter259=== RUN TestPartSizeForNAR/5_TiB_S3_max_object260=== PAUSE TestPartSizeForNAR/5_TiB_S3_max_object261=== CONT TestRegisterUploadedObjectReusesConnections2622026/11/11 23:54:26 WARN Request returned retryable status, retrying attempt=1 backoff=1ms status=502 url=http://127.0.0.1:60257263=== CONT TestUploadBuildLog_FileBodyReplayedOnRetry264=== CONT TestRunGarbageCollection_FinishedOnAnotherReplica265=== CONT TestRunGarbageCollection_NotFoundAfterLocalRun266--- PASS: TestStaticToken (0.00s)267=== RUN TestSetClientTLS/rejects_connection_without_client_cert2682026/11/11 23:54:26 WARN Rate limiter backed off name=server-test rate=52692026/11/11 23:54:26 WARN Request returned retryable status, retrying attempt=2 backoff=0s status=503 url=http://127.0.0.1:60259270=== CONT TestParsePathInfoJSONMultiplePaths271=== RUN TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths272=== PAUSE TestSetClientTLS/rejects_connection_without_client_cert273=== PAUSE TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths274=== RUN TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths275=== PAUSE TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths276=== RUN TestSetClientTLS/succeeds_with_client_cert_and_CA277=== PAUSE TestSetClientTLS/succeeds_with_client_cert_and_CA278=== RUN TestSetClientTLS/preserves_debug_logging_transport279=== PAUSE TestSetClientTLS/preserves_debug_logging_transport280=== CONT TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)281=== CONT TestPathInfoCACompatibility/new_structured_format_-_nar_method282=== CONT TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI283=== CONT TestPathInfoHashCompatibility/new_structured_format_with_sha512284=== CONT TestPathInfoCACompatibility/old_string_format_-_text285=== CONT TestPathInfoCACompatibility/old_string_format_-_fixed_recursive286=== CONT TestPathInfoHashCompatibility/old_string_format_with_colon287=== CONT TestConvertHashToNix32/SRI_format_to_Nix32288=== CONT TestStreamPushBatchesUnderLoad/oneAtATime=false289--- PASS: TestStreamPushAnswersEveryLineWhenCanceled (0.01s)290--- PASS: TestFileTokenMissing (0.00s)291=== CONT TestGetStorePathHash/valid_store_path292--- PASS: TestShellSplit (0.00s)293--- PASS: TestShellSplitErrors (0.00s)294--- PASS: TestStreamPushIsolatesFailures (0.00s)295--- PASS: TestRegisterUploadedObject_OutlivesPush (0.00s)296--- PASS: TestResolveStorePath (0.00s)297--- PASS: TestDoWithRetry_FinalResponseBodyReadable (0.00s)298--- PASS: TestEncodeNixBase32WithRealHash (0.00s)299--- PASS: TestScriptTokenEmptyToken (0.01s)300--- PASS: TestSetClientTLSDoesNotMutateDefaultTransport (0.01s)301=== RUN TestSetClientTLSErrors/missing_cert_file302=== PAUSE TestSetClientTLSErrors/missing_cert_file303=== RUN TestSetClientTLSErrors/missing_key_file304=== PAUSE TestSetClientTLSErrors/missing_key_file305=== RUN TestSetClientTLSErrors/missing_ca_file306=== PAUSE TestSetClientTLSErrors/missing_ca_file307=== RUN TestSetClientTLSErrors/invalid_ca_file308=== PAUSE TestSetClientTLSErrors/invalid_ca_file309=== CONT TestConvertHashToNix32/already_Nix32_format310=== CONT TestGetStorePathHash/hash_with_wrong_length_should_error311=== CONT TestGetStorePathHash/hash_with_invalid_characters_should_error312=== CONT TestGetStorePathHash/basename_without_hyphen_should_error313=== CONT TestStreamPushBatchesUnderLoad/oneAtATime=true314=== CONT TestParsePathInfoJSON/Nix_format315=== CONT TestParsePathInfoJSON/invalid_JSON316=== CONT TestParsePathInfoJSON/whitespace_only317=== CONT TestParsePathInfoJSON/empty_input318=== CONT TestParsePathInfoJSON/Lix_format319--- PASS: TestParsePathInfoJSON (0.00s)320 --- PASS: TestParsePathInfoJSON/Nix_format (0.00s)321 --- PASS: TestParsePathInfoJSON/invalid_JSON (0.00s)322 --- PASS: TestParsePathInfoJSON/whitespace_only (0.00s)323 --- PASS: TestParsePathInfoJSON/empty_input (0.00s)324 --- PASS: TestParsePathInfoJSON/Lix_format (0.00s)325=== CONT TestEncodeNixBase32/empty_input326=== CONT TestEncodeNixBase32/test_string_hash327--- PASS: TestEncodeNixBase32 (0.00s)328 --- PASS: TestEncodeNixBase32/empty_input (0.00s)329 --- PASS: TestEncodeNixBase32/test_string_hash (0.00s)330=== CONT TestFilterOversizedClosures/no_limit_keeps_everything331=== CONT TestFilterOversizedClosures/all_closures_skipped3322026/11/11 23:54:26 WARN Skipping closure: path exceeds server max NAR size top_level_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper oversized_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper nar_size=100 max_nar_size=50333=== CONT TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped3342026/11/11 23:54:26 WARN Skipping closure: path exceeds server max NAR size top_level_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper oversized_path=/nix/store/bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb-vm-image nar_size=5000 max_nar_size=2000335=== CONT TestPathInfoCACompatibility/null_ca_field336--- PASS: TestFilterOversizedClosures (0.00s)337 --- PASS: TestFilterOversizedClosures/no_limit_keeps_everything (0.00s)338 --- PASS: TestFilterOversizedClosures/all_closures_skipped (0.00s)339 --- PASS: TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped (0.00s)340=== CONT TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths341=== CONT TestSetClientTLS/preserves_debug_logging_transport342=== CONT TestConvertHashToNix32/invalid_format343=== CONT TestSetClientTLS/succeeds_with_client_cert_and_CA344--- PASS: TestStreamPushBatchesUnderLoad (0.00s)345 --- PASS: TestStreamPushBatchesUnderLoad/oneAtATime=true (0.00s)346 --- PASS: TestStreamPushBatchesUnderLoad/oneAtATime=false (0.00s)347=== RUN TestPartSizeForNAR/capped_at_5_GiB348=== PAUSE TestPartSizeForNAR/capped_at_5_GiB3492026/11/11 23:54:26 WARN Request returned retryable status, retrying attempt=2 backoff=1ms status=502 url=http://127.0.0.1:60257350=== CONT TestPathInfoCACompatibility/new_structured_format_-_text351=== CONT TestSetClientTLSErrors/missing_ca_file352=== CONT TestSetClientTLSErrors/missing_key_file353=== CONT TestPartSizeForNAR/zero_stays_at_minimum354=== CONT TestPartSizeForNAR/1_TiB355=== CONT TestPartSizeForNAR/capped_at_5_GiB356=== CONT TestPartSizeForNAR/5_TiB_S3_max_object357=== CONT TestPartSizeForNAR/115_GiB_needs_larger_parts358=== CONT TestPartSizeForNAR/small_stays_at_minimum359=== CONT TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths360=== RUN TestRateLimiterFeedback/200_does_not_enable_limiter361=== PAUSE TestRateLimiterFeedback/200_does_not_enable_limiter362=== CONT TestPartSizeForNAR/80_GiB_fits_at_minimum363=== CONT TestSetClientTLS/rejects_connection_without_client_cert364=== RUN TestRateLimiterFeedback/400_does_not_enable_limiter365=== PAUSE TestRateLimiterFeedback/400_does_not_enable_limiter366=== CONT TestRateLimiterFeedback/429_enables_limiter367=== CONT TestSetClientTLSErrors/missing_cert_file368--- PASS: TestDoWithRetry_BodyReplayedViaGetBody (0.01s)369--- PASS: TestScriptTokenBadJSON (0.01s)370=== CONT TestRateLimiterFeedback/200_does_not_enable_limiter371--- PASS: TestUploadMultipart_ReturnsAfterDroppedBody (0.01s)372=== CONT TestSetClientTLSErrors/invalid_ca_file373--- PASS: TestStreamPushRequestLine (0.02s)374=== CONT TestRateLimiterFeedback/503_enables_limiter375=== CONT TestRateLimiterFeedback/400_does_not_enable_limiter376--- PASS: TestGetStorePathHash (0.00s)377 --- PASS: TestGetStorePathHash/valid_store_path (0.00s)378 --- PASS: TestGetStorePathHash/hash_with_wrong_length_should_error (0.00s)379 --- PASS: TestGetStorePathHash/hash_with_invalid_characters_should_error (0.00s)380 --- PASS: TestGetStorePathHash/basename_without_hyphen_should_error (0.00s)381--- PASS: TestPathInfoCACompatibility (0.00s)382 --- PASS: TestPathInfoCACompatibility/new_structured_format_-_nar_method (0.00s)383 --- PASS: TestPathInfoCACompatibility/old_string_format_-_text (0.00s)384 --- PASS: TestPathInfoCACompatibility/old_string_format_-_fixed_recursive (0.00s)385 --- PASS: TestPathInfoCACompatibility/null_ca_field (0.00s)386 --- PASS: TestPathInfoCACompatibility/new_structured_format_-_text (0.00s)387--- PASS: TestConvertHashToNix32 (0.00s)388 --- PASS: TestConvertHashToNix32/SRI_format_to_Nix32 (0.00s)389 --- PASS: TestConvertHashToNix32/already_Nix32_format (0.00s)390 --- PASS: TestConvertHashToNix32/invalid_format (0.00s)391--- PASS: TestParsePathInfoJSONMultiplePaths (0.00s)392 --- PASS: TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths (0.00s)393 --- PASS: TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths (0.00s)394--- PASS: TestPathInfoHashCompatibility (0.00s)395 --- PASS: TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI) (0.00s)396 --- PASS: TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI (0.00s)397 --- PASS: TestPathInfoHashCompatibility/new_structured_format_with_sha512 (0.00s)398 --- PASS: TestPathInfoHashCompatibility/old_string_format_with_colon (0.00s)399--- PASS: TestPartSizeForNAR (0.01s)400 --- PASS: TestPartSizeForNAR/zero_stays_at_minimum (0.00s)401 --- PASS: TestPartSizeForNAR/1_TiB (0.00s)402 --- PASS: TestPartSizeForNAR/capped_at_5_GiB (0.00s)403 --- PASS: TestPartSizeForNAR/5_TiB_S3_max_object (0.00s)404 --- PASS: TestPartSizeForNAR/115_GiB_needs_larger_parts (0.00s)405 --- PASS: TestPartSizeForNAR/small_stays_at_minimum (0.00s)406 --- PASS: TestPartSizeForNAR/80_GiB_fits_at_minimum (0.00s)407--- PASS: TestSetClientTLSErrors (0.01s)408 --- PASS: TestSetClientTLSErrors/missing_ca_file (0.00s)409 --- PASS: TestSetClientTLSErrors/missing_key_file (0.00s)410 --- PASS: TestSetClientTLSErrors/missing_cert_file (0.00s)411 --- PASS: TestSetClientTLSErrors/invalid_ca_file (0.00s)4122026/11/11 23:54:26 INFO Garbage collection started4132026/11/11 23:54:26 WARN Rate limiter enabled after throttle name=server-test rate=54142026/11/11 23:54:26 WARN Request returned retryable status, retrying attempt=1 backoff=0s status=429 url=http://127.0.0.1:603054152026/11/11 23:54:26 WARN Rate limiter enabled after throttle name=server-test rate=54162026/11/11 23:54:26 WARN Request returned retryable status, retrying attempt=1 backoff=0s status=503 url=http://127.0.0.1:603094172026/11/11 23:54:26 WARN Rate limiter backed off name=server-test rate=54182026/11/11 23:54:26 WARN Request returned retryable status, retrying attempt=3 backoff=1ms status=502 url=http://127.0.0.1:602574192026/11/11 23:54:26 WARN Rate limiter enabled after throttle name=s3-test rate=54202026/11/11 23:54:26 WARN Request returned retryable status, retrying attempt=1 backoff=0s status=503 url=http://127.0.0.1:603304212026/11/11 23:54:26 WARN Rate limiter backed off name=server-test rate=5422--- PASS: TestRateLimiterFeedback (0.01s)423 --- PASS: TestRateLimiterFeedback/200_does_not_enable_limiter (0.00s)424 --- PASS: TestRateLimiterFeedback/400_does_not_enable_limiter (0.00s)425 --- PASS: TestRateLimiterFeedback/503_enables_limiter (0.00s)426 --- PASS: TestRateLimiterFeedback/429_enables_limiter (0.00s)4272026/11/11 23:54:26 INFO Garbage collection started428--- PASS: TestUploadBuildLog_FileBodyReplayedOnRetry (0.01s)4292026/11/11 23:54:26 INFO Garbage collection progress phase=running_on_another_replica failed_uploads_deleted=0 old_closures_deleted=0 objects_marked=0 objects_deleted=0 objects_failed=0430--- PASS: TestRunGarbageCollection_NotFoundAfterLocalRun (0.01s)4312026/11/11 23:54:26 WARN Request returned retryable status, retrying attempt=4 backoff=1ms status=502 url=http://127.0.0.1:602574322026/11/11 23:54:26 WARN Garbage collection finished on another replica. Its statistics are not available here433--- PASS: TestRunGarbageCollection_FinishedOnAnotherReplica (0.01s)4342026/11/11 23:54:26 WARN Request returned retryable status, retrying attempt=5 backoff=1ms status=502 url=http://127.0.0.1:602574352026/11/11 23:54:26 WARN Request returned retryable status, retrying attempt=6 backoff=1ms status=502 url=http://127.0.0.1:602574362026/11/11 23:54:26 WARN Request returned retryable status, retrying attempt=7 backoff=1ms status=502 url=http://127.0.0.1:602574372026/11/11 23:54:26 WARN Request returned retryable status, retrying attempt=8 backoff=1ms status=502 url=http://127.0.0.1:602574382026/11/11 23:54:26 WARN Request returned retryable status, retrying attempt=9 backoff=1ms status=502 url=http://127.0.0.1:602574392026/11/11 23:54:26 WARN Request returned retryable status, retrying attempt=10 backoff=1ms status=502 url=http://127.0.0.1:602574402026/11/11 23:54:26 WARN Request returned retryable status, retrying attempt=11 backoff=1ms status=502 url=http://127.0.0.1:602574412026/11/11 23:54:26 WARN Request returned retryable status, retrying attempt=12 backoff=1ms status=502 url=http://127.0.0.1:602574422026/11/11 23:54:26 WARN Request returned retryable status, retrying attempt=13 backoff=1ms status=502 url=http://127.0.0.1:60257443--- PASS: TestScriptTokenNoExpiryRerunsEveryCall (0.04s)4442026/11/11 23:54:26 http: TLS handshake error from 127.0.0.1:60345: remote error: tls: bad certificate445--- PASS: TestSetClientTLS (0.01s)446 --- PASS: TestSetClientTLS/succeeds_with_client_cert_and_CA (0.01s)447 --- PASS: TestSetClientTLS/preserves_debug_logging_transport (0.01s)448 --- PASS: TestSetClientTLS/rejects_connection_without_client_cert (0.03s)4492026/11/11 23:54:26 WARN Request returned retryable status, retrying attempt=14 backoff=1ms status=502 url=http://127.0.0.1:60257450--- PASS: TestRegisterUploadedObjectReusesConnections (0.04s)451--- PASS: TestScriptTokenCachesUntilRefresh (0.05s)4522026/11/11 23:54:26 WARN Request returned retryable status, retrying attempt=15 backoff=1ms status=502 url=http://127.0.0.1:602574532026/11/11 23:54:26 WARN Request returned retryable status, retrying attempt=16 backoff=1ms status=502 url=http://127.0.0.1:602574542026/11/11 23:54:26 WARN Request returned retryable status, retrying attempt=17 backoff=1ms status=502 url=http://127.0.0.1:60257455--- PASS: TestDumpPathWriterError (0.05s)456--- PASS: TestRetryTimeoutOutlastsMaxRetries (0.06s)457--- PASS: TestDumpPathSingleFile (0.05s)458--- PASS: TestCaseHackSuffix (0.06s)459--- PASS: TestDumpPathMatchesNix (0.08s)4602026/11/11 23:54:26 WARN Request failed, retrying attempt=1 backoff=100ms error="Post \"http://127.0.0.1:60261/api/uploads/complete\": context deadline exceeded" url=http://127.0.0.1:60261/api/uploads/complete4612026/11/11 23:54:26 WARN Failed to register uploaded object key=abc.narinfo error="sending request: context canceled during retry: context deadline exceeded"4622026/11/11 23:54:26 WARN Request failed, retrying attempt=1 backoff=100ms error="Post \"http://127.0.0.1:60261/api/uploads/complete\": context deadline exceeded" url=http://127.0.0.1:60261/api/uploads/complete4632026/11/11 23:54:26 WARN Request failed, retrying attempt=1 backoff=100ms error="Post \"http://127.0.0.1:60261/api/uploads/complete\": context deadline exceeded" url=http://127.0.0.1:60261/api/uploads/complete4642026/11/11 23:54:26 WARN Failed to register uploaded object key=abc.narinfo error="sending request: context canceled during retry: context deadline exceeded"4652026/11/11 23:54:26 WARN Failed to register uploaded object key=abc.narinfo error="sending request: context canceled during retry: context deadline exceeded"466--- PASS: TestRegisterUploadedObject_BoundedAgainstSilentServer (0.10s)467--- PASS: TestUploadMultipart_PartsInParallel (0.62s)468--- PASS: TestRateLimiterFeedback_400DoesNotCountAsSuccess (1.00s)469PASS470Running server tests...471The files belonging to this database system will be owned by user "_tribuchetbld5".472This user must also own the server process.473474The database cluster will be initialized with locale "C".475The default database encoding has accordingly been set to "SQL_ASCII".476The default text search configuration will be set to "english".477478Data page checksums are enabled.479480creating directory /private/var/tb/5/scratch/0f12ee7d684ae0cb/build/postgres3761740089/data ... ok481creating subdirectories ... ok482selecting dynamic shared memory implementation ... posix483selecting default "max_connections" ... 100484selecting default "shared_buffers" ... 128MB485selecting default time zone ... UTC486creating configuration files ... ok487running bootstrap script ... ok488performing post-bootstrap initialization ... ok489syncing data to disk ... ok490491initdb: warning: enabling "trust" authentication for local connections492initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.493494Success. You can now start the database server using:495496 pg_ctl -D /private/var/tb/5/scratch/0f12ee7d684ae0cb/build/postgres3761740089/data -l logfile start497498/private/var/tb/5/scratch/0f12ee7d684ae0cb/build/postgres3761740089:5432 - no response4992026-11-11 23:54:28.427 UTC [94789] LOG: starting PostgreSQL 18.6 on aarch64-apple-darwin25.6.0, compiled by clang version 21.1.8, 64-bit5002026-11-11 23:54:28.428 UTC [94789] LOG: listening on Unix socket "/private/var/tb/5/scratch/0f12ee7d684ae0cb/build/postgres3761740089/.s.PGSQL.5432"5012026-11-11 23:54:28.431 UTC [94796] LOG: database system was shut down at 2026-11-11 23:54:28 UTC5022026-11-11 23:54:28.431 UTC [94789] LOG: database system is ready to accept connections503/private/var/tb/5/scratch/0f12ee7d684ae0cb/build/postgres3761740089:5432 - accepting connections504{"timestamp":"2026-11-11T23:54:28.648675Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"4efc4c89-acfd-4e2a-bcbe-542af45024e0","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"GET","uri":"/health/ready","status_code":503,"suppressed_errors":0,"duration_ms":0,"result":"server_error","target":"rustfs::server::http","filename":"rustfs/src/server/layer.rs","line_number":502,"threadName":"rustfs-worker","threadId":"ThreadId(11)"}505=== RUN TestAbortSucceeded506=== PAUSE TestAbortSucceeded507=== RUN TestService_AuthMiddleware508=== PAUSE TestService_AuthMiddleware509=== RUN TestService_AuthMiddleware_MTLSProxyHeader510=== PAUSE TestService_AuthMiddleware_MTLSProxyHeader511=== RUN TestService_AuthMiddleware_MTLSBoundSubjects512=== PAUSE TestService_AuthMiddleware_MTLSBoundSubjects513=== RUN TestService_ReadAuthMiddleware514=== PAUSE TestService_ReadAuthMiddleware515=== RUN TestService_AuthMiddleware_OIDC516=== PAUSE TestService_AuthMiddleware_OIDC517=== RUN TestService_RequireScope_OIDC518=== PAUSE TestService_RequireScope_OIDC519=== RUN TestService_ReadScope_PublicByDefault520=== PAUSE TestService_ReadScope_PublicByDefault521=== RUN TestCacheConfigHandler522=== PAUSE TestCacheConfigHandler523=== RUN TestCacheStatsHandler524=== PAUSE TestCacheStatsHandler525=== RUN TestClientCADerivations526=== PAUSE TestClientCADerivations527=== RUN TestClientErrorHandling528=== PAUSE TestClientErrorHandling529=== RUN TestClientIntegration530=== PAUSE TestClientIntegration531=== RUN TestClientMultipleUploads532=== PAUSE TestClientMultipleUploads533=== RUN TestClientWithDependencies534=== PAUSE TestClientWithDependencies535=== RUN TestClientSharedPathCommittedMidPush536=== PAUSE TestClientSharedPathCommittedMidPush537=== RUN TestPinProtectsFromGC538=== PAUSE TestPinProtectsFromGC539=== RUN TestClientPushesUseOnePush540=== PAUSE TestClientPushesUseOnePush541=== RUN TestClientFallsBackToClosures542=== PAUSE TestClientFallsBackToClosures543=== RUN TestDeleteClosuresRacingPins544=== PAUSE TestDeleteClosuresRacingPins545=== RUN TestConcurrentCommitsSharingObjectsDoNotDeadlock546=== PAUSE TestConcurrentCommitsSharingObjectsDoNotDeadlock547=== RUN TestResolveDBConnectionString548=== PAUSE TestResolveDBConnectionString549=== RUN TestConnectWaitsForAPeerMigration550=== PAUSE TestConnectWaitsForAPeerMigration551=== RUN TestLeadElectsOneAndHandsOver552=== PAUSE TestLeadElectsOneAndHandsOver553=== RUN TestLeadIncumbentWinsAfterRestart5542026/11/11 23:54:28 INFO lead: acquired remote=192.0.2.1:1234 generation=15552026/11/11 23:54:29 INFO lead: released remote=192.0.2.1:1234 generation=15562026/11/11 23:54:29 INFO lead: acquired remote=192.0.2.1:1234 generation=25572026/11/11 23:54:30 INFO lead: released remote=192.0.2.1:1234 generation=2558--- PASS: TestLeadIncumbentWinsAfterRestart (1.93s)559=== RUN TestLeadUnannouncedStandbyYieldsToIncumbent560=== PAUSE TestLeadUnannouncedStandbyYieldsToIncumbent561=== RUN TestLeadIncumbentAnnouncesAtOnce562=== PAUSE TestLeadIncumbentAnnouncesAtOnce563=== RUN TestLeadGenerationGrowsWithEveryGrant564=== PAUSE TestLeadGenerationGrowsWithEveryGrant565=== RUN TestLeadEndsOnShutdown566=== PAUSE TestLeadEndsOnShutdown567=== RUN TestLeadEndsWhenItsConnectionHangs5682026/11/11 23:54:30 INFO lead: acquired remote=192.0.2.1:1234 generation=15692026-11-11 23:54:32.282 UTC [94846] FATAL: terminating connection due to administrator command5702026/11/11 23:54:32 INFO lead: acquired remote=192.0.2.1:1234 generation=25712026/11/11 23:54:33 WARN lead: lock connection lost error="timeout: context deadline exceeded"5722026/11/11 23:54:33 INFO lead: released remote=192.0.2.1:1234 generation=15732026/11/11 23:54:33 INFO lead: released remote=192.0.2.1:1234 generation=2574--- PASS: TestLeadEndsWhenItsConnectionHangs (2.99s)575=== RUN TestGCAdvisoryLockBlocksConcurrentRun576=== PAUSE TestGCAdvisoryLockBlocksConcurrentRun577=== RUN TestGCBugBareHashReferences578=== PAUSE TestGCBugBareHashReferences579=== RUN TestGCMetrics580=== PAUSE TestGCMetrics581=== RUN TestPushDedupSurvivesConcurrentGC582=== PAUSE TestPushDedupSurvivesConcurrentGC583=== RUN TestDeduplicatedObjectsRecordedAsPending584=== PAUSE TestDeduplicatedObjectsRecordedAsPending585=== RUN TestGCSweepSkipsPendingObjects586=== PAUSE TestGCSweepSkipsPendingObjects587=== RUN TestTombstonedObjectOfferedWithoutWaiting588=== PAUSE TestTombstonedObjectOfferedWithoutWaiting589=== RUN TestGCSweepDeliversEachKeyOnce590=== PAUSE TestGCSweepDeliversEachKeyOnce591=== RUN TestCreatePendingClosureVerifyS3FailureReleasesConnection592=== PAUSE TestCreatePendingClosureVerifyS3FailureReleasesConnection593=== RUN TestForceGCDuringPushOffersSweptObject594=== PAUSE TestForceGCDuringPushOffersSweptObject595=== RUN TestFailedS3DeleteKeepsTombstone596=== PAUSE TestFailedS3DeleteKeepsTombstone597=== RUN TestSweepSkipsRowsLockedByPush598=== PAUSE TestSweepSkipsRowsLockedByPush599=== RUN TestRegisterCompletedObjectNeedsPendingRow600=== PAUSE TestRegisterCompletedObjectNeedsPendingRow601=== RUN TestGetExistingObjectsLocksRows602=== PAUSE TestGetExistingObjectsLocksRows603=== RUN TestSweepRechecksPendingAfterLocking604=== PAUSE TestSweepRechecksPendingAfterLocking605=== RUN TestPushWaitsForSweepHoldingRow606=== PAUSE TestPushWaitsForSweepHoldingRow607=== RUN TestCommitRacingPendingCleanupKeepsObjects608=== PAUSE TestCommitRacingPendingCleanupKeepsObjects609=== RUN TestGCEndsOnShutdown610=== PAUSE TestGCEndsOnShutdown611=== RUN TestGCTaskStore_StartNew612=== PAUSE TestGCTaskStore_StartNew613=== RUN TestGCTaskStore_DeduplicateSameParams614=== PAUSE TestGCTaskStore_DeduplicateSameParams615=== RUN TestGCTaskStore_ConflictDifferentParams616=== PAUSE TestGCTaskStore_ConflictDifferentParams617=== RUN TestGCTaskStore_GetEmpty618=== PAUSE TestGCTaskStore_GetEmpty619=== RUN TestGCTaskStore_GetReturnsLatest620=== PAUSE TestGCTaskStore_GetReturnsLatest621=== RUN TestGCTaskStore_CompletedAllowsNewTask622=== PAUSE TestGCTaskStore_CompletedAllowsNewTask623=== RUN TestGCTaskStore_PhaseUpdates624=== PAUSE TestGCTaskStore_PhaseUpdates625=== RUN TestGCTaskStore_Fail626=== PAUSE TestGCTaskStore_Fail627=== RUN TestGracefulShutdownDrainsInflight628=== PAUSE TestGracefulShutdownDrainsInflight629=== RUN TestService_healthCheckHandler630=== PAUSE TestService_healthCheckHandler631=== RUN TestService_readinessHandler632=== PAUSE TestService_readinessHandler633=== RUN TestGenerateLandingPage634=== PAUSE TestGenerateLandingPage635=== RUN TestEnsureAbortUploadsRule636=== PAUSE TestEnsureAbortUploadsRule637=== RUN TestCacheConfigHandlerMaxNarSize638=== PAUSE TestCacheConfigHandlerMaxNarSize639=== RUN TestCreatePendingClosureRejectsOversizedNAR640=== PAUSE TestCreatePendingClosureRejectsOversizedNAR641=== RUN TestNARDeduplicationMetadataUploadBug642=== PAUSE TestNARDeduplicationMetadataUploadBug643=== RUN TestMetricsInventory644=== PAUSE TestMetricsInventory645=== RUN TestMetricsCommit646=== PAUSE TestMetricsCommit647=== RUN TestService_NativeMTLS648=== PAUSE TestService_NativeMTLS649=== RUN TestServerTLSConfig650=== PAUSE TestServerTLSConfig651=== RUN TestMultipartCleanup652=== PAUSE TestMultipartCleanup653=== RUN TestMultipartUploadAbortedWhenCancelledBeforeRecorded654=== PAUSE TestMultipartUploadAbortedWhenCancelledBeforeRecorded655=== RUN TestPendingCleanupUsesOneCutoff656=== PAUSE TestPendingCleanupUsesOneCutoff657=== RUN TestObjectStatsTrigger658=== PAUSE TestObjectStatsTrigger659=== RUN TestObjectStatsUpdatedOncePerCommit660=== PAUSE TestObjectStatsUpdatedOncePerCommit661=== RUN TestOrphanedObjectsGC662=== PAUSE TestOrphanedObjectsGC663=== RUN TestOrphanedObjectsGCStressTest664=== PAUSE TestOrphanedObjectsGCStressTest665=== RUN TestCreatePin_ReservedPins666=== PAUSE TestCreatePin_ReservedPins667=== RUN TestPresentReportsOnlyClosureRoots668=== PAUSE TestPresentReportsOnlyClosureRoots669=== RUN TestPresentRefreshesOnlyStaleClosures670=== PAUSE TestPresentRefreshesOnlyStaleClosures671=== RUN TestPresentNotReportedWhileGCDeletesClosure672=== PAUSE TestPresentNotReportedWhileGCDeletesClosure673=== RUN TestParseSingleRange674=== PAUSE TestParseSingleRange675=== RUN TestProxyHeadersOnlyTrustedOnSocket6762026/11/11 23:54:33 INFO Starting HTTP server address=127.0.0.1:603776772026/11/11 23:54:33 INFO Starting HTTP server address=proxy.sock6782026/11/11 23:54:33 WARN mTLS auth: subject not in bound subjects subject="CN=someone"6792026/11/11 23:54:33 INFO Shutdown signal received, draining in-flight requests timeout=10s680--- PASS: TestProxyHeadersOnlyTrustedOnSocket (0.17s)681=== RUN TestIsValidCachePath682=== PAUSE TestIsValidCachePath683=== RUN TestReadProxyNarinfo684=== PAUSE TestReadProxyNarinfo685=== RUN TestReadProxyNarinfoAlreadyDecompressed686=== PAUSE TestReadProxyNarinfoAlreadyDecompressed687=== RUN TestReadProxyContentNegotiation688=== PAUSE TestReadProxyContentNegotiation689=== RUN TestReadProxyNarStreaming690=== PAUSE TestReadProxyNarStreaming691=== RUN TestReadProxy404692=== PAUSE TestReadProxy404693=== RUN TestReadProxyInvalidPath694=== PAUSE TestReadProxyInvalidPath695=== RUN TestReadProxyHead696=== PAUSE TestReadProxyHead697=== RUN TestReadProxyOutlastsServerWriteTimeout698=== PAUSE TestReadProxyOutlastsServerWriteTimeout699=== RUN TestReadProxyConditionalGet700=== PAUSE TestReadProxyConditionalGet701=== RUN TestReadProxyRootRedirectsToIndexHTML702=== PAUSE TestReadProxyRootRedirectsToIndexHTML703=== RUN TestReadProxyDisabled704=== PAUSE TestReadProxyDisabled705=== RUN TestReadRedirectNar706=== PAUSE TestReadRedirectNar707=== RUN TestReadRedirectKeepsNarinfoProxied708=== PAUSE TestReadRedirectKeepsNarinfoProxied709=== RUN TestReadProxyRangeRequest710=== PAUSE TestReadProxyRangeRequest711=== RUN TestReadRedirectUsesPublicS3URL712=== PAUSE TestReadRedirectUsesPublicS3URL713=== RUN TestPush_OverlappingRootsStoreOneRowPerKey714=== PAUSE TestPush_OverlappingRootsStoreOneRowPerKey715=== RUN TestPush_CompleteCommitsEveryRoot716=== PAUSE TestPush_CompleteCommitsEveryRoot717=== RUN TestPush_RepeatedRootCommitsOnce718=== PAUSE TestPush_RepeatedRootCommitsOnce719=== RUN TestPush_CompleteWaitsForCleanupOfThePush720=== PAUSE TestPush_CompleteWaitsForCleanupOfThePush721=== RUN TestPush_RootsAreLockedInByteOrder722=== PAUSE TestPush_RootsAreLockedInByteOrder723=== RUN TestPush_SkippedKeySurvivesGCBeforeCommit724=== PAUSE TestPush_SkippedKeySurvivesGCBeforeCommit725=== RUN TestPush_RejectsBadRequests726=== PAUSE TestPush_RejectsBadRequests727=== RUN TestPush_SignsNarinfosOfItsPendingObjects728=== PAUSE TestPush_SignsNarinfosOfItsPendingObjects729=== RUN TestSharedNarBothUploadsComplete730=== PAUSE TestSharedNarBothUploadsComplete731=== RUN TestCompleteMultipartUpload_ErrorButObjectExists732=== PAUSE TestCompleteMultipartUpload_ErrorButObjectExists733=== RUN TestCompletedNarNotReofferedAcrossClosures734=== PAUSE TestCompletedNarNotReofferedAcrossClosures735=== RUN TestPresignedUploadRegisteredBeforeCommit736=== PAUSE TestPresignedUploadRegisteredBeforeCommit737=== RUN TestService_Rustfstest738=== PAUSE TestService_Rustfstest739=== RUN TestParseSize740=== PAUSE TestParseSize741=== RUN TestSkippedUploadsHandler742=== PAUSE TestSkippedUploadsHandler743=== RUN TestSystemdListenerNotActivated744--- PASS: TestSystemdListenerNotActivated (0.00s)745=== RUN TestWatchdogBeatsWhenHealthy746--- PASS: TestWatchdogBeatsWhenHealthy (0.03s)747=== RUN TestWatchdogSkipsWhenUnhealthy7482026/11/11 23:54:33 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7492026/11/11 23:54:33 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7502026/11/11 23:54:33 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7512026/11/11 23:54:33 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7522026/11/11 23:54:33 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7532026/11/11 23:54:34 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7542026/11/11 23:54:34 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7552026/11/11 23:54:34 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7562026/11/11 23:54:34 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7572026/11/11 23:54:34 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"758--- PASS: TestWatchdogSkipsWhenUnhealthy (0.20s)759=== RUN TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle760=== PAUSE TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle761=== RUN TestProxyWriteTimeout762=== PAUSE TestProxyWriteTimeout763=== RUN TestPendingClosureWriteTimeout764=== PAUSE TestPendingClosureWriteTimeout765=== RUN TestIsValidUploadKey766=== PAUSE TestIsValidUploadKey767=== RUN TestUploadHandlersRejectInvalidKeys768=== PAUSE TestUploadHandlersRejectInvalidKeys769=== RUN TestUploadHandlersRejectOversizedBody770=== PAUSE TestUploadHandlersRejectOversizedBody771=== RUN TestService_cleanupPendingClosuresHandler772=== PAUSE TestService_cleanupPendingClosuresHandler773=== RUN TestService_createPendingClosureHandler774=== PAUSE TestService_createPendingClosureHandler775=== RUN TestService_verifyS3Integrity776=== PAUSE TestService_verifyS3Integrity777=== RUN TestService_verifyS3ReuploadsStaleNarinfo778=== PAUSE TestService_verifyS3ReuploadsStaleNarinfo779=== RUN TestCompleteMultipartUnregistered780=== PAUSE TestCompleteMultipartUnregistered781=== RUN TestCreatePendingClosure_SmallNARUsesSimplePUT782=== PAUSE TestCreatePendingClosure_SmallNARUsesSimplePUT783=== CONT TestPush_SignsNarinfosOfItsPendingObjects784=== CONT TestUploadHandlersRejectOversizedBody785=== CONT TestPendingClosureWriteTimeout786=== CONT TestAbortSucceeded787--- PASS: TestAbortSucceeded (0.00s)788=== CONT TestCreatePendingClosure_SmallNARUsesSimplePUT789=== CONT TestCompleteMultipartUnregistered790=== CONT TestReadRedirectNar791=== CONT TestService_verifyS3ReuploadsStaleNarinfo792=== CONT TestService_verifyS3Integrity793=== CONT TestService_createPendingClosureHandler794=== CONT TestService_cleanupPendingClosuresHandler795=== CONT TestPush_RejectsBadRequests796=== CONT TestPush_SkippedKeySurvivesGCBeforeCommit797=== CONT TestPush_RootsAreLockedInByteOrder798=== CONT TestPush_CompleteWaitsForCleanupOfThePush799=== CONT TestPush_RepeatedRootCommitsOnce800=== CONT TestPush_CompleteCommitsEveryRoot801=== CONT TestUploadHandlersRejectInvalidKeys802=== CONT TestPush_OverlappingRootsStoreOneRowPerKey803=== CONT TestReadRedirectUsesPublicS3URL804=== CONT TestService_Rustfstest805=== CONT TestReadProxyRangeRequest806=== CONT TestProxyWriteTimeout807=== CONT TestReadRedirectKeepsNarinfoProxied808=== CONT TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle809=== RUN TestPendingClosureWriteTimeout/empty810=== RUN TestService_verifyS3ReuploadsStaleNarinfo/lost,_other_NAR_pushed811=== RUN TestProxyWriteTimeout/narinfo812=== PAUSE TestService_verifyS3ReuploadsStaleNarinfo/lost,_other_NAR_pushed813=== RUN TestService_verifyS3ReuploadsStaleNarinfo/intact,_other_NAR_pushed814=== PAUSE TestService_verifyS3ReuploadsStaleNarinfo/intact,_other_NAR_pushed815=== RUN TestService_verifyS3ReuploadsStaleNarinfo/first_of_two_lost816=== PAUSE TestService_verifyS3ReuploadsStaleNarinfo/first_of_two_lost817=== RUN TestService_verifyS3ReuploadsStaleNarinfo/first_of_two_lost,_second_pushed818=== PAUSE TestPendingClosureWriteTimeout/empty819=== RUN TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info820=== RUN TestPendingClosureWriteTimeout/400_objects821=== PAUSE TestService_verifyS3ReuploadsStaleNarinfo/first_of_two_lost,_second_pushed822=== RUN TestService_verifyS3ReuploadsStaleNarinfo/lost,_same_NAR_pushed823=== PAUSE TestService_verifyS3ReuploadsStaleNarinfo/lost,_same_NAR_pushed824=== PAUSE TestProxyWriteTimeout/narinfo825=== RUN TestProxyWriteTimeout/1_GiB_nar826=== PAUSE TestProxyWriteTimeout/1_GiB_nar827=== RUN TestProxyWriteTimeout/10_GiB_nar828=== PAUSE TestProxyWriteTimeout/10_GiB_nar829=== RUN TestProxyWriteTimeout/unknown_size830=== PAUSE TestProxyWriteTimeout/unknown_size831=== CONT TestReadProxyDisabled832=== PAUSE TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info833=== RUN TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal834=== PAUSE TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal835=== RUN TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key836=== PAUSE TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key837=== RUN TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key838=== PAUSE TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key839=== CONT TestSkippedUploadsHandler840=== PAUSE TestPendingClosureWriteTimeout/400_objects841=== RUN TestPendingClosureWriteTimeout/670k_objects842=== PAUSE TestPendingClosureWriteTimeout/670k_objects843=== RUN TestPendingClosureWriteTimeout/handler_extends_the_server's_deadline844=== PAUSE TestPendingClosureWriteTimeout/handler_extends_the_server's_deadline845=== CONT TestReadProxyRootRedirectsToIndexHTML8462026/11/11 23:54:34 INFO Client skipped oversized paths paths=3 nar_bytes=5000000000847=== CONT TestParseSize848--- PASS: TestParseSize (0.00s)849=== CONT TestIsValidUploadKey850=== RUN TestIsValidUploadKey/narinfo851=== PAUSE TestIsValidUploadKey/narinfo852=== RUN TestIsValidUploadKey/nar_zst853=== PAUSE TestIsValidUploadKey/nar_zst854=== RUN TestIsValidUploadKey/nar_xz855=== PAUSE TestIsValidUploadKey/nar_xz856=== RUN TestIsValidUploadKey/nar_plain857=== PAUSE TestIsValidUploadKey/nar_plain858=== RUN TestIsValidUploadKey/listing859=== PAUSE TestIsValidUploadKey/listing860=== RUN TestIsValidUploadKey/build_log861=== PAUSE TestIsValidUploadKey/build_log862=== RUN TestIsValidUploadKey/build_log_home-manager_file863=== PAUSE TestIsValidUploadKey/build_log_home-manager_file864=== RUN TestIsValidUploadKey/build_log_plus_in_name865=== PAUSE TestIsValidUploadKey/build_log_plus_in_name866=== RUN TestIsValidUploadKey/build_log_question_mark867=== PAUSE TestIsValidUploadKey/build_log_question_mark868=== RUN TestIsValidUploadKey/build_log_equals869=== PAUSE TestIsValidUploadKey/build_log_equals870=== RUN TestIsValidUploadKey/realisation871=== PAUSE TestIsValidUploadKey/realisation872=== RUN TestIsValidUploadKey/realisation_plus_in_output873=== PAUSE TestIsValidUploadKey/realisation_plus_in_output874=== RUN TestIsValidUploadKey/nix-cache-info875=== PAUSE TestIsValidUploadKey/nix-cache-info876=== RUN TestIsValidUploadKey/index.html877=== PAUSE TestIsValidUploadKey/index.html878=== RUN TestIsValidUploadKey/narinfo_key,_nar_type879=== PAUSE TestIsValidUploadKey/narinfo_key,_nar_type880=== RUN TestIsValidUploadKey/nar_key,_narinfo_type881=== PAUSE TestIsValidUploadKey/nar_key,_narinfo_type882=== RUN TestIsValidUploadKey/listing_key,_narinfo_type883=== PAUSE TestIsValidUploadKey/listing_key,_narinfo_type884=== RUN TestIsValidUploadKey/traversal885=== PAUSE TestIsValidUploadKey/traversal886=== RUN TestIsValidUploadKey/traversal_nar887=== PAUSE TestIsValidUploadKey/traversal_nar888=== RUN TestIsValidUploadKey/absolute889=== PAUSE TestIsValidUploadKey/absolute890=== RUN TestIsValidUploadKey/empty_key891=== PAUSE TestIsValidUploadKey/empty_key892=== RUN TestIsValidUploadKey/unknown_type893=== PAUSE TestIsValidUploadKey/unknown_type894=== CONT TestReadProxyConditionalGet895--- PASS: TestSkippedUploadsHandler (0.01s)896=== CONT TestReadProxyOutlastsServerWriteTimeout897=== RUN TestUploadHandlersRejectOversizedBody/request_more_parts898=== PAUSE TestUploadHandlersRejectOversizedBody/request_more_parts899=== RUN TestUploadHandlersRejectOversizedBody/create_pending_closure900=== PAUSE TestUploadHandlersRejectOversizedBody/create_pending_closure901=== RUN TestUploadHandlersRejectOversizedBody/complete_multipart902=== PAUSE TestUploadHandlersRejectOversizedBody/complete_multipart903=== CONT TestCompletedNarNotReofferedAcrossClosures9042026/11/11 23:54:35 INFO Received uploads request method=POST path=/api/pending_closures905--- PASS: TestCreatePendingClosure_SmallNARUsesSimplePUT (1.10s)906=== CONT TestReadProxyHead9072026/11/11 23:54:35 INFO Received push request method=POST path=/api/pushes9082026/11/11 23:54:35 INFO Received complete push request method=POST path=/api/pushes/1/complete9092026/11/11 23:54:35 INFO Completed push id=1 objects=4 duration=31.400708ms9102026/11/11 23:54:35 INFO Received push request method=POST path=/api/pushes9112026/11/11 23:54:35 INFO Aborted multipart uploads count=0 kept=09122026/11/11 23:54:35 INFO Received complete multipart upload request method=POST path=/api/multipart/complete9132026/11/11 23:54:35 WARN Force mode enabled - objects will be deleted immediately without grace period9142026/11/11 23:54:35 ERROR Failed to get multipart upload error="no rows in result set" upload_id=does-not-exist object_key=nar/0000000000000000000000000000000000000000000000000000.nar.zst915--- PASS: TestCompleteMultipartUnregistered (1.53s)916=== CONT TestPresignedUploadRegisteredBeforeCommit9172026/11/11 23:54:35 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=2 objects-deleted-after-grace-period=2 objects-failed-to-delete=09182026/11/11 23:54:35 INFO Vacuumed table table=pending_closures9192026/11/11 23:54:35 INFO Vacuumed table table=pending_objects9202026/11/11 23:54:35 INFO Vacuumed table table=multipart_uploads9212026/11/11 23:54:35 INFO Vacuumed table table=closures9222026/11/11 23:54:35 INFO Vacuumed table table=objects9232026/11/11 23:54:35 INFO Received complete push request method=POST path=/api/pushes/2/complete9242026/11/11 23:54:35 INFO Completed push id=2 objects=4 duration=9.340542ms925--- PASS: TestPush_SkippedKeySurvivesGCBeforeCommit (1.70s)926=== CONT TestReadProxyInvalidPath9272026/11/11 23:54:35 INFO Received push request method=POST path=/api/pushes9282026/11/11 23:54:35 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign9292026/11/11 23:54:35 INFO Signed narinfos id=1 count=19302026/11/11 23:54:35 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign9312026/11/11 23:54:35 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign9322026/11/11 23:54:35 ERROR Failed to sign narinfos signer="index 1" error="signing key cannot be nil"9332026/11/11 23:54:35 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign9342026/11/11 23:54:35 ERROR Failed to sign narinfos signer=niks3-test-1 error="signer failed"9352026/11/11 23:54:35 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign9362026/11/11 23:54:35 ERROR Signer returned unexpected signature count signer=niks3-test-1 got=0 want=19372026/11/11 23:54:35 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign9382026/11/11 23:54:35 ERROR Signer returned unexpected object key signer=niks3-test-1 object_key=unexpected.narinfo939--- PASS: TestPush_SignsNarinfosOfItsPendingObjects (1.88s)940=== CONT TestGetExistingObjectsLocksRows9412026/11/11 23:54:36 INFO Received cleanup request method=DELETE path=/api/pending_closures9422026/11/11 23:54:36 INFO Aborted multipart uploads count=0 kept=09432026/11/11 23:54:36 INFO Received uploads request method=POST path=/api/pending_closures9442026/11/11 23:54:36 INFO Received cleanup request method=DELETE path=/api/pending_closures9452026/11/11 23:54:36 INFO Aborted multipart uploads count=1 kept=09462026/11/11 23:54:36 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete9472026-11-11 23:54:36.191 UTC [94923] ERROR: Closure does not exist: id=19482026-11-11 23:54:36.191 UTC [94923] CONTEXT: PL/pgSQL function commit_pending_closure(bigint) line 13 at RAISE9492026-11-11 23:54:36.191 UTC [94923] STATEMENT: -- name: CommitPendingClosure :one950 SELECT commit_pending_closure($1::bigint)::bigint951 952--- PASS: TestService_cleanupPendingClosuresHandler (2.09s)953=== CONT TestRegisterCompletedObjectNeedsPendingRow954--- PASS: TestReadRedirectNar (2.22s)955=== CONT TestSweepSkipsRowsLockedByPush9562026/11/11 23:54:36 INFO Received uploads request method=POST path=/api/pending_closures957--- PASS: TestService_Rustfstest (2.52s)958=== CONT TestCompleteMultipartUpload_ErrorButObjectExists959--- PASS: TestReadProxyDisabled (2.73s)960=== CONT TestSweepRechecksPendingAfterLocking961=== RUN TestPush_RejectsBadRequests/root_not_in_objects962=== PAUSE TestPush_RejectsBadRequests/root_not_in_objects963=== RUN TestPush_RejectsBadRequests/no_roots964=== PAUSE TestPush_RejectsBadRequests/no_roots965=== RUN TestPush_RejectsBadRequests/no_objects966=== PAUSE TestPush_RejectsBadRequests/no_objects967=== RUN TestPush_RejectsBadRequests/bad_root968=== PAUSE TestPush_RejectsBadRequests/bad_root969=== CONT TestReadProxy404970--- PASS: TestReadRedirectKeepsNarinfoProxied (3.31s)971=== CONT TestFailedS3DeleteKeepsTombstone9722026/11/11 23:54:37 INFO Received push request method=POST path=/api/pushes9732026/11/11 23:54:37 INFO Received complete multipart upload request method=POST path=/api/multipart/complete9742026/11/11 23:54:37 INFO Received complete push request method=POST path=/api/pushes/1/complete9752026/11/11 23:54:37 INFO Completed multipart upload object_key=nar/dadb44fdadb44fdadb44fdadb44f000000000000000000000000.nar.zst upload_id=MzIyODlmZWItZTZhMy00OWIwLTllNzMtNjI4NTlmMDg5YTgwLmFlZGI5N2E5LWJiNGUtNDA1Yi1iYzA5LTFhNDkwMjc5M2RlY3gxNzk0NDQxMjc2NDY5NTg5MDAw parts=109762026/11/11 23:54:37 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete9772026/11/11 23:54:37 INFO Completed push id=1 objects=6 duration=20.7025ms978--- PASS: TestPush_CompleteCommitsEveryRoot (3.63s)979=== CONT TestReadProxyNarStreaming9802026/11/11 23:54:37 INFO Completed upload id=1 objects=2 duration=11.7665ms9812026/11/11 23:54:37 INFO Received uploads request method=POST path=/api/pending_closures9822026/11/11 23:54:37 INFO Received uploads request method=POST path=/api/pending_closures9832026/11/11 23:54:37 INFO Object in database but missing from S3 key=dadb44fdadb44fdadb44fdadb44f0000.narinfo9842026/11/11 23:54:37 WARN Found objects in DB but missing from S3, will re-upload count=1985--- PASS: TestService_verifyS3Integrity (3.66s)986=== CONT TestReadProxyContentNegotiation9872026/11/11 23:54:37 INFO Received uploads request method=POST path=/api/pending_closures9882026/11/11 23:54:37 INFO Received uploads request method=POST path=/api/pending_closures9892026/11/11 23:54:37 INFO Received uploads request method=POST path=/api/pending_closures990--- PASS: TestReadRedirectUsesPublicS3URL (3.96s)991=== CONT TestReadProxyNarinfoAlreadyDecompressed9922026/11/11 23:54:38 INFO Received push request method=POST path=/api/pushes9932026-11-11 23:54:38.416 UTC [94982] ERROR: could not obtain lock on row in relation "closures"9942026-11-11 23:54:38.416 UTC [94982] STATEMENT: SELECT 1 FROM closures WHERE key = $1 FOR UPDATE NOWAIT9952026-11-11 23:54:38.423 UTC [94982] ERROR: could not obtain lock on row in relation "closures"9962026-11-11 23:54:38.423 UTC [94982] STATEMENT: SELECT 1 FROM closures WHERE key = $1 FOR UPDATE NOWAIT9972026-11-11 23:54:38.430 UTC [94982] ERROR: could not obtain lock on row in relation "closures"9982026-11-11 23:54:38.430 UTC [94982] STATEMENT: SELECT 1 FROM closures WHERE key = $1 FOR UPDATE NOWAIT9992026-11-11 23:54:38.430 UTC [94982] ERROR: could not obtain lock on row in relation "closures"10002026-11-11 23:54:38.430 UTC [94982] STATEMENT: SELECT 1 FROM closures WHERE key = $1 FOR UPDATE NOWAIT10012026-11-11 23:54:38.436 UTC [94982] ERROR: could not obtain lock on row in relation "closures"10022026-11-11 23:54:38.436 UTC [94982] STATEMENT: SELECT 1 FROM closures WHERE key = $1 FOR UPDATE NOWAIT1003--- PASS: TestPush_RootsAreLockedInByteOrder (4.35s)1004=== CONT TestReadProxyNarinfo10052026/11/11 23:54:38 INFO Received uploads request method=POST path=/api/pending_closures1006--- PASS: TestReadProxyRangeRequest (4.71s)1007=== CONT TestIsValidCachePath1008=== RUN TestIsValidCachePath/narinfo1009=== PAUSE TestIsValidCachePath/narinfo1010=== RUN TestIsValidCachePath/narinfo_all_nix_base32_chars1011=== PAUSE TestIsValidCachePath/narinfo_all_nix_base32_chars1012=== RUN TestIsValidCachePath/nar_zst1013=== PAUSE TestIsValidCachePath/nar_zst1014=== RUN TestIsValidCachePath/nar_xz1015=== PAUSE TestIsValidCachePath/nar_xz1016=== RUN TestIsValidCachePath/nar_bz21017=== PAUSE TestIsValidCachePath/nar_bz21018=== RUN TestIsValidCachePath/nar_uncompressed1019=== PAUSE TestIsValidCachePath/nar_uncompressed1020=== RUN TestIsValidCachePath/ls1021=== PAUSE TestIsValidCachePath/ls1022=== RUN TestIsValidCachePath/log1023=== PAUSE TestIsValidCachePath/log1024=== RUN TestIsValidCachePath/realisation1025=== PAUSE TestIsValidCachePath/realisation1026=== RUN TestIsValidCachePath/nix-cache-info1027=== PAUSE TestIsValidCachePath/nix-cache-info1028=== RUN TestIsValidCachePath/index.html1029=== PAUSE TestIsValidCachePath/index.html1030=== RUN TestIsValidCachePath/traversal_parent1031=== PAUSE TestIsValidCachePath/traversal_parent1032=== RUN TestIsValidCachePath/traversal_in_middle1033=== PAUSE TestIsValidCachePath/traversal_in_middle1034=== RUN TestIsValidCachePath/invalid_char_e1035=== PAUSE TestIsValidCachePath/invalid_char_e1036=== RUN TestIsValidCachePath/invalid_char_u1037=== PAUSE TestIsValidCachePath/invalid_char_u1038=== RUN TestIsValidCachePath/random_path1039=== PAUSE TestIsValidCachePath/random_path1040=== RUN TestIsValidCachePath/empty1041=== PAUSE TestIsValidCachePath/empty1042=== RUN TestIsValidCachePath/leading_slash1043=== PAUSE TestIsValidCachePath/leading_slash1044=== RUN TestIsValidCachePath/wrong_extension1045=== PAUSE TestIsValidCachePath/wrong_extension1046=== RUN TestIsValidCachePath/short_hash1047=== PAUSE TestIsValidCachePath/short_hash1048=== CONT TestDeleteClosuresRacingPins10492026/11/11 23:54:39 INFO Received push request method=POST path=/api/pushes10502026/11/11 23:54:39 INFO Received complete multipart upload request method=POST path=/api/multipart/complete10512026/11/11 23:54:39 INFO Completed multipart upload object_key=nar/0000000000000000000000000000000000000000000000000000.nar.zst upload_id=MzIyODlmZWItZTZhMy00OWIwLTllNzMtNjI4NTlmMDg5YTgwLjZiMGFkNmMxLTVmNzgtNGY4Yy1hYzYxLTExNzZlMGZhNDRiY3gxNzk0NDQxMjc3ODM3NTAwMDAw parts=1010522026/11/11 23:54:39 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete10532026/11/11 23:54:39 INFO Completed upload id=1 objects=2 duration=10.061333ms10542026/11/11 23:54:39 INFO Received get closure request method=GET path=/api/closures/0000000000000000000000000000000010552026/11/11 23:54:39 INFO Received uploads request method=POST path=/api/pending_closures10562026/11/11 23:54:39 INFO Starting cleanup of old closures method=DELETE path=/api/closures10572026/11/11 23:54:39 INFO Aborted multipart uploads count=0 kept=010582026/11/11 23:54:39 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=010592026/11/11 23:54:39 INFO Vacuumed table table=pending_closures1060--- PASS: TestReadProxyConditionalGet (5.20s)1061=== CONT TestParseSingleRange1062=== RUN TestParseSingleRange/none1063=== PAUSE TestParseSingleRange/none1064=== RUN TestParseSingleRange/unknown_unit1065=== PAUSE TestParseSingleRange/unknown_unit1066=== RUN TestParseSingleRange/multi-range_ignored1067=== PAUSE TestParseSingleRange/multi-range_ignored1068=== RUN TestParseSingleRange/malformed_no_dash1069=== PAUSE TestParseSingleRange/malformed_no_dash1070=== RUN TestParseSingleRange/malformed_both_empty1071=== PAUSE TestParseSingleRange/malformed_both_empty1072=== RUN TestParseSingleRange/malformed_end_before_start1073=== PAUSE TestParseSingleRange/malformed_end_before_start1074=== RUN TestParseSingleRange/closed1075=== PAUSE TestParseSingleRange/closed1076=== RUN TestParseSingleRange/open-ended1077=== PAUSE TestParseSingleRange/open-ended1078=== RUN TestParseSingleRange/end_clamped_to_size1079=== PAUSE TestParseSingleRange/end_clamped_to_size1080=== RUN TestParseSingleRange/suffix1081=== PAUSE TestParseSingleRange/suffix1082=== RUN TestParseSingleRange/suffix_exceeds_size1083=== PAUSE TestParseSingleRange/suffix_exceeds_size1084=== RUN TestParseSingleRange/single_byte1085=== PAUSE TestParseSingleRange/single_byte1086=== RUN TestParseSingleRange/start_past_EOF1087=== PAUSE TestParseSingleRange/start_past_EOF1088=== RUN TestParseSingleRange/start_far_past_EOF1089=== PAUSE TestParseSingleRange/start_far_past_EOF1090=== CONT TestForceGCDuringPushOffersSweptObject1091=== RUN TestForceGCDuringPushOffersSweptObject/before_pending_rows1092=== PAUSE TestForceGCDuringPushOffersSweptObject/before_pending_rows1093=== RUN TestForceGCDuringPushOffersSweptObject/after_presence_check1094=== PAUSE TestForceGCDuringPushOffersSweptObject/after_presence_check1095=== CONT TestCreatePendingClosureVerifyS3FailureReleasesConnection10962026/11/11 23:54:39 INFO Vacuumed table table=pending_objects10972026/11/11 23:54:39 INFO Vacuumed table table=multipart_uploads10982026/11/11 23:54:39 INFO Vacuumed table table=closures10992026/11/11 23:54:39 INFO Vacuumed table table=objects11002026-11-11 23:54:39.422 UTC [94990] ERROR: Push does not exist: id=111012026-11-11 23:54:39.422 UTC [94990] CONTEXT: PL/pgSQL function commit_push(bigint) line 11 at RAISE11022026-11-11 23:54:39.422 UTC [94990] STATEMENT: SELECT commit_push($1)11032026/11/11 23:54:39 INFO Received get closure request method=GET path=/api/closures/000000000000000000000000000000001104--- PASS: TestPush_CompleteWaitsForCleanupOfThePush (5.32s)1105=== CONT TestGCSweepDeliversEachKeyOnce1106--- PASS: TestService_createPendingClosureHandler (5.33s)1107=== CONT TestPresentNotReportedWhileGCDeletesClosure1108=== RUN TestPresentNotReportedWhileGCDeletesClosure/stale1109=== PAUSE TestPresentNotReportedWhileGCDeletesClosure/stale1110=== RUN TestPresentNotReportedWhileGCDeletesClosure/fresh1111=== PAUSE TestPresentNotReportedWhileGCDeletesClosure/fresh1112=== CONT TestPresentRefreshesOnlyStaleClosures11132026/11/11 23:54:39 INFO Received push request method=POST path=/api/pushes1114--- PASS: TestPush_OverlappingRootsStoreOneRowPerKey (5.53s)1115=== CONT TestPresentReportsOnlyClosureRoots11162026/11/11 23:54:39 INFO Received push request method=POST path=/api/pushes11172026/11/11 23:54:39 INFO Received complete push request method=POST path=/api/pushes/1/complete11182026/11/11 23:54:39 INFO Completed push id=1 objects=4 duration=40.592875ms1119--- PASS: TestPush_RepeatedRootCommitsOnce (5.80s)1120=== CONT TestCreatePin_ReservedPins11212026/11/11 23:54:39 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:60436/oidc1122--- PASS: TestReadProxyRootRedirectsToIndexHTML (5.87s)1123=== CONT TestSharedNarBothUploadsComplete11242026/11/11 23:54:40 INFO Received complete multipart upload request method=POST path=/api/multipart/complete11252026/11/11 23:54:40 INFO Completed multipart upload object_key=nar/hhhhhhhhhhhhhhhhhhhhhhhhhhhhhh0100000000000000000000.nar.zst upload_id=MzIyODlmZWItZTZhMy00OWIwLTllNzMtNjI4NTlmMDg5YTgwLjFkNGM0MTUyLTg1Y2QtNGVhOC1hYjVkLTM2OWM1ZTlkNTZmYngxNzk0NDQxMjc4NTg0MjU5MDAw parts=1211262026/11/11 23:54:40 INFO Received uploads request method=POST path=/api/pending_closures1127--- PASS: TestCompletedNarNotReofferedAcrossClosures (5.95s)1128=== CONT TestTombstonedObjectOfferedWithoutWaiting11292026/11/11 23:54:40 INFO Received uploads request method=POST path=/api/pending_closures11302026/11/11 23:54:40 INFO Received complete multipart upload request method=POST path=/api/multipart/complete1131--- PASS: TestReadProxyInvalidPath (4.84s)1132=== CONT TestLeadEndsOnShutdown1133--- PASS: TestReadProxyHead (5.84s)1134=== CONT TestLeadGenerationGrowsWithEveryGrant11352026/11/11 23:54:41 INFO Received uploads request method=POST path=/api/pending_closures11362026/11/11 23:54:41 INFO Registered completed upload object_key=nar/jjjjjjjjjjjjjjjjjjjjjjjjjjjjjj0100000000000000000000.nar.zst11372026/11/11 23:54:41 INFO Received uploads request method=POST path=/api/pending_closures1138--- PASS: TestPresignedUploadRegisteredBeforeCommit (5.77s)1139=== CONT TestGCSweepSkipsPendingObjects1140--- PASS: TestGetExistingObjectsLocksRows (5.68s)1141=== CONT TestOrphanedObjectsGCStressTest1142--- PASS: TestRegisterCompletedObjectNeedsPendingRow (5.64s)1143=== CONT TestLeadIncumbentAnnouncesAtOnce11442026/11/11 23:54:42 INFO Aborted multipart uploads count=0 kept=011452026/11/11 23:54:42 WARN Force mode enabled - objects will be deleted immediately without grace period11462026/11/11 23:54:42 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=011472026/11/11 23:54:42 INFO Vacuumed table table=pending_closures11482026/11/11 23:54:42 INFO Vacuumed table table=pending_objects11492026/11/11 23:54:42 INFO Vacuumed table table=multipart_uploads11502026/11/11 23:54:42 INFO Vacuumed table table=closures11512026/11/11 23:54:42 INFO Vacuumed table table=objects11522026/11/11 23:54:42 INFO Aborted multipart uploads count=0 kept=011532026/11/11 23:54:42 WARN Force mode enabled - objects will be deleted immediately without grace period11542026/11/11 23:54:42 INFO Received uploads request method=POST path=/api/pending_closures11552026/11/11 23:54:42 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=011562026/11/11 23:54:42 INFO Vacuumed table table=pending_closures11572026/11/11 23:54:42 INFO Vacuumed table table=pending_objects11582026/11/11 23:54:42 INFO Vacuumed table table=multipart_uploads11592026/11/11 23:54:42 INFO Vacuumed table table=closures11602026/11/11 23:54:42 INFO Vacuumed table table=objects1161--- PASS: TestSweepSkipsRowsLockedByPush (6.19s)1162=== CONT TestDeduplicatedObjectsRecordedAsPending11632026/11/11 23:54:42 INFO Received complete multipart upload request method=POST path=/api/multipart/complete11642026/11/11 23:54:42 WARN CompleteMultipartUpload errored but object exists; treating as success error="The specified key does not exist." object_key=nar/gggggggggggggggggggggggggggggg0300000000000000000000.nar.zst upload_id=MzIyODlmZWItZTZhMy00OWIwLTllNzMtNjI4NTlmMDg5YTgwLmE2M2M5N2RhLWNlODEtNGVmYi05NTlkLTQ4MjJlMTJiODIwMXgxNzk0NDQxMjgyMzY5MDI4MDAw11652026/11/11 23:54:42 INFO Aborted multipart uploads count=0 kept=011662026/11/11 23:54:42 INFO Completed multipart upload object_key=nar/gggggggggggggggggggggggggggggg0300000000000000000000.nar.zst upload_id=MzIyODlmZWItZTZhMy00OWIwLTllNzMtNjI4NTlmMDg5YTgwLmE2M2M5N2RhLWNlODEtNGVmYi05NTlkLTQ4MjJlMTJiODIwMXgxNzk0NDQxMjgyMzY5MDI4MDAw parts=11167--- PASS: TestCompleteMultipartUpload_ErrorButObjectExists (6.12s)1168=== CONT TestLeadUnannouncedStandbyYieldsToIncumbent11692026/11/11 23:54:42 WARN Force mode enabled - objects will be deleted immediately without grace period11702026/11/11 23:54:42 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=011712026/11/11 23:54:42 INFO Vacuumed table table=pending_closures11722026/11/11 23:54:42 INFO Vacuumed table table=pending_objects11732026/11/11 23:54:42 INFO Vacuumed table table=multipart_uploads11742026/11/11 23:54:42 INFO Vacuumed table table=closures11752026/11/11 23:54:42 INFO Vacuumed table table=objects1176--- PASS: TestSweepRechecksPendingAfterLocking (6.00s)1177=== CONT TestPushDedupSurvivesConcurrentGC11782026/11/11 23:54:43 INFO Received uploads request method=POST path=/api/pending_closures1179--- PASS: TestReadProxy404 (6.41s)1180=== CONT TestGCMetrics11812026/11/11 23:54:43 INFO Aborted multipart uploads count=0 kept=011822026/11/11 23:54:43 WARN Force mode enabled - objects will be deleted immediately without grace period11832026/11/11 23:54:43 ERROR failed to remove object object=nar/dddddddddddddddddddddddddddddddddddddddddddddddddddd.nar.zst error="Access Denied."11842026/11/11 23:54:43 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.narinfo error="Access Denied."1185--- PASS: TestFailedS3DeleteKeepsTombstone (6.21s)1186=== CONT TestGCBugBareHashReferences1187--- PASS: TestReadProxyContentNegotiation (6.04s)1188=== CONT TestGCAdvisoryLockBlocksConcurrentRun1189--- PASS: TestReadProxyNarStreaming (6.23s)1190=== CONT TestOrphanedObjectsGC1191--- PASS: TestReadProxyNarinfoAlreadyDecompressed (6.11s)1192=== CONT TestObjectStatsUpdatedOncePerCommit11932026/11/11 23:54:44 ERROR Failed to decode narinfo key=3hcdxyjf9yiq7qf3i4548drb6sjmwa1v.narinfo limit=16777216 error=<nil>1194--- PASS: TestReadProxyNarinfo (6.13s)1195=== CONT TestLeadElectsOneAndHandsOver1196--- PASS: TestReadProxyOutlastsServerWriteTimeout (10.54s)1197=== CONT TestConnectWaitsForAPeerMigration11982026/11/11 23:54:45 INFO Received uploads request method=POST path=/api/pending_closures11992026/11/11 23:54:45 WARN Rate limiter enabled after throttle name=s3-test rate=512002026/11/11 23:54:45 WARN S3 rate limit hit operation="complete multipart upload" error="Please reduce your request rate."1201=== NAME TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle1202 throttle_test.go:213: Proxy stats: total=13, throttled=10, completeMultipart=101203 throttle_test.go:215: Rate limiter: enabled=true, rate=5.001204--- PASS: TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle (10.94s)1205=== CONT TestResolveDBConnectionString1206=== RUN TestResolveDBConnectionString/flag_wins1207=== PAUSE TestResolveDBConnectionString/flag_wins1208=== RUN TestResolveDBConnectionString/file_when_flag_empty1209=== PAUSE TestResolveDBConnectionString/file_when_flag_empty1210=== RUN TestResolveDBConnectionString/missing_file_is_an_error1211=== PAUSE TestResolveDBConnectionString/missing_file_is_an_error1212=== RUN TestResolveDBConnectionString/PGHOST_allows_empty1213=== PAUSE TestResolveDBConnectionString/PGHOST_allows_empty1214=== RUN TestResolveDBConnectionString/nothing_configured1215=== PAUSE TestResolveDBConnectionString/nothing_configured1216=== CONT TestConcurrentCommitsSharingObjectsDoNotDeadlock1217--- PASS: TestCreatePendingClosureVerifyS3FailureReleasesConnection (5.97s)1218=== CONT TestService_readinessHandler1219--- PASS: TestPresentRefreshesOnlyStaleClosures (6.00s)1220=== CONT TestObjectStatsTrigger12212026/11/11 23:54:45 INFO Aborted multipart uploads count=0 kept=012222026/11/11 23:54:45 WARN Force mode enabled - objects will be deleted immediately without grace period1223--- PASS: TestPresentReportsOnlyClosureRoots (6.41s)1224=== CONT TestService_healthCheckHandler12252026/11/11 23:54:46 INFO Received create pin request method=POST path=/api/pins/worker-x86_64-linux12262026/11/11 23:54:46 WARN Refused reserved pin name=worker-x86_64-linux12272026/11/11 23:54:46 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=3 objects-deleted-after-grace-period=3 objects-failed-to-delete=012282026/11/11 23:54:46 INFO Received create pin request method=POST path=/api/pins/worker-x86_64-linux12292026/11/11 23:54:46 INFO Received create pin request method=POST path=/api/pins/my-app12302026/11/11 23:54:46 INFO Received create pin request method=POST path=/api/pins/worker-x86_64-linux1231--- PASS: TestCreatePin_ReservedPins (6.48s)1232=== CONT TestPendingCleanupUsesOneCutoff12332026/11/11 23:54:46 INFO Vacuumed table table=pending_closures12342026/11/11 23:54:46 INFO Vacuumed table table=pending_objects12352026/11/11 23:54:46 INFO Vacuumed table table=multipart_uploads12362026/11/11 23:54:46 INFO Vacuumed table table=closures12372026/11/11 23:54:46 INFO Vacuumed table table=objects1238--- PASS: TestGCSweepDeliversEachKeyOnce (6.99s)1239=== CONT TestMultipartUploadAbortedWhenCancelledBeforeRecorded12402026/11/11 23:54:46 INFO Received uploads request method=POST path=/api/pending_closures12412026/11/11 23:54:46 INFO Received uploads request method=POST path=/api/pending_closures12422026/11/11 23:54:46 INFO Received uploads request method=POST path=/api/pending_closures1243--- PASS: TestTombstonedObjectOfferedWithoutWaiting (6.73s)1244=== CONT TestService_AuthMiddleware_OIDC12452026/11/11 23:54:46 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:60494/oidc12462026/11/11 23:54:47 INFO lead: acquired remote=192.0.2.1:1234 generation=112472026/11/11 23:54:47 INFO lead: acquired remote=192.0.2.1:1234 generation=112482026/11/11 23:54:47 INFO Received uploads request method=POST path=/api/pending_closures12492026/11/11 23:54:47 INFO Aborted multipart uploads count=0 kept=012502026/11/11 23:54:47 WARN Force mode enabled - objects will be deleted immediately without grace period12512026/11/11 23:54:47 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=012522026/11/11 23:54:47 INFO Vacuumed table table=pending_closures12532026/11/11 23:54:47 INFO Vacuumed table table=pending_objects12542026/11/11 23:54:47 INFO Vacuumed table table=multipart_uploads12552026/11/11 23:54:47 INFO Vacuumed table table=closures12562026/11/11 23:54:47 INFO Vacuumed table table=objects1257--- PASS: TestGCSweepSkipsPendingObjects (6.35s)1258=== CONT TestMultipartCleanup12592026/11/11 23:54:48 INFO lead: acquired remote=192.0.2.1:1234 generation=112602026/11/11 23:54:48 INFO lead: released remote=192.0.2.1:1234 generation=11261--- PASS: TestLeadIncumbentAnnouncesAtOnce (6.24s)1262=== CONT TestServerTLSConfig1263=== RUN TestServerTLSConfig/no_client_CA1264=== PAUSE TestServerTLSConfig/no_client_CA1265=== RUN TestServerTLSConfig/missing_CA_file1266=== PAUSE TestServerTLSConfig/missing_CA_file1267=== RUN TestServerTLSConfig/not_a_PEM_file1268=== PAUSE TestServerTLSConfig/not_a_PEM_file1269=== CONT TestService_NativeMTLS12702026/11/11 23:54:48 INFO Received complete multipart upload request method=POST path=/api/multipart/complete12712026/11/11 23:54:48 INFO lead: released remote=192.0.2.1:1234 generation=11272--- PASS: TestLeadEndsOnShutdown (7.51s)1273=== CONT TestMetricsCommit12742026/11/11 23:54:48 INFO Completed multipart upload object_key=nar/gggggggggggggggggggggggggggggg0100000000000000000000.nar.zst upload_id=MzIyODlmZWItZTZhMy00OWIwLTllNzMtNjI4NTlmMDg5YTgwLjY4MzA0YzQ0LWI2MzctNDExOC1iYWEyLWQ5YTRjZDMzMDNjMHgxNzk0NDQxMjg2NjA1NTkzMDAw parts=1212752026/11/11 23:54:48 INFO Received uploads request method=POST path=/api/pending_closures1276--- PASS: TestDeduplicatedObjectsRecordedAsPending (5.90s)1277=== CONT TestCacheStatsHandler12782026/11/11 23:54:48 INFO lead: released remote=192.0.2.1:1234 generation=112792026/11/11 23:54:48 INFO lead: acquired remote=192.0.2.1:1234 generation=21280--- PASS: TestDeleteClosuresRacingPins (9.75s)1281=== CONT TestMetricsInventory12822026/11/11 23:54:48 INFO lead: acquired remote=192.0.2.1:1234 generation=112832026/11/11 23:54:49 INFO Received uploads request method=POST path=/api/pending_closures12842026/11/11 23:54:49 INFO Aborted multipart uploads count=0 kept=012852026/11/11 23:54:49 INFO Aborted multipart uploads count=0 kept=012862026/11/11 23:54:49 WARN Force mode enabled - objects will be deleted immediately without grace period12872026/11/11 23:54:49 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=012882026/11/11 23:54:49 INFO Vacuumed table table=pending_closures12892026/11/11 23:54:49 INFO Vacuumed table table=pending_objects12902026/11/11 23:54:49 INFO Vacuumed table table=multipart_uploads12912026/11/11 23:54:49 INFO Vacuumed table table=closures12922026/11/11 23:54:49 INFO Vacuumed table table=objects1293--- PASS: TestGCMetrics (5.79s)1294=== CONT TestClientPushesUseOnePush12952026/11/11 23:54:49 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=012962026/11/11 23:54:49 INFO Vacuumed table table=pending_closures12972026/11/11 23:54:49 INFO Vacuumed table table=pending_objects12982026/11/11 23:54:49 INFO Vacuumed table table=multipart_uploads12992026/11/11 23:54:49 INFO lead: released remote=192.0.2.1:1234 generation=213002026/11/11 23:54:49 INFO Vacuumed table table=closures13012026/11/11 23:54:49 INFO lead: acquired remote=192.0.2.1:1234 generation=313022026/11/11 23:54:49 INFO lead: released remote=192.0.2.1:1234 generation=31303--- PASS: TestLeadGenerationGrowsWithEveryGrant (8.47s)1304=== CONT TestGracefulShutdownDrainsInflight13052026/11/11 23:54:49 INFO Starting HTTP server address=127.0.0.1:6050513062026/11/11 23:54:49 INFO Shutdown signal received, draining in-flight requests timeout=10s13072026/11/11 23:54:49 INFO Vacuumed table table=objects13082026/11/11 23:54:49 INFO Aborted multipart uploads count=0 kept=013092026/11/11 23:54:49 WARN Force mode enabled - objects will be deleted immediately without grace period13102026/11/11 23:54:49 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=013112026/11/11 23:54:49 INFO Vacuumed table table=pending_closures13122026/11/11 23:54:49 INFO Vacuumed table table=pending_objects13132026/11/11 23:54:49 INFO Vacuumed table table=multipart_uploads13142026/11/11 23:54:49 INFO Vacuumed table table=closures13152026/11/11 23:54:49 INFO Vacuumed table table=objects1316--- PASS: TestGracefulShutdownDrainsInflight (0.08s)1317=== CONT TestPinProtectsFromGC1318--- PASS: TestPushDedupSurvivesConcurrentGC (6.71s)1319=== CONT TestGCTaskStore_Fail1320--- PASS: TestGCTaskStore_Fail (0.00s)1321=== CONT TestClientSharedPathCommittedMidPush13222026/11/11 23:54:49 INFO lead: released remote=192.0.2.1:1234 generation=113232026/11/11 23:54:49 INFO lead: acquired remote=192.0.2.1:1234 generation=213242026/11/11 23:54:49 INFO lead: given back to the incumbent remote=192.0.2.1:1234 generation=213252026/11/11 23:54:49 INFO lead: acquired remote=192.0.2.1:1234 generation=313262026/11/11 23:54:49 INFO Received complete multipart upload request method=POST path=/api/multipart/complete1327--- PASS: TestGCBugBareHashReferences (6.24s)1328=== CONT TestCacheConfigHandler1329=== RUN TestCacheConfigHandler/full_config,_no_issuer1330=== PAUSE TestCacheConfigHandler/full_config,_no_issuer1331=== RUN TestCacheConfigHandler/no_cache_url_configured1332=== PAUSE TestCacheConfigHandler/no_cache_url_configured1333=== RUN TestCacheConfigHandler/no_signing_keys1334=== PAUSE TestCacheConfigHandler/no_signing_keys1335=== RUN TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator1336=== PAUSE TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator1337=== CONT TestGCTaskStore_PhaseUpdates1338--- PASS: TestGCTaskStore_PhaseUpdates (0.00s)1339=== CONT TestClientWithDependencies13402026/11/11 23:54:49 ERROR failed to check GC advisory lock error="query pg_locks: failed to connect to `user=_tribuchetbld5 database=niks3`: /nonexistent/.s.PGSQL.5432 (/nonexistent): dial error: dial unix /nonexistent/.s.PGSQL.5432: connect: no such file or directory"1341--- PASS: TestGCAdvisoryLockBlocksConcurrentRun (6.14s)1342=== CONT TestService_ReadScope_PublicByDefault13432026/11/11 23:54:49 INFO Completed multipart upload object_key=nar/gggggggggggggggggggggggggggggg0100000000000000000000.nar.zst upload_id=MzIyODlmZWItZTZhMy00OWIwLTllNzMtNjI4NTlmMDg5YTgwLmJiMWFlMDNhLTFmMTMtNDA5YS1iODliLTFmYmE1MTRkN2M0NngxNzk0NDQxMjg2NjUwODIxMDAw parts=121344--- PASS: TestSharedNarBothUploadsComplete (9.97s)1345=== CONT TestGCTaskStore_CompletedAllowsNewTask1346--- PASS: TestGCTaskStore_CompletedAllowsNewTask (0.00s)1347=== CONT TestClientMultipleUploads1348--- PASS: TestObjectStatsUpdatedOncePerCommit (6.82s)1349=== CONT TestService_RequireScope_OIDC13502026/11/11 23:54:51 INFO lead: acquired remote=192.0.2.1:1234 generation=113512026/11/11 23:54:51 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:60512/oidc13522026/11/11 23:54:51 INFO lead: released remote=192.0.2.1:1234 generation=31353--- PASS: TestLeadUnannouncedStandbyYieldsToIncumbent (8.99s)1354=== CONT TestClientIntegration13552026/11/11 23:54:51 WARN readiness check failed error="closed pool"1356--- PASS: TestService_readinessHandler (6.58s)1357=== CONT TestGCTaskStore_GetReturnsLatest1358--- PASS: TestGCTaskStore_GetReturnsLatest (0.00s)1359=== CONT TestNARDeduplicationMetadataUploadBug13602026/11/11 23:54:52 INFO lead: released remote=192.0.2.1:1234 generation=113612026/11/11 23:54:52 INFO lead: acquired remote=192.0.2.1:1234 generation=21362--- PASS: TestConnectWaitsForAPeerMigration (7.68s)1363=== CONT TestClientErrorHandling1364=== RUN TestClientErrorHandling/InvalidStorePath1365=== PAUSE TestClientErrorHandling/InvalidStorePath1366=== RUN TestClientErrorHandling/InvalidAuthToken1367=== PAUSE TestClientErrorHandling/InvalidAuthToken1368=== RUN TestClientErrorHandling/ServerNotAvailable1369=== PAUSE TestClientErrorHandling/ServerNotAvailable1370=== CONT TestClientCADerivations1371--- PASS: TestObjectStatsTrigger (7.17s)1372=== CONT TestCreatePendingClosureRejectsOversizedNAR13732026/11/11 23:54:52 INFO Received uploads request method=POST path=/api/pending_closures1374--- PASS: TestCreatePendingClosureRejectsOversizedNAR (0.01s)1375=== CONT TestGCTaskStore_GetEmpty1376--- PASS: TestGCTaskStore_GetEmpty (0.00s)1377=== CONT TestEnsureAbortUploadsRule1378=== NAME TestOrphanedObjectsGC1379 orphaned_objects_gc_test.go:287: GC Test Summary:1380 orphaned_objects_gc_test.go:288: - Kept: 2 objects from closure A1381 orphaned_objects_gc_test.go:289: - Deleted: 2 objects from closure B1382 orphaned_objects_gc_test.go:290: - Deleted: 6 orphaned chain objects (X1->X2->X3)1383 orphaned_objects_gc_test.go:291: - Deleted: 2 orphaned single objects (Y)1384 orphaned_objects_gc_test.go:292: - Total deleted: 10 objects1385--- PASS: TestOrphanedObjectsGC (8.74s)1386=== CONT TestGenerateLandingPage1387--- PASS: TestGenerateLandingPage (0.00s)1388=== CONT TestCacheConfigHandlerMaxNarSize1389--- PASS: TestCacheConfigHandlerMaxNarSize (0.00s)1390=== CONT TestGCTaskStore_ConflictDifferentParams1391--- PASS: TestGCTaskStore_ConflictDifferentParams (0.00s)1392=== CONT TestCommitRacingPendingCleanupKeepsObjects1393--- PASS: TestService_healthCheckHandler (6.84s)1394=== CONT TestGCTaskStore_StartNew1395--- PASS: TestGCTaskStore_StartNew (0.00s)1396=== CONT TestPushWaitsForSweepHoldingRow1397--- PASS: TestConcurrentCommitsSharingObjectsDoNotDeadlock (8.10s)1398=== CONT TestService_AuthMiddleware_MTLSBoundSubjects13992026/11/11 23:54:53 INFO Received uploads request method=POST path=/api/pending_closures14002026/11/11 23:54:53 INFO Received uploads request method=POST path=/api/pending_closures14012026/11/11 23:54:53 INFO Received cleanup request method=DELETE path=/api/pending_closures14022026/11/11 23:54:53 INFO lead: released remote=192.0.2.1:1234 generation=21403--- PASS: TestLeadElectsOneAndHandsOver (8.87s)1404=== CONT TestGCTaskStore_DeduplicateSameParams1405--- PASS: TestGCTaskStore_DeduplicateSameParams (0.00s)1406=== CONT TestService_AuthMiddleware_MTLSProxyHeader14072026/11/11 23:54:53 INFO Received uploads request method=POST path=/api/pending_closures1408--- PASS: TestMultipartUploadAbortedWhenCancelledBeforeRecorded (7.18s)1409=== CONT TestService_ReadAuthMiddleware1410=== RUN TestService_AuthMiddleware_OIDC/valid_OIDC_token1411=== PAUSE TestService_AuthMiddleware_OIDC/valid_OIDC_token1412=== RUN TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected1413=== PAUSE TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected1414=== RUN TestService_AuthMiddleware_OIDC/malformed_token_rejected1415=== PAUSE TestService_AuthMiddleware_OIDC/malformed_token_rejected1416=== RUN TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured1417=== PAUSE TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured1418=== CONT TestGCEndsOnShutdown1419=== RUN TestGCEndsOnShutdown/before_the_run1420=== PAUSE TestGCEndsOnShutdown/before_the_run1421=== RUN TestGCEndsOnShutdown/blocked_in_the_sweep's_S3_delete1422=== PAUSE TestGCEndsOnShutdown/blocked_in_the_sweep's_S3_delete1423=== RUN TestGCEndsOnShutdown/blocked_on_a_row_lock_in_the_mark1424=== PAUSE TestGCEndsOnShutdown/blocked_on_a_row_lock_in_the_mark1425=== CONT TestService_AuthMiddleware14262026/11/11 23:54:54 INFO Received uploads request method=POST path=/api/pending_closures14272026/11/11 23:54:54 INFO Received cleanup request method=DELETE path=/api/pending_closures14282026/11/11 23:54:54 WARN Failed to abort upload, keeping its closure key=nar/dadb44fdadb44fdadb44fdadb44f000000000000000000000000.nar.zst error="Get \"http://127.0.0.1:1/bucket71/?location=\": dial tcp 127.0.0.1:1: connect: connection refused" code=""14292026/11/11 23:54:54 INFO Aborted multipart uploads count=0 kept=114302026/11/11 23:54:54 INFO Received cleanup request method=DELETE path=/api/pending_closures14312026/11/11 23:54:54 INFO Aborted multipart uploads count=1 kept=014322026/11/11 23:54:54 WARN mTLS auth: subject not in bound subjects subject="CN=reader"14332026/11/11 23:54:54 WARN mTLS auth: subject not in bound subjects subject="CN=reader"1434--- PASS: TestService_NativeMTLS (6.36s)1435=== CONT TestClientFallsBackToClosures1436--- PASS: TestMultipartCleanup (6.69s)1437=== CONT TestService_verifyS3ReuploadsStaleNarinfo/lost,_other_NAR_pushed14382026/11/11 23:54:54 INFO Received push request method=POST path=/api/pushes14392026/11/11 23:54:54 INFO Received complete push request method=POST path=/api/pushes/1/complete14402026/11/11 23:54:54 INFO Completed push id=1 objects=4 duration=52.20375ms14412026/11/11 23:54:54 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete14422026/11/11 23:54:54 INFO Completed upload id=2 objects=2 duration=1.131541ms1443--- PASS: TestMetricsCommit (6.84s)1444=== CONT TestService_verifyS3ReuploadsStaleNarinfo/lost,_same_NAR_pushed1445--- PASS: TestCacheStatsHandler (6.72s)1446=== CONT TestService_verifyS3ReuploadsStaleNarinfo/first_of_two_lost,_second_pushed1447--- PASS: TestMetricsInventory (7.00s)1448=== CONT TestService_verifyS3ReuploadsStaleNarinfo/first_of_two_lost14492026/11/11 23:54:56 INFO Received push request method=POST path=/api/pushes14502026/11/11 23:54:56 INFO Uploading 2 paths to 127.0.0.1 (1 already cached)14512026/11/11 23:54:56 INFO Uploading id8cy6rqw5838zjlyqz5xhym16ka5c8m-shared-dep (136B)14522026/11/11 23:54:56 INFO Uploading g8nhv8vrkcwbsh8bfkdc1krs2lcabksa-b (256B)14532026/11/11 23:54:56 WARN Failed to register uploaded object key=id8cy6rqw5838zjlyqz5xhym16ka5c8m.ls error="server returned 404: 404 page not found\n"14542026/11/11 23:54:56 WARN Failed to register uploaded object key=jj7idcv9hfk3ivm04yf1w9bl8cc8vyw7.ls error="server returned 404: 404 page not found\n"14552026/11/11 23:54:56 WARN Failed to register uploaded object key=nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst error="server returned 404: 404 page not found\n"14562026/11/11 23:54:56 WARN Failed to register uploaded object key=nar/1qabmd0sk7s540g4qr3ryjm6dq0p1fgy4g7n049mlzpa8viwhx40.nar.zst error="server returned 404: 404 page not found\n"14572026/11/11 23:54:56 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign14582026/11/11 23:54:56 WARN Failed to register uploaded object key=g8nhv8vrkcwbsh8bfkdc1krs2lcabksa.ls error="server returned 404: 404 page not found\n"14592026/11/11 23:54:56 INFO Signed narinfos id=1 count=314602026/11/11 23:54:56 INFO Uploading 3 narinfos14612026/11/11 23:54:56 WARN Failed to register uploaded object key=jj7idcv9hfk3ivm04yf1w9bl8cc8vyw7.narinfo error="server returned 404: 404 page not found\n"14622026/11/11 23:54:56 WARN Failed to register uploaded object key=id8cy6rqw5838zjlyqz5xhym16ka5c8m.narinfo error="server returned 404: 404 page not found\n"14632026/11/11 23:54:56 INFO Received complete push request method=POST path=/api/pushes/1/complete14642026/11/11 23:54:56 WARN Failed to register uploaded object key=g8nhv8vrkcwbsh8bfkdc1krs2lcabksa.narinfo error="server returned 404: 404 page not found\n"14652026/11/11 23:54:56 INFO Completed push id=1 objects=8 duration=43.745666ms14662026/11/11 23:54:56 INFO Upload complete. (342ms)1467=== NAME TestClientPushesUseOnePush1468 client_pushes_test.go:97: Retrieved narinfo from S3:1469 StorePath: /private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestClientPushesUseOnePush1761971058/001/store/id8cy6rqw5838zjlyqz5xhym16ka5c8m-shared-dep1470 URL: nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst1471 Compression: zstd1472 NarHash: sha256:1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y821473 NarSize: 1361474 References: 1475 CA: text:sha256:08nxw05k7b0pzzy0f3swvnw4ldxdbclkdnklpidwmrxdhvfrmv7n1476 client_pushes_test.go:97: Retrieved narinfo from S3:1477 StorePath: /private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestClientPushesUseOnePush1761971058/001/store/jj7idcv9hfk3ivm04yf1w9bl8cc8vyw7-a1478 URL: nar/1qabmd0sk7s540g4qr3ryjm6dq0p1fgy4g7n049mlzpa8viwhx40.nar.zst1479 Compression: zstd1480 NarHash: sha256:1qabmd0sk7s540g4qr3ryjm6dq0p1fgy4g7n049mlzpa8viwhx401481 NarSize: 2561482 References: /private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestClientPushesUseOnePush1761971058/001/store/id8cy6rqw5838zjlyqz5xhym16ka5c8m-shared-dep1483 CA: text:sha256:192wbwjadyl38jgc7b6l5zfwy15pnj8s8pzxyd0ksfh6sg65zna21484 client_pushes_test.go:97: Retrieved narinfo from S3:1485 StorePath: /private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestClientPushesUseOnePush1761971058/001/store/g8nhv8vrkcwbsh8bfkdc1krs2lcabksa-b1486 URL: nar/1qabmd0sk7s540g4qr3ryjm6dq0p1fgy4g7n049mlzpa8viwhx40.nar.zst1487 Compression: zstd1488 NarHash: sha256:1qabmd0sk7s540g4qr3ryjm6dq0p1fgy4g7n049mlzpa8viwhx401489 NarSize: 2561490 References: /private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestClientPushesUseOnePush1761971058/001/store/id8cy6rqw5838zjlyqz5xhym16ka5c8m-shared-dep1491 CA: text:sha256:192wbwjadyl38jgc7b6l5zfwy15pnj8s8pzxyd0ksfh6sg65zna214922026/11/11 23:54:56 INFO Received push request method=POST path=/api/pushes1493--- PASS: TestClientPushesUseOnePush (7.59s)14942026/11/11 23:54:56 INFO Uploading 2 paths to 127.0.0.1 (0 already cached)1495=== CONT TestService_verifyS3ReuploadsStaleNarinfo/intact,_other_NAR_pushed14962026/11/11 23:54:56 INFO Uploading zi1pyfxaaigld1gv8lb8a8qqypdh8gsf-shared-dep (136B)14972026/11/11 23:54:56 INFO Uploading 985mi4qi84l9b09116qhjki7mi5xlx7v-top (264B)14982026/11/11 23:54:57 WARN Failed to register uploaded object key=zi1pyfxaaigld1gv8lb8a8qqypdh8gsf.ls error="server returned 404: 404 page not found\n"14992026/11/11 23:54:57 WARN Failed to register uploaded object key=985mi4qi84l9b09116qhjki7mi5xlx7v.ls error="server returned 404: 404 page not found\n"15002026/11/11 23:54:57 WARN Failed to register uploaded object key=nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst error="server returned 404: 404 page not found\n"15012026/11/11 23:54:57 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign15022026/11/11 23:54:57 WARN Failed to register uploaded object key=nar/0zp6fm663v9pb3g2afj3cncj5gf8wkrzpj32vzxvyvprkp206bkm.nar.zst error="server returned 404: 404 page not found\n"15032026/11/11 23:54:57 INFO Signed narinfos id=1 count=215042026/11/11 23:54:57 INFO Uploading 2 narinfos1505=== NAME TestPinProtectsFromGC1506 client_integration_test.go:779: Pinned store path: /private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestPinProtectsFromGC325070215/001/store/g9x1rn3llzgfrh0736jw411rxkwqb8zg-pinned-file.txt1507 client_integration_test.go:780: Unpinned store path: /private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestPinProtectsFromGC325070215/001/store/shav4yx91hx2587viqc4ynxisf881ah8-unpinned-file.txt15082026/11/11 23:54:57 WARN Failed to register uploaded object key=zi1pyfxaaigld1gv8lb8a8qqypdh8gsf.narinfo error="server returned 404: 404 page not found\n"15092026/11/11 23:54:57 INFO Received complete push request method=POST path=/api/pushes/1/complete15102026/11/11 23:54:57 WARN Failed to register uploaded object key=985mi4qi84l9b09116qhjki7mi5xlx7v.narinfo error="server returned 404: 404 page not found\n"15112026/11/11 23:54:57 INFO Completed push id=1 objects=6 duration=36.237958ms15122026/11/11 23:54:57 INFO Upload complete. (353ms)1513=== NAME TestClientSharedPathCommittedMidPush1514 client_integration_test.go:728: Retrieved narinfo from S3:1515 StorePath: /private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestClientSharedPathCommittedMidPush1416742097/001/store/zi1pyfxaaigld1gv8lb8a8qqypdh8gsf-shared-dep1516 URL: nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst1517 Compression: zstd1518 NarHash: sha256:1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y821519 NarSize: 1361520 References: 1521 CA: text:sha256:08nxw05k7b0pzzy0f3swvnw4ldxdbclkdnklpidwmrxdhvfrmv7n1522 client_integration_test.go:728: Retrieved narinfo from S3:1523 StorePath: /private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestClientSharedPathCommittedMidPush1416742097/001/store/985mi4qi84l9b09116qhjki7mi5xlx7v-top1524 URL: nar/0zp6fm663v9pb3g2afj3cncj5gf8wkrzpj32vzxvyvprkp206bkm.nar.zst1525 Compression: zstd1526 NarHash: sha256:0zp6fm663v9pb3g2afj3cncj5gf8wkrzpj32vzxvyvprkp206bkm1527 NarSize: 2641528 References: /private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestClientSharedPathCommittedMidPush1416742097/001/store/zi1pyfxaaigld1gv8lb8a8qqypdh8gsf-shared-dep1529 CA: text:sha256:1104j3n5p4631888pm1qmj9gx9wcbzg3k3kizjr1mk6inh5s15jg15302026/11/11 23:54:57 INFO Received push request method=POST path=/api/pushes15312026/11/11 23:54:57 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)15322026/11/11 23:54:57 INFO Uploading g9x1rn3llzgfrh0736jw411rxkwqb8zg-pinned-file.txt (128B)15332026/11/11 23:54:57 WARN Failed to register uploaded object key=g9x1rn3llzgfrh0736jw411rxkwqb8zg.ls error="server returned 404: 404 page not found\n"1534--- PASS: TestClientSharedPathCommittedMidPush (7.74s)1535=== CONT TestProxyWriteTimeout/narinfo15362026/11/11 23:54:57 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign15372026/11/11 23:54:57 WARN Failed to register uploaded object key=nar/0qmhsg42pqsz7x6hh02j8gznnac3yi3qpjhrqbwvz88i194jbb5s.nar.zst error="server returned 404: 404 page not found\n"15382026/11/11 23:54:57 INFO Signed narinfos id=1 count=11539=== CONT TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info15402026/11/11 23:54:57 INFO Received uploads request method=POST path=/15412026/11/11 23:54:57 INFO Uploading 1 narinfos1542=== CONT TestPendingClosureWriteTimeout/empty1543=== CONT TestPendingClosureWriteTimeout/handler_extends_the_server's_deadline1544--- PASS: TestService_ReadScope_PublicByDefault (7.41s)1545=== CONT TestPendingClosureWriteTimeout/670k_objects1546=== CONT TestPendingClosureWriteTimeout/400_objects1547=== CONT TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key15482026/11/11 23:54:57 INFO Received request for more parts method=POST path=/1549=== CONT TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key15502026/11/11 23:54:57 INFO Received complete multipart upload request method=POST path=/1551=== CONT TestProxyWriteTimeout/10_GiB_nar1552=== CONT TestProxyWriteTimeout/unknown_size1553=== CONT TestProxyWriteTimeout/1_GiB_nar1554--- PASS: TestProxyWriteTimeout (0.04s)1555 --- PASS: TestProxyWriteTimeout/narinfo (0.00s)1556 --- PASS: TestProxyWriteTimeout/10_GiB_nar (0.00s)1557 --- PASS: TestProxyWriteTimeout/unknown_size (0.00s)1558 --- PASS: TestProxyWriteTimeout/1_GiB_nar (0.00s)1559=== CONT TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal15602026/11/11 23:54:57 INFO Received uploads request method=POST path=/1561--- PASS: TestUploadHandlersRejectInvalidKeys (0.04s)1562 --- PASS: TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info (0.01s)1563 --- PASS: TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key (0.00s)1564 --- PASS: TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key (0.00s)1565 --- PASS: TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal (0.00s)1566=== CONT TestIsValidUploadKey/narinfo1567=== CONT TestIsValidUploadKey/realisation_plus_in_output1568=== CONT TestIsValidUploadKey/unknown_type1569=== CONT TestIsValidUploadKey/empty_key1570=== CONT TestIsValidUploadKey/absolute1571=== CONT TestIsValidUploadKey/traversal_nar1572=== CONT TestIsValidUploadKey/traversal1573=== CONT TestIsValidUploadKey/listing_key,_narinfo_type1574=== CONT TestIsValidUploadKey/nar_key,_narinfo_type1575=== CONT TestIsValidUploadKey/narinfo_key,_nar_type1576=== CONT TestIsValidUploadKey/index.html1577=== CONT TestIsValidUploadKey/nix-cache-info1578=== CONT TestIsValidUploadKey/build_log_home-manager_file1579=== CONT TestIsValidUploadKey/realisation1580=== CONT TestIsValidUploadKey/build_log_equals1581=== CONT TestIsValidUploadKey/build_log_question_mark1582=== CONT TestIsValidUploadKey/build_log_plus_in_name1583=== CONT TestIsValidUploadKey/nar_plain1584=== CONT TestIsValidUploadKey/build_log1585=== CONT TestIsValidUploadKey/listing1586=== CONT TestIsValidUploadKey/nar_xz1587=== CONT TestIsValidUploadKey/nar_zst1588--- PASS: TestIsValidUploadKey (0.00s)1589 --- PASS: TestIsValidUploadKey/narinfo (0.00s)1590 --- PASS: TestIsValidUploadKey/realisation_plus_in_output (0.00s)1591 --- PASS: TestIsValidUploadKey/unknown_type (0.00s)1592 --- PASS: TestIsValidUploadKey/empty_key (0.00s)1593 --- PASS: TestIsValidUploadKey/absolute (0.00s)1594 --- PASS: TestIsValidUploadKey/traversal_nar (0.00s)1595 --- PASS: TestIsValidUploadKey/traversal (0.00s)1596 --- PASS: TestIsValidUploadKey/listing_key,_narinfo_type (0.00s)1597 --- PASS: TestIsValidUploadKey/nar_key,_narinfo_type (0.00s)1598 --- PASS: TestIsValidUploadKey/narinfo_key,_nar_type (0.00s)1599 --- PASS: TestIsValidUploadKey/index.html (0.00s)1600 --- PASS: TestIsValidUploadKey/nix-cache-info (0.00s)1601 --- PASS: TestIsValidUploadKey/build_log_home-manager_file (0.00s)1602 --- PASS: TestIsValidUploadKey/realisation (0.00s)1603 --- PASS: TestIsValidUploadKey/build_log_equals (0.00s)1604 --- PASS: TestIsValidUploadKey/build_log_question_mark (0.00s)1605 --- PASS: TestIsValidUploadKey/build_log_plus_in_name (0.00s)1606 --- PASS: TestIsValidUploadKey/nar_plain (0.00s)1607 --- PASS: TestIsValidUploadKey/build_log (0.00s)1608 --- PASS: TestIsValidUploadKey/listing (0.00s)1609 --- PASS: TestIsValidUploadKey/nar_xz (0.00s)1610 --- PASS: TestIsValidUploadKey/nar_zst (0.00s)1611=== CONT TestUploadHandlersRejectOversizedBody/request_more_parts16122026/11/11 23:54:57 INFO Received request for more parts method=POST path=/1613=== CONT TestUploadHandlersRejectOversizedBody/complete_multipart16142026/11/11 23:54:57 INFO Received complete multipart upload request method=POST path=/1615=== CONT TestUploadHandlersRejectOversizedBody/create_pending_closure16162026/11/11 23:54:57 INFO Received complete push request method=POST path=/api/pushes/1/complete16172026/11/11 23:54:57 WARN Failed to register uploaded object key=g9x1rn3llzgfrh0736jw411rxkwqb8zg.narinfo error="server returned 404: 404 page not found\n"16182026/11/11 23:54:57 INFO Received uploads request method=POST path=/16192026/11/11 23:54:57 INFO Completed push id=1 objects=3 duration=27.490958ms16202026/11/11 23:54:57 INFO Upload complete. (286ms)16212026/11/11 23:54:57 INFO Received push request method=POST path=/api/pushes16222026/11/11 23:54:57 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)16232026/11/11 23:54:57 INFO Uploading shav4yx91hx2587viqc4ynxisf881ah8-unpinned-file.txt (128B)16242026/11/11 23:54:57 WARN Failed to register uploaded object key=shav4yx91hx2587viqc4ynxisf881ah8.ls error="server returned 404: 404 page not found\n"16252026/11/11 23:54:57 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign16262026/11/11 23:54:57 WARN Failed to register uploaded object key=nar/0gh0wdnr6gmk4r5sfzzh12isnl14rgmkrwy1ws41hpsrlndclg5h.nar.zst error="server returned 404: 404 page not found\n"16272026/11/11 23:54:57 INFO Signed narinfos id=2 count=116282026/11/11 23:54:57 INFO Uploading 1 narinfos1629=== NAME TestClientWithDependencies1630 client_integration_test.go:661: Built derivation: /private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestClientWithDependencies22730890/001/store/z479yjr65ch13iwbs7vdazjfl6i7a52v-test-script16312026/11/11 23:54:57 INFO Received complete push request method=POST path=/api/pushes/2/complete16322026/11/11 23:54:57 WARN Failed to register uploaded object key=shav4yx91hx2587viqc4ynxisf881ah8.narinfo error="server returned 404: 404 page not found\n"16332026/11/11 23:54:57 INFO Completed push id=2 objects=3 duration=672.792µs16342026/11/11 23:54:57 INFO Upload complete. (177ms)1635 client_integration_test.go:663: Found 1 dependencies (including self)16362026/11/11 23:54:57 INFO Starting cleanup of old closures method=DELETE path=/api/closures16372026/11/11 23:54:57 INFO Garbage collection started1638--- PASS: TestUploadHandlersRejectOversizedBody (0.07s)1639 --- PASS: TestUploadHandlersRejectOversizedBody/request_more_parts (0.02s)1640 --- PASS: TestUploadHandlersRejectOversizedBody/complete_multipart (0.02s)1641 --- PASS: TestUploadHandlersRejectOversizedBody/create_pending_closure (0.30s)1642=== CONT TestPush_RejectsBadRequests/root_not_in_objects16432026/11/11 23:54:57 INFO Received push request method=POST path=/api/pushes1644=== CONT TestPush_RejectsBadRequests/no_objects16452026/11/11 23:54:57 INFO Received push request method=POST path=/api/pushes1646=== CONT TestPush_RejectsBadRequests/bad_root16472026/11/11 23:54:57 INFO Received push request method=POST path=/api/pushes1648=== CONT TestPush_RejectsBadRequests/no_roots16492026/11/11 23:54:57 INFO Aborted multipart uploads count=0 kept=016502026/11/11 23:54:57 INFO Received push request method=POST path=/api/pushes1651--- PASS: TestPush_RejectsBadRequests (3.04s)1652 --- PASS: TestPush_RejectsBadRequests/root_not_in_objects (0.02s)1653 --- PASS: TestPush_RejectsBadRequests/no_objects (0.01s)1654 --- PASS: TestPush_RejectsBadRequests/bad_root (0.00s)1655 --- PASS: TestPush_RejectsBadRequests/no_roots (0.00s)1656=== CONT TestIsValidCachePath/narinfo1657=== CONT TestIsValidCachePath/random_path16582026/11/11 23:54:57 WARN Force mode enabled - objects will be deleted immediately without grace period1659=== CONT TestIsValidCachePath/invalid_char_u1660=== CONT TestIsValidCachePath/invalid_char_e1661=== CONT TestIsValidCachePath/traversal_in_middle1662=== CONT TestIsValidCachePath/traversal_parent1663=== CONT TestIsValidCachePath/index.html1664=== CONT TestIsValidCachePath/nix-cache-info1665=== CONT TestIsValidCachePath/realisation1666=== CONT TestIsValidCachePath/log1667=== CONT TestIsValidCachePath/ls1668=== CONT TestIsValidCachePath/nar_uncompressed1669=== CONT TestIsValidCachePath/nar_bz21670=== CONT TestIsValidCachePath/nar_xz1671=== CONT TestIsValidCachePath/empty1672=== CONT TestIsValidCachePath/nar_zst1673=== CONT TestIsValidCachePath/wrong_extension1674=== CONT TestIsValidCachePath/short_hash1675=== CONT TestIsValidCachePath/narinfo_all_nix_base32_chars1676=== CONT TestIsValidCachePath/leading_slash1677--- PASS: TestIsValidCachePath (0.01s)1678 --- PASS: TestIsValidCachePath/narinfo (0.00s)1679 --- PASS: TestIsValidCachePath/random_path (0.00s)1680 --- PASS: TestIsValidCachePath/invalid_char_u (0.00s)1681 --- PASS: TestIsValidCachePath/invalid_char_e (0.00s)1682 --- PASS: TestIsValidCachePath/traversal_in_middle (0.00s)1683 --- PASS: TestIsValidCachePath/traversal_parent (0.00s)1684 --- PASS: TestIsValidCachePath/index.html (0.00s)1685 --- PASS: TestIsValidCachePath/nix-cache-info (0.00s)1686 --- PASS: TestIsValidCachePath/realisation (0.00s)1687 --- PASS: TestIsValidCachePath/log (0.00s)1688 --- PASS: TestIsValidCachePath/ls (0.00s)1689 --- PASS: TestIsValidCachePath/nar_uncompressed (0.00s)1690 --- PASS: TestIsValidCachePath/nar_bz2 (0.00s)1691 --- PASS: TestIsValidCachePath/nar_xz (0.00s)1692 --- PASS: TestIsValidCachePath/empty (0.00s)1693 --- PASS: TestIsValidCachePath/nar_zst (0.00s)1694 --- PASS: TestIsValidCachePath/wrong_extension (0.00s)1695 --- PASS: TestIsValidCachePath/short_hash (0.00s)1696 --- PASS: TestIsValidCachePath/narinfo_all_nix_base32_chars (0.00s)1697 --- PASS: TestIsValidCachePath/leading_slash (0.00s)1698=== CONT TestParseSingleRange/end_clamped_to_size1699=== CONT TestForceGCDuringPushOffersSweptObject/before_pending_rows17002026/11/11 23:54:57 INFO Received push request method=POST path=/api/pushes17012026/11/11 23:54:57 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)17022026/11/11 23:54:57 INFO Uploading z479yjr65ch13iwbs7vdazjfl6i7a52v-test-script (136B)17032026/11/11 23:54:57 WARN Failed to register uploaded object key=nar/1s7yghixzpinyqm7g59kyn3sav81pmnsdi5v63m6x4r2vacy907j.nar.zst error="server returned 404: 404 page not found\n"17042026/11/11 23:54:57 WARN Failed to register uploaded object key=z479yjr65ch13iwbs7vdazjfl6i7a52v.ls error="server returned 404: 404 page not found\n"17052026/11/11 23:54:57 WARN Failed to register uploaded object key=log/pwyyxqpcykgb1mfsbwkk12bkyyj9nm3v-test-script.drv error="server returned 404: 404 page not found\n"17062026/11/11 23:54:57 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign17072026/11/11 23:54:58 INFO Signed narinfos id=1 count=117082026/11/11 23:54:58 INFO Uploading 1 narinfos17092026/11/11 23:54:58 INFO Received complete push request method=POST path=/api/pushes/1/complete17102026/11/11 23:54:58 WARN Failed to register uploaded object key=z479yjr65ch13iwbs7vdazjfl6i7a52v.narinfo error="server returned 404: 404 page not found\n"17112026/11/11 23:54:58 INFO Completed push id=1 objects=4 duration=88.633458ms1712=== RUN TestService_RequireScope_OIDC/builder_may_write1713=== PAUSE TestService_RequireScope_OIDC/builder_may_write17142026/11/11 23:54:58 INFO Upload complete. (460ms)1715=== RUN TestService_RequireScope_OIDC/builder_may_not_admin1716=== PAUSE TestService_RequireScope_OIDC/builder_may_not_admin1717=== NAME TestClientWithDependencies1718 client_integration_test.go:665: Skipping nix copy test - isolated store (/private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestClientWithDependencies22730890/001/store) requires matching store prefix1719=== RUN TestService_RequireScope_OIDC/ops_may_admin1720=== PAUSE TestService_RequireScope_OIDC/ops_may_admin1721=== RUN TestService_RequireScope_OIDC/ops_may_not_write1722=== PAUSE TestService_RequireScope_OIDC/ops_may_not_write1723=== RUN TestService_RequireScope_OIDC/reader_may_not_write1724=== PAUSE TestService_RequireScope_OIDC/reader_may_not_write1725=== RUN TestService_RequireScope_OIDC/static_token_may_admin1726=== PAUSE TestService_RequireScope_OIDC/static_token_may_admin1727=== RUN TestService_RequireScope_OIDC/static_token_may_write1728=== PAUSE TestService_RequireScope_OIDC/static_token_may_write1729=== RUN TestService_RequireScope_OIDC/reader_may_read1730=== PAUSE TestService_RequireScope_OIDC/reader_may_read1731=== RUN TestService_RequireScope_OIDC/writer_implies_read1732=== PAUSE TestService_RequireScope_OIDC/writer_implies_read1733=== RUN TestService_RequireScope_OIDC/anonymous_may_not_read1734=== PAUSE TestService_RequireScope_OIDC/anonymous_may_not_read1735=== RUN TestService_RequireScope_OIDC/reader_may_read_with_netrc1736=== PAUSE TestService_RequireScope_OIDC/reader_may_read_with_netrc1737=== RUN TestService_RequireScope_OIDC/static_token_may_admin_with_netrc1738=== PAUSE TestService_RequireScope_OIDC/static_token_may_admin_with_netrc1739=== RUN TestService_RequireScope_OIDC/wrong_netrc_password_may_not_read1740=== PAUSE TestService_RequireScope_OIDC/wrong_netrc_password_may_not_read1741=== RUN TestService_RequireScope_OIDC/empty_netrc_password_may_not_read1742=== PAUSE TestService_RequireScope_OIDC/empty_netrc_password_may_not_read1743=== CONT TestParseSingleRange/start_far_past_EOF1744=== CONT TestParseSingleRange/start_past_EOF1745=== CONT TestParseSingleRange/single_byte1746=== CONT TestParseSingleRange/suffix_exceeds_size1747=== CONT TestParseSingleRange/suffix1748=== NAME TestClientMultipleUploads1749 client_integration_test.go:406: Created store path 0: /private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestClientMultipleUploads1177525307/001/store/8hvak1lcnj57i32hvavmwq1m88kma0lr-test-file-0.txt1750=== CONT TestParseSingleRange/none1751=== CONT TestParseSingleRange/open-ended17522026/11/11 23:54:58 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=3 objects-deleted-after-grace-period=3 objects-failed-to-delete=01753=== CONT TestParseSingleRange/closed1754=== CONT TestParseSingleRange/malformed_end_before_start1755=== CONT TestParseSingleRange/malformed_both_empty1756=== CONT TestParseSingleRange/malformed_no_dash1757=== CONT TestParseSingleRange/multi-range_ignored1758=== CONT TestParseSingleRange/unknown_unit1759--- PASS: TestParseSingleRange (0.00s)1760 --- PASS: TestParseSingleRange/end_clamped_to_size (0.00s)1761 --- PASS: TestParseSingleRange/start_far_past_EOF (0.00s)1762 --- PASS: TestParseSingleRange/start_past_EOF (0.00s)1763 --- PASS: TestParseSingleRange/single_byte (0.00s)1764 --- PASS: TestParseSingleRange/suffix_exceeds_size (0.00s)1765 --- PASS: TestParseSingleRange/suffix (0.00s)1766 --- PASS: TestParseSingleRange/none (0.00s)1767 --- PASS: TestParseSingleRange/open-ended (0.00s)1768 --- PASS: TestParseSingleRange/closed (0.00s)1769 --- PASS: TestParseSingleRange/malformed_end_before_start (0.00s)1770 --- PASS: TestParseSingleRange/malformed_both_empty (0.00s)1771 --- PASS: TestParseSingleRange/malformed_no_dash (0.00s)1772 --- PASS: TestParseSingleRange/multi-range_ignored (0.00s)1773 --- PASS: TestParseSingleRange/unknown_unit (0.00s)1774=== CONT TestForceGCDuringPushOffersSweptObject/after_presence_check1775--- PASS: TestClientWithDependencies (8.45s)1776=== CONT TestPresentNotReportedWhileGCDeletesClosure/stale17772026/11/11 23:54:58 INFO Vacuumed table table=pending_closures17782026/11/11 23:54:58 INFO Vacuumed table table=pending_objects17792026/11/11 23:54:58 INFO Vacuumed table table=multipart_uploads17802026/11/11 23:54:58 INFO Vacuumed table table=closures1781=== NAME TestClientMultipleUploads1782 client_integration_test.go:406: Created store path 1: /private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestClientMultipleUploads1177525307/001/store/mqxwfj706v5cz7rgxh9flhdbrrw35jb8-test-file-1.txt17832026/11/11 23:54:58 INFO Vacuumed table table=objects1784 client_integration_test.go:406: Created store path 2: /private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestClientMultipleUploads1177525307/001/store/wikb6j56apyih6flfnlw9yclgfxm95sa-test-file-2.txt17852026/11/11 23:54:58 INFO Received push request method=POST path=/api/pushes17862026/11/11 23:54:58 INFO Uploading 3 paths to 127.0.0.1 (0 already cached)17872026/11/11 23:54:58 INFO Uploading wikb6j56apyih6flfnlw9yclgfxm95sa-test-file-2.txt (160B)17882026/11/11 23:54:58 INFO Uploading mqxwfj706v5cz7rgxh9flhdbrrw35jb8-test-file-1.txt (160B)17892026/11/11 23:54:58 INFO Uploading 8hvak1lcnj57i32hvavmwq1m88kma0lr-test-file-0.txt (160B)17902026/11/11 23:54:58 WARN Failed to register uploaded object key=nar/1823g6vx4q5zqvr73m7lkq1wpk40fin7bsc792di430yk7sg4lka.nar.zst error="server returned 404: 404 page not found\n"17912026/11/11 23:54:58 WARN Failed to register uploaded object key=wikb6j56apyih6flfnlw9yclgfxm95sa.ls error="server returned 404: 404 page not found\n"17922026/11/11 23:54:58 WARN Failed to register uploaded object key=mqxwfj706v5cz7rgxh9flhdbrrw35jb8.ls error="server returned 404: 404 page not found\n"17932026/11/11 23:54:58 WARN Failed to register uploaded object key=nar/0ahq3izw3h0b0c08p3xdfclh758fwxnp85ccvflasb4vnfsv50ri.nar.zst error="server returned 404: 404 page not found\n"17942026/11/11 23:54:58 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign17952026/11/11 23:54:58 WARN Failed to register uploaded object key=8hvak1lcnj57i32hvavmwq1m88kma0lr.ls error="server returned 404: 404 page not found\n"17962026/11/11 23:54:58 WARN Failed to register uploaded object key=nar/13p9pqi0ga6fx2apcwls9hjnv7nmf740ggpn5zvfzdsp5vz2bbg4.nar.zst error="server returned 404: 404 page not found\n"17972026/11/11 23:54:58 INFO Signed narinfos id=1 count=317982026/11/11 23:54:58 INFO Uploading 3 narinfos1799=== NAME TestClientIntegration1800 client_integration_test.go:292: Created store path: /private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestClientIntegration1741901704/002/store/kin295a57gd5xzdhxxhi8kmdxns1yc5r-test-file.txt18012026/11/11 23:54:58 WARN Failed to register uploaded object key=wikb6j56apyih6flfnlw9yclgfxm95sa.narinfo error="server returned 404: 404 page not found\n"18022026/11/11 23:54:58 WARN Failed to register uploaded object key=8hvak1lcnj57i32hvavmwq1m88kma0lr.narinfo error="server returned 404: 404 page not found\n"18032026/11/11 23:54:58 INFO Received complete push request method=POST path=/api/pushes/1/complete18042026/11/11 23:54:58 WARN Failed to register uploaded object key=mqxwfj706v5cz7rgxh9flhdbrrw35jb8.narinfo error="server returned 404: 404 page not found\n"18052026/11/11 23:54:59 INFO Completed push id=1 objects=9 duration=71.624166ms18062026/11/11 23:54:59 INFO Upload complete. (370ms)1807=== NAME TestClientMultipleUploads1808 client_integration_test.go:417: Uploaded 3 paths in 418.577292ms18092026/11/11 23:54:59 INFO Received push request method=POST path=/api/pushes18102026/11/11 23:54:59 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)18112026/11/11 23:54:59 INFO Uploading kin295a57gd5xzdhxxhi8kmdxns1yc5r-test-file.txt (152B)18122026/11/11 23:54:59 WARN Failed to register uploaded object key=kin295a57gd5xzdhxxhi8kmdxns1yc5r.ls error="server returned 404: 404 page not found\n"18132026/11/11 23:54:59 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign18142026/11/11 23:54:59 WARN Failed to register uploaded object key=nar/11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk1.nar.zst error="server returned 404: 404 page not found\n"18152026/11/11 23:54:59 INFO Signed narinfos id=1 count=11816--- PASS: TestClientMultipleUploads (9.17s)1817=== CONT TestPresentNotReportedWhileGCDeletesClosure/fresh18182026/11/11 23:54:59 INFO Uploading 1 narinfos18192026/11/11 23:54:59 INFO Received complete push request method=POST path=/api/pushes/1/complete18202026/11/11 23:54:59 WARN Failed to register uploaded object key=kin295a57gd5xzdhxxhi8kmdxns1yc5r.narinfo error="server returned 404: 404 page not found\n"1821=== NAME TestNARDeduplicationMetadataUploadBug1822 metadata_upload_test.go:48: First store path: /private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestNARDeduplicationMetadataUploadBug2947314861/001/store/qjibh0lxy1dcg8z28n4911k3c4db35pn-file1.txt18232026/11/11 23:54:59 INFO Completed push id=1 objects=3 duration=30.798ms18242026/11/11 23:54:59 INFO Upload complete. (333ms)18252026/11/11 23:54:59 INFO All 1 paths already cached1826=== NAME TestClientIntegration1827 client_integration_test.go:318: Retrieved narinfo from S3:1828 StorePath: /private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestClientIntegration1741901704/002/store/kin295a57gd5xzdhxxhi8kmdxns1yc5r-test-file.txt1829 URL: nar/11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk1.nar.zst1830 Compression: zstd1831 NarHash: sha256:11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk11832 NarSize: 1521833 References: 1834 CA: fixed:r:sha256:11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk11835 client_integration_test.go:319: Retrieved .ls file from S3 (compressed size: 77 bytes)1836 client_integration_test.go:319: Decompressed .ls content (64 bytes):1837 {"version":1,"root":{"type":"regular","size":39,"narOffset":96}}18382026/11/11 23:54:59 INFO Aborted multipart uploads count=1 kept=018392026/11/11 23:54:59 INFO Received push request method=POST path=/api/pushes18402026/11/11 23:54:59 INFO Received cleanup request method=DELETE path=/api/pending_closures18412026/11/11 23:54:59 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)18422026/11/11 23:54:59 INFO Aborted multipart uploads count=1 kept=018432026/11/11 23:54:59 INFO Uploading qjibh0lxy1dcg8z28n4911k3c4db35pn-file1.txt (160B)1844--- PASS: TestPendingCleanupUsesOneCutoff (13.02s)1845=== CONT TestResolveDBConnectionString/flag_wins1846=== CONT TestResolveDBConnectionString/PGHOST_allows_empty1847=== CONT TestResolveDBConnectionString/nothing_configured1848=== CONT TestResolveDBConnectionString/missing_file_is_an_error1849=== CONT TestResolveDBConnectionString/file_when_flag_empty1850=== CONT TestServerTLSConfig/no_client_CA1851=== CONT TestServerTLSConfig/not_a_PEM_file1852--- PASS: TestResolveDBConnectionString (0.04s)1853 --- PASS: TestResolveDBConnectionString/flag_wins (0.00s)1854 --- PASS: TestResolveDBConnectionString/PGHOST_allows_empty (0.00s)1855 --- PASS: TestResolveDBConnectionString/nothing_configured (0.00s)1856 --- PASS: TestResolveDBConnectionString/missing_file_is_an_error (0.00s)1857 --- PASS: TestResolveDBConnectionString/file_when_flag_empty (0.00s)18582026/11/11 23:54:59 WARN Failed to register uploaded object key=qjibh0lxy1dcg8z28n4911k3c4db35pn.ls error="server returned 404: 404 page not found\n"18592026/11/11 23:54:59 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign18602026/11/11 23:54:59 WARN Failed to register uploaded object key=nar/1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf.nar.zst error="server returned 404: 404 page not found\n"18612026/11/11 23:54:59 INFO Signed narinfos id=1 count=118622026/11/11 23:54:59 INFO Uploading 1 narinfos1863=== CONT TestServerTLSConfig/missing_CA_file1864--- PASS: TestServerTLSConfig (0.00s)1865 --- PASS: TestServerTLSConfig/no_client_CA (0.00s)1866 --- PASS: TestServerTLSConfig/not_a_PEM_file (0.05s)1867 --- PASS: TestServerTLSConfig/missing_CA_file (0.00s)1868=== CONT TestCacheConfigHandler/full_config,_no_issuer1869=== CONT TestCacheConfigHandler/no_signing_keys1870=== CONT TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator1871=== CONT TestCacheConfigHandler/no_cache_url_configured1872--- PASS: TestCacheConfigHandler (0.02s)1873 --- PASS: TestCacheConfigHandler/full_config,_no_issuer (0.00s)1874 --- PASS: TestCacheConfigHandler/no_signing_keys (0.00s)1875 --- PASS: TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator (0.00s)1876 --- PASS: TestCacheConfigHandler/no_cache_url_configured (0.00s)1877=== CONT TestClientErrorHandling/InvalidStorePath18782026/11/11 23:54:59 INFO Received complete push request method=POST path=/api/pushes/1/complete18792026/11/11 23:54:59 WARN Failed to register uploaded object key=qjibh0lxy1dcg8z28n4911k3c4db35pn.narinfo error="server returned 404: 404 page not found\n"18802026/11/11 23:54:59 INFO Completed push id=1 objects=3 duration=45.521167ms18812026/11/11 23:54:59 INFO Upload complete. (324ms)1882=== NAME TestNARDeduplicationMetadataUploadBug1883 metadata_upload_test.go:54: Retrieved narinfo from S3:1884 StorePath: /private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestNARDeduplicationMetadataUploadBug2947314861/001/store/qjibh0lxy1dcg8z28n4911k3c4db35pn-file1.txt1885 URL: nar/1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf.nar.zst1886 Compression: zstd1887 NarHash: sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf1888 NarSize: 1601889 References: 1890 CA: fixed:r:sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf1891 metadata_upload_test.go:55: Retrieved .ls file from S3 (compressed size: 77 bytes)1892 metadata_upload_test.go:55: Decompressed .ls content (64 bytes):1893 {"version":1,"root":{"type":"regular","size":44,"narOffset":96}}18942026/11/11 23:54:59 INFO Garbage collection progress phase="" failed_uploads_deleted=0 old_closures_deleted=1 objects_marked=3 objects_deleted=3 objects_failed=018952026/11/11 23:54:59 INFO Received create pin request method=POST path=/api/pins/myapp18962026/11/11 23:54:59 INFO Received push request method=POST path=/api/pushes18972026/11/11 23:54:59 INFO Object in database but missing from S3 key=kin295a57gd5xzdhxxhi8kmdxns1yc5r.ls18982026/11/11 23:54:59 WARN Found objects in DB but missing from S3, will re-upload count=118992026/11/11 23:54:59 INFO Uploading 0 paths to 127.0.0.1 (1 already cached)19002026/11/11 23:54:59 INFO Created/updated pin name=myapp store_path=/private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestPinProtectsFromGC325070215/001/store/g9x1rn3llzgfrh0736jw411rxkwqb8zg-pinned-file.txt narinfo_key=g9x1rn3llzgfrh0736jw411rxkwqb8zg.narinfo19012026/11/11 23:54:59 INFO Starting cleanup of old closures method=DELETE path=/api/closures19022026/11/11 23:54:59 INFO Garbage collection started19032026/11/11 23:54:59 INFO Aborted multipart uploads count=0 kept=019042026/11/11 23:54:59 INFO Received complete push request method=POST path=/api/pushes/2/complete19052026/11/11 23:54:59 WARN Failed to register uploaded object key=kin295a57gd5xzdhxxhi8kmdxns1yc5r.ls error="server returned 404: 404 page not found\n"19062026/11/11 23:54:59 WARN Force mode enabled - objects will be deleted immediately without grace period19072026/11/11 23:54:59 INFO Completed push id=2 objects=3 duration=513.167µs19082026/11/11 23:54:59 INFO Upload complete. (137ms)19092026/11/11 23:54:59 INFO Installed lifecycle rule aborting incomplete NAR uploads bucket=bucket86 days=21910=== NAME TestClientIntegration1911 client_integration_test.go:336: Retrieved .ls file from S3 (compressed size: 62 bytes)19122026/11/11 23:54:59 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=01913 client_integration_test.go:336: Decompressed .ls content (49 bytes):1914 {"version":1,"root":{"type":"regular","size":39}}1915--- PASS: TestEnsureAbortUploadsRule (7.16s)1916=== CONT TestClientErrorHandling/ServerNotAvailable1917=== NAME TestNARDeduplicationMetadataUploadBug19182026/11/11 23:54:59 INFO Vacuumed table table=pending_closures1919 metadata_upload_test.go:64: Second store path (same content): /private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestNARDeduplicationMetadataUploadBug2947314861/001/store/3mxzc96myvfyag3pfsl07zc5n7f44imj-file2.txt19202026/11/11 23:54:59 INFO Vacuumed table table=pending_objects19212026/11/11 23:54:59 INFO Vacuumed table table=multipart_uploads19222026/11/11 23:54:59 INFO Vacuumed table table=closures19232026/11/11 23:54:59 INFO Vacuumed table table=objects19242026/11/11 23:54:59 INFO Received push request method=POST path=/api/pushes19252026/11/11 23:54:59 INFO Uploading 0 paths to 127.0.0.1 (1 already cached)19262026/11/11 23:54:59 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign19272026/11/11 23:54:59 WARN Failed to register uploaded object key=3mxzc96myvfyag3pfsl07zc5n7f44imj.ls error="server returned 404: 404 page not found\n"19282026/11/11 23:54:59 INFO Signed narinfos id=2 count=119292026/11/11 23:54:59 INFO Uploading 1 narinfos1930=== NAME TestClientCADerivations1931 client_ca_test.go:136: Built CA derivation: /private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestClientCADerivations2185753818/001/store/wm84lbs6vh082mdw1cd6n0p27zhj37mb-ca-test19322026/11/11 23:55:00 INFO Received complete push request method=POST path=/api/pushes/2/complete19332026/11/11 23:55:00 WARN Failed to register uploaded object key=3mxzc96myvfyag3pfsl07zc5n7f44imj.narinfo error="server returned 404: 404 page not found\n"19342026/11/11 23:55:00 INFO Completed push id=2 objects=3 duration=601µs19352026/11/11 23:55:00 INFO Upload complete. (198ms)1936=== NAME TestNARDeduplicationMetadataUploadBug1937 metadata_upload_test.go:76: Retrieved narinfo from S3:1938 StorePath: /private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestNARDeduplicationMetadataUploadBug2947314861/001/store/3mxzc96myvfyag3pfsl07zc5n7f44imj-file2.txt1939 URL: nar/1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf.nar.zst1940 Compression: zstd1941 NarHash: sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf1942 NarSize: 1601943 References: 1944 CA: fixed:r:sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf1945 metadata_upload_test.go:77: Retrieved .ls file from S3 (compressed size: 62 bytes)1946 metadata_upload_test.go:77: Decompressed .ls content (49 bytes):1947 {"version":1,"root":{"type":"regular","size":44}}1948=== NAME TestClientCADerivations1949 client_ca_test.go:139: Found 1 dependencies (including self)19502026/11/11 23:55:00 INFO Received push request method=POST path=/api/pushes19512026/11/11 23:55:00 INFO Uploading 0 paths to 127.0.0.1 (1 already cached)1952--- PASS: TestNARDeduplicationMetadataUploadBug (8.29s)1953=== CONT TestClientErrorHandling/InvalidAuthToken19542026/11/11 23:55:00 INFO Aborted multipart uploads count=0 kept=019552026/11/11 23:55:00 WARN Force mode enabled - objects will be deleted immediately without grace period19562026/11/11 23:55:00 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=019572026/11/11 23:55:00 INFO Received complete push request method=POST path=/api/pushes/3/complete19582026/11/11 23:55:00 WARN Failed to register uploaded object key=kin295a57gd5xzdhxxhi8kmdxns1yc5r.ls error="server returned 404: 404 page not found\n"19592026/11/11 23:55:00 INFO Completed push id=3 objects=3 duration=712.625µs19602026/11/11 23:55:00 INFO Upload complete. (154ms)19612026/11/11 23:55:00 INFO Vacuumed table table=pending_closures19622026/11/11 23:55:00 INFO Received push request method=POST path=/api/pushes1963=== NAME TestClientIntegration1964 client_integration_test.go:353: Retrieved .ls file from S3 (compressed size: 62 bytes)1965 client_integration_test.go:353: Decompressed .ls content (49 bytes):1966 {"version":1,"root":{"type":"regular","size":39}}1967 client_integration_test.go:364: Testing garbage collection...19682026/11/11 23:55:00 WARN Request failed, retrying attempt=1 backoff=100ms error="Post \"http://localhost:19999/api/objects/present\": dial tcp 127.0.0.1:19999: connect: connection refused" url=http://localhost:19999/api/objects/present19692026/11/11 23:55:00 INFO Vacuumed table table=pending_objects19702026/11/11 23:55:00 INFO Vacuumed table table=multipart_uploads19712026/11/11 23:55:00 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)19722026/11/11 23:55:00 INFO Uploading wm84lbs6vh082mdw1cd6n0p27zhj37mb-ca-test (144B)19732026/11/11 23:55:00 INFO Starting cleanup of old closures method=DELETE path=/api/closures19742026/11/11 23:55:00 INFO Garbage collection started19752026/11/11 23:55:00 INFO Vacuumed table table=closures19762026/11/11 23:55:00 INFO Vacuumed table table=objects19772026/11/11 23:55:00 INFO Aborted multipart uploads count=0 kept=019782026/11/11 23:55:00 WARN Force mode enabled - objects will be deleted immediately without grace period19792026/11/11 23:55:00 WARN Failed to register uploaded object key=wm84lbs6vh082mdw1cd6n0p27zhj37mb.ls error="server returned 404: 404 page not found\n"1980--- PASS: TestCommitRacingPendingCleanupKeepsObjects (7.67s)1981=== CONT TestService_AuthMiddleware_OIDC/valid_OIDC_token19822026/11/11 23:55:00 WARN Failed to register uploaded object key=nar/04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n.nar.zst error="server returned 404: 404 page not found\n"1983=== CONT TestService_AuthMiddleware_OIDC/malformed_token_rejected19842026/11/11 23:55:00 WARN Authentication failed token_preview=not-a-valid-jwt token_length=15 oidc_error="no provider could verify the token (signature or issuer mismatch)" oidc_provider="" tried_providers=[test]1985=== CONT TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured1986=== CONT TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected19872026/11/11 23:55:00 WARN Request failed, retrying attempt=2 backoff=203.413694ms error="Post \"http://localhost:19999/api/objects/present\": dial tcp 127.0.0.1:19999: connect: connection refused" url=http://localhost:19999/api/objects/present19882026/11/11 23:55:00 WARN Failed to register uploaded object key=log/ymjs98c91fsa4zz9bfbsdc1q54r855qj-ca-test.drv error="server returned 404: 404 page not found\n"19892026/11/11 23:55:00 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign19902026/11/11 23:55:00 WARN Authentication failed token_preview=eyJhbGciOi...e7RJlJpWeQ token_length=701 oidc_error="no rule matched: claim \"repository_owner\" value [otherorg] not in allowed patterns [myorg]" oidc_provider=test tried_providers=[test]19912026/11/11 23:55:00 INFO Signed narinfos id=1 count=11992=== CONT TestGCEndsOnShutdown/before_the_run19932026/11/11 23:55:00 INFO Uploading 1 narinfos1994--- PASS: TestService_AuthMiddleware_OIDC (6.95s)1995 --- PASS: TestService_AuthMiddleware_OIDC/valid_OIDC_token (0.00s)1996 --- PASS: TestService_AuthMiddleware_OIDC/malformed_token_rejected (0.00s)1997 --- PASS: TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured (0.00s)1998 --- PASS: TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected (0.02s)19992026/11/11 23:55:00 INFO Received uploads request method=POST path=/api/pending_closures20002026/11/11 23:55:00 INFO Received complete push request method=POST path=/api/pushes/1/complete
loading 662 hidden lines…
26632026/11/11 23:55:20 INFO Vacuumed table table=closures26642026/11/11 23:55:20 INFO Received complete push request method=POST path=/26652026/11/11 23:55:20 INFO Vacuumed table table=objects26662026/11/11 23:55:20 INFO Vacuumed table table=objects26672026/11/11 23:55:20 INFO Completed push id=13 objects=23 duration=5.940041ms26682026/11/11 23:55:20 INFO Received push request method=POST path=/26692026/11/11 23:55:20 INFO Aborted multipart uploads count=0 kept=026702026/11/11 23:55:20 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=026712026/11/11 23:55:20 INFO Received push request method=POST path=/26722026/11/11 23:55:20 INFO Received push request method=POST path=/26732026/11/11 23:55:20 INFO Vacuumed table table=pending_closures26742026/11/11 23:55:20 INFO Received push request method=POST path=/26752026/11/11 23:55:20 INFO Aborted multipart uploads count=0 kept=026762026/11/11 23:55:20 INFO Aborted multipart uploads count=0 kept=026772026/11/11 23:55:20 INFO Vacuumed table table=pending_objects26782026/11/11 23:55:20 INFO Received complete upload request method=POST path=/26792026/11/11 23:55:20 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=2 objects-failed-to-delete=026802026/11/11 23:55:20 WARN Force mode enabled - objects will be deleted immediately without grace period26812026/11/11 23:55:20 INFO Vacuumed table table=multipart_uploads26822026/11/11 23:55:20 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=026832026/11/11 23:55:20 INFO Vacuumed table table=closures26842026/11/11 23:55:20 INFO Vacuumed table table=objects26852026/11/11 23:55:20 INFO Vacuumed table table=pending_closures26862026/11/11 23:55:20 INFO Vacuumed table table=pending_objects26872026/11/11 23:55:20 INFO Received complete push request method=POST path=/26882026/11/11 23:55:20 INFO Vacuumed table table=pending_closures26892026/11/11 23:55:20 INFO Received uploads request method=POST path=/26902026/11/11 23:55:20 INFO Vacuumed table table=multipart_uploads26912026/11/11 23:55:20 INFO Completed upload id=2 objects=7 duration=29.05275ms26922026/11/11 23:55:20 INFO Completed push id=19 objects=8 duration=1.540708ms26932026/11/11 23:55:20 INFO Received push request method=POST path=/26942026/11/11 23:55:20 INFO Vacuumed table table=closures26952026/11/11 23:55:20 INFO Vacuumed table table=pending_objects26962026/11/11 23:55:20 INFO Received uploads request method=POST path=/26972026/11/11 23:55:20 INFO Vacuumed table table=objects26982026/11/11 23:55:20 INFO Vacuumed table table=multipart_uploads26992026/11/11 23:55:20 INFO Received uploads request method=POST path=/27002026/11/11 23:55:20 INFO Aborted multipart uploads count=0 kept=027012026/11/11 23:55:20 INFO Vacuumed table table=closures27022026/11/11 23:55:20 INFO Vacuumed table table=objects27032026/11/11 23:55:20 INFO Received uploads request method=POST path=/27042026/11/11 23:55:20 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=027052026/11/11 23:55:20 INFO Aborted multipart uploads count=0 kept=027062026/11/11 23:55:20 INFO Received push request method=POST path=/27072026/11/11 23:55:20 INFO Received complete push request method=POST path=/27082026/11/11 23:55:20 INFO Vacuumed table table=pending_closures27092026/11/11 23:55:20 INFO Completed push id=14 objects=3 duration=6.537375ms27102026/11/11 23:55:20 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=027112026/11/11 23:55:20 INFO Vacuumed table table=pending_objects27122026/11/11 23:55:20 INFO Vacuumed table table=pending_closures27132026/11/11 23:55:20 INFO Vacuumed table table=multipart_uploads27142026/11/11 23:55:20 INFO Vacuumed table table=pending_objects27152026/11/11 23:55:20 INFO Vacuumed table table=multipart_uploads27162026/11/11 23:55:20 INFO Vacuumed table table=closures27172026/11/11 23:55:20 INFO Vacuumed table table=closures27182026/11/11 23:55:20 INFO Received complete push request method=POST path=/27192026/11/11 23:55:20 INFO Received complete push request method=POST path=/27202026/11/11 23:55:20 INFO Received uploads request method=POST path=/27212026/11/11 23:55:20 INFO Vacuumed table table=objects27222026/11/11 23:55:20 INFO Vacuumed table table=objects27232026/11/11 23:55:20 INFO Completed push id=5 objects=6 duration=533.792µs27242026/11/11 23:55:20 INFO Received uploads request method=POST path=/27252026/11/11 23:55:20 INFO Aborted multipart uploads count=0 kept=027262026/11/11 23:55:20 INFO Received uploads request method=POST path=/27272026/11/11 23:55:20 INFO Aborted multipart uploads count=0 kept=027282026/11/11 23:55:20 INFO Completed push id=1 objects=7 duration=16.95675ms27292026/11/11 23:55:20 WARN Force mode enabled - objects will be deleted immediately without grace period27302026/11/11 23:55:20 INFO Received complete upload request method=POST path=/27312026/11/11 23:55:20 WARN Force mode enabled - objects will be deleted immediately without grace period27322026/11/11 23:55:20 INFO Received push request method=POST path=/27332026/11/11 23:55:20 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=027342026/11/11 23:55:20 INFO Completed upload id=15 objects=4 duration=6.779667ms27352026/11/11 23:55:20 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=027362026/11/11 23:55:20 INFO Vacuumed table table=pending_closures27372026/11/11 23:55:20 INFO Received complete push request method=POST path=/27382026/11/11 23:55:20 INFO Aborted multipart uploads count=0 kept=027392026/11/11 23:55:20 INFO Received complete push request method=POST path=/27402026/11/11 23:55:20 INFO Vacuumed table table=pending_closures27412026/11/11 23:55:20 INFO Received push request method=POST path=/27422026/11/11 23:55:20 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=027432026/11/11 23:55:20 INFO Received uploads request method=POST path=/27442026/11/11 23:55:20 INFO Vacuumed table table=pending_objects27452026/11/11 23:55:20 INFO Completed push id=3 objects=21 duration=6.326541ms27462026/11/11 23:55:20 INFO Vacuumed table table=pending_objects27472026/11/11 23:55:20 INFO Vacuumed table table=multipart_uploads27482026/11/11 23:55:20 INFO Completed push id=2 objects=7 duration=1.541958ms27492026/11/11 23:55:20 INFO Received push request method=POST path=/27502026/11/11 23:55:20 INFO Received uploads request method=POST path=/27512026/11/11 23:55:20 INFO Vacuumed table table=multipart_uploads27522026/11/11 23:55:20 INFO Vacuumed table table=closures27532026/11/11 23:55:20 INFO Received complete push request method=POST path=/27542026/11/11 23:55:20 INFO Aborted multipart uploads count=0 kept=027552026/11/11 23:55:20 INFO Vacuumed table table=closures27562026/11/11 23:55:20 INFO Received uploads request method=POST path=/27572026/11/11 23:55:20 INFO Vacuumed table table=objects27582026/11/11 23:55:20 INFO Completed push id=1 objects=2 duration=1.109292ms27592026/11/11 23:55:20 INFO Vacuumed table table=pending_closures27602026/11/11 23:55:20 INFO Vacuumed table table=objects27612026/11/11 23:55:20 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=027622026/11/11 23:55:20 INFO Received push request method=POST path=/27632026/11/11 23:55:20 INFO Received push request method=POST path=/27642026/11/11 23:55:20 INFO Received push request method=POST path=/27652026/11/11 23:55:20 INFO Received complete upload request method=POST path=/27662026/11/11 23:55:20 INFO Received push request method=POST path=/27672026/11/11 23:55:20 INFO Completed upload id=16 objects=3 duration=529.75µs27682026/11/11 23:55:20 INFO Vacuumed table table=pending_objects27692026/11/11 23:55:20 INFO Vacuumed table table=pending_closures27702026/11/11 23:55:20 INFO Received uploads request method=POST path=/27712026/11/11 23:55:20 INFO Aborted multipart uploads count=0 kept=027722026/11/11 23:55:20 INFO Received push request method=POST path=/27732026/11/11 23:55:20 INFO Vacuumed table table=multipart_uploads27742026/11/11 23:55:20 INFO Received uploads request method=POST path=/27752026/11/11 23:55:20 INFO Aborted multipart uploads count=0 kept=027762026/11/11 23:55:20 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=027772026/11/11 23:55:20 INFO Received uploads request method=POST path=/27782026/11/11 23:55:20 INFO Aborted multipart uploads count=0 kept=027792026/11/11 23:55:20 INFO Vacuumed table table=closures27802026/11/11 23:55:20 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=027812026/11/11 23:55:20 INFO Received uploads request method=POST path=/27822026/11/11 23:55:20 INFO Vacuumed table table=pending_objects27832026/11/11 23:55:20 INFO Vacuumed table table=objects27842026/11/11 23:55:20 INFO Vacuumed table table=multipart_uploads27852026/11/11 23:55:20 INFO Received uploads request method=POST path=/27862026/11/11 23:55:20 INFO Vacuumed table table=pending_closures27872026/11/11 23:55:20 INFO Vacuumed table table=pending_closures27882026/11/11 23:55:20 WARN Force mode enabled - objects will be deleted immediately without grace period27892026/11/11 23:55:20 INFO Received complete push request method=POST path=/27902026/11/11 23:55:20 INFO Vacuumed table table=closures27912026/11/11 23:55:20 INFO Completed push id=15 objects=5 duration=523.5µs27922026/11/11 23:55:20 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=027932026/11/11 23:55:20 INFO Received push request method=POST path=/27942026/11/11 23:55:20 INFO Vacuumed table table=pending_objects27952026/11/11 23:55:20 INFO Received uploads request method=POST path=/27962026/11/11 23:55:20 INFO Received uploads request method=POST path=/27972026/11/11 23:55:20 INFO Vacuumed table table=objects27982026/11/11 23:55:20 INFO Vacuumed table table=pending_objects27992026/11/11 23:55:20 INFO Vacuumed table table=multipart_uploads28002026/11/11 23:55:20 INFO Vacuumed table table=multipart_uploads28012026/11/11 23:55:20 INFO Received push request method=POST path=/28022026/11/11 23:55:20 INFO Vacuumed table table=closures28032026/11/11 23:55:20 INFO Received uploads request method=POST path=/28042026/11/11 23:55:20 INFO Vacuumed table table=objects28052026/11/11 23:55:20 INFO Received complete upload request method=POST path=/28062026/11/11 23:55:20 INFO Vacuumed table table=pending_closures28072026/11/11 23:55:20 INFO Vacuumed table table=closures28082026/11/11 23:55:20 INFO Completed upload id=11 objects=6 duration=8.278792ms28092026/11/11 23:55:20 INFO Received uploads request method=POST path=/28102026/11/11 23:55:20 INFO Received uploads request method=POST path=/28112026/11/11 23:55:20 INFO Vacuumed table table=pending_objects28122026/11/11 23:55:20 INFO Received uploads request method=POST path=/28132026/11/11 23:55:20 INFO Aborted multipart uploads count=0 kept=028142026/11/11 23:55:20 INFO Vacuumed table table=multipart_uploads28152026/11/11 23:55:20 INFO Received complete upload request method=POST path=/28162026/11/11 23:55:20 WARN Force mode enabled - objects will be deleted immediately without grace period28172026/11/11 23:55:20 INFO Vacuumed table table=objects28182026/11/11 23:55:20 INFO Completed upload id=18 objects=4 duration=792.916µs28192026/11/11 23:55:20 INFO Received uploads request method=POST path=/28202026/11/11 23:55:20 INFO Vacuumed table table=closures28212026/11/11 23:55:20 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=028222026/11/11 23:55:20 INFO Aborted multipart uploads count=0 kept=028232026/11/11 23:55:20 INFO Aborted multipart uploads count=0 kept=028242026/11/11 23:55:20 INFO Received push request method=POST path=/28252026/11/11 23:55:20 WARN Force mode enabled - objects will be deleted immediately without grace period28262026/11/11 23:55:20 INFO Received complete push request method=POST path=/28272026/11/11 23:55:20 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=028282026/11/11 23:55:20 INFO Garbage collection completed failed-uploads-deleted=4 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=028292026/11/11 23:55:20 INFO Received complete push request method=POST path=/28302026/11/11 23:55:20 INFO Vacuumed table table=pending_closures28312026/11/11 23:55:20 INFO Completed push id=9 objects=5 duration=5.664167ms28322026/11/11 23:55:20 INFO Vacuumed table table=pending_closures28332026/11/11 23:55:20 INFO Vacuumed table table=pending_closures28342026/11/11 23:55:20 INFO Completed push id=17 objects=6 duration=5.798208ms28352026/11/11 23:55:20 INFO Vacuumed table table=pending_objects28362026/11/11 23:55:20 INFO Vacuumed table table=multipart_uploads28372026/11/11 23:55:20 INFO Vacuumed table table=closures28382026/11/11 23:55:20 INFO Vacuumed table table=objects28392026/11/11 23:55:20 INFO Vacuumed table table=pending_objects28402026/11/11 23:55:20 INFO Vacuumed table table=objects28412026/11/11 23:55:20 INFO Aborted multipart uploads count=0 kept=028422026/11/11 23:55:20 INFO Vacuumed table table=multipart_uploads28432026/11/11 23:55:20 INFO Vacuumed table table=pending_objects28442026/11/11 23:55:20 WARN Force mode enabled - objects will be deleted immediately without grace period28452026/11/11 23:55:20 INFO Vacuumed table table=multipart_uploads28462026/11/11 23:55:20 INFO Received push request method=POST path=/28472026/11/11 23:55:20 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=028482026/11/11 23:55:20 INFO Received uploads request method=POST path=/28492026/11/11 23:55:20 INFO Vacuumed table table=closures28502026/11/11 23:55:20 INFO Vacuumed table table=closures28512026/11/11 23:55:20 INFO Vacuumed table table=pending_closures28522026/11/11 23:55:20 INFO Vacuumed table table=objects28532026/11/11 23:55:20 INFO Vacuumed table table=objects28542026/11/11 23:55:20 INFO Vacuumed table table=pending_objects28552026/11/11 23:55:20 INFO Vacuumed table table=multipart_uploads28562026/11/11 23:55:20 INFO Aborted multipart uploads count=0 kept=028572026/11/11 23:55:20 INFO Vacuumed table table=closures28582026/11/11 23:55:20 INFO Vacuumed table table=objects28592026/11/11 23:55:20 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=028602026/11/11 23:55:20 INFO Aborted multipart uploads count=0 kept=028612026/11/11 23:55:20 INFO Received uploads request method=POST path=/28622026/11/11 23:55:20 INFO Vacuumed table table=pending_closures28632026/11/11 23:55:20 INFO Received push request method=POST path=/28642026/11/11 23:55:20 INFO Vacuumed table table=pending_objects28652026/11/11 23:55:20 INFO Vacuumed table table=multipart_uploads28662026/11/11 23:55:20 WARN Force mode enabled - objects will be deleted immediately without grace period28672026/11/11 23:55:20 INFO Vacuumed table table=closures28682026/11/11 23:55:20 INFO Received complete push request method=POST path=/28692026/11/11 23:55:20 INFO Vacuumed table table=objects28702026/11/11 23:55:20 INFO Completed push id=6 objects=5 duration=1.51925ms28712026/11/11 23:55:20 INFO Received push request method=POST path=/28722026/11/11 23:55:20 INFO Received push request method=POST path=/28732026/11/11 23:55:20 INFO Aborted multipart uploads count=0 kept=028742026/11/11 23:55:20 WARN Force mode enabled - objects will be deleted immediately without grace period28752026/11/11 23:55:20 INFO Received push request method=POST path=/28762026/11/11 23:55:20 INFO Received push request method=POST path=/28772026/11/11 23:55:20 INFO Received push request method=POST path=/28782026/11/11 23:55:20 INFO Received push request method=POST path=/28792026/11/11 23:55:20 INFO Received complete push request method=POST path=/28802026/11/11 23:55:20 INFO Aborted multipart uploads count=0 kept=028812026/11/11 23:55:20 INFO Completed push id=14 objects=3 duration=808.208µs28822026/11/11 23:55:20 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=2 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=028832026/11/11 23:55:20 INFO Vacuumed table table=pending_closures28842026/11/11 23:55:20 INFO Vacuumed table table=pending_objects28852026/11/11 23:55:20 INFO Vacuumed table table=multipart_uploads28862026/11/11 23:55:20 INFO Vacuumed table table=closures28872026/11/11 23:55:20 INFO Vacuumed table table=objects28882026/11/11 23:55:20 INFO Received push request method=POST path=/28892026/11/11 23:55:20 INFO Received uploads request method=POST path=/28902026/11/11 23:55:20 INFO Received push request method=POST path=/28912026/11/11 23:55:20 INFO Received complete push request method=POST path=/28922026/11/11 23:55:20 INFO Completed push id=26 objects=14 duration=860.625µs28932026/11/11 23:55:20 INFO Received complete push request method=POST path=/28942026/11/11 23:55:20 INFO Completed push id=21 objects=9 duration=588.083µs28952026/11/11 23:55:20 INFO Received push request method=POST path=/28962026/11/11 23:55:20 INFO Received uploads request method=POST path=/28972026/11/11 23:55:20 INFO Received push request method=POST path=/28982026/11/11 23:55:20 INFO Received uploads request method=POST path=/28992026/11/11 23:55:20 INFO Received push request method=POST path=/29002026/11/11 23:55:20 INFO Aborted multipart uploads count=0 kept=029012026/11/11 23:55:20 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=029022026/11/11 23:55:20 INFO Vacuumed table table=pending_closures29032026/11/11 23:55:20 INFO Vacuumed table table=pending_objects29042026/11/11 23:55:20 INFO Received complete upload request method=POST path=/29052026/11/11 23:55:20 INFO Vacuumed table table=multipart_uploads29062026/11/11 23:55:20 INFO Completed upload id=13 objects=8 duration=10.623375ms29072026/11/11 23:55:20 INFO Vacuumed table table=closures29082026/11/11 23:55:20 INFO Vacuumed table table=objects29092026/11/11 23:55:20 INFO Received uploads request method=POST path=/29102026/11/11 23:55:20 INFO Received uploads request method=POST path=/29112026/11/11 23:55:20 INFO Received push request method=POST path=/29122026/11/11 23:55:20 INFO Received push request method=POST path=/29132026/11/11 23:55:20 INFO Received push request method=POST path=/29142026/11/11 23:55:20 INFO Received push request method=POST path=/29152026/11/11 23:55:20 INFO Received push request method=POST path=/29162026/11/11 23:55:21 INFO Received complete upload request method=POST path=/29172026/11/11 23:55:21 INFO Completed upload id=14 objects=16 duration=923.041µs29182026/11/11 23:55:21 INFO Received complete push request method=POST path=/29192026/11/11 23:55:21 INFO Completed push id=27 objects=25 duration=1.044417ms29202026/11/11 23:55:21 INFO Aborted multipart uploads count=0 kept=029212026/11/11 23:55:21 INFO Garbage collection completed failed-uploads-deleted=3 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=029222026/11/11 23:55:21 INFO Vacuumed table table=pending_closures29232026/11/11 23:55:21 INFO Vacuumed table table=pending_objects29242026/11/11 23:55:21 INFO Vacuumed table table=multipart_uploads29252026/11/11 23:55:21 INFO Vacuumed table table=closures29262026/11/11 23:55:21 INFO Aborted multipart uploads count=0 kept=029272026/11/11 23:55:21 INFO Vacuumed table table=objects29282026/11/11 23:55:21 WARN Force mode enabled - objects will be deleted immediately without grace period29292026/11/11 23:55:21 ERROR failed to remove object object=aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa.ls error="Access Denied."29302026/11/11 23:55:21 ERROR failed to remove object object=realisations/sha256:bbbbbbbb!out.doi error="Access Denied."29312026/11/11 23:55:21 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=029322026/11/11 23:55:21 INFO Received complete push request method=POST path=/29332026/11/11 23:55:21 INFO Received complete push request method=POST path=/29342026/11/11 23:55:21 INFO Vacuumed table table=pending_closures29352026/11/11 23:55:21 INFO Completed push id=24 objects=5 duration=1.381791ms29362026/11/11 23:55:21 INFO Vacuumed table table=pending_objects29372026/11/11 23:55:21 INFO Vacuumed table table=multipart_uploads29382026/11/11 23:55:21 INFO Completed push id=1 objects=6 duration=15.850625ms29392026/11/11 23:55:21 INFO Vacuumed table table=closures29402026/11/11 23:55:21 INFO Received uploads request method=POST path=/29412026/11/11 23:55:21 INFO Vacuumed table table=objects29422026/11/11 23:55:21 INFO Received uploads request method=POST path=/29432026/11/11 23:55:21 INFO Received complete push request method=POST path=/29442026/11/11 23:55:21 INFO Received complete upload request method=POST path=/29452026/11/11 23:55:21 INFO Completed push id=17 objects=11 duration=1.933625ms29462026/11/11 23:55:21 INFO Completed upload id=3 objects=8 duration=2.460833ms29472026/11/11 23:55:21 INFO Received push request method=POST path=/29482026/11/11 23:55:21 INFO Received push request method=POST path=/29492026/11/11 23:55:21 INFO Received uploads request method=POST path=/29502026/11/11 23:55:21 INFO Received push request method=POST path=/29512026/11/11 23:55:21 INFO Aborted multipart uploads count=0 kept=029522026/11/11 23:55:21 ERROR failed to remove object object=aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa.ls error="Access Denied."29532026/11/11 23:55:21 ERROR failed to remove object object=realisations/sha256:bbbbbbbb!out.doi error="Access Denied."29542026/11/11 23:55:21 INFO Received complete upload request method=POST path=/29552026/11/11 23:55:21 ERROR failed to remove object object=cccccccccccccccccccccccccccccccc.ls error="Access Denied."29562026/11/11 23:55:21 INFO Completed upload id=26 objects=6 duration=310.083µs29572026/11/11 23:55:21 ERROR failed to remove object object=cccccccccccccccccccccccccccccccc.narinfo error="Access Denied."29582026/11/11 23:55:21 ERROR failed to remove object object=ffffffffffffffffffffffffffffffff.ls error="Access Denied."29592026/11/11 23:55:21 ERROR failed to remove object object=ffffffffffffffffffffffffffffffff.narinfo error="Access Denied."29602026/11/11 23:55:21 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.ls error="Access Denied."29612026/11/11 23:55:21 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.narinfo error="Access Denied."29622026/11/11 23:55:21 ERROR failed to remove object object=iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.narinfo error="Access Denied."29632026/11/11 23:55:21 ERROR failed to remove object object=nar/cccccccccccccccccccccccccccccccccccccccccccccccccccc.nar.zst error="Access Denied."29642026/11/11 23:55:21 ERROR failed to remove object object=nar/ffffffffffffffffffffffffffffffffffffffffffffffffffff.nar.zst error="Access Denied."29652026/11/11 23:55:21 INFO Received complete push request method=POST path=/29662026/11/11 23:55:21 INFO Received uploads request method=POST path=/29672026/11/11 23:55:21 ERROR failed to remove object object=nar/hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.nar.zst error="Access Denied."29682026/11/11 23:55:21 ERROR failed to remove object object=nar/iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.nar.zst error="Access Denied."29692026/11/11 23:55:21 ERROR failed to remove object object=realisations/sha256:aaaaaaaa!out.doi error="Access Denied."29702026/11/11 23:55:21 INFO Completed push id=21 objects=26 duration=694.208µs29712026/11/11 23:55:21 ERROR failed to remove object object=realisations/sha256:cccccccc!out.doi error="Access Denied."29722026/11/11 23:55:21 ERROR failed to remove object object=realisations/sha256:dddddddd!out.doi error="Access Denied."29732026/11/11 23:55:21 ERROR failed to remove object object=realisations/sha256:ffffffff!out.doi error="Access Denied."29742026/11/11 23:55:21 INFO Received complete upload request method=POST path=/29752026/11/11 23:55:21 ERROR failed to remove object object=realisations/sha256:gggggggg!out.doi error="Access Denied."29762026/11/11 23:55:21 ERROR failed to remove object object=realisations/sha256:hhhhhhhh!out.doi error="Access Denied."29772026/11/11 23:55:21 INFO Received complete push request method=POST path=/29782026/11/11 23:55:21 INFO Completed upload id=29 objects=5 duration=425.084µs29792026/11/11 23:55:21 ERROR failed to remove object object=realisations/sha256:iiiiiiii!out.doi error="Access Denied."29802026/11/11 23:55:21 INFO Completed push id=5 objects=28 duration=828.042µs29812026/11/11 23:55:21 INFO Received push request method=POST path=/29822026/11/11 23:55:21 INFO Received complete push request method=POST path=/29832026/11/11 23:55:21 INFO Aborted multipart uploads count=0 kept=029842026/11/11 23:55:21 INFO Received uploads request method=POST path=/29852026/11/11 23:55:21 INFO Completed push id=10 objects=2 duration=457.542µs29862026/11/11 23:55:21 WARN Force mode enabled - objects will be deleted immediately without grace period29872026/11/11 23:55:21 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=029882026/11/11 23:55:21 INFO Vacuumed table table=pending_closures29892026/11/11 23:55:21 INFO Aborted multipart uploads count=0 kept=029902026/11/11 23:55:21 INFO Vacuumed table table=pending_objects29912026/11/11 23:55:21 WARN Force mode enabled - objects will be deleted immediately without grace period29922026/11/11 23:55:21 INFO Vacuumed table table=multipart_uploads29932026/11/11 23:55:21 INFO Received complete upload request method=POST path=/29942026/11/11 23:55:21 INFO Vacuumed table table=closures29952026/11/11 23:55:21 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=16 objects-failed-to-delete=029962026/11/11 23:55:21 INFO Vacuumed table table=objects29972026/11/11 23:55:21 INFO Received complete upload request method=POST path=/29982026/11/11 23:55:21 INFO Received push request method=POST path=/29992026/11/11 23:55:21 INFO Completed upload id=4 objects=14 duration=1.3325ms30002026/11/11 23:55:21 INFO Received uploads request method=POST path=/30012026/11/11 23:55:21 INFO Vacuumed table table=pending_closures30022026/11/11 23:55:21 INFO Completed upload id=1 objects=15 duration=45.886458ms30032026/11/11 23:55:21 INFO Aborted multipart uploads count=0 kept=030042026/11/11 23:55:21 INFO Received complete upload request method=POST path=/30052026/11/11 23:55:21 INFO Received uploads request method=POST path=/30062026/11/11 23:55:21 INFO Received complete upload request method=POST path=/30072026/11/11 23:55:21 WARN Force mode enabled - objects will be deleted immediately without grace period30082026/11/11 23:55:21 INFO Completed upload id=31 objects=3 duration=768.75µs30092026/11/11 23:55:21 INFO Aborted multipart uploads count=0 kept=030102026/11/11 23:55:21 INFO Completed upload id=28 objects=17 duration=302.708µs30112026/11/11 23:55:21 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=030122026/11/11 23:55:21 INFO Received complete push request method=POST path=/30132026/11/11 23:55:21 INFO Received complete upload request method=POST path=/30142026/11/11 23:55:21 INFO Received complete push request method=POST path=/30152026/11/11 23:55:21 INFO Vacuumed table table=pending_objects30162026/11/11 23:55:21 INFO Completed push id=2 objects=4 duration=603.583µs30172026/11/11 23:55:21 ERROR failed to remove object object=gggggggggggggggggggggggggggggggg.ls error="Access Denied."30182026/11/11 23:55:21 ERROR failed to remove object object=gggggggggggggggggggggggggggggggg.narinfo error="Access Denied."30192026/11/11 23:55:21 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.ls error="Access Denied."30202026/11/11 23:55:21 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.narinfo error="Access Denied."30212026/11/11 23:55:21 ERROR failed to remove object object=nar/gggggggggggggggggggggggggggggggggggggggggggggggggggg.nar.zst error="Access Denied."30222026/11/11 23:55:21 ERROR failed to remove object object=nar/hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.nar.zst error="Access Denied."30232026/11/11 23:55:21 ERROR failed to remove object object=realisations/sha256:gggggggg!out.doi error="Access Denied."30242026/11/11 23:55:21 INFO Vacuumed table table=multipart_uploads30252026/11/11 23:55:21 INFO Completed upload id=22 objects=2 duration=494.291µs30262026/11/11 23:55:21 INFO Completed push id=29 objects=2 duration=444.5µs30272026/11/11 23:55:21 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.ls error="Access Denied."30282026/11/11 23:55:21 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.narinfo error="Access Denied."30292026/11/11 23:55:21 INFO Aborted multipart uploads count=0 kept=030302026/11/11 23:55:21 INFO Vacuumed table table=closures30312026/11/11 23:55:21 INFO Aborted multipart uploads count=0 kept=030322026/11/11 23:55:21 INFO Vacuumed table table=pending_closures30332026/11/11 23:55:21 INFO Received complete upload request method=POST path=/30342026/11/11 23:55:21 INFO Aborted multipart uploads count=0 kept=030352026/11/11 23:55:21 INFO Received complete push request method=POST path=/30362026/11/11 23:55:21 ERROR failed to remove object object=ffffffffffffffffffffffffffffffff.ls error="Access Denied."30372026/11/11 23:55:21 ERROR failed to remove object object=ffffffffffffffffffffffffffffffff.narinfo error="Access Denied."30382026/11/11 23:55:21 ERROR failed to remove object object=nar/dddddddddddddddddddddddddddddddddddddddddddddddddddd.nar.zst error="Access Denied."30392026/11/11 23:55:21 ERROR failed to remove object object=nar/ffffffffffffffffffffffffffffffffffffffffffffffffffff.nar.zst error="Access Denied."30402026/11/11 23:55:21 ERROR failed to remove object object=realisations/sha256:dddddddd!out.doi error="Access Denied."30412026/11/11 23:55:21 ERROR failed to remove object object=aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa.ls error="Access Denied."30422026/11/11 23:55:21 ERROR failed to remove object object=nar/cccccccccccccccccccccccccccccccccccccccccccccccccccc.nar.zst error="Access Denied."30432026/11/11 23:55:21 ERROR failed to remove object object=realisations/sha256:cccccccc!out.doi error="Access Denied."30442026/11/11 23:55:21 ERROR failed to remove object object=cccccccccccccccccccccccccccccccc.ls error="Access Denied."30452026/11/11 23:55:21 ERROR failed to remove object object=cccccccccccccccccccccccccccccccc.narinfo error="Access Denied."30462026/11/11 23:55:21 INFO Completed push id=31 objects=6 duration=460.166µs30472026/11/11 23:55:21 INFO Received push request method=POST path=/30482026/11/11 23:55:21 INFO Completed upload id=17 objects=5 duration=625.583µs30492026/11/11 23:55:21 INFO Vacuumed table table=objects30502026/11/11 23:55:21 WARN Force mode enabled - objects will be deleted immediately without grace period30512026/11/11 23:55:21 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=030522026/11/11 23:55:21 INFO Received uploads request method=POST path=/30532026/11/11 23:55:21 ERROR failed to remove object object=gggggggggggggggggggggggggggggggg.ls error="Access Denied."30542026/11/11 23:55:21 ERROR failed to remove object object=gggggggggggggggggggggggggggggggg.narinfo error="Access Denied."30552026/11/11 23:55:21 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.ls error="Access Denied."30562026/11/11 23:55:21 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.narinfo error="Access Denied."30572026/11/11 23:55:21 ERROR failed to remove object object=nar/gggggggggggggggggggggggggggggggggggggggggggggggggggg.nar.zst error="Access Denied."30582026/11/11 23:55:21 INFO Received complete push request method=POST path=/30592026/11/11 23:55:21 ERROR failed to remove object object=nar/hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.nar.zst error="Access Denied."30602026/11/11 23:55:21 ERROR failed to remove object object=realisations/sha256:gggggggg!out.doi error="Access Denied."30612026/11/11 23:55:21 INFO Completed push id=32 objects=9 duration=317.416µs30622026/11/11 23:55:21 INFO Vacuumed table table=pending_objects30632026/11/11 23:55:21 INFO Vacuumed table table=multipart_uploads30642026/11/11 23:55:21 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=030652026/11/11 23:55:21 INFO Received push request method=POST path=/30662026/11/11 23:55:21 INFO Received push request method=POST path=/30672026/11/11 23:55:21 INFO Vacuumed table table=closures30682026/11/11 23:55:21 INFO Vacuumed table table=pending_closures30692026/11/11 23:55:21 INFO Received uploads request method=POST path=/30702026/11/11 23:55:21 INFO Received push request method=POST path=/30712026/11/11 23:55:21 INFO Vacuumed table table=objects30722026/11/11 23:55:21 INFO Vacuumed table table=pending_objects30732026/11/11 23:55:21 INFO Received push request method=POST path=/30742026/11/11 23:55:21 INFO Received push request method=POST path=/30752026/11/11 23:55:21 INFO Received push request method=POST path=/30762026/11/11 23:55:21 INFO Received uploads request method=POST path=/30772026/11/11 23:55:21 INFO Vacuumed table table=multipart_uploads30782026/11/11 23:55:21 INFO Received push request method=POST path=/30792026/11/11 23:55:21 INFO Vacuumed table table=closures30802026/11/11 23:55:21 INFO Vacuumed table table=pending_closures30812026/11/11 23:55:21 INFO Aborted multipart uploads count=0 kept=030822026/11/11 23:55:21 INFO Received push request method=POST path=/30832026/11/11 23:55:21 INFO Received push request method=POST path=/30842026/11/11 23:55:21 INFO Received push request method=POST path=/30852026/11/11 23:55:21 INFO Aborted multipart uploads count=0 kept=030862026/11/11 23:55:21 INFO Vacuumed table table=objects30872026/11/11 23:55:21 ERROR failed to remove object object=realisations/sha256:gggggggg!out.doi error="Access Denied."30882026/11/11 23:55:21 INFO Aborted multipart uploads count=0 kept=030892026/11/11 23:55:21 INFO Received uploads request method=POST path=/30902026/11/11 23:55:21 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=2 objects-failed-to-delete=030912026/11/11 23:55:21 INFO Received uploads request method=POST path=/30922026/11/11 23:55:21 INFO Received complete upload request method=POST path=/30932026/11/11 23:55:21 INFO Received push request method=POST path=/30942026/11/11 23:55:21 INFO Aborted multipart uploads count=0 kept=030952026/11/11 23:55:21 INFO Received complete push request method=POST path=/30962026/11/11 23:55:21 INFO Completed upload id=18 objects=2 duration=854.041µs30972026/11/11 23:55:21 WARN Force mode enabled - objects will be deleted immediately without grace period30982026/11/11 23:55:21 INFO Received push request method=POST path=/30992026/11/11 23:55:21 INFO Vacuumed table table=pending_closures31002026/11/11 23:55:21 INFO Completed push id=19 objects=3 duration=531.292µs31012026/11/11 23:55:21 INFO Vacuumed table table=pending_objects31022026/11/11 23:55:21 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=031032026/11/11 23:55:21 INFO Received uploads request method=POST path=/31042026/11/11 23:55:21 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=5 objects-failed-to-delete=031052026/11/11 23:55:21 INFO Received complete upload request method=POST path=/31062026/11/11 23:55:21 INFO Received push request method=POST path=/31072026/11/11 23:55:21 INFO Vacuumed table table=pending_objects31082026/11/11 23:55:21 INFO Completed upload id=33 objects=9 duration=255.667µs31092026/11/11 23:55:21 INFO Aborted multipart uploads count=0 kept=031102026/11/11 23:55:21 INFO Vacuumed table table=multipart_uploads31112026/11/11 23:55:21 INFO Vacuumed table table=multipart_uploads31122026/11/11 23:55:21 INFO Aborted multipart uploads count=0 kept=031132026/11/11 23:55:21 WARN Force mode enabled - objects will be deleted immediately without grace period31142026/11/11 23:55:21 INFO Vacuumed table table=pending_closures31152026/11/11 23:55:21 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=031162026/11/11 23:55:21 INFO Received push request method=POST path=/31172026/11/11 23:55:21 INFO Vacuumed table table=closures31182026/11/11 23:55:21 INFO Vacuumed table table=pending_closures31192026/11/11 23:55:21 INFO Vacuumed table table=closures31202026/11/11 23:55:21 INFO Vacuumed table table=objects31212026/11/11 23:55:21 INFO Vacuumed table table=pending_objects31222026/11/11 23:55:21 INFO Aborted multipart uploads count=0 kept=031232026/11/11 23:55:21 INFO Vacuumed table table=pending_closures31242026/11/11 23:55:21 INFO Received push request method=POST path=/31252026/11/11 23:55:21 INFO Vacuumed table table=multipart_uploads31262026/11/11 23:55:21 INFO Vacuumed table table=closures31272026/11/11 23:55:21 INFO Vacuumed table table=objects31282026/11/11 23:55:21 INFO Vacuumed table table=pending_objects31292026/11/11 23:55:21 INFO Vacuumed table table=objects31302026/11/11 23:55:21 INFO Garbage collection completed failed-uploads-deleted=4 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=031312026/11/11 23:55:21 INFO Vacuumed table table=multipart_uploads31322026/11/11 23:55:21 INFO Vacuumed table table=pending_closures31332026/11/11 23:55:21 INFO Vacuumed table table=pending_objects31342026/11/11 23:55:21 INFO Vacuumed table table=closures31352026/11/11 23:55:21 INFO Received complete upload request method=POST path=/31362026/11/11 23:55:21 INFO Vacuumed table table=pending_objects31372026/11/11 23:55:21 INFO Vacuumed table table=multipart_uploads31382026/11/11 23:55:21 INFO Vacuumed table table=multipart_uploads31392026/11/11 23:55:21 INFO Vacuumed table table=closures31402026/11/11 23:55:21 INFO Vacuumed table table=closures31412026/11/11 23:55:21 INFO Completed upload id=10 objects=2 duration=7.9165ms31422026/11/11 23:55:21 INFO Received push request method=POST path=/31432026/11/11 23:55:21 INFO Vacuumed table table=objects31442026/11/11 23:55:21 INFO Vacuumed table table=objects31452026/11/11 23:55:21 INFO Received push request method=POST path=/31462026/11/11 23:55:22 INFO Vacuumed table table=objects31472026/11/11 23:55:22 INFO Received push request method=POST path=/31482026/11/11 23:55:22 INFO Aborted multipart uploads count=0 kept=031492026/11/11 23:55:22 INFO Received complete upload request method=POST path=/31502026/11/11 23:55:22 INFO Received push request method=POST path=/31512026/11/11 23:55:22 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=6 objects-failed-to-delete=031522026/11/11 23:55:22 INFO Received push request method=POST path=/31532026/11/11 23:55:22 INFO Vacuumed table table=pending_closures31542026/11/11 23:55:22 INFO Received uploads request method=POST path=/31552026/11/11 23:55:22 INFO Received uploads request method=POST path=/31562026/11/11 23:55:22 INFO Vacuumed table table=pending_objects31572026/11/11 23:55:22 INFO Received uploads request method=POST path=/31582026/11/11 23:55:22 INFO Received push request method=POST path=/31592026/11/11 23:55:22 INFO Vacuumed table table=multipart_uploads31602026/11/11 23:55:22 INFO Vacuumed table table=closures31612026/11/11 23:55:22 INFO Received complete push request method=POST path=/31622026/11/11 23:55:22 INFO Vacuumed table table=objects31632026/11/11 23:55:22 INFO Completed upload id=1 objects=9 duration=46.928042ms31642026/11/11 23:55:22 INFO Aborted multipart uploads count=0 kept=031652026/11/11 23:55:22 INFO Completed push id=6 objects=7 duration=690.916µs31662026/11/11 23:55:22 INFO Received complete push request method=POST path=/31672026/11/11 23:55:22 INFO Received complete push request method=POST path=/31682026/11/11 23:55:22 INFO Received push request method=POST path=/31692026/11/11 23:55:22 INFO Received push request method=POST path=/31702026/11/11 23:55:22 WARN Force mode enabled - objects will be deleted immediately without grace period31712026/11/11 23:55:22 INFO Completed push id=20 objects=4 duration=290.667µs31722026/11/11 23:55:22 INFO Completed push id=5 objects=8 duration=1.171333ms31732026/11/11 23:55:22 INFO Received uploads request method=POST path=/31742026/11/11 23:55:22 INFO Received uploads request method=POST path=/31752026/11/11 23:55:22 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=031762026/11/11 23:55:22 INFO Received complete upload request method=POST path=/31772026/11/11 23:55:22 INFO Completed upload id=13 objects=7 duration=348.292µs31782026/11/11 23:55:22 INFO Vacuumed table table=pending_closures31792026/11/11 23:55:22 INFO Received push request method=POST path=/31802026/11/11 23:55:22 INFO Received complete upload request method=POST path=/31812026/11/11 23:55:22 INFO Received uploads request method=POST path=/31822026/11/11 23:55:22 INFO Completed upload id=20 objects=4 duration=7.124292ms31832026/11/11 23:55:22 INFO Received push request method=POST path=/31842026/11/11 23:55:22 INFO Aborted multipart uploads count=0 kept=031852026/11/11 23:55:22 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=031862026/11/11 23:55:22 INFO Vacuumed table table=pending_objects31872026/11/11 23:55:22 INFO Vacuumed table table=pending_closures31882026/11/11 23:55:22 INFO Received uploads request method=POST path=/31892026/11/11 23:55:22 INFO Received complete upload request method=POST path=/31902026/11/11 23:55:22 INFO Vacuumed table table=multipart_uploads31912026/11/11 23:55:22 INFO Vacuumed table table=pending_objects31922026/11/11 23:55:22 INFO Vacuumed table table=multipart_uploads31932026/11/11 23:55:22 INFO Vacuumed table table=closures31942026/11/11 23:55:22 INFO Completed upload id=23 objects=7 duration=6.4325ms31952026/11/11 23:55:22 INFO Vacuumed table table=closures31962026/11/11 23:55:22 INFO Vacuumed table table=objects31972026/11/11 23:55:22 INFO Vacuumed table table=objects31982026/11/11 23:55:22 INFO Aborted multipart uploads count=0 kept=031992026/11/11 23:55:22 INFO Received uploads request method=POST path=/32002026/11/11 23:55:22 INFO Received complete push request method=POST path=/32012026/11/11 23:55:22 INFO Aborted multipart uploads count=0 kept=032022026/11/11 23:55:22 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=032032026/11/11 23:55:22 INFO Completed push id=6 objects=26 duration=5.607541ms32042026/11/11 23:55:22 INFO Vacuumed table table=pending_closures32052026/11/11 23:55:22 WARN Force mode enabled - objects will be deleted immediately without grace period32062026/11/11 23:55:22 INFO Received uploads request method=POST path=/32072026/11/11 23:55:22 INFO Vacuumed table table=pending_objects32082026/11/11 23:55:22 INFO Vacuumed table table=multipart_uploads32092026/11/11 23:55:22 INFO Aborted multipart uploads count=0 kept=032102026/11/11 23:55:22 INFO Received push request method=POST path=/32112026/11/11 23:55:22 INFO Vacuumed table table=closures32122026/11/11 23:55:22 WARN Force mode enabled - objects will be deleted immediately without grace period32132026/11/11 23:55:22 INFO Received complete upload request method=POST path=/32142026/11/11 23:55:22 INFO Vacuumed table table=objects32152026/11/11 23:55:22 INFO Completed upload id=8 objects=3 duration=719.75µs32162026/11/11 23:55:22 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=032172026/11/11 23:55:22 INFO Received push request method=POST path=/32182026/11/11 23:55:22 INFO Vacuumed table table=pending_closures32192026/11/11 23:55:22 INFO Received push request method=POST path=/32202026/11/11 23:55:22 INFO Received uploads request method=POST path=/32212026/11/11 23:55:22 INFO Vacuumed table table=pending_objects32222026/11/11 23:55:22 INFO Vacuumed table table=multipart_uploads32232026/11/11 23:55:22 INFO Vacuumed table table=closures32242026/11/11 23:55:22 INFO Vacuumed table table=objects32252026/11/11 23:55:22 INFO Received complete push request method=POST path=/32262026/11/11 23:55:22 INFO Completed push id=6 objects=6 duration=482.833µs32272026/11/11 23:55:22 INFO Received uploads request method=POST path=/32282026/11/11 23:55:22 INFO Received push request method=POST path=/32292026/11/11 23:55:22 INFO Aborted multipart uploads count=0 kept=032302026/11/11 23:55:22 WARN Force mode enabled - objects will be deleted immediately without grace period32312026/11/11 23:55:22 INFO Received complete push request method=POST path=/32322026/11/11 23:55:22 INFO Completed push id=15 objects=24 duration=990.917µs32332026/11/11 23:55:22 INFO Received uploads request method=POST path=/32342026/11/11 23:55:22 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=2 objects-failed-to-delete=032352026/11/11 23:55:22 INFO Received uploads request method=POST path=/32362026/11/11 23:55:22 INFO Vacuumed table table=pending_closures32372026/11/11 23:55:22 INFO Vacuumed table table=pending_objects32382026/11/11 23:55:22 INFO Vacuumed table table=multipart_uploads32392026/11/11 23:55:22 INFO Received uploads request method=POST path=/32402026/11/11 23:55:22 INFO Received complete upload request method=POST path=/32412026/11/11 23:55:22 INFO Completed upload id=22 objects=8 duration=255.875µs32422026/11/11 23:55:22 INFO Received complete push request method=POST path=/32432026/11/11 23:55:22 INFO Completed push id=23 objects=5 duration=443.041µs32442026/11/11 23:55:22 INFO Received complete upload request method=POST path=/32452026/11/11 23:55:22 INFO Completed upload id=24 objects=8 duration=277.375µs32462026/11/11 23:55:22 INFO Received complete upload request method=POST path=/32472026/11/11 23:55:22 INFO Completed upload id=28 objects=5 duration=261.375µs32482026/11/11 23:55:22 INFO Vacuumed table table=closures32492026/11/11 23:55:22 INFO Received complete upload request method=POST path=/32502026/11/11 23:55:22 INFO Received complete push request method=POST path=/32512026/11/11 23:55:22 INFO Completed upload id=6 objects=6 duration=424.25µs32522026/11/11 23:55:22 INFO Vacuumed table table=objects32532026/11/11 23:55:22 INFO Aborted multipart uploads count=0 kept=032542026/11/11 23:55:22 INFO Completed push id=1 objects=5 duration=26.8605ms32552026/11/11 23:55:22 WARN Force mode enabled - objects will be deleted immediately without grace period32562026/11/11 23:55:22 INFO Garbage collection completed failed-uploads-deleted=3 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=032572026/11/11 23:55:22 INFO Received complete push request method=POST path=/32582026/11/11 23:55:22 INFO Vacuumed table table=pending_closures32592026/11/11 23:55:22 INFO Received push request method=POST path=/32602026/11/11 23:55:22 INFO Completed push id=10 objects=15 duration=757.166µs32612026/11/11 23:55:22 INFO Vacuumed table table=pending_objects32622026/11/11 23:55:22 INFO Received uploads request method=POST path=/32632026/11/11 23:55:22 INFO Vacuumed table table=multipart_uploads32642026/11/11 23:55:22 INFO Received complete push request method=POST path=/32652026/11/11 23:55:22 INFO Vacuumed table table=closures32662026/11/11 23:55:22 INFO Completed push id=11 objects=8 duration=7.244667ms32672026/11/11 23:55:22 INFO Received complete upload request method=POST path=/32682026/11/11 23:55:22 INFO Vacuumed table table=objects32692026/11/11 23:55:22 INFO Aborted multipart uploads count=0 kept=032702026/11/11 23:55:22 INFO Aborted multipart uploads count=0 kept=032712026/11/11 23:55:22 INFO Completed upload id=30 objects=5 duration=373.417µs32722026/11/11 23:55:22 INFO Received push request method=POST path=/32732026/11/11 23:55:22 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=032742026/11/11 23:55:22 WARN Force mode enabled - objects will be deleted immediately without grace period32752026/11/11 23:55:22 INFO Received uploads request method=POST path=/32762026/11/11 23:55:22 INFO Vacuumed table table=pending_closures32772026/11/11 23:55:22 INFO Garbage collection completed failed-uploads-deleted=4 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=032782026/11/11 23:55:22 INFO Vacuumed table table=pending_objects32792026/11/11 23:55:22 INFO Aborted multipart uploads count=0 kept=032802026/11/11 23:55:22 INFO Vacuumed table table=multipart_uploads32812026/11/11 23:55:22 WARN Force mode enabled - objects will be deleted immediately without grace period32822026/11/11 23:55:22 INFO Vacuumed table table=closures32832026/11/11 23:55:22 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=032842026/11/11 23:55:22 INFO Vacuumed table table=objects32852026/11/11 23:55:22 INFO Vacuumed table table=pending_closures32862026/11/11 23:55:22 INFO Vacuumed table table=pending_closures32872026/11/11 23:55:22 INFO Vacuumed table table=pending_objects32882026/11/11 23:55:22 INFO Vacuumed table table=multipart_uploads32892026/11/11 23:55:22 INFO Vacuumed table table=closures32902026/11/11 23:55:22 INFO Vacuumed table table=objects32912026/11/11 23:55:22 INFO Vacuumed table table=pending_objects32922026/11/11 23:55:22 INFO Received push request method=POST path=/32932026/11/11 23:55:22 INFO Vacuumed table table=multipart_uploads32942026/11/11 23:55:22 INFO Received uploads request method=POST path=/32952026/11/11 23:55:22 INFO Vacuumed table table=closures32962026/11/11 23:55:22 INFO Vacuumed table table=objects32972026/11/11 23:55:22 INFO Received complete push request method=POST path=/32982026/11/11 23:55:22 INFO Completed push id=31 objects=3 duration=357.625µs32992026/11/11 23:55:22 INFO Received push request method=POST path=/33002026/11/11 23:55:22 INFO Aborted multipart uploads count=0 kept=033012026/11/11 23:55:22 WARN Force mode enabled - objects will be deleted immediately without grace period33022026/11/11 23:55:22 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=033032026/11/11 23:55:22 INFO Vacuumed table table=pending_closures33042026/11/11 23:55:22 INFO Received complete push request method=POST path=/33052026/11/11 23:55:22 INFO Vacuumed table table=pending_objects33062026/11/11 23:55:22 INFO Received uploads request method=POST path=/33072026/11/11 23:55:22 ERROR failed to remove object object=realisations/sha256:iiiiiiii!out.doi error="Access Denied."33082026/11/11 23:55:22 INFO Completed push id=9 objects=4 duration=1.029625ms33092026/11/11 23:55:22 INFO Vacuumed table table=multipart_uploads33102026/11/11 23:55:22 INFO Aborted multipart uploads count=0 kept=033112026/11/11 23:55:22 INFO Vacuumed table table=closures33122026/11/11 23:55:22 WARN Force mode enabled - objects will be deleted immediately without grace period33132026/11/11 23:55:22 ERROR failed to remove object object=ffffffffffffffffffffffffffffffff.ls error="Access Denied."33142026/11/11 23:55:22 INFO Vacuumed table table=objects33152026/11/11 23:55:22 INFO Aborted multipart uploads count=0 kept=033162026/11/11 23:55:22 WARN Force mode enabled - objects will be deleted immediately without grace period33172026/11/11 23:55:22 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=033182026/11/11 23:55:22 INFO Vacuumed table table=pending_closures33192026/11/11 23:55:22 INFO Vacuumed table table=pending_objects33202026/11/11 23:55:22 INFO Vacuumed table table=multipart_uploads33212026/11/11 23:55:22 INFO Vacuumed table table=closures33222026/11/11 23:55:22 INFO Received complete upload request method=POST path=/33232026/11/11 23:55:22 INFO Received push request method=POST path=/33242026/11/11 23:55:22 INFO Vacuumed table table=objects33252026/11/11 23:55:22 INFO Completed upload id=24 objects=18 duration=396.916µs33262026/11/11 23:55:22 INFO Received complete push request method=POST path=/33272026/11/11 23:55:22 INFO Received push request method=POST path=/33282026/11/11 23:55:22 INFO Completed push id=25 objects=2 duration=541.542µs33292026/11/11 23:55:22 INFO Received complete push request method=POST path=/33302026/11/11 23:55:22 INFO Completed push id=27 objects=4 duration=364.958µs33312026/11/11 23:55:23 INFO Received complete upload request method=POST path=/33322026/11/11 23:55:23 INFO Completed upload id=14 objects=8 duration=1.121208ms33332026/11/11 23:55:23 INFO Received uploads request method=POST path=/33342026/11/11 23:55:23 INFO Received complete push request method=POST path=/33352026/11/11 23:55:23 INFO Completed push id=32 objects=6 duration=427.583µs33362026/11/11 23:55:23 INFO Received complete upload request method=POST path=/33372026/11/11 23:55:23 INFO Completed upload id=33 objects=7 duration=288.292µs33382026/11/11 23:55:23 INFO Aborted multipart uploads count=0 kept=033392026/11/11 23:55:23 INFO Received complete upload request method=POST path=/33402026/11/11 23:55:23 WARN Force mode enabled - objects will be deleted immediately without grace period33412026/11/11 23:55:23 INFO Completed upload id=34 objects=3 duration=253µs33422026/11/11 23:55:23 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=033432026/11/11 23:55:23 INFO Received complete push request method=POST path=/33442026/11/11 23:55:23 INFO Completed push id=35 objects=11 duration=348.25µs33452026/11/11 23:55:23 INFO Aborted multipart uploads count=0 kept=033462026/11/11 23:55:23 INFO Vacuumed table table=pending_closures33472026/11/11 23:55:23 WARN Force mode enabled - objects will be deleted immediately without grace period33482026/11/11 23:55:23 INFO Received complete upload request method=POST path=/33492026/11/11 23:55:23 INFO Completed upload id=5 objects=5 duration=557.542µs33502026/11/11 23:55:23 INFO Garbage collection completed failed-uploads-deleted=6 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=033512026/11/11 23:55:23 INFO Received complete push request method=POST path=/33522026/11/11 23:55:23 INFO Vacuumed table table=pending_objects33532026/11/11 23:55:23 INFO Received uploads request method=POST path=/33542026/11/11 23:55:23 INFO Vacuumed table table=multipart_uploads33552026/11/11 23:55:23 INFO Completed push id=13 objects=6 duration=1.217792ms33562026/11/11 23:55:23 ERROR failed to remove object object=bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb.ls error="Access Denied."33572026/11/11 23:55:23 ERROR failed to remove object object=bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb.narinfo error="Access Denied."33582026/11/11 23:55:23 INFO Vacuumed table table=closures33592026/11/11 23:55:23 INFO Received uploads request method=POST path=/33602026/11/11 23:55:23 INFO Received push request method=POST path=/33612026/11/11 23:55:23 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.ls error="Access Denied."33622026/11/11 23:55:23 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.narinfo error="Access Denied."33632026/11/11 23:55:23 ERROR failed to remove object object=ffffffffffffffffffffffffffffffff.ls error="Access Denied."33642026/11/11 23:55:23 ERROR failed to remove object object=ffffffffffffffffffffffffffffffff.narinfo error="Access Denied."33652026/11/11 23:55:23 ERROR failed to remove object object=gggggggggggggggggggggggggggggggg.ls error="Access Denied."33662026/11/11 23:55:23 INFO Vacuumed table table=pending_closures33672026/11/11 23:55:23 INFO Received push request method=POST path=/33682026/11/11 23:55:23 INFO Vacuumed table table=objects33692026/11/11 23:55:23 INFO Received push request method=POST path=/33702026/11/11 23:55:23 ERROR failed to remove object object=gggggggggggggggggggggggggggggggg.narinfo error="Access Denied."33712026/11/11 23:55:23 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.ls error="Access Denied."33722026/11/11 23:55:23 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.narinfo error="Access Denied."33732026/11/11 23:55:23 ERROR failed to remove object object=iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.ls error="Access Denied."33742026/11/11 23:55:23 ERROR failed to remove object object=iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.narinfo error="Access Denied."33752026/11/11 23:55:23 ERROR failed to remove object object=nar/bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb.nar.zst error="Access Denied."33762026/11/11 23:55:23 ERROR failed to remove object object=nar/dddddddddddddddddddddddddddddddddddddddddddddddddddd.nar.zst error="Access Denied."33772026/11/11 23:55:23 ERROR failed to remove object object=nar/ffffffffffffffffffffffffffffffffffffffffffffffffffff.nar.zst error="Access Denied."33782026/11/11 23:55:23 ERROR failed to remove object object=nar/gggggggggggggggggggggggggggggggggggggggggggggggggggg.nar.zst error="Access Denied."33792026/11/11 23:55:23 ERROR failed to remove object object=nar/hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.nar.zst error="Access Denied."33802026/11/11 23:55:23 ERROR failed to remove object object=nar/iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.nar.zst error="Access Denied."33812026/11/11 23:55:23 ERROR failed to remove object object=realisations/sha256:bbbbbbbb!out.doi error="Access Denied."33822026/11/11 23:55:23 ERROR failed to remove object object=realisations/sha256:cccccccc!out.doi error="Access Denied."33832026/11/11 23:55:23 ERROR failed to remove object object=realisations/sha256:ffffffff!out.doi error="Access Denied."33842026/11/11 23:55:23 ERROR failed to remove object object=realisations/sha256:iiiiiiii!out.doi error="Access Denied."33852026/11/11 23:55:23 ERROR failed to remove object object=cccccccccccccccccccccccccccccccc.ls error="Access Denied."33862026/11/11 23:55:23 INFO Received uploads request method=POST path=/33872026/11/11 23:55:23 ERROR failed to remove object object=cccccccccccccccccccccccccccccccc.narinfo error="Access Denied."33882026/11/11 23:55:23 ERROR failed to remove object object=nar/cccccccccccccccccccccccccccccccccccccccccccccccccccc.nar.zst error="Access Denied."33892026/11/11 23:55:23 INFO Received uploads request method=POST path=/33902026/11/11 23:55:23 INFO Received uploads request method=POST path=/33912026/11/11 23:55:23 INFO Received uploads request method=POST path=/33922026/11/11 23:55:23 INFO Vacuumed table table=pending_objects33932026/11/11 23:55:23 INFO Aborted multipart uploads count=0 kept=033942026/11/11 23:55:23 INFO Received push request method=POST path=/33952026/11/11 23:55:23 INFO Vacuumed table table=multipart_uploads33962026/11/11 23:55:23 INFO Received uploads request method=POST path=/33972026/11/11 23:55:23 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=033982026/11/11 23:55:23 INFO Vacuumed table table=closures33992026/11/11 23:55:23 INFO Vacuumed table table=pending_closures34002026/11/11 23:55:23 INFO Vacuumed table table=objects34012026/11/11 23:55:23 INFO Received push request method=POST path=/34022026/11/11 23:55:23 INFO Vacuumed table table=pending_objects34032026/11/11 23:55:23 INFO Vacuumed table table=multipart_uploads34042026/11/11 23:55:23 INFO Received push request method=POST path=/34052026/11/11 23:55:23 INFO Aborted multipart uploads count=0 kept=034062026/11/11 23:55:23 WARN Force mode enabled - objects will be deleted immediately without grace period34072026/11/11 23:55:23 INFO Received complete upload request method=POST path=/34082026/11/11 23:55:23 ERROR failed to remove object object=bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb.ls error="Access Denied."34092026/11/11 23:55:23 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.ls error="Access Denied."34102026/11/11 23:55:23 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.ls error="Access Denied."34112026/11/11 23:55:23 ERROR failed to remove object object=iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.ls error="Access Denied."34122026/11/11 23:55:23 ERROR failed to remove object object=iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.narinfo error="Access Denied."34132026/11/11 23:55:23 ERROR failed to remove object object=nar/iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.nar.zst error="Access Denied."34142026/11/11 23:55:23 ERROR failed to remove object object=realisations/sha256:bbbbbbbb!out.doi error="Access Denied."34152026/11/11 23:55:23 ERROR failed to remove object object=realisations/sha256:ffffffff!out.doi error="Access Denied."34162026/11/11 23:55:23 ERROR failed to remove object object=realisations/sha256:iiiiiiii!out.doi error="Access Denied."34172026/11/11 23:55:23 INFO Completed upload id=23 objects=16 duration=1.314875ms34182026/11/11 23:55:23 INFO Vacuumed table table=closures34192026/11/11 23:55:23 INFO Aborted multipart uploads count=0 kept=034202026/11/11 23:55:23 WARN Force mode enabled - objects will be deleted immediately without grace period34212026/11/11 23:55:23 INFO Vacuumed table table=objects34222026/11/11 23:55:23 INFO Received complete push request method=POST path=/34232026/11/11 23:55:23 INFO Aborted multipart uploads count=0 kept=034242026/11/11 23:55:23 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=9 objects-failed-to-delete=034252026/11/11 23:55:23 WARN Force mode enabled - objects will be deleted immediately without grace period34262026/11/11 23:55:23 INFO Completed push id=28 objects=26 duration=7.470292ms34272026/11/11 23:55:23 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=034282026/11/11 23:55:23 INFO Received complete push request method=POST path=/34292026/11/11 23:55:23 INFO Vacuumed table table=pending_closures34302026/11/11 23:55:23 INFO Vacuumed table table=pending_closures34312026/11/11 23:55:23 INFO Completed push id=30 objects=3 duration=340.75µs34322026/11/11 23:55:23 INFO Vacuumed table table=pending_objects34332026/11/11 23:55:23 INFO Vacuumed table table=multipart_uploads34342026/11/11 23:55:23 INFO Received complete push request method=POST path=/34352026/11/11 23:55:23 INFO Vacuumed table table=closures34362026/11/11 23:55:23 INFO Completed push id=32 objects=19 duration=500.458µs34372026/11/11 23:55:23 INFO Vacuumed table table=pending_objects34382026/11/11 23:55:23 INFO Vacuumed table table=objects34392026/11/11 23:55:23 INFO Vacuumed table table=multipart_uploads34402026/11/11 23:55:23 INFO Aborted multipart uploads count=0 kept=034412026/11/11 23:55:23 INFO Vacuumed table table=closures34422026/11/11 23:55:23 WARN Force mode enabled - objects will be deleted immediately without grace period34432026/11/11 23:55:23 INFO Received uploads request method=POST path=/34442026/11/11 23:55:23 INFO Vacuumed table table=objects34452026/11/11 23:55:23 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=034462026/11/11 23:55:23 INFO Received complete upload request method=POST path=/34472026/11/11 23:55:23 INFO Completed upload id=16 objects=17 duration=2.148ms34482026/11/11 23:55:23 INFO Received push request method=POST path=/34492026/11/11 23:55:23 INFO Aborted multipart uploads count=0 kept=034502026/11/11 23:55:23 WARN Force mode enabled - objects will be deleted immediately without grace period34512026/11/11 23:55:23 INFO Received uploads request method=POST path=/34522026/11/11 23:55:23 INFO Received push request method=POST path=/34532026/11/11 23:55:23 INFO Received uploads request method=POST path=/34542026/11/11 23:55:23 INFO Received complete push request method=POST path=/34552026/11/11 23:55:23 INFO Vacuumed table table=pending_closures34562026/11/11 23:55:23 INFO Received push request method=POST path=/34572026/11/11 23:55:23 INFO Received uploads request method=POST path=/34582026/11/11 23:55:23 INFO Completed push id=1 objects=5 duration=39.135458ms34592026/11/11 23:55:23 INFO Vacuumed table table=pending_objects34602026/11/11 23:55:23 INFO Received push request method=POST path=/34612026/11/11 23:55:23 INFO Vacuumed table table=multipart_uploads34622026/11/11 23:55:23 INFO Vacuumed table table=closures34632026/11/11 23:55:23 INFO Received complete upload request method=POST path=/34642026/11/11 23:55:23 INFO Vacuumed table table=objects34652026/11/11 23:55:23 INFO Completed upload id=19 objects=25 duration=6.212125ms34662026/11/11 23:55:23 INFO Received push request method=POST path=/34672026/11/11 23:55:23 INFO Aborted multipart uploads count=0 kept=034682026/11/11 23:55:23 INFO Received push request method=POST path=/34692026/11/11 23:55:23 WARN Force mode enabled - objects will be deleted immediately without grace period34702026/11/11 23:55:23 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=034712026/11/11 23:55:23 INFO Vacuumed table table=pending_closures34722026/11/11 23:55:23 INFO Vacuumed table table=pending_objects34732026/11/11 23:55:23 INFO Vacuumed table table=multipart_uploads34742026/11/11 23:55:23 INFO Vacuumed table table=closures34752026/11/11 23:55:23 INFO Vacuumed table table=objects34762026/11/11 23:55:23 INFO Received push request method=POST path=/34772026/11/11 23:55:23 INFO Received uploads request method=POST path=/34782026/11/11 23:55:23 INFO Received uploads request method=POST path=/34792026/11/11 23:55:23 INFO Received push request method=POST path=/34802026/11/11 23:55:23 INFO Received push request method=POST path=/34812026/11/11 23:55:23 INFO Received uploads request method=POST path=/34822026/11/11 23:55:23 INFO Received complete push request method=POST path=/34832026/11/11 23:55:23 INFO Completed push id=16 objects=4 duration=1.138958ms34842026/11/11 23:55:23 INFO Received complete push request method=POST path=/34852026/11/11 23:55:23 INFO Received uploads request method=POST path=/34862026/11/11 23:55:23 INFO Received complete upload request method=POST path=/34872026/11/11 23:55:23 INFO Completed upload id=20 objects=5 duration=322.875µs34882026/11/11 23:55:23 INFO Completed push id=5 objects=9 duration=14.063583ms34892026/11/11 23:55:23 INFO Received push request method=POST path=/34902026/11/11 23:55:23 INFO Received uploads request method=POST path=/34912026/11/11 23:55:23 INFO Received push request method=POST path=/34922026/11/11 23:55:23 INFO Received uploads request method=POST path=/34932026/11/11 23:55:23 INFO Received push request method=POST path=/34942026/11/11 23:55:23 INFO Received uploads request method=POST path=/34952026/11/11 23:55:23 INFO Received push request method=POST path=/34962026/11/11 23:55:23 INFO Received push request method=POST path=/34972026/11/11 23:55:23 INFO Received complete push request method=POST path=/34982026/11/11 23:55:23 INFO Received push request method=POST path=/34992026/11/11 23:55:23 INFO Completed push id=17 objects=6 duration=10.362167ms35002026/11/11 23:55:23 INFO Aborted multipart uploads count=0 kept=035012026/11/11 23:55:23 WARN Force mode enabled - objects will be deleted immediately without grace period35022026/11/11 23:55:23 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=035032026/11/11 23:55:23 INFO Aborted multipart uploads count=0 kept=035042026/11/11 23:55:23 INFO Vacuumed table table=pending_closures35052026/11/11 23:55:23 WARN Force mode enabled - objects will be deleted immediately without grace period35062026/11/11 23:55:23 INFO Vacuumed table table=pending_objects35072026/11/11 23:55:23 INFO Garbage collection completed failed-uploads-deleted=3 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=035082026/11/11 23:55:23 INFO Vacuumed table table=multipart_uploads35092026/11/11 23:55:23 INFO Vacuumed table table=pending_closures35102026/11/11 23:55:23 INFO Received complete push request method=POST path=/35112026/11/11 23:55:23 INFO Vacuumed table table=pending_objects35122026/11/11 23:55:23 INFO Completed push id=2 objects=25 duration=830.958µs35132026/11/11 23:55:23 INFO Vacuumed table table=multipart_uploads35142026/11/11 23:55:23 INFO Vacuumed table table=closures35152026/11/11 23:55:23 INFO Received push request method=POST path=/35162026/11/11 23:55:23 INFO Vacuumed table table=objects35172026/11/11 23:55:23 INFO Vacuumed table table=closures35182026/11/11 23:55:23 INFO Aborted multipart uploads count=0 kept=035192026/11/11 23:55:23 INFO Aborted multipart uploads count=0 kept=035202026/11/11 23:55:23 INFO Vacuumed table table=objects35212026/11/11 23:55:24 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=035222026/11/11 23:55:24 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=035232026/11/11 23:55:24 INFO Vacuumed table table=pending_closures35242026/11/11 23:55:24 INFO Received complete push request method=POST path=/35252026/11/11 23:55:24 INFO Aborted multipart uploads count=0 kept=035262026/11/11 23:55:24 INFO Vacuumed table table=pending_objects35272026/11/11 23:55:24 INFO Completed push id=2 objects=4 duration=521.833µs35282026/11/11 23:55:24 INFO Vacuumed table table=multipart_uploads35292026/11/11 23:55:24 INFO Vacuumed table table=closures35302026/11/11 23:55:24 WARN Force mode enabled - objects will be deleted immediately without grace period35312026/11/11 23:55:24 INFO Vacuumed table table=objects35322026/11/11 23:55:24 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=035332026/11/11 23:55:24 INFO Vacuumed table table=pending_closures35342026/11/11 23:55:24 INFO Received push request method=POST path=/35352026/11/11 23:55:24 INFO Received uploads request method=POST path=/35362026/11/11 23:55:24 INFO Vacuumed table table=pending_closures35372026/11/11 23:55:24 INFO Vacuumed table table=pending_objects35382026/11/11 23:55:24 INFO Vacuumed table table=multipart_uploads35392026/11/11 23:55:24 INFO Received uploads request method=POST path=/35402026/11/11 23:55:24 INFO Vacuumed table table=closures35412026/11/11 23:55:24 INFO Received push request method=POST path=/35422026/11/11 23:55:24 INFO Aborted multipart uploads count=0 kept=035432026/11/11 23:55:24 INFO Vacuumed table table=objects35442026/11/11 23:55:24 INFO Vacuumed table table=pending_objects35452026/11/11 23:55:24 INFO Vacuumed table table=multipart_uploads35462026/11/11 23:55:24 WARN Force mode enabled - objects will be deleted immediately without grace period35472026/11/11 23:55:24 INFO Aborted multipart uploads count=0 kept=035482026/11/11 23:55:24 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=035492026/11/11 23:55:24 WARN Force mode enabled - objects will be deleted immediately without grace period35502026/11/11 23:55:24 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=035512026/11/11 23:55:24 INFO Vacuumed table table=pending_closures35522026/11/11 23:55:24 INFO Vacuumed table table=closures35532026/11/11 23:55:24 INFO Vacuumed table table=pending_objects35542026/11/11 23:55:24 INFO Vacuumed table table=multipart_uploads35552026/11/11 23:55:24 INFO Vacuumed table table=closures35562026/11/11 23:55:24 INFO Vacuumed table table=pending_closures35572026/11/11 23:55:24 INFO Vacuumed table table=objects35582026/11/11 23:55:24 INFO Received push request method=POST path=/35592026/11/11 23:55:24 INFO Received push request method=POST path=/35602026/11/11 23:55:24 INFO Received complete push request method=POST path=/35612026/11/11 23:55:24 INFO Vacuumed table table=objects35622026/11/11 23:55:24 INFO Completed push id=31 objects=14 duration=778.875µs35632026/11/11 23:55:24 INFO Received push request method=POST path=/35642026/11/11 23:55:24 INFO Vacuumed table table=pending_objects35652026/11/11 23:55:24 INFO Received uploads request method=POST path=/35662026/11/11 23:55:24 INFO Vacuumed table table=multipart_uploads35672026/11/11 23:55:24 INFO Received push request method=POST path=/35682026/11/11 23:55:24 INFO Received complete push request method=POST path=/35692026/11/11 23:55:24 INFO Received push request method=POST path=/35702026/11/11 23:55:24 INFO Completed push id=4 objects=7 duration=496.875µs35712026/11/11 23:55:24 INFO Received uploads request method=POST path=/35722026/11/11 23:55:24 INFO Aborted multipart uploads count=0 kept=035732026/11/11 23:55:24 INFO Received uploads request method=POST path=/35742026/11/11 23:55:24 INFO Aborted multipart uploads count=0 kept=035752026/11/11 23:55:24 INFO Vacuumed table table=closures35762026/11/11 23:55:24 WARN Force mode enabled - objects will be deleted immediately without grace period35772026/11/11 23:55:24 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=035782026/11/11 23:55:24 INFO Received uploads request method=POST path=/35792026/11/11 23:55:24 INFO Vacuumed table table=pending_closures35802026/11/11 23:55:24 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=035812026/11/11 23:55:24 INFO Received complete push request method=POST path=/35822026/11/11 23:55:24 INFO Completed push id=11 objects=11 duration=1.198792ms35832026/11/11 23:55:24 INFO Vacuumed table table=pending_objects35842026/11/11 23:55:24 INFO Vacuumed table table=objects35852026/11/11 23:55:24 INFO Vacuumed table table=multipart_uploads35862026/11/11 23:55:24 INFO Vacuumed table table=closures35872026/11/11 23:55:24 INFO Vacuumed table table=objects35882026/11/11 23:55:24 INFO Received push request method=POST path=/35892026/11/11 23:55:24 INFO Vacuumed table table=pending_closures35902026/11/11 23:55:24 INFO Received uploads request method=POST path=/35912026/11/11 23:55:24 INFO Received complete push request method=POST path=/35922026/11/11 23:55:24 INFO Completed push id=4 objects=4 duration=1.06825ms35932026/11/11 23:55:24 INFO Vacuumed table table=pending_objects35942026/11/11 23:55:24 INFO Received complete push request method=POST path=/35952026/11/11 23:55:24 INFO Vacuumed table table=multipart_uploads35962026/11/11 23:55:24 INFO Vacuumed table table=closures35972026/11/11 23:55:24 INFO Vacuumed table table=objects35982026/11/11 23:55:24 INFO Completed push id=3 objects=8 duration=31.279375ms35992026/11/11 23:55:24 INFO Received complete push request method=POST path=/36002026/11/11 23:55:24 INFO Completed push id=13 objects=12 duration=1.6905ms36012026/11/11 23:55:24 INFO Received push request method=POST path=/36022026/11/11 23:55:24 INFO Aborted multipart uploads count=0 kept=036032026/11/11 23:55:24 INFO Received complete push request method=POST path=/36042026/11/11 23:55:24 INFO Received push request method=POST path=/36052026/11/11 23:55:24 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=6 objects-failed-to-delete=036062026/11/11 23:55:24 INFO Completed push id=4 objects=7 duration=576.167µs36072026/11/11 23:55:24 INFO Received push request method=POST path=/36082026/11/11 23:55:24 INFO Vacuumed table table=pending_closures36092026/11/11 23:55:24 INFO Received uploads request method=POST path=/36102026/11/11 23:55:24 INFO Vacuumed table table=pending_objects36112026/11/11 23:55:24 INFO Vacuumed table table=multipart_uploads36122026/11/11 23:55:24 INFO Received uploads request method=POST path=/36132026/11/11 23:55:24 INFO Vacuumed table table=closures36142026/11/11 23:55:24 INFO Received push request method=POST path=/36152026/11/11 23:55:24 INFO Vacuumed table table=objects36162026/11/11 23:55:24 INFO Aborted multipart uploads count=0 kept=036172026/11/11 23:55:24 INFO Received complete push request method=POST path=/36182026/11/11 23:55:24 INFO Received push request method=POST path=/36192026/11/11 23:55:24 INFO Completed push id=7 objects=15 duration=832.5µs36202026/11/11 23:55:24 WARN Force mode enabled - objects will be deleted immediately without grace period36212026/11/11 23:55:24 INFO Received push request method=POST path=/36222026/11/11 23:55:24 INFO Received complete push request method=POST path=/36232026/11/11 23:55:24 ERROR failed to remove object object=bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb.ls error="Access Denied."36242026/11/11 23:55:24 ERROR failed to remove object object=gggggggggggggggggggggggggggggggg.ls error="Access Denied."36252026/11/11 23:55:24 INFO Received push request method=POST path=/36262026/11/11 23:55:24 INFO Completed push id=6 objects=6 duration=552.791µs36272026/11/11 23:55:24 ERROR failed to remove object object=gggggggggggggggggggggggggggggggg.narinfo error="Access Denied."36282026/11/11 23:55:24 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.ls error="Access Denied."36292026/11/11 23:55:24 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.narinfo error="Access Denied."36302026/11/11 23:55:24 ERROR failed to remove object object=nar/gggggggggggggggggggggggggggggggggggggggggggggggggggg.nar.zst error="Access Denied."36312026/11/11 23:55:24 ERROR failed to remove object object=nar/hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.nar.zst error="Access Denied."36322026/11/11 23:55:24 ERROR failed to remove object object=realisations/sha256:bbbbbbbb!out.doi error="Access Denied."36332026/11/11 23:55:24 ERROR failed to remove object object=realisations/sha256:dddddddd!out.doi error="Access Denied."36342026/11/11 23:55:24 ERROR failed to remove object object=realisations/sha256:gggggggg!out.doi error="Access Denied."36352026/11/11 23:55:24 ERROR failed to remove object object=realisations/sha256:hhhhhhhh!out.doi error="Access Denied."36362026/11/11 23:55:24 INFO Received push request method=POST path=/36372026/11/11 23:55:24 INFO Received push request method=POST path=/36382026/11/11 23:55:24 INFO Received complete push request method=POST path=/36392026/11/11 23:55:24 INFO Completed push id=8 objects=2 duration=626.833µs36402026/11/11 23:55:24 INFO Received uploads request method=POST path=/36412026/11/11 23:55:24 INFO Received uploads request method=POST path=/36422026/11/11 23:55:24 INFO Received complete upload request method=POST path=/36432026/11/11 23:55:24 INFO Completed upload id=6 objects=7 duration=1.256875ms36442026/11/11 23:55:24 INFO Received push request method=POST path=/36452026/11/11 23:55:24 INFO Received complete push request method=POST path=/36462026/11/11 23:55:24 INFO Completed push id=7 objects=7 duration=1.547209ms36472026/11/11 23:55:24 INFO Received complete push request method=POST path=/36482026/11/11 23:55:24 INFO Completed push id=12 objects=6 duration=588.833µs36492026/11/11 23:55:25 INFO Received complete upload request method=POST path=/36502026/11/11 23:55:25 INFO Received complete push request method=POST path=/36512026/11/11 23:55:25 INFO Completed upload id=6 objects=24 duration=3.818042ms36522026/11/11 23:55:25 INFO Completed push id=4 objects=6 duration=1.771625ms36532026/11/11 23:55:25 INFO Received push request method=POST path=/36542026/11/11 23:55:25 INFO Received complete push request method=POST path=/36552026/11/11 23:55:25 INFO Received complete push request method=POST path=/36562026/11/11 23:55:25 INFO Completed push id=7 objects=27 duration=1.881625ms36572026/11/11 23:55:25 INFO Completed push id=1 objects=24 duration=42.361041ms36582026/11/11 23:55:25 INFO Received complete push request method=POST path=/36592026/11/11 23:55:25 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=8 objects-deleted-after-grace-period=8 objects-failed-to-delete=036602026/11/11 23:55:25 INFO Completed push id=8 objects=6 duration=1.284333ms36612026/11/11 23:55:25 INFO Vacuumed table table=pending_closures36622026/11/11 23:55:25 INFO Received complete push request method=POST path=/36632026/11/11 23:55:25 INFO Vacuumed table table=pending_objects36642026/11/11 23:55:25 INFO Completed push id=19 objects=6 duration=1.974708ms36652026/11/11 23:55:25 INFO Aborted multipart uploads count=0 kept=036662026/11/11 23:55:25 INFO Vacuumed table table=multipart_uploads36672026/11/11 23:55:25 INFO Vacuumed table table=closures36682026/11/11 23:55:25 INFO Vacuumed table table=objects36692026/11/11 23:55:25 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=036702026/11/11 23:55:25 INFO Aborted multipart uploads count=0 kept=036712026/11/11 23:55:25 INFO Aborted multipart uploads count=0 kept=036722026/11/11 23:55:25 WARN Force mode enabled - objects will be deleted immediately without grace period36732026/11/11 23:55:25 WARN Force mode enabled - objects will be deleted immediately without grace period36742026/11/11 23:55:25 INFO Received complete push request method=POST path=/36752026/11/11 23:55:25 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=036762026/11/11 23:55:25 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.ls error="Access Denied."36772026/11/11 23:55:25 ERROR failed to remove object object=realisations/sha256:bbbbbbbb!out.doi error="Access Denied."36782026/11/11 23:55:25 INFO Completed push id=17 objects=22 duration=667.875µs36792026/11/11 23:55:25 ERROR failed to remove object object=bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb.ls error="Access Denied."36802026/11/11 23:55:25 INFO Vacuumed table table=pending_closures36812026/11/11 23:55:25 INFO Aborted multipart uploads count=0 kept=036822026/11/11 23:55:25 INFO Vacuumed table table=pending_objects36832026/11/11 23:55:25 WARN Force mode enabled - objects will be deleted immediately without grace period36842026/11/11 23:55:25 INFO Vacuumed table table=multipart_uploads36852026/11/11 23:55:25 INFO Vacuumed table table=closures36862026/11/11 23:55:25 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.ls error="Access Denied."36872026/11/11 23:55:25 ERROR failed to remove object object=realisations/sha256:bbbbbbbb!out.doi error="Access Denied."36882026/11/11 23:55:25 INFO Vacuumed table table=pending_closures36892026/11/11 23:55:25 ERROR failed to remove object object=bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb.ls error="Access Denied."36902026/11/11 23:55:25 INFO Vacuumed table table=objects36912026/11/11 23:55:25 INFO Received complete push request method=POST path=/36922026/11/11 23:55:25 INFO Completed push id=7 objects=7 duration=1.16275ms36932026/11/11 23:55:25 INFO Received complete upload request method=POST path=/36942026/11/11 23:55:25 INFO Received complete upload request method=POST path=/36952026/11/11 23:55:25 INFO Completed upload id=9 objects=3 duration=465.041µs36962026/11/11 23:55:25 INFO Received uploads request method=POST path=/36972026/11/11 23:55:25 INFO Received complete upload request method=POST path=/36982026/11/11 23:55:25 INFO Completed upload id=15 objects=3 duration=815.375µs36992026/11/11 23:55:25 INFO Completed upload id=9 objects=2 duration=661.208µs37002026/11/11 23:55:25 INFO Received push request method=POST path=/37012026/11/11 23:55:25 INFO Received push request method=POST path=/37022026/11/11 23:55:25 INFO Received complete push request method=POST path=/37032026/11/11 23:55:25 INFO Aborted multipart uploads count=0 kept=037042026/11/11 23:55:25 INFO Vacuumed table table=pending_objects37052026/11/11 23:55:25 INFO Completed push id=8 objects=3 duration=577.292µs37062026/11/11 23:55:25 ERROR failed to remove object object=aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa.ls error="Access Denied."37072026/11/11 23:55:25 ERROR failed to remove object object=realisations/sha256:iiiiiiii!out.doi error="Access Denied."37082026/11/11 23:55:25 INFO Vacuumed table table=multipart_uploads37092026/11/11 23:55:25 INFO Received push request method=POST path=/37102026/11/11 23:55:25 INFO Received uploads request method=POST path=/37112026/11/11 23:55:25 INFO Received uploads request method=POST path=/37122026/11/11 23:55:25 INFO Received uploads request method=POST path=/37132026/11/11 23:55:25 INFO Received complete upload request method=POST path=/37142026/11/11 23:55:25 INFO Completed upload id=13 objects=10 duration=969.792µs37152026/11/11 23:55:25 INFO Received complete push request method=POST path=/37162026/11/11 23:55:25 INFO Received complete upload request method=POST path=/37172026/11/11 23:55:25 INFO Completed push id=12 objects=3 duration=746.584µs37182026/11/11 23:55:25 INFO Aborted multipart uploads count=0 kept=037192026/11/11 23:55:25 INFO Vacuumed table table=closures37202026/11/11 23:55:25 INFO Completed upload id=3 objects=9 duration=420.375µs37212026/11/11 23:55:25 WARN Force mode enabled - objects will be deleted immediately without grace period37222026/11/11 23:55:25 INFO Received uploads request method=POST path=/37232026/11/11 23:55:25 INFO Received uploads request method=POST path=/37242026/11/11 23:55:25 INFO Vacuumed table table=objects37252026/11/11 23:55:25 INFO Received push request method=POST path=/37262026/11/11 23:55:25 INFO Received uploads request method=POST path=/37272026/11/11 23:55:25 INFO Received complete upload request method=POST path=/37282026/11/11 23:55:25 INFO Received push request method=POST path=/37292026/11/11 23:55:25 INFO Completed upload id=16 objects=23 duration=414.833µs37302026/11/11 23:55:25 INFO Received uploads request method=POST path=/37312026/11/11 23:55:25 INFO Received complete upload request method=POST path=/37322026/11/11 23:55:25 INFO Completed upload id=15 objects=6 duration=266.208µs37332026/11/11 23:55:25 INFO Received complete push request method=POST path=/37342026/11/11 23:55:25 INFO Received uploads request method=POST path=/37352026/11/11 23:55:25 INFO Received complete push request method=POST path=/37362026/11/11 23:55:25 INFO Completed push id=19 objects=14 duration=1.255292ms37372026/11/11 23:55:25 INFO Received uploads request method=POST path=/37382026/11/11 23:55:25 INFO Completed push id=5 objects=6 duration=713.708µs37392026/11/11 23:55:25 INFO Aborted multipart uploads count=0 kept=037402026/11/11 23:55:25 INFO Received complete push request method=POST path=/37412026/11/11 23:55:25 INFO Aborted multipart uploads count=0 kept=037422026/11/11 23:55:25 WARN Force mode enabled - objects will be deleted immediately without grace period37432026/11/11 23:55:25 INFO Completed push id=13 objects=22 duration=342.084µs37442026/11/11 23:55:25 WARN Force mode enabled - objects will be deleted immediately without grace period37452026/11/11 23:55:25 INFO Received complete push request method=POST path=/37462026/11/11 23:55:25 INFO Completed push id=21 objects=6 duration=262.666µs37472026/11/11 23:55:25 INFO Received complete upload request method=POST path=/37482026/11/11 23:55:25 INFO Received complete upload request method=POST path=/37492026/11/11 23:55:25 INFO Completed upload id=22 objects=7 duration=259.084µs37502026/11/11 23:55:25 INFO Received complete upload request method=POST path=/37512026/11/11 23:55:25 INFO Completed upload id=17 objects=7 duration=453.709µs37522026/11/11 23:55:25 INFO Completed upload id=18 objects=11 duration=616.375µs37532026/11/11 23:55:25 INFO Received complete push request method=POST path=/37542026/11/11 23:55:25 INFO Aborted multipart uploads count=0 kept=037552026/11/11 23:55:25 INFO Completed push id=24 objects=4 duration=347.5µs37562026/11/11 23:55:25 ERROR failed to remove object object=aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa.ls error="Access Denied."37572026/11/11 23:55:25 ERROR failed to remove object object=realisations/sha256:iiiiiiii!out.doi error="Access Denied."37582026/11/11 23:55:25 INFO Received uploads request method=POST path=/37592026/11/11 23:55:25 INFO Received push request method=POST path=/37602026/11/11 23:55:25 INFO Received complete push request method=POST path=/37612026/11/11 23:55:25 INFO Completed push id=25 objects=9 duration=562.791µs37622026/11/11 23:55:25 INFO Aborted multipart uploads count=0 kept=037632026/11/11 23:55:25 INFO Received complete upload request method=POST path=/37642026/11/11 23:55:25 WARN Force mode enabled - objects will be deleted immediately without grace period37652026/11/11 23:55:25 INFO Completed upload id=26 objects=3 duration=202.083µs37662026/11/11 23:55:25 INFO Received complete upload request method=POST path=/37672026/11/11 23:55:25 INFO Completed upload id=5 objects=7 duration=898.459µs37682026/11/11 23:55:25 INFO Received complete upload request method=POST path=/37692026/11/11 23:55:25 INFO Completed upload id=14 objects=6 duration=346.5µs37702026/11/11 23:55:25 INFO Received push request method=POST path=/37712026/11/11 23:55:26 INFO Received complete upload request method=POST path=/37722026/11/11 23:55:26 INFO Completed upload id=6 objects=9 duration=514.791µs37732026/11/11 23:55:26 INFO Received uploads request method=POST path=/37742026/11/11 23:55:26 INFO Received complete upload request method=POST path=/37752026/11/11 23:55:26 INFO Received complete upload request method=POST path=/37762026/11/11 23:55:26 INFO Completed upload id=27 objects=7 duration=267.375µs37772026/11/11 23:55:26 INFO Completed upload id=3 objects=5 duration=421.708µs37782026/11/11 23:55:26 INFO Received complete push request method=POST path=/37792026/11/11 23:55:26 INFO Received complete upload request method=POST path=/37802026/11/11 23:55:26 INFO Received complete upload request method=POST path=/37812026/11/11 23:55:26 INFO Completed upload id=7 objects=3 duration=515.666µs37822026/11/11 23:55:26 INFO Completed upload id=28 objects=3 duration=728.25µs37832026/11/11 23:55:26 INFO Completed push id=17 objects=22 duration=1.193875ms37842026/11/11 23:55:26 INFO Aborted multipart uploads count=0 kept=037852026/11/11 23:55:26 INFO Received uploads request method=POST path=/37862026/11/11 23:55:26 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=037872026/11/11 23:55:26 INFO Vacuumed table table=pending_closures37882026/11/11 23:55:26 INFO Received push request method=POST path=/37892026/11/11 23:55:26 INFO Received complete push request method=POST path=/37902026/11/11 23:55:26 INFO Completed push id=19 objects=14 duration=454.459µs37912026/11/11 23:55:26 INFO Vacuumed table table=pending_objects37922026/11/11 23:55:26 INFO Vacuumed table table=multipart_uploads37932026/11/11 23:55:26 INFO Vacuumed table table=closures37942026/11/11 23:55:26 INFO Received uploads request method=POST path=/37952026/11/11 23:55:26 INFO Vacuumed table table=objects37962026/11/11 23:55:26 INFO Received complete push request method=POST path=/37972026/11/11 23:55:26 INFO Received complete upload request method=POST path=/37982026/11/11 23:55:26 INFO Completed push id=29 objects=23 duration=403.375µs37992026/11/11 23:55:26 INFO Completed upload id=10 objects=23 duration=448.25µs38002026/11/11 23:55:26 INFO Received complete push request method=POST path=/38012026/11/11 23:55:26 ERROR failed to remove object object=realisations/sha256:cccccccc!out.doi error="Access Denied."38022026/11/11 23:55:26 INFO Received uploads request method=POST path=/38032026/11/11 23:55:26 INFO Received complete push request method=POST path=/38042026/11/11 23:55:26 INFO Completed push id=30 objects=6 duration=296.792µs38052026/11/11 23:55:26 INFO Received uploads request method=POST path=/38062026/11/11 23:55:26 INFO Received complete push request method=POST path=/38072026/11/11 23:55:26 INFO Completed push id=15 objects=7 duration=727.292µs38082026/11/11 23:55:26 INFO Completed push id=18 objects=23 duration=442.541µs38092026/11/11 23:55:26 INFO Received uploads request method=POST path=/38102026/11/11 23:55:26 INFO Received uploads request method=POST path=/38112026/11/11 23:55:26 INFO Received uploads request method=POST path=/38122026/11/11 23:55:26 INFO Received push request method=POST path=/38132026/11/11 23:55:26 INFO Received complete upload request method=POST path=/38142026/11/11 23:55:26 INFO Completed upload id=22 objects=2 duration=296.375µs38152026/11/11 23:55:26 INFO Received complete push request method=POST path=/38162026/11/11 23:55:26 INFO Aborted multipart uploads count=0 kept=038172026/11/11 23:55:26 INFO Completed push id=2 objects=10 duration=1.0305ms38182026/11/11 23:55:26 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=038192026/11/11 23:55:26 INFO Vacuumed table table=pending_closures38202026/11/11 23:55:26 INFO Vacuumed table table=pending_objects38212026/11/11 23:55:26 INFO Received complete upload request method=POST path=/38222026/11/11 23:55:26 INFO Received push request method=POST path=/38232026/11/11 23:55:26 INFO Vacuumed table table=multipart_uploads38242026/11/11 23:55:26 INFO Completed upload id=11 objects=6 duration=342.708µs38252026/11/11 23:55:26 INFO Received complete push request method=POST path=/38262026/11/11 23:55:26 INFO Received complete push request method=POST path=/38272026/11/11 23:55:26 INFO Received complete push request method=POST path=/38282026/11/11 23:55:26 INFO Vacuumed table table=closures38292026/11/11 23:55:26 INFO Received push request method=POST path=/38302026/11/11 23:55:26 INFO Completed push id=8 objects=7 duration=1.009042ms38312026/11/11 23:55:26 INFO Completed push id=15 objects=4 duration=355.125µs38322026/11/11 23:55:26 INFO Received complete upload request method=POST path=/38332026/11/11 23:55:26 INFO Completed push id=33 objects=3 duration=335.167µs38342026/11/11 23:55:26 INFO Vacuumed table table=objects38352026/11/11 23:55:26 INFO Received uploads request method=POST path=/38362026/11/11 23:55:26 INFO Completed upload id=20 objects=6 duration=571.125µs38372026/11/11 23:55:26 INFO Received push request method=POST path=/38382026/11/11 23:55:26 INFO Received complete push request method=POST path=/38392026/11/11 23:55:26 INFO Received uploads request method=POST path=/38402026/11/11 23:55:26 INFO Received uploads request method=POST path=/38412026/11/11 23:55:26 INFO Received uploads request method=POST path=/38422026/11/11 23:55:26 INFO Completed push id=34 objects=6 duration=289.208µs38432026/11/11 23:55:26 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=11 objects-failed-to-delete=038442026/11/11 23:55:26 INFO Received push request method=POST path=/38452026/11/11 23:55:26 INFO Received complete upload request method=POST path=/38462026/11/11 23:55:26 INFO Received complete push request method=POST path=/38472026/11/11 23:55:26 INFO Vacuumed table table=pending_closures38482026/11/11 23:55:26 INFO Received complete push request method=POST path=/38492026/11/11 23:55:26 INFO Received push request method=POST path=/38502026/11/11 23:55:26 INFO Completed upload id=21 objects=2 duration=265.708µs38512026/11/11 23:55:26 INFO Completed push id=11 objects=9 duration=465µs38522026/11/11 23:55:26 INFO Completed push id=35 objects=8 duration=472.792µs38532026/11/11 23:55:26 INFO Received push request method=POST path=/38542026/11/11 23:55:26 INFO Vacuumed table table=pending_objects38552026/11/11 23:55:26 INFO Received uploads request method=POST path=/38562026/11/11 23:55:26 INFO Received push request method=POST path=/38572026/11/11 23:55:26 INFO Received complete upload request method=POST path=/38582026/11/11 23:55:26 INFO Vacuumed table table=multipart_uploads38592026/11/11 23:55:26 INFO Aborted multipart uploads count=0 kept=038602026/11/11 23:55:26 INFO Received complete upload request method=POST path=/38612026/11/11 23:55:26 INFO Aborted multipart uploads count=0 kept=038622026/11/11 23:55:26 INFO Received push request method=POST path=/38632026/11/11 23:55:26 INFO Completed upload id=36 objects=9 duration=199.5µs38642026/11/11 23:55:26 INFO Received complete push request method=POST path=/38652026/11/11 23:55:26 INFO Vacuumed table table=closures38662026/11/11 23:55:26 INFO Completed upload id=7 objects=10 duration=413.375µs38672026/11/11 23:55:26 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=038682026/11/11 23:55:26 INFO Received complete upload request method=POST path=/38692026/11/11 23:55:26 WARN Force mode enabled - objects will be deleted immediately without grace period38702026/11/11 23:55:26 INFO Vacuumed table table=pending_closures38712026/11/11 23:55:26 INFO Completed upload id=3 objects=24 duration=5.686458ms38722026/11/11 23:55:26 INFO Completed push id=12 objects=15 duration=5.755083ms38732026/11/11 23:55:26 INFO Vacuumed table table=objects38742026/11/11 23:55:26 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=038752026/11/11 23:55:26 INFO Garbage collection completed failed-uploads-deleted=3 old-closures-deleted=1 objects-marked-for-deletion=3 objects-deleted-after-grace-period=3 objects-failed-to-delete=038762026/11/11 23:55:26 INFO Vacuumed table table=pending_closures38772026/11/11 23:55:26 INFO Aborted multipart uploads count=0 kept=038782026/11/11 23:55:26 INFO Received push request method=POST path=/38792026/11/11 23:55:26 INFO Received push request method=POST path=/38802026/11/11 23:55:26 INFO Received uploads request method=POST path=/38812026/11/11 23:55:26 INFO Vacuumed table table=pending_objects38822026/11/11 23:55:26 INFO Vacuumed table table=pending_closures38832026/11/11 23:55:26 INFO Vacuumed table table=pending_objects38842026/11/11 23:55:26 WARN Force mode enabled - objects will be deleted immediately without grace period38852026/11/11 23:55:26 INFO Received push request method=POST path=/38862026/11/11 23:55:26 INFO Vacuumed table table=multipart_uploads38872026/11/11 23:55:26 INFO Aborted multipart uploads count=0 kept=038882026/11/11 23:55:26 INFO Vacuumed table table=multipart_uploads38892026/11/11 23:55:26 INFO Received complete upload request method=POST path=/38902026/11/11 23:55:26 INFO Vacuumed table table=closures38912026/11/11 23:55:26 INFO Vacuumed table table=pending_objects38922026/11/11 23:55:26 WARN Force mode enabled - objects will be deleted immediately without grace period38932026/11/11 23:55:26 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=038942026/11/11 23:55:26 INFO Vacuumed table table=closures38952026/11/11 23:55:26 INFO Completed upload id=9 objects=16 duration=518.667µs38962026/11/11 23:55:26 INFO Vacuumed table table=multipart_uploads38972026/11/11 23:55:26 INFO Vacuumed table table=objects38982026/11/11 23:55:26 INFO Vacuumed table table=objects38992026/11/11 23:55:26 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=039002026/11/11 23:55:26 INFO Received push request method=POST path=/39012026/11/11 23:55:26 INFO Vacuumed table table=closures39022026/11/11 23:55:26 INFO Vacuumed table table=pending_closures39032026/11/11 23:55:26 INFO Received uploads request method=POST path=/39042026/11/11 23:55:26 INFO Received uploads request method=POST path=/39052026/11/11 23:55:26 INFO Received push request method=POST path=/39062026/11/11 23:55:26 INFO Vacuumed table table=pending_closures39072026/11/11 23:55:26 INFO Vacuumed table table=objects39082026/11/11 23:55:26 INFO Received push request method=POST path=/39092026/11/11 23:55:26 INFO Vacuumed table table=pending_objects39102026/11/11 23:55:26 INFO Received complete push request method=POST path=/39112026/11/11 23:55:26 INFO Received push request method=POST path=/39122026/11/11 23:55:26 INFO Vacuumed table table=multipart_uploads39132026/11/11 23:55:26 INFO Completed push id=10 objects=3 duration=769µs39142026/11/11 23:55:26 INFO Received uploads request method=POST path=/39152026/11/11 23:55:26 INFO Received complete push request method=POST path=/39162026/11/11 23:55:26 INFO Received push request method=POST path=/39172026/11/11 23:55:26 INFO Vacuumed table table=closures39182026/11/11 23:55:26 INFO Received push request method=POST path=/39192026/11/11 23:55:26 INFO Received uploads request method=POST path=/39202026/11/11 23:55:26 INFO Completed push id=24 objects=24 duration=878.459µs39212026/11/11 23:55:26 INFO Vacuumed table table=objects39222026/11/11 23:55:26 INFO Vacuumed table table=pending_objects39232026/11/11 23:55:26 INFO Received complete push request method=POST path=/39242026/11/11 23:55:26 INFO Received complete upload request method=POST path=/39252026/11/11 23:55:26 INFO Aborted multipart uploads count=0 kept=039262026/11/11 23:55:26 INFO Vacuumed table table=multipart_uploads39272026/11/11 23:55:26 INFO Received push request method=POST path=/39282026/11/11 23:55:26 INFO Completed push id=14 objects=4 duration=2.208916ms39292026/11/11 23:55:26 INFO Received uploads request method=POST path=/39302026/11/11 23:55:26 INFO Received uploads request method=POST path=/39312026/11/11 23:55:26 INFO Completed upload id=15 objects=6 duration=209.917µs39322026/11/11 23:55:26 INFO Received uploads request method=POST path=/39332026/11/11 23:55:26 INFO Vacuumed table table=closures39342026/11/11 23:55:26 WARN Force mode enabled - objects will be deleted immediately without grace period39352026/11/11 23:55:26 INFO Aborted multipart uploads count=0 kept=039362026/11/11 23:55:26 INFO Received push request method=POST path=/39372026/11/11 23:55:26 INFO Vacuumed table table=objects39382026/11/11 23:55:26 INFO Received complete push request method=POST path=/39392026/11/11 23:55:26 WARN Force mode enabled - objects will be deleted immediately without grace period39402026/11/11 23:55:26 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=039412026/11/11 23:55:26 INFO Aborted multipart uploads count=0 kept=039422026/11/11 23:55:26 INFO Vacuumed table table=pending_closures39432026/11/11 23:55:26 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=039442026/11/11 23:55:26 INFO Received uploads request method=POST path=/39452026/11/11 23:55:26 INFO Received push request method=POST path=/39462026/11/11 23:55:26 INFO Vacuumed table table=pending_closures39472026/11/11 23:55:26 INFO Received push request method=POST path=/39482026/11/11 23:55:26 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=039492026/11/11 23:55:26 INFO Received uploads request method=POST path=/39502026/11/11 23:55:26 INFO Vacuumed table table=pending_objects39512026/11/11 23:55:26 INFO Vacuumed table table=pending_objects39522026/11/11 23:55:26 INFO Aborted multipart uploads count=0 kept=039532026/11/11 23:55:26 INFO Received complete upload request method=POST path=/39542026/11/11 23:55:26 INFO Vacuumed table table=multipart_uploads39552026/11/11 23:55:26 INFO Vacuumed table table=multipart_uploads39562026/11/11 23:55:26 INFO Completed push id=3 objects=22 duration=25.628833ms39572026/11/11 23:55:26 INFO Vacuumed table table=pending_closures39582026/11/11 23:55:26 INFO Completed upload id=23 objects=15 duration=733.875µs39592026/11/11 23:55:26 WARN Force mode enabled - objects will be deleted immediately without grace period39602026/11/11 23:55:26 INFO Vacuumed table table=closures39612026/11/11 23:55:26 INFO Vacuumed table table=closures39622026/11/11 23:55:26 INFO Vacuumed table table=pending_objects39632026/11/11 23:55:26 INFO Received push request method=POST path=/39642026/11/11 23:55:26 INFO Received push request method=POST path=/39652026/11/11 23:55:26 INFO Vacuumed table table=multipart_uploads39662026/11/11 23:55:26 INFO Vacuumed table table=objects39672026/11/11 23:55:26 INFO Vacuumed table table=objects39682026/11/11 23:55:26 INFO Vacuumed table table=closures39692026/11/11 23:55:26 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=039702026/11/11 23:55:26 INFO Vacuumed table table=objects39712026/11/11 23:55:26 INFO Aborted multipart uploads count=0 kept=039722026/11/11 23:55:26 INFO Vacuumed table table=pending_closures39732026/11/11 23:55:26 INFO Received uploads request method=POST path=/39742026/11/11 23:55:26 INFO Received uploads request method=POST path=/39752026/11/11 23:55:26 WARN Force mode enabled - objects will be deleted immediately without grace period39762026/11/11 23:55:26 INFO Received push request method=POST path=/39772026/11/11 23:55:26 INFO Received uploads request method=POST path=/39782026/11/11 23:55:26 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=039792026/11/11 23:55:26 INFO Vacuumed table table=pending_objects39802026/11/11 23:55:26 INFO Received uploads request method=POST path=/39812026/11/11 23:55:26 INFO Received complete push request method=POST path=/39822026/11/11 23:55:26 INFO Vacuumed table table=pending_closures39832026/11/11 23:55:26 INFO Vacuumed table table=multipart_uploads39842026/11/11 23:55:26 INFO Received push request method=POST path=/39852026/11/11 23:55:26 INFO Completed push id=14 objects=3 duration=309.583µs39862026/11/11 23:55:26 INFO Received push request method=POST path=/39872026/11/11 23:55:26 INFO Vacuumed table table=closures39882026/11/11 23:55:26 INFO Vacuumed table table=pending_objects39892026/11/11 23:55:26 INFO Received complete upload request method=POST path=/39902026/11/11 23:55:26 INFO Received uploads request method=POST path=/39912026/11/11 23:55:26 INFO Vacuumed table table=objects39922026/11/11 23:55:26 INFO Vacuumed table table=multipart_uploads39932026/11/11 23:55:26 INFO Received uploads request method=POST path=/39942026/11/11 23:55:26 INFO Received complete upload request method=POST path=/39952026/11/11 23:55:26 INFO Completed upload id=19 objects=6 duration=407.375µs39962026/11/11 23:55:26 INFO Aborted multipart uploads count=0 kept=039972026/11/11 23:55:26 INFO Vacuumed table table=closures39982026/11/11 23:55:26 INFO Completed upload id=20 objects=4 duration=261.75µs39992026/11/11 23:55:26 WARN Force mode enabled - objects will be deleted immediately without grace period40002026/11/11 23:55:26 INFO Vacuumed table table=objects40012026/11/11 23:55:27 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=040022026/11/11 23:55:27 INFO Vacuumed table table=pending_closures40032026/11/11 23:55:27 INFO Received uploads request method=POST path=/40042026/11/11 23:55:27 INFO Vacuumed table table=pending_objects40052026/11/11 23:55:27 INFO Aborted multipart uploads count=0 kept=040062026/11/11 23:55:27 INFO Vacuumed table table=multipart_uploads40072026/11/11 23:55:27 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=040082026/11/11 23:55:27 INFO Vacuumed table table=closures40092026/11/11 23:55:27 INFO Vacuumed table table=objects40102026/11/11 23:55:27 INFO Vacuumed table table=pending_closures40112026/11/11 23:55:27 INFO Vacuumed table table=pending_objects40122026/11/11 23:55:27 INFO Received push request method=POST path=/40132026/11/11 23:55:27 INFO Received complete upload request method=POST path=/40142026/11/11 23:55:27 INFO Vacuumed table table=multipart_uploads40152026/11/11 23:55:27 INFO Received complete upload request method=POST path=/40162026/11/11 23:55:27 INFO Vacuumed table table=closures40172026/11/11 23:55:27 INFO Completed upload id=17 objects=6 duration=6.510875ms40182026/11/11 23:55:27 INFO Completed upload id=22 objects=7 duration=6.208833ms40192026/11/11 23:55:27 INFO Vacuumed table table=objects40202026/11/11 23:55:27 INFO Received push request method=POST path=/40212026/11/11 23:55:27 INFO Received complete push request method=POST path=/40222026/11/11 23:55:27 INFO Received push request method=POST path=/40232026/11/11 23:55:27 INFO Completed push id=24 objects=9 duration=655.75µs40242026/11/11 23:55:27 INFO Received uploads request method=POST path=/40252026/11/11 23:55:27 INFO Received push request method=POST path=/40262026/11/11 23:55:27 INFO Received push request method=POST path=/40272026/11/11 23:55:27 INFO Received complete upload request method=POST path=/40282026/11/11 23:55:27 INFO Received push request method=POST path=/40292026/11/11 23:55:27 INFO Received uploads request method=POST path=/40302026/11/11 23:55:27 INFO Completed upload id=2 objects=2 duration=394.292µs40312026/11/11 23:55:27 INFO Received uploads request method=POST path=/40322026/11/11 23:55:27 INFO Received complete upload request method=POST path=/40332026/11/11 23:55:27 INFO Completed upload id=15 objects=9 duration=269.917µs40342026/11/11 23:55:27 INFO Received complete upload request method=POST path=/40352026/11/11 23:55:27 INFO Completed upload id=23 objects=7 duration=958.167µs40362026/11/11 23:55:27 INFO Received complete push request method=POST path=/40372026/11/11 23:55:27 INFO Completed push id=16 objects=27 duration=492.458µs40382026/11/11 23:55:27 INFO Received complete upload request method=POST path=/40392026/11/11 23:55:27 INFO Received complete upload request method=POST path=/40402026/11/11 23:55:27 INFO Received uploads request method=POST path=/40412026/11/11 23:55:27 INFO Received complete push request method=POST path=/40422026/11/11 23:55:27 INFO Completed upload id=26 objects=5 duration=255.625µs40432026/11/11 23:55:27 INFO Completed upload id=33 objects=5 duration=784µs40442026/11/11 23:55:27 INFO Completed push id=21 objects=3 duration=290.833µs40452026/11/11 23:55:27 INFO Received complete push request method=POST path=/40462026/11/11 23:55:27 INFO Received push request method=POST path=/40472026/11/11 23:55:27 INFO Received uploads request method=POST path=/40482026/11/11 23:55:27 INFO Completed push id=27 objects=3 duration=477.542µs40492026/11/11 23:55:27 INFO Received complete upload request method=POST path=/40502026/11/11 23:55:27 INFO Completed upload id=28 objects=5 duration=484.334µs40512026/11/11 23:55:27 INFO Aborted multipart uploads count=0 kept=040522026/11/11 23:55:27 INFO Garbage collection completed failed-uploads-deleted=3 old-closures-deleted=3 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=040532026/11/11 23:55:27 INFO Vacuumed table table=pending_closures40542026/11/11 23:55:27 INFO Received complete push request method=POST path=/40552026/11/11 23:55:27 INFO Completed push id=29 objects=17 duration=275.417µs40562026/11/11 23:55:27 INFO Received complete push request method=POST path=/40572026/11/11 23:55:27 INFO Vacuumed table table=pending_objects40582026/11/11 23:55:27 INFO Aborted multipart uploads count=0 kept=040592026/11/11 23:55:27 INFO Completed push id=6 objects=5 duration=564.584µs40602026/11/11 23:55:27 INFO Vacuumed table table=multipart_uploads40612026/11/11 23:55:27 WARN Force mode enabled - objects will be deleted immediately without grace period40622026/11/11 23:55:27 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=8 objects-deleted-after-grace-period=8 objects-failed-to-delete=040632026/11/11 23:55:27 INFO Received push request method=POST path=/40642026/11/11 23:55:27 INFO Vacuumed table table=closures40652026/11/11 23:55:27 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=040662026/11/11 23:55:27 INFO Received complete push request method=POST path=/40672026/11/11 23:55:27 INFO Received push request method=POST path=/40682026/11/11 23:55:27 INFO Vacuumed table table=objects40692026/11/11 23:55:27 INFO Vacuumed table table=pending_closures40702026/11/11 23:55:27 INFO Completed push id=21 objects=17 duration=564.25µs40712026/11/11 23:55:27 INFO Received push request method=POST path=/40722026/11/11 23:55:27 INFO Received complete push request method=POST path=/40732026/11/11 23:55:27 INFO Completed push id=19 objects=7 duration=425.792µs40742026/11/11 23:55:27 INFO Vacuumed table table=pending_closures40752026/11/11 23:55:27 INFO Received push request method=POST path=/40762026/11/11 23:55:27 INFO Vacuumed table table=pending_objects40772026/11/11 23:55:27 INFO Received push request method=POST path=/40782026/11/11 23:55:27 INFO Received uploads request method=POST path=/40792026/11/11 23:55:27 INFO Vacuumed table table=multipart_uploads40802026/11/11 23:55:27 INFO Received complete push request method=POST path=/40812026/11/11 23:55:27 INFO Received push request method=POST path=/40822026/11/11 23:55:27 INFO Vacuumed table table=closures40832026/11/11 23:55:27 INFO Vacuumed table table=pending_objects40842026/11/11 23:55:27 INFO Completed push id=16 objects=5 duration=6.124334ms40852026/11/11 23:55:27 INFO Vacuumed table table=multipart_uploads40862026/11/11 23:55:27 INFO Received complete push request method=POST path=/40872026/11/11 23:55:27 INFO Aborted multipart uploads count=0 kept=040882026/11/11 23:55:27 INFO Received push request method=POST path=/40892026/11/11 23:55:27 INFO Received complete push request method=POST path=/40902026/11/11 23:55:27 INFO Vacuumed table table=objects40912026/11/11 23:55:27 INFO Vacuumed table table=closures40922026/11/11 23:55:27 INFO Completed push id=30 objects=4 duration=898.542µs40932026/11/11 23:55:27 WARN Force mode enabled - objects will be deleted immediately without grace period40942026/11/11 23:55:27 INFO Received uploads request method=POST path=/40952026/11/11 23:55:27 INFO Aborted multipart uploads count=0 kept=040962026/11/11 23:55:27 INFO Completed push id=18 objects=10 duration=383.208µs40972026/11/11 23:55:27 INFO Vacuumed table table=objects40982026/11/11 23:55:27 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=2 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=040992026/11/11 23:55:27 INFO Aborted multipart uploads count=0 kept=041002026/11/11 23:55:27 INFO Received uploads request method=POST path=/41012026/11/11 23:55:27 INFO Vacuumed table table=pending_closures41022026/11/11 23:55:27 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=041032026/11/11 23:55:27 INFO Received complete upload request method=POST path=/41042026/11/11 23:55:27 INFO Vacuumed table table=pending_closures41052026/11/11 23:55:27 INFO Vacuumed table table=pending_objects41062026/11/11 23:55:27 INFO Aborted multipart uploads count=0 kept=041072026/11/11 23:55:27 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=2 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=041082026/11/11 23:55:27 INFO Completed upload id=11 objects=7 duration=519.833µs41092026/11/11 23:55:27 INFO Vacuumed table table=pending_objects41102026/11/11 23:55:27 INFO Aborted multipart uploads count=0 kept=041112026/11/11 23:55:27 INFO Received push request method=POST path=/41122026/11/11 23:55:27 INFO Vacuumed table table=multipart_uploads41132026/11/11 23:55:27 INFO Vacuumed table table=multipart_uploads41142026/11/11 23:55:27 INFO Vacuumed table table=pending_closures41152026/11/11 23:55:27 WARN Force mode enabled - objects will be deleted immediately without grace period41162026/11/11 23:55:27 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=041172026/11/11 23:55:27 INFO Received uploads request method=POST path=/41182026/11/11 23:55:27 INFO Vacuumed table table=pending_closures41192026/11/11 23:55:27 INFO Vacuumed table table=closures41202026/11/11 23:55:27 INFO Vacuumed table table=closures41212026/11/11 23:55:27 INFO Garbage collection completed failed-uploads-deleted=5 old-closures-deleted=2 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=041222026/11/11 23:55:27 INFO Received push request method=POST path=/41232026/11/11 23:55:27 INFO Vacuumed table table=pending_objects41242026/11/11 23:55:27 INFO Received uploads request method=POST path=/41252026/11/11 23:55:27 INFO Vacuumed table table=pending_objects41262026/11/11 23:55:27 INFO Vacuumed table table=multipart_uploads41272026/11/11 23:55:27 INFO Vacuumed table table=objects41282026/11/11 23:55:27 INFO Vacuumed table table=objects41292026/11/11 23:55:27 INFO Vacuumed table table=multipart_uploads41302026/11/11 23:55:27 INFO Vacuumed table table=closures41312026/11/11 23:55:27 INFO Received complete push request method=POST path=/41322026/11/11 23:55:27 INFO Aborted multipart uploads count=0 kept=041332026/11/11 23:55:27 INFO Received uploads request method=POST path=/41342026/11/11 23:55:27 INFO Vacuumed table table=objects41352026/11/11 23:55:27 INFO Completed push id=32 objects=7 duration=6.884834ms41362026/11/11 23:55:27 INFO Received complete push request method=POST path=/41372026/11/11 23:55:27 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=041382026/11/11 23:55:27 INFO Completed push id=16 objects=16 duration=1.111291ms41392026/11/11 23:55:27 INFO Received push request method=POST path=/41402026/11/11 23:55:27 INFO Vacuumed table table=pending_closures41412026/11/11 23:55:27 INFO Received complete push request method=POST path=/41422026/11/11 23:55:27 INFO Vacuumed table table=pending_objects41432026/11/11 23:55:27 INFO Completed push id=26 objects=4 duration=341.458µs41442026/11/11 23:55:27 INFO Vacuumed table table=multipart_uploads41452026/11/11 23:55:27 INFO Vacuumed table table=closures41462026/11/11 23:55:27 INFO Aborted multipart uploads count=0 kept=041472026/11/11 23:55:27 INFO Received complete push request method=POST path=/41482026/11/11 23:55:27 INFO Vacuumed table table=closures41492026/11/11 23:55:27 INFO Vacuumed table table=pending_closures41502026/11/11 23:55:27 INFO Completed push id=8 objects=6 duration=5.553333ms41512026/11/11 23:55:27 INFO Vacuumed table table=objects41522026/11/11 23:55:27 INFO Received complete upload request method=POST path=/41532026/11/11 23:55:27 ERROR failed to remove object object=cccccccccccccccccccccccccccccccc.ls error="Access Denied."41542026/11/11 23:55:27 ERROR failed to remove object object=iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.ls error="Access Denied."41552026/11/11 23:55:27 ERROR failed to remove object object=iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.narinfo error="Access Denied."41562026/11/11 23:55:27 ERROR failed to remove object object=nar/iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.nar.zst error="Access Denied."41572026/11/11 23:55:27 ERROR failed to remove object object=realisations/sha256:ffffffff!out.doi error="Access Denied."41582026/11/11 23:55:27 ERROR failed to remove object object=realisations/sha256:hhhhhhhh!out.doi error="Access Denied."41592026/11/11 23:55:27 ERROR failed to remove object object=realisations/sha256:iiiiiiii!out.doi error="Access Denied."41602026/11/11 23:55:27 INFO Completed upload id=28 objects=13 duration=519.791µs41612026/11/11 23:55:27 INFO Received uploads request method=POST path=/41622026/11/11 23:55:27 INFO Vacuumed table table=objects41632026/11/11 23:55:27 INFO Received uploads request method=POST path=/41642026/11/11 23:55:27 INFO Received complete push request method=POST path=/41652026/11/11 23:55:27 INFO Received push request method=POST path=/41662026/11/11 23:55:27 INFO Received uploads request method=POST path=/41672026/11/11 23:55:27 INFO Vacuumed table table=pending_objects41682026/11/11 23:55:27 INFO Completed push id=29 objects=3 duration=522.042µs41692026/11/11 23:55:27 INFO Received uploads request method=POST path=/41702026/11/11 23:55:27 INFO Received push request method=POST path=/41712026/11/11 23:55:27 INFO Received uploads request method=POST path=/41722026/11/11 23:55:27 INFO Vacuumed table table=multipart_uploads41732026/11/11 23:55:27 INFO Received complete upload request method=POST path=/41742026/11/11 23:55:27 INFO Received push request method=POST path=/41752026/11/11 23:55:27 INFO Aborted multipart uploads count=0 kept=041762026/11/11 23:55:27 INFO Aborted multipart uploads count=0 kept=041772026/11/11 23:55:27 INFO Completed upload id=31 objects=2 duration=364.542µs41782026/11/11 23:55:27 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=041792026/11/11 23:55:27 WARN Force mode enabled - objects will be deleted immediately without grace period41802026/11/11 23:55:27 INFO Received uploads request method=POST path=/41812026/11/11 23:55:27 INFO Received complete push request method=POST path=/41822026/11/11 23:55:27 INFO Completed push id=33 objects=6 duration=299.542µs41832026/11/11 23:55:27 INFO Vacuumed table table=closures41842026/11/11 23:55:27 INFO Vacuumed table table=pending_closures41852026/11/11 23:55:27 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=041862026/11/11 23:55:27 INFO Aborted multipart uploads count=0 kept=041872026/11/11 23:55:27 INFO Vacuumed table table=pending_objects41882026/11/11 23:55:27 INFO Aborted multipart uploads count=0 kept=041892026/11/11 23:55:27 INFO Vacuumed table table=pending_closures41902026/11/11 23:55:27 INFO Vacuumed table table=multipart_uploads41912026/11/11 23:55:27 INFO Vacuumed table table=closures41922026/11/11 23:55:27 WARN Force mode enabled - objects will be deleted immediately without grace period41932026/11/11 23:55:27 WARN Force mode enabled - objects will be deleted immediately without grace period41942026/11/11 23:55:27 INFO Vacuumed table table=objects41952026/11/11 23:55:27 INFO Vacuumed table table=objects41962026/11/11 23:55:27 INFO Vacuumed table table=pending_objects41972026/11/11 23:55:27 ERROR failed to remove object object=cccccccccccccccccccccccccccccccc.ls error="Access Denied."41982026/11/11 23:55:27 ERROR failed to remove object object=iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.ls error="Access Denied."41992026/11/11 23:55:27 ERROR failed to remove object object=iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.narinfo error="Access Denied."42002026/11/11 23:55:27 ERROR failed to remove object object=nar/iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.nar.zst error="Access Denied."42012026/11/11 23:55:27 ERROR failed to remove object object=realisations/sha256:ffffffff!out.doi error="Access Denied."42022026/11/11 23:55:27 ERROR failed to remove object object=realisations/sha256:hhhhhhhh!out.doi error="Access Denied."42032026/11/11 23:55:27 ERROR failed to remove object object=realisations/sha256:iiiiiiii!out.doi error="Access Denied."42042026/11/11 23:55:27 INFO Vacuumed table table=multipart_uploads42052026/11/11 23:55:27 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=042062026/11/11 23:55:27 INFO Aborted multipart uploads count=0 kept=042072026/11/11 23:55:27 INFO Vacuumed table table=closures42082026/11/11 23:55:27 INFO Received complete upload request method=POST path=/42092026/11/11 23:55:27 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=042102026/11/11 23:55:27 INFO Received complete upload request method=POST path=/42112026/11/11 23:55:27 INFO Vacuumed table table=objects42122026/11/11 23:55:27 INFO Completed upload id=21 objects=3 duration=11.23125ms42132026/11/11 23:55:27 INFO Vacuumed table table=pending_closures42142026/11/11 23:55:27 INFO Completed upload id=12 objects=26 duration=11.287833ms42152026/11/11 23:55:27 INFO Vacuumed table table=pending_closures42162026/11/11 23:55:27 INFO Received push request method=POST path=/42172026/11/11 23:55:27 INFO Vacuumed table table=pending_objects42182026/11/11 23:55:27 INFO Received push request method=POST path=/42192026/11/11 23:55:27 INFO Aborted multipart uploads count=0 kept=042202026/11/11 23:55:27 INFO Vacuumed table table=multipart_uploads42212026/11/11 23:55:27 WARN Force mode enabled - objects will be deleted immediately without grace period42222026/11/11 23:55:27 INFO Received uploads request method=POST path=/42232026/11/11 23:55:27 INFO Aborted multipart uploads count=0 kept=042242026/11/11 23:55:27 INFO Vacuumed table table=closures42252026/11/11 23:55:27 INFO Received complete push request method=POST path=/42262026/11/11 23:55:27 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=7 objects-failed-to-delete=042272026/11/11 23:55:27 INFO Vacuumed table table=pending_objects42282026/11/11 23:55:27 INFO Received complete push request method=POST path=/42292026/11/11 23:55:27 INFO Received push request method=POST path=/42302026/11/11 23:55:27 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=042312026/11/11 23:55:27 INFO Vacuumed table table=objects42322026/11/11 23:55:27 INFO Vacuumed table table=multipart_uploads42332026/11/11 23:55:27 INFO Completed push id=16 objects=8 duration=445.458µs42342026/11/11 23:55:27 INFO Vacuumed table table=pending_closures42352026/11/11 23:55:27 INFO Completed push id=7 objects=20 duration=859.042µs42362026/11/11 23:55:27 INFO Received push request method=POST path=/42372026/11/11 23:55:27 INFO Vacuumed table table=closures42382026/11/11 23:55:27 INFO Received push request method=POST path=/42392026/11/11 23:55:27 INFO Vacuumed table table=pending_closures42402026/11/11 23:55:27 INFO Vacuumed table table=objects42412026/11/11 23:55:27 INFO Received complete upload request method=POST path=/42422026/11/11 23:55:27 INFO Vacuumed table table=pending_objects42432026/11/11 23:55:27 INFO Aborted multipart uploads count=0 kept=042442026/11/11 23:55:27 INFO Aborted multipart uploads count=0 kept=042452026/11/11 23:55:27 INFO Received push request method=POST path=/42462026/11/11 23:55:27 INFO Vacuumed table table=multipart_uploads42472026/11/11 23:55:27 WARN Force mode enabled - objects will be deleted immediately without grace period42482026/11/11 23:55:27 INFO Completed upload id=21 objects=25 duration=780.458µs42492026/11/11 23:55:27 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=042502026/11/11 23:55:27 INFO Aborted multipart uploads count=0 kept=042512026/11/11 23:55:27 INFO Received uploads request method=POST path=/42522026/11/11 23:55:27 INFO Vacuumed table table=closures42532026/11/11 23:55:27 INFO Vacuumed table table=pending_objects42542026/11/11 23:55:27 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=042552026/11/11 23:55:27 INFO Received uploads request method=POST path=/42562026/11/11 23:55:27 INFO Vacuumed table table=objects42572026/11/11 23:55:27 INFO Vacuumed table table=pending_closures42582026/11/11 23:55:27 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=042592026/11/11 23:55:27 INFO Vacuumed table table=pending_closures42602026/11/11 23:55:27 INFO Vacuumed table table=multipart_uploads42612026/11/11 23:55:27 INFO Vacuumed table table=pending_closures42622026/11/11 23:55:27 INFO Received push request method=POST path=/42632026/11/11 23:55:27 INFO Received push request method=POST path=/42642026/11/11 23:55:27 INFO Vacuumed table table=closures42652026/11/11 23:55:27 INFO Vacuumed table table=pending_objects42662026/11/11 23:55:27 INFO Aborted multipart uploads count=0 kept=042672026/11/11 23:55:27 INFO Aborted multipart uploads count=0 kept=042682026/11/11 23:55:27 INFO Vacuumed table table=pending_objects42692026/11/11 23:55:27 INFO Vacuumed table table=objects42702026/11/11 23:55:27 INFO Vacuumed table table=multipart_uploads42712026/11/11 23:55:27 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=042722026/11/11 23:55:27 INFO Vacuumed table table=multipart_uploads42732026/11/11 23:55:27 INFO Vacuumed table table=pending_closures42742026/11/11 23:55:27 INFO Vacuumed table table=closures42752026/11/11 23:55:27 INFO Vacuumed table table=closures42762026/11/11 23:55:27 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=042772026/11/11 23:55:27 INFO Vacuumed table table=pending_objects42782026/11/11 23:55:27 INFO Vacuumed table table=pending_objects42792026/11/11 23:55:27 INFO Vacuumed table table=multipart_uploads42802026/11/11 23:55:27 INFO Vacuumed table table=pending_closures42812026/11/11 23:55:27 INFO Vacuumed table table=objects42822026/11/11 23:55:27 INFO Vacuumed table table=objects42832026/11/11 23:55:27 INFO Aborted multipart uploads count=0 kept=042842026/11/11 23:55:27 INFO Vacuumed table table=multipart_uploads42852026/11/11 23:55:27 INFO Vacuumed table table=closures42862026/11/11 23:55:27 INFO Vacuumed table table=closures42872026/11/11 23:55:27 WARN Force mode enabled - objects will be deleted immediately without grace period42882026/11/11 23:55:27 INFO Vacuumed table table=pending_objects42892026/11/11 23:55:27 INFO Vacuumed table table=objects42902026/11/11 23:55:27 INFO Vacuumed table table=objects42912026/11/11 23:55:27 INFO Vacuumed table table=multipart_uploads42922026/11/11 23:55:27 INFO Vacuumed table table=closures42932026/11/11 23:55:27 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=042942026/11/11 23:55:27 INFO Vacuumed table table=objects42952026/11/11 23:55:27 INFO Vacuumed table table=pending_closures42962026/11/11 23:55:27 INFO Aborted multipart uploads count=0 kept=042972026/11/11 23:55:27 INFO Received push request method=POST path=/42982026/11/11 23:55:27 INFO Vacuumed table table=pending_objects42992026/11/11 23:55:27 WARN Force mode enabled - objects will be deleted immediately without grace period43002026/11/11 23:55:27 INFO Vacuumed table table=multipart_uploads43012026/11/11 23:55:27 INFO Received complete upload request method=POST path=/43022026/11/11 23:55:27 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=043032026/11/11 23:55:27 INFO Received uploads request method=POST path=/43042026/11/11 23:55:27 INFO Vacuumed table table=closures43052026/11/11 23:55:27 INFO Vacuumed table table=pending_closures43062026/11/11 23:55:27 INFO Received uploads request method=POST path=/43072026/11/11 23:55:27 INFO Completed upload id=13 objects=14 duration=1.974708ms43082026/11/11 23:55:27 INFO Vacuumed table table=objects43092026/11/11 23:55:27 INFO Vacuumed table table=pending_objects43102026/11/11 23:55:27 INFO Received uploads request method=POST path=/43112026/11/11 23:55:27 INFO Aborted multipart uploads count=0 kept=043122026/11/11 23:55:27 INFO Aborted multipart uploads count=0 kept=043132026/11/11 23:55:27 INFO Received push request method=POST path=/43142026/11/11 23:55:27 INFO Vacuumed table table=multipart_uploads43152026/11/11 23:55:27 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=043162026/11/11 23:55:27 INFO Vacuumed table table=closures43172026/11/11 23:55:27 INFO Vacuumed table table=pending_closures43182026/11/11 23:55:27 INFO Vacuumed table table=objects43192026/11/11 23:55:27 INFO Received complete push request method=POST path=/43202026/11/11 23:55:27 INFO Vacuumed table table=pending_objects43212026/11/11 23:55:27 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=043222026/11/11 23:55:27 INFO Received uploads request method=POST path=/43232026/11/11 23:55:27 INFO Received complete upload request method=POST path=/43242026/11/11 23:55:27 INFO Received complete push request method=POST path=/43252026/11/11 23:55:27 INFO Vacuumed table table=multipart_uploads43262026/11/11 23:55:27 INFO Completed push id=5 objects=3 duration=5.894167ms43272026/11/11 23:55:27 INFO Completed push id=22 objects=3 duration=5.814291ms43282026/11/11 23:55:27 INFO Vacuumed table table=pending_closures43292026/11/11 23:55:27 INFO Completed upload id=19 objects=2 duration=5.826208ms43302026/11/11 23:55:27 INFO Received complete push request method=POST path=/43312026/11/11 23:55:27 INFO Vacuumed table table=closures43322026/11/11 23:55:27 INFO Vacuumed table table=objects43332026/11/11 23:55:27 INFO Vacuumed table table=pending_objects43342026/11/11 23:55:27 INFO Completed push id=11 objects=6 duration=1.073333ms43352026/11/11 23:55:27 INFO Vacuumed table table=multipart_uploads43362026/11/11 23:55:27 INFO Received uploads request method=POST path=/43372026/11/11 23:55:27 INFO Received uploads request method=POST path=/43382026/11/11 23:55:28 INFO Received complete upload request method=POST path=/43392026/11/11 23:55:28 INFO Vacuumed table table=closures43402026/11/11 23:55:28 INFO Completed upload id=23 objects=18 duration=6.399875ms43412026/11/11 23:55:28 INFO Vacuumed table table=objects43422026/11/11 23:55:28 INFO Received complete push request method=POST path=/43432026/11/11 23:55:28 INFO Received uploads request method=POST path=/43442026/11/11 23:55:28 INFO Received push request method=POST path=/43452026/11/11 23:55:28 INFO Completed push id=33 objects=7 duration=396.167µs43462026/11/11 23:55:28 INFO Received push request method=POST path=/43472026/11/11 23:55:28 INFO Received push request method=POST path=/43482026/11/11 23:55:28 INFO Received complete push request method=POST path=/43492026/11/11 23:55:28 INFO Received complete upload request method=POST path=/43502026/11/11 23:55:28 INFO Received complete push request method=POST path=/43512026/11/11 23:55:28 INFO Received complete upload request method=POST path=/43522026/11/11 23:55:28 INFO Completed push id=8 objects=6 duration=362.25µs43532026/11/11 23:55:28 INFO Completed upload id=26 objects=3 duration=299.917µs43542026/11/11 23:55:28 INFO Completed upload id=22 objects=22 duration=244.875µs43552026/11/11 23:55:28 INFO Completed push id=24 objects=3 duration=312.875µs43562026/11/11 23:55:28 INFO Received push request method=POST path=/43572026/11/11 23:55:28 INFO Received push request method=POST path=/43582026/11/11 23:55:28 INFO Aborted multipart uploads count=0 kept=043592026/11/11 23:55:28 INFO Received push request method=POST path=/43602026/11/11 23:55:28 WARN Force mode enabled - objects will be deleted immediately without grace period43612026/11/11 23:55:28 INFO Received uploads request method=POST path=/43622026/11/11 23:55:28 INFO Aborted multipart uploads count=0 kept=043632026/11/11 23:55:28 INFO Received complete push request method=POST path=/43642026/11/11 23:55:28 INFO Completed push id=26 objects=5 duration=459.458µs43652026/11/11 23:55:28 WARN Force mode enabled - objects will be deleted immediately without grace period43662026/11/11 23:55:28 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=043672026/11/11 23:55:28 INFO Received push request method=POST path=/43682026/11/11 23:55:28 INFO Received complete push request method=POST path=/43692026/11/11 23:55:28 INFO Received complete push request method=POST path=/43702026/11/11 23:55:28 INFO Vacuumed table table=pending_closures43712026/11/11 23:55:28 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=043722026/11/11 23:55:28 INFO Received push request method=POST path=/43732026/11/11 23:55:28 INFO Received complete upload request method=POST path=/43742026/11/11 23:55:28 INFO Completed push id=18 objects=6 duration=295µs43752026/11/11 23:55:28 INFO Completed upload id=24 objects=14 duration=393.5µs43762026/11/11 23:55:28 INFO Completed push id=31 objects=6 duration=1.149834ms43772026/11/11 23:55:28 INFO Received complete push request method=POST path=/43782026/11/11 23:55:28 INFO Vacuumed table table=pending_objects43792026/11/11 23:55:28 INFO Aborted multipart uploads count=0 kept=043802026/11/11 23:55:28 INFO Vacuumed table table=multipart_uploads43812026/11/11 23:55:28 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=043822026/11/11 23:55:28 INFO Completed push id=9 objects=7 duration=1.178875ms43832026/11/11 23:55:28 INFO Received complete push request method=POST path=/43842026/11/11 23:55:28 INFO Received uploads request method=POST path=/43852026/11/11 23:55:28 INFO Vacuumed table table=closures43862026/11/11 23:55:28 INFO Vacuumed table table=pending_closures43872026/11/11 23:55:28 INFO Completed push id=19 objects=3 duration=287.75µs43882026/11/11 23:55:28 INFO Received complete push request method=POST path=/43892026/11/11 23:55:28 INFO Vacuumed table table=objects43902026/11/11 23:55:28 INFO Vacuumed table table=pending_closures43912026/11/11 23:55:28 INFO Completed push id=9 objects=24 duration=367.416µs43922026/11/11 23:55:28 INFO Vacuumed table table=pending_objects43932026/11/11 23:55:28 INFO Vacuumed table table=pending_objects43942026/11/11 23:55:28 INFO Received uploads request method=POST path=/43952026/11/11 23:55:28 INFO Received uploads request method=POST path=/43962026/11/11 23:55:28 INFO Vacuumed table table=multipart_uploads43972026/11/11 23:55:28 INFO Vacuumed table table=multipart_uploads43982026/11/11 23:55:28 INFO Received uploads request method=POST path=/43992026/11/11 23:55:28 INFO Vacuumed table table=closures44002026/11/11 23:55:28 INFO Received uploads request method=POST path=/44012026/11/11 23:55:28 INFO Vacuumed table table=closures44022026/11/11 23:55:28 INFO Received complete upload request method=POST path=/44032026/11/11 23:55:28 INFO Vacuumed table table=objects44042026/11/11 23:55:28 INFO Received complete upload request method=POST path=/44052026/11/11 23:55:28 INFO Vacuumed table table=objects44062026/11/11 23:55:28 INFO Completed upload id=10 objects=10 duration=339.75µs44072026/11/11 23:55:28 INFO Received complete upload request method=POST path=/44082026/11/11 23:55:28 INFO Completed upload id=12 objects=6 duration=282.208µs44092026/11/11 23:55:28 INFO Completed upload id=25 objects=4 duration=198.875µs44102026/11/11 23:55:28 INFO Received complete upload request method=POST path=/44112026/11/11 23:55:28 INFO Received uploads request method=POST path=/44122026/11/11 23:55:28 INFO Completed upload id=20 objects=3 duration=928.875µs44132026/11/11 23:55:28 INFO Received complete push request method=POST path=/44142026/11/11 23:55:28 INFO Received push request method=POST path=/44152026/11/11 23:55:28 INFO Completed push id=17 objects=3 duration=5.90575ms44162026/11/11 23:55:28 INFO Received push request method=POST path=/44172026/11/11 23:55:28 INFO Received push request method=POST path=/44182026/11/11 23:55:28 INFO Aborted multipart uploads count=0 kept=044192026/11/11 23:55:28 INFO Received complete push request method=POST path=/44202026/11/11 23:55:28 INFO Completed push id=20 objects=8 duration=302.291µs44212026/11/11 23:55:28 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=2 objects-failed-to-delete=044222026/11/11 23:55:28 INFO Received complete upload request method=POST path=/44232026/11/11 23:55:28 INFO Received push request method=POST path=/44242026/11/11 23:55:28 INFO Completed upload id=24 objects=7 duration=591.042µs44252026/11/11 23:55:28 INFO Received uploads request method=POST path=/44262026/11/11 23:55:28 INFO Received complete upload request method=POST path=/44272026/11/11 23:55:28 INFO Aborted multipart uploads count=0 kept=044282026/11/11 23:55:28 INFO Completed upload id=10 objects=17 duration=774.583µs44292026/11/11 23:55:28 INFO Vacuumed table table=pending_closures44302026/11/11 23:55:28 INFO Received complete upload request method=POST path=/44312026/11/11 23:55:28 INFO Received uploads request method=POST path=/44322026/11/11 23:55:28 INFO Received push request method=POST path=/44332026/11/11 23:55:28 INFO Completed upload id=10 objects=7 duration=355.959µs44342026/11/11 23:55:28 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=044352026/11/11 23:55:28 INFO Vacuumed table table=pending_objects44362026/11/11 23:55:28 INFO Received complete push request method=POST path=/44372026/11/11 23:55:28 INFO Vacuumed table table=pending_closures44382026/11/11 23:55:28 INFO Received uploads request method=POST path=/44392026/11/11 23:55:28 INFO Received push request method=POST path=/44402026/11/11 23:55:28 INFO Vacuumed table table=multipart_uploads44412026/11/11 23:55:28 INFO Completed push id=23 objects=5 duration=584.541µs44422026/11/11 23:55:28 INFO Vacuumed table table=pending_objects44432026/11/11 23:55:28 INFO Received complete push request method=POST path=/44442026/11/11 23:55:28 INFO Received complete push request method=POST path=/44452026/11/11 23:55:28 INFO Vacuumed table table=closures44462026/11/11 23:55:28 INFO Received uploads request method=POST path=/44472026/11/11 23:55:28 INFO Vacuumed table table=multipart_uploads44482026/11/11 23:55:28 INFO Completed push id=14 objects=3 duration=323.333µs44492026/11/11 23:55:28 INFO Vacuumed table table=objects44502026/11/11 23:55:28 INFO Completed push id=27 objects=11 duration=407.542µs44512026/11/11 23:55:28 INFO Received complete upload request method=POST path=/44522026/11/11 23:55:28 INFO Received push request method=POST path=/44532026/11/11 23:55:28 INFO Vacuumed table table=closures44542026/11/11 23:55:28 INFO Completed upload id=18 objects=4 duration=372.875µs44552026/11/11 23:55:28 INFO Received complete upload request method=POST path=/44562026/11/11 23:55:28 INFO Vacuumed table table=objects44572026/11/11 23:55:28 INFO Completed upload id=24 objects=3 duration=193.834µs44582026/11/11 23:55:28 INFO Received push request method=POST path=/44592026/11/11 23:55:28 INFO Received complete push request method=POST path=/44602026/11/11 23:55:28 INFO Received complete upload request method=POST path=/44612026/11/11 23:55:28 INFO Completed push id=14 objects=6 duration=1.128334ms44622026/11/11 23:55:28 INFO Completed upload id=29 objects=26 duration=247.833µs44632026/11/11 23:55:28 INFO Received uploads request method=POST path=/44642026/11/11 23:55:28 INFO Received uploads request method=POST path=/44652026/11/11 23:55:28 INFO Received complete push request method=POST path=/44662026/11/11 23:55:28 INFO Completed push id=25 objects=4 duration=1.279125ms44672026/11/11 23:55:28 INFO Received complete push request method=POST path=/44682026/11/11 23:55:28 INFO Completed push id=30 objects=8 duration=1.114875ms44692026/11/11 23:55:28 INFO Received push request method=POST path=/44702026/11/11 23:55:28 INFO Aborted multipart uploads count=0 kept=044712026/11/11 23:55:28 INFO Received push request method=POST path=/44722026/11/11 23:55:28 INFO Received complete upload request method=POST path=/44732026/11/11 23:55:28 WARN Force mode enabled - objects will be deleted immediately without grace period44742026/11/11 23:55:28 INFO Received complete upload request method=POST path=/44752026/11/11 23:55:28 INFO Received push request method=POST path=/44762026/11/11 23:55:28 INFO Completed upload id=26 objects=2 duration=616.292µs44772026/11/11 23:55:28 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=044782026/11/11 23:55:28 INFO Aborted multipart uploads count=0 kept=044792026/11/11 23:55:28 INFO Completed upload id=31 objects=5 duration=147.375µs44802026/11/11 23:55:28 INFO Aborted multipart uploads count=0 kept=044812026/11/11 23:55:28 INFO Vacuumed table table=pending_closures44822026/11/11 23:55:28 INFO Aborted multipart uploads count=0 kept=044832026/11/11 23:55:28 WARN Force mode enabled - objects will be deleted immediately without grace period44842026/11/11 23:55:28 INFO Received complete push request method=POST path=/44852026/11/11 23:55:28 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=1 objects-deleted-after-grace-period=0 objects-failed-to-delete=044862026/11/11 23:55:28 INFO Completed push id=32 objects=3 duration=185.041µs44872026/11/11 23:55:28 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=044882026/11/11 23:55:28 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=044892026/11/11 23:55:28 INFO Vacuumed table table=pending_objects44902026/11/11 23:55:28 INFO Vacuumed table table=pending_closures44912026/11/11 23:55:28 INFO Aborted multipart uploads count=0 kept=044922026/11/11 23:55:28 INFO Vacuumed table table=multipart_uploads44932026/11/11 23:55:28 INFO Vacuumed table table=closures44942026/11/11 23:55:28 INFO Vacuumed table table=pending_objects44952026/11/11 23:55:28 WARN Force mode enabled - objects will be deleted immediately without grace period44962026/11/11 23:55:28 INFO Vacuumed table table=objects44972026/11/11 23:55:28 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=044982026/11/11 23:55:28 INFO Vacuumed table table=pending_closures44992026/11/11 23:55:28 INFO Vacuumed table table=multipart_uploads45002026/11/11 23:55:28 INFO Vacuumed table table=closures45012026/11/11 23:55:28 INFO Vacuumed table table=pending_objects45022026/11/11 23:55:28 INFO Vacuumed table table=objects45032026/11/11 23:55:28 INFO Vacuumed table table=multipart_uploads45042026/11/11 23:55:28 INFO Vacuumed table table=pending_closures45052026/11/11 23:55:28 INFO Vacuumed table table=closures45062026/11/11 23:55:28 INFO Received push request method=POST path=/45072026/11/11 23:55:28 INFO Vacuumed table table=pending_closures45082026/11/11 23:55:28 INFO Vacuumed table table=objects45092026/11/11 23:55:28 INFO Received uploads request method=POST path=/45102026/11/11 23:55:28 INFO Vacuumed table table=pending_objects45112026/11/11 23:55:28 INFO Vacuumed table table=pending_objects45122026/11/11 23:55:28 INFO Received uploads request method=POST path=/45132026/11/11 23:55:28 INFO Vacuumed table table=multipart_uploads45142026/11/11 23:55:28 INFO Received push request method=POST path=/45152026/11/11 23:55:28 INFO Vacuumed table table=multipart_uploads45162026/11/11 23:55:28 INFO Received complete push request method=POST path=/45172026/11/11 23:55:28 INFO Vacuumed table table=closures45182026/11/11 23:55:28 INFO Received uploads request method=POST path=/45192026/11/11 23:55:28 INFO Vacuumed table table=closures45202026/11/11 23:55:28 INFO Vacuumed table table=objects45212026/11/11 23:55:28 INFO Completed push id=12 objects=2 duration=5.986209ms45222026/11/11 23:55:28 INFO Vacuumed table table=objects45232026/11/11 23:55:28 INFO Received uploads request method=POST path=/45242026/11/11 23:55:28 INFO Received uploads request method=POST path=/45252026/11/11 23:55:28 INFO Aborted multipart uploads count=0 kept=045262026/11/11 23:55:28 WARN Force mode enabled - objects will be deleted immediately without grace period45272026/11/11 23:55:28 INFO Received push request method=POST path=/45282026/11/11 23:55:28 INFO Received complete push request method=POST path=/45292026/11/11 23:55:28 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=045302026/11/11 23:55:28 INFO Received uploads request method=POST path=/45312026/11/11 23:55:28 INFO Vacuumed table table=pending_closures45322026/11/11 23:55:28 INFO Completed push id=23 objects=28 duration=1.009959ms45332026/11/11 23:55:28 INFO Aborted multipart uploads count=0 kept=045342026/11/11 23:55:28 INFO Vacuumed table table=pending_objects45352026/11/11 23:55:28 INFO Aborted multipart uploads count=0 kept=045362026/11/11 23:55:28 INFO Vacuumed table table=multipart_uploads45372026/11/11 23:55:28 INFO Vacuumed table table=closures45382026/11/11 23:55:28 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=045392026/11/11 23:55:28 ERROR failed to remove object object=cccccccccccccccccccccccccccccccc.ls error="Access Denied."45402026/11/11 23:55:28 ERROR failed to remove object object=ffffffffffffffffffffffffffffffff.ls error="Access Denied."45412026/11/11 23:55:28 ERROR failed to remove object object=realisations/sha256:ffffffff!out.doi error="Access Denied."45422026/11/11 23:55:28 INFO Received complete upload request method=POST path=/45432026/11/11 23:55:28 INFO Vacuumed table table=objects45442026/11/11 23:55:28 INFO Completed upload id=27 objects=8 duration=254.166µs45452026/11/11 23:55:28 INFO Vacuumed table table=pending_closures45462026/11/11 23:55:28 INFO Received push request method=POST path=/45472026/11/11 23:55:28 INFO Received uploads request method=POST path=/45482026/11/11 23:55:28 INFO Received push request method=POST path=/45492026/11/11 23:55:28 INFO Received uploads request method=POST path=/45502026/11/11 23:55:28 INFO Vacuumed table table=pending_objects45512026/11/11 23:55:28 INFO Received push request method=POST path=/45522026/11/11 23:55:28 INFO Received uploads request method=POST path=/45532026/11/11 23:55:28 INFO Vacuumed table table=multipart_uploads45542026/11/11 23:55:28 INFO Aborted multipart uploads count=0 kept=045552026/11/11 23:55:28 INFO Received complete push request method=POST path=/45562026/11/11 23:55:28 INFO Vacuumed table table=closures45572026/11/11 23:55:28 INFO Received uploads request method=POST path=/45582026/11/11 23:55:28 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=045592026/11/11 23:55:28 INFO Completed push id=28 objects=11 duration=569.208µs45602026/11/11 23:55:28 INFO Vacuumed table table=objects45612026/11/11 23:55:28 INFO Vacuumed table table=pending_closures45622026/11/11 23:55:28 INFO Received push request method=POST path=/45632026/11/11 23:55:28 INFO Received complete push request method=POST path=/45642026/11/11 23:55:28 INFO Completed push id=18 objects=6 duration=890.167µs45652026/11/11 23:55:28 INFO Received uploads request method=POST path=/45662026/11/11 23:55:28 INFO Vacuumed table table=pending_objects45672026/11/11 23:55:28 INFO Received complete upload request method=POST path=/45682026/11/11 23:55:28 INFO Vacuumed table table=multipart_uploads45692026/11/11 23:55:28 INFO Aborted multipart uploads count=0 kept=045702026/11/11 23:55:28 INFO Completed upload id=23 objects=9 duration=264.5µs45712026/11/11 23:55:28 INFO Vacuumed table table=closures45722026/11/11 23:55:28 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=045732026/11/11 23:55:28 INFO Vacuumed table table=objects45742026/11/11 23:55:28 INFO Vacuumed table table=pending_closures45752026/11/11 23:55:28 INFO Received push request method=POST path=/45762026/11/11 23:55:28 INFO Aborted multipart uploads count=0 kept=045772026/11/11 23:55:28 INFO Vacuumed table table=pending_objects45782026/11/11 23:55:28 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=045792026/11/11 23:55:28 INFO Vacuumed table table=multipart_uploads45802026/11/11 23:55:28 INFO Vacuumed table table=pending_closures45812026/11/11 23:55:28 INFO Received uploads request method=POST path=/45822026/11/11 23:55:28 INFO Vacuumed table table=closures45832026/11/11 23:55:28 INFO Vacuumed table table=pending_objects45842026/11/11 23:55:28 INFO Vacuumed table table=objects45852026/11/11 23:55:28 INFO Vacuumed table table=multipart_uploads45862026/11/11 23:55:28 INFO Vacuumed table table=closures45872026/11/11 23:55:28 INFO Received push request method=POST path=/45882026/11/11 23:55:28 INFO Vacuumed table table=objects45892026/11/11 23:55:28 INFO Received complete push request method=POST path=/45902026/11/11 23:55:28 INFO Received complete push request method=POST path=/45912026/11/11 23:55:28 INFO Completed push id=22 objects=3 duration=5.926208ms45922026/11/11 23:55:28 INFO Received complete upload request method=POST path=/45932026/11/11 23:55:28 INFO Completed push id=16 objects=26 duration=395.417µs45942026/11/11 23:55:28 INFO Received complete push request method=POST path=/45952026/11/11 23:55:28 INFO Completed upload id=25 objects=16 duration=848.5µs45962026/11/11 23:55:28 INFO Aborted multipart uploads count=0 kept=045972026/11/11 23:55:28 INFO Aborted multipart uploads count=0 kept=045982026/11/11 23:55:28 INFO Completed push id=9 objects=9 duration=948.084µs45992026/11/11 23:55:28 WARN Force mode enabled - objects will be deleted immediately without grace period46002026/11/11 23:55:28 WARN Force mode enabled - objects will be deleted immediately without grace period46012026/11/11 23:55:28 INFO Aborted multipart uploads count=0 kept=046022026/11/11 23:55:28 WARN Force mode enabled - objects will be deleted immediately without grace period46032026/11/11 23:55:28 INFO Garbage collection completed failed-uploads-deleted=4 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=046042026/11/11 23:55:28 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=046052026/11/11 23:55:28 INFO Vacuumed table table=pending_closures46062026/11/11 23:55:28 INFO Vacuumed table table=pending_closures46072026/11/11 23:55:28 INFO Received complete push request method=POST path=/46082026/11/11 23:55:28 INFO Vacuumed table table=pending_objects46092026/11/11 23:55:28 INFO Vacuumed table table=pending_objects46102026/11/11 23:55:28 INFO Completed push id=26 objects=23 duration=412.083µs46112026/11/11 23:55:28 INFO Vacuumed table table=multipart_uploads46122026/11/11 23:55:28 INFO Vacuumed table table=multipart_uploads46132026/11/11 23:55:28 INFO Vacuumed table table=closures46142026/11/11 23:55:28 INFO Vacuumed table table=objects46152026/11/11 23:55:28 INFO Vacuumed table table=closures46162026/11/11 23:55:28 INFO Vacuumed table table=objects46172026/11/11 23:55:28 INFO Received complete upload request method=POST path=/46182026/11/11 23:55:28 INFO Received complete push request method=POST path=/46192026/11/11 23:55:28 INFO Received complete push request method=POST path=/46202026/11/11 23:55:28 INFO Completed upload id=21 objects=8 duration=5.694792ms46212026/11/11 23:55:28 INFO Completed push id=13 objects=15 duration=6.32125ms46222026/11/11 23:55:28 INFO Completed push id=27 objects=6 duration=6.389ms46232026/11/11 23:55:28 INFO Received complete push request method=POST path=/46242026/11/11 23:55:28 INFO Received push request method=POST path=/46252026/11/11 23:55:28 INFO Aborted multipart uploads count=0 kept=046262026/11/11 23:55:28 INFO Completed push id=22 objects=6 duration=6.990333ms46272026/11/11 23:55:28 ERROR failed to remove object object=realisations/sha256:ffffffff!out.doi error="Access Denied."46282026/11/11 23:55:28 INFO Received complete push request method=POST path=/46292026/11/11 23:55:28 INFO Received push request method=POST path=/46302026/11/11 23:55:28 INFO Received complete upload request method=POST path=/46312026/11/11 23:55:28 INFO Received complete push request method=POST path=/46322026/11/11 23:55:28 INFO Completed upload id=15 objects=2 duration=413.333µs46332026/11/11 23:55:28 INFO Completed push id=24 objects=8 duration=506.917µs46342026/11/11 23:55:28 INFO Completed push id=1 objects=9 duration=429.25µs46352026/11/11 23:55:28 INFO Received complete upload request method=POST path=/46362026/11/11 23:55:28 INFO Completed upload id=25 objects=9 duration=405.875µs46372026/11/11 23:55:28 INFO Received uploads request method=POST path=/46382026/11/11 23:55:28 INFO Received complete upload request method=POST path=/46392026/11/11 23:55:28 INFO Received push request method=POST path=/46402026/11/11 23:55:28 INFO Completed upload id=27 objects=3 duration=426.459µs46412026/11/11 23:55:28 INFO Received complete upload request method=POST path=/46422026/11/11 23:55:28 INFO Received uploads request method=POST path=/46432026/11/11 23:55:28 INFO Received complete upload request method=POST path=/46442026/11/11 23:55:28 INFO Completed upload id=28 objects=6 duration=201µs46452026/11/11 23:55:28 INFO Completed upload id=22 objects=5 duration=551.958µs46462026/11/11 23:55:28 INFO Received uploads request method=POST path=/46472026/11/11 23:55:28 INFO Received complete push request method=POST path=/46482026/11/11 23:55:28 INFO Received complete push request method=POST path=/46492026/11/11 23:55:28 INFO Received complete push request method=POST path=/46502026/11/11 23:55:28 INFO Received complete upload request method=POST path=/46512026/11/11 23:55:28 INFO Completed push id=30 objects=4 duration=331.083µs46522026/11/11 23:55:28 INFO Completed push id=28 objects=3 duration=6.72025ms46532026/11/11 23:55:28 INFO Completed push id=29 objects=24 duration=6.7065ms46542026/11/11 23:55:28 INFO Completed upload id=26 objects=8 duration=6.700584ms46552026/11/11 23:55:28 INFO Received complete push request method=POST path=/46562026/11/11 23:55:28 INFO Completed push id=31 objects=7 duration=694.875µs46572026/11/11 23:55:28 INFO Received complete push request method=POST path=/46582026/11/11 23:55:28 INFO Received complete push request method=POST path=/46592026/11/11 23:55:28 INFO Aborted multipart uploads count=0 kept=046602026/11/11 23:55:28 INFO Received complete upload request method=POST path=/46612026/11/11 23:55:28 INFO Completed push id=29 objects=15 duration=312.291µs46622026/11/11 23:55:28 INFO Completed push id=28 objects=14 duration=390.75µs46632026/11/11 23:55:28 WARN Force mode enabled - objects will be deleted immediately without grace period46642026/11/11 23:55:28 INFO Completed upload id=32 objects=5 duration=345.167µs46652026/11/11 23:55:28 INFO Received complete push request method=POST path=/46662026/11/11 23:55:28 INFO Received push request method=POST path=/46672026/11/11 23:55:28 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=046682026/11/11 23:55:28 INFO Completed push id=30 objects=6 duration=306.584µs46692026/11/11 23:55:29 INFO Received uploads request method=POST path=/46702026/11/11 23:55:29 INFO Received complete upload request method=POST path=/46712026/11/11 23:55:29 INFO Completed upload id=31 objects=3 duration=294.791µs46722026/11/11 23:55:29 INFO Aborted multipart uploads count=0 kept=046732026/11/11 23:55:29 INFO Aborted multipart uploads count=0 kept=046742026/11/11 23:55:29 WARN Force mode enabled - objects will be deleted immediately without grace period46752026/11/11 23:55:29 WARN Force mode enabled - objects will be deleted immediately without grace period46762026/11/11 23:55:29 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=046772026/11/11 23:55:29 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=046782026/11/11 23:55:29 INFO Vacuumed table table=pending_closures46792026/11/11 23:55:29 ERROR failed to remove object object=realisations/sha256:iiiiiiii!out.doi error="Access Denied."46802026/11/11 23:55:29 INFO Vacuumed table table=pending_closures46812026/11/11 23:55:29 INFO Received uploads request method=POST path=/46822026/11/11 23:55:29 INFO Received complete push request method=POST path=/46832026/11/11 23:55:29 INFO Vacuumed table table=pending_closures46842026/11/11 23:55:29 INFO Vacuumed table table=pending_objects46852026/11/11 23:55:29 INFO Received uploads request method=POST path=/46862026/11/11 23:55:29 INFO Completed push id=27 objects=15 duration=365.958µs46872026/11/11 23:55:29 INFO Vacuumed table table=pending_objects46882026/11/11 23:55:29 INFO Vacuumed table table=multipart_uploads46892026/11/11 23:55:29 INFO Vacuumed table table=multipart_uploads46902026/11/11 23:55:29 INFO Vacuumed table table=pending_objects46912026/11/11 23:55:29 INFO Vacuumed table table=closures46922026/11/11 23:55:29 INFO Vacuumed table table=closures46932026/11/11 23:55:29 INFO Aborted multipart uploads count=0 kept=046942026/11/11 23:55:29 INFO Vacuumed table table=multipart_uploads46952026/11/11 23:55:29 INFO Vacuumed table table=closures46962026/11/11 23:55:29 INFO Vacuumed table table=objects46972026/11/11 23:55:29 INFO Vacuumed table table=objects46982026/11/11 23:55:29 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.ls error="Access Denied."46992026/11/11 23:55:29 ERROR failed to remove object object=realisations/sha256:cccccccc!out.doi error="Access Denied."47002026/11/11 23:55:29 INFO Vacuumed table table=objects47012026/11/11 23:55:29 INFO Received complete push request method=POST path=/47022026/11/11 23:55:29 INFO Completed push id=20 objects=3 duration=778.25µs47032026/11/11 23:55:29 INFO Received uploads request method=POST path=/47042026/11/11 23:55:29 INFO Aborted multipart uploads count=0 kept=047052026/11/11 23:55:29 WARN Force mode enabled - objects will be deleted immediately without grace period47062026/11/11 23:55:29 INFO Received complete upload request method=POST path=/47072026/11/11 23:55:29 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=3 objects-failed-to-delete=047082026/11/11 23:55:29 INFO Completed upload id=21 objects=9 duration=695.417µs47092026/11/11 23:55:29 INFO Received push request method=POST path=/47102026/11/11 23:55:29 INFO Vacuumed table table=pending_closures47112026/11/11 23:55:29 INFO Received complete push request method=POST path=/47122026/11/11 23:55:29 INFO Received push request method=POST path=/47132026/11/11 23:55:29 INFO Completed push id=25 objects=10 duration=469.375µs47142026/11/11 23:55:29 INFO Vacuumed table table=pending_objects47152026/11/11 23:55:29 INFO Received push request method=POST path=/47162026/11/11 23:55:29 INFO Received complete upload request method=POST path=/47172026/11/11 23:55:29 INFO Vacuumed table table=multipart_uploads47182026/11/11 23:55:29 INFO Completed upload id=29 objects=5 duration=458.667µs47192026/11/11 23:55:29 INFO Received complete upload request method=POST path=/47202026/11/11 23:55:29 INFO Vacuumed table table=closures47212026/11/11 23:55:29 INFO Completed upload id=22 objects=6 duration=250.541µs47222026/11/11 23:55:29 INFO Vacuumed table table=objects47232026/11/11 23:55:29 INFO Received complete upload request method=POST path=/47242026/11/11 23:55:29 INFO Completed upload id=30 objects=2 duration=271.625µs47252026/11/11 23:55:29 INFO Received uploads request method=POST path=/47262026/11/11 23:55:29 INFO Received complete push request method=POST path=/47272026/11/11 23:55:29 INFO Received complete upload request method=POST path=/47282026/11/11 23:55:29 INFO Completed push id=31 objects=20 duration=337µs47292026/11/11 23:55:29 INFO Received uploads request method=POST path=/47302026/11/11 23:55:29 INFO Received complete push request method=POST path=/47312026/11/11 23:55:29 INFO Completed upload id=21 objects=7 duration=962.292µs47322026/11/11 23:55:29 INFO Received complete upload request method=POST path=/47332026/11/11 23:55:29 INFO Completed upload id=32 objects=5 duration=155.5µs47342026/11/11 23:55:29 INFO Completed push id=1 objects=11 duration=460.917µs47352026/11/11 23:55:29 INFO Received push request method=POST path=/47362026/11/11 23:55:29 INFO Received push request method=POST path=/47372026/11/11 23:55:29 INFO Received push request method=POST path=/47382026/11/11 23:55:29 INFO Received complete upload request method=POST path=/47392026/11/11 23:55:29 INFO Completed upload id=33 objects=3 duration=402.666µs47402026/11/11 23:55:29 INFO Received uploads request method=POST path=/47412026/11/11 23:55:29 INFO Received uploads request method=POST path=/47422026/11/11 23:55:29 INFO Aborted multipart uploads count=0 kept=047432026/11/11 23:55:29 WARN Force mode enabled - objects will be deleted immediately without grace period47442026/11/11 23:55:29 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=047452026/11/11 23:55:29 INFO Received uploads request method=POST path=/47462026/11/11 23:55:29 INFO Received uploads request method=POST path=/47472026/11/11 23:55:29 INFO Received complete upload request method=POST path=/47482026/11/11 23:55:29 INFO Completed upload id=27 objects=4 duration=267.084µs47492026/11/11 23:55:29 INFO Received uploads request method=POST path=/47502026/11/11 23:55:29 INFO Vacuumed table table=pending_closures47512026/11/11 23:55:29 INFO Received complete push request method=POST path=/47522026/11/11 23:55:29 INFO Completed push id=13 objects=11 duration=532.542µs47532026/11/11 23:55:29 INFO Received uploads request method=POST path=/47542026/11/11 23:55:29 INFO Received complete upload request method=POST path=/47552026/11/11 23:55:29 INFO Vacuumed table table=pending_objects47562026/11/11 23:55:29 INFO Received uploads request method=POST path=/47572026/11/11 23:55:29 INFO Vacuumed table table=multipart_uploads47582026/11/11 23:55:29 INFO Completed upload id=16 objects=3 duration=432.833µs47592026/11/11 23:55:29 INFO Received uploads request method=POST path=/47602026/11/11 23:55:29 INFO Aborted multipart uploads count=0 kept=047612026/11/11 23:55:29 INFO Vacuumed table table=closures47622026/11/11 23:55:29 INFO Vacuumed table table=objects47632026/11/11 23:55:29 WARN Force mode enabled - objects will be deleted immediately without grace period47642026/11/11 23:55:29 INFO Received push request method=POST path=/47652026/11/11 23:55:29 INFO Received push request method=POST path=/47662026/11/11 23:55:29 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=047672026/11/11 23:55:29 INFO Received push request method=POST path=/47682026/11/11 23:55:29 INFO Vacuumed table table=pending_closures47692026/11/11 23:55:29 INFO Vacuumed table table=pending_objects47702026/11/11 23:55:29 INFO Vacuumed table table=multipart_uploads47712026/11/11 23:55:29 INFO Vacuumed table table=closures47722026/11/11 23:55:29 INFO Vacuumed table table=objects47732026/11/11 23:55:29 INFO Received uploads request method=POST path=/47742026/11/11 23:55:29 INFO Received complete upload request method=POST path=/47752026/11/11 23:55:29 INFO Completed upload id=34 objects=24 duration=365.166µs47762026/11/11 23:55:29 INFO Aborted multipart uploads count=0 kept=047772026/11/11 23:55:29 WARN Force mode enabled - objects will be deleted immediately without grace period47782026/11/11 23:55:29 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=047792026/11/11 23:55:29 INFO Received complete upload request method=POST path=/47802026/11/11 23:55:29 INFO Received complete push request method=POST path=/47812026/11/11 23:55:29 INFO Completed upload id=2 objects=7 duration=355.5µs47822026/11/11 23:55:29 INFO Completed push id=16 objects=14 duration=648.125µs47832026/11/11 23:55:29 INFO Vacuumed table table=pending_closures47842026/11/11 23:55:29 INFO Aborted multipart uploads count=0 kept=047852026/11/11 23:55:29 WARN Force mode enabled - objects will be deleted immediately without grace period47862026/11/11 23:55:29 INFO Vacuumed table table=pending_objects47872026/11/11 23:55:29 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=047882026/11/11 23:55:29 INFO Received complete push request method=POST path=/47892026/11/11 23:55:29 INFO Vacuumed table table=multipart_uploads47902026/11/11 23:55:29 INFO Vacuumed table table=pending_closures47912026/11/11 23:55:29 INFO Vacuumed table table=closures47922026/11/11 23:55:29 INFO Completed push id=28 objects=19 duration=6.1455ms47932026/11/11 23:55:29 INFO Vacuumed table table=pending_objects47942026/11/11 23:55:29 INFO Vacuumed table table=objects47952026/11/11 23:55:29 INFO Vacuumed table table=multipart_uploads47962026/11/11 23:55:29 INFO Vacuumed table table=closures47972026/11/11 23:55:29 INFO Vacuumed table table=objects47982026/11/11 23:55:29 INFO Aborted multipart uploads count=0 kept=047992026/11/11 23:55:29 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=048002026/11/11 23:55:29 INFO Vacuumed table table=pending_closures48012026/11/11 23:55:29 INFO Vacuumed table table=pending_objects48022026/11/11 23:55:29 INFO Vacuumed table table=multipart_uploads48032026/11/11 23:55:29 INFO Vacuumed table table=closures48042026/11/11 23:55:29 INFO Vacuumed table table=objects48052026/11/11 23:55:29 INFO Received push request method=POST path=/48062026/11/11 23:55:29 INFO Received uploads request method=POST path=/48072026/11/11 23:55:29 INFO Received complete upload request method=POST path=/48082026/11/11 23:55:29 INFO Completed upload id=25 objects=6 duration=550.625µs48092026/11/11 23:55:29 INFO Received push request method=POST path=/48102026/11/11 23:55:29 INFO Received uploads request method=POST path=/48112026/11/11 23:55:29 INFO Received complete push request method=POST path=/48122026/11/11 23:55:29 INFO Completed push id=11 objects=9 duration=352.125µs48132026/11/11 23:55:29 INFO Received complete push request method=POST path=/48142026/11/11 23:55:29 INFO Completed push id=29 objects=10 duration=319.625µs48152026/11/11 23:55:29 INFO Received complete push request method=POST path=/48162026/11/11 23:55:29 INFO Completed push id=15 objects=24 duration=593.166µs48172026/11/11 23:55:29 INFO Received complete upload request method=POST path=/48182026/11/11 23:55:29 INFO Received complete upload request method=POST path=/48192026/11/11 23:55:29 INFO Completed upload id=30 objects=6 duration=231.292µs48202026/11/11 23:55:29 INFO Completed upload id=19 objects=2 duration=3.99775ms48212026/11/11 23:55:29 INFO Received complete upload request method=POST path=/48222026/11/11 23:55:29 INFO Received complete upload request method=POST path=/48232026/11/11 23:55:29 INFO Received complete upload request method=POST path=/48242026/11/11 23:55:29 INFO Completed upload id=8 objects=6 duration=304.833µs48252026/11/11 23:55:29 INFO Completed upload id=31 objects=5 duration=391.292µs48262026/11/11 23:55:29 INFO Completed upload id=24 objects=7 duration=451.792µs48272026/11/11 23:55:29 INFO Received complete push request method=POST path=/48282026/11/11 23:55:29 INFO Received complete upload request method=POST path=/48292026/11/11 23:55:29 INFO Completed push id=26 objects=3 duration=252.292µs48302026/11/11 23:55:29 INFO Completed upload id=34 objects=3 duration=430.625µs48312026/11/11 23:55:29 INFO Received complete upload request method=POST path=/48322026/11/11 23:55:29 INFO Completed upload id=28 objects=8 duration=252.333µs48332026/11/11 23:55:29 INFO Aborted multipart uploads count=0 kept=048342026/11/11 23:55:29 WARN Force mode enabled - objects will be deleted immediately without grace period48352026/11/11 23:55:29 INFO Received complete upload request method=POST path=/48362026/11/11 23:55:29 INFO Completed upload id=29 objects=10 duration=236.084µs48372026/11/11 23:55:29 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=048382026/11/11 23:55:29 INFO Received complete push request method=POST path=/48392026/11/11 23:55:29 INFO Completed push id=4 objects=6 duration=435µs48402026/11/11 23:55:29 INFO Vacuumed table table=pending_closures48412026/11/11 23:55:29 INFO Received complete upload request method=POST path=/48422026/11/11 23:55:29 INFO Completed upload id=30 objects=20 duration=168.334µs48432026/11/11 23:55:29 INFO Received uploads request method=POST path=/48442026/11/11 23:55:29 INFO Vacuumed table table=pending_objects48452026/11/11 23:55:29 INFO Received complete push request method=POST path=/48462026/11/11 23:55:29 INFO Received complete push request method=POST path=/48472026/11/11 23:55:29 INFO Vacuumed table table=multipart_uploads48482026/11/11 23:55:29 INFO Vacuumed table table=closures48492026/11/11 23:55:29 INFO Completed push id=31 objects=11 duration=988.417µs48502026/11/11 23:55:29 INFO Completed push id=16 objects=7 duration=1.319292ms48512026/11/11 23:55:29 INFO Received push request method=POST path=/48522026/11/11 23:55:29 INFO Vacuumed table table=objects48532026/11/11 23:55:29 INFO Received complete upload request method=POST path=/48542026/11/11 23:55:29 INFO Completed upload id=32 objects=2 duration=539.541µs48552026/11/11 23:55:29 INFO Aborted multipart uploads count=0 kept=048562026/11/11 23:55:29 WARN Force mode enabled - objects will be deleted immediately without grace period48572026/11/11 23:55:29 INFO Received complete push request method=POST path=/48582026/11/11 23:55:29 INFO Completed push id=33 objects=3 duration=244.083µs48592026/11/11 23:55:29 INFO Garbage collection completed failed-uploads-deleted=3 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=048602026/11/11 23:55:29 INFO Vacuumed table table=pending_closures48612026/11/11 23:55:29 INFO Received complete upload request method=POST path=/48622026/11/11 23:55:29 INFO Completed upload id=34 objects=3 duration=153.667µs48632026/11/11 23:55:29 INFO Vacuumed table table=pending_objects48642026/11/11 23:55:29 INFO Vacuumed table table=multipart_uploads48652026/11/11 23:55:29 INFO Vacuumed table table=closures48662026/11/11 23:55:29 INFO Aborted multipart uploads count=0 kept=048672026/11/11 23:55:29 INFO Vacuumed table table=objects48682026/11/11 23:55:29 WARN Force mode enabled - objects will be deleted immediately without grace period48692026/11/11 23:55:29 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=048702026/11/11 23:55:29 INFO Received uploads request method=POST path=/48712026/11/11 23:55:29 INFO Vacuumed table table=pending_closures48722026/11/11 23:55:29 INFO Aborted multipart uploads count=0 kept=048732026/11/11 23:55:29 INFO Vacuumed table table=pending_objects48742026/11/11 23:55:29 INFO Vacuumed table table=multipart_uploads48752026/11/11 23:55:29 WARN Force mode enabled - objects will be deleted immediately without grace period48762026/11/11 23:55:29 INFO Vacuumed table table=closures48772026/11/11 23:55:29 INFO Vacuumed table table=objects48782026/11/11 23:55:29 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=048792026/11/11 23:55:29 INFO Vacuumed table table=pending_closures48802026/11/11 23:55:29 INFO Received complete push request method=POST path=/48812026/11/11 23:55:29 INFO Completed push id=23 objects=6 duration=370.25µs48822026/11/11 23:55:29 INFO Vacuumed table table=pending_objects48832026/11/11 23:55:29 INFO Vacuumed table table=multipart_uploads48842026/11/11 23:55:29 INFO Vacuumed table table=closures48852026/11/11 23:55:29 INFO Vacuumed table table=objects48862026/11/11 23:55:29 INFO Received complete push request method=POST path=/48872026/11/11 23:55:29 INFO Completed push id=24 objects=6 duration=309.875µs48882026/11/11 23:55:29 INFO Aborted multipart uploads count=0 kept=048892026/11/11 23:55:29 WARN Force mode enabled - objects will be deleted immediately without grace period48902026/11/11 23:55:29 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=048912026/11/11 23:55:29 INFO Vacuumed table table=pending_closures48922026/11/11 23:55:29 INFO Vacuumed table table=pending_objects48932026/11/11 23:55:29 INFO Vacuumed table table=multipart_uploads48942026/11/11 23:55:29 INFO Vacuumed table table=closures48952026/11/11 23:55:29 INFO Vacuumed table table=objects48962026/11/11 23:55:29 INFO Received complete upload request method=POST path=/48972026/11/11 23:55:29 INFO Completed upload id=12 objects=9 duration=368.75µs48982026/11/11 23:55:29 INFO Received complete push request method=POST path=/48992026/11/11 23:55:29 INFO Completed push id=25 objects=7 duration=384.916µs49002026/11/11 23:55:29 INFO Received complete upload request method=POST path=/49012026/11/11 23:55:29 INFO Completed upload id=17 objects=25 duration=1.201208ms49022026/11/11 23:55:29 INFO Received push request method=POST path=/49032026/11/11 23:55:29 INFO Received complete upload request method=POST path=/49042026/11/11 23:55:29 INFO Completed upload id=21 objects=2 duration=202.5µs49052026/11/11 23:55:29 INFO Aborted multipart uploads count=0 kept=049062026/11/11 23:55:29 WARN Force mode enabled - objects will be deleted immediately without grace period49072026/11/11 23:55:29 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=049082026/11/11 23:55:29 INFO Vacuumed table table=pending_closures49092026/11/11 23:55:29 INFO Vacuumed table table=pending_objects49102026/11/11 23:55:29 INFO Vacuumed table table=multipart_uploads49112026/11/11 23:55:29 INFO Vacuumed table table=closures49122026/11/11 23:55:29 INFO Vacuumed table table=objects49132026/11/11 23:55:30 INFO Received complete upload request method=POST path=/49142026/11/11 23:55:30 INFO Completed upload id=26 objects=24 duration=432.542µs49152026/11/11 23:55:30 INFO Received complete push request method=POST path=/49162026/11/11 23:55:30 INFO Completed push id=7 objects=24 duration=3.560333ms49172026/11/11 23:55:30 INFO Received uploads request method=POST path=/49182026/11/11 23:55:30 INFO Received uploads request method=POST path=/49192026/11/11 23:55:30 INFO Received uploads request method=POST path=/49202026/11/11 23:55:30 INFO Received complete upload request method=POST path=/49212026/11/11 23:55:30 INFO Received push request method=POST path=/49222026/11/11 23:55:30 INFO Completed upload id=27 objects=26 duration=318.5µs49232026/11/11 23:55:30 INFO Received uploads request method=POST path=/49242026/11/11 23:55:30 INFO Received complete push request method=POST path=/49252026/11/11 23:55:30 INFO Completed push id=28 objects=6 duration=324.25µs49262026/11/11 23:55:30 INFO Received complete push request method=POST path=/49272026/11/11 23:55:30 INFO Received complete push request method=POST path=/49282026/11/11 23:55:30 INFO Completed push id=29 objects=6 duration=266.834µs49292026/11/11 23:55:30 INFO Completed push id=13 objects=2 duration=5.453542ms49302026/11/11 23:55:30 INFO Received complete upload request method=POST path=/49312026/11/11 23:55:30 INFO Completed upload id=27 objects=13 duration=506.583µs49322026/11/11 23:55:30 INFO Aborted multipart uploads count=0 kept=049332026/11/11 23:55:30 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=049342026/11/11 23:55:30 INFO Vacuumed table table=pending_closures49352026/11/11 23:55:30 INFO Vacuumed table table=pending_objects49362026/11/11 23:55:30 INFO Vacuumed table table=multipart_uploads49372026/11/11 23:55:30 INFO Vacuumed table table=closures49382026/11/11 23:55:30 INFO Vacuumed table table=objects49392026/11/11 23:55:30 INFO Received uploads request method=POST path=/49402026/11/11 23:55:30 INFO Received push request method=POST path=/49412026/11/11 23:55:30 INFO Received push request method=POST path=/49422026/11/11 23:55:30 INFO Received uploads request method=POST path=/49432026/11/11 23:55:30 INFO Received uploads request method=POST path=/49442026/11/11 23:55:30 INFO Received complete upload request method=POST path=/49452026/11/11 23:55:30 INFO Completed upload id=29 objects=4 duration=506µs49462026/11/11 23:55:30 INFO Received uploads request method=POST path=/49472026/11/11 23:55:30 INFO Received uploads request method=POST path=/49482026/11/11 23:55:30 INFO Received complete upload request method=POST path=/49492026/11/11 23:55:30 INFO Completed upload id=30 objects=8 duration=206.5µs49502026/11/11 23:55:30 INFO Received complete upload request method=POST path=/49512026/11/11 23:55:30 INFO Completed upload id=18 objects=22 duration=284.041µs49522026/11/11 23:55:30 INFO Received complete push request method=POST path=/49532026/11/11 23:55:30 INFO Completed push id=11 objects=6 duration=395.125µs49542026/11/11 23:55:30 INFO Received complete upload request method=POST path=/49552026/11/11 23:55:30 INFO Completed upload id=21 objects=8 duration=314.375µs49562026/11/11 23:55:30 INFO Received complete upload request method=POST path=/49572026/11/11 23:55:30 INFO Completed upload id=31 objects=6 duration=188.542µs49582026/11/11 23:55:30 INFO Received complete upload request method=POST path=/49592026/11/11 23:55:30 INFO Completed upload id=32 objects=4 duration=346.75µs49602026/11/11 23:55:30 INFO Received complete push request method=POST path=/49612026/11/11 23:55:30 INFO Completed push id=20 objects=13 duration=284.792µs49622026/11/11 23:55:30 INFO Received complete push request method=POST path=/49632026/11/11 23:55:30 INFO Completed push id=22 objects=4 duration=448.375µs49642026/11/11 23:55:30 INFO Received complete upload request method=POST path=/49652026/11/11 23:55:30 INFO Completed upload id=22 objects=7 duration=161.542µs49662026/11/11 23:55:30 INFO Received complete push request method=POST path=/49672026/11/11 23:55:30 INFO Completed push id=24 objects=5 duration=175.292µs49682026/11/11 23:55:30 INFO Received complete upload request method=POST path=/49692026/11/11 23:55:30 INFO Completed upload id=33 objects=10 duration=236.5µs49702026/11/11 23:55:30 INFO Received complete upload request method=POST path=/49712026/11/11 23:55:30 INFO Completed upload id=23 objects=7 duration=218.75µs49722026/11/11 23:55:30 INFO Received complete push request method=POST path=/49732026/11/11 23:55:30 INFO Completed push id=24 objects=5 duration=270.375µs49742026/11/11 23:55:30 INFO Received complete upload request method=POST path=/49752026/11/11 23:55:30 INFO Completed upload id=25 objects=8 duration=164.583µs49762026/11/11 23:55:30 INFO Received complete upload request method=POST path=/49772026/11/11 23:55:30 INFO Completed upload id=25 objects=2 duration=330.375µs49782026/11/11 23:55:30 INFO Received complete push request method=POST path=/49792026/11/11 23:55:30 INFO Completed push id=26 objects=4 duration=170.958µs49802026/11/11 23:55:30 INFO Received complete upload request method=POST path=/49812026/11/11 23:55:30 INFO Completed upload id=26 objects=20 duration=476.083µs49822026/11/11 23:55:30 INFO Received complete push request method=POST path=/49832026/11/11 23:55:30 INFO Completed push id=30 objects=2 duration=175µs49842026/11/11 23:55:30 INFO Received complete upload request method=POST path=/49852026/11/11 23:55:30 INFO Completed upload id=34 objects=23 duration=205.375µs49862026/11/11 23:55:30 INFO Received complete push request method=POST path=/49872026/11/11 23:55:30 INFO Completed push id=28 objects=7 duration=226.25µs49882026/11/11 23:55:30 INFO Received complete push request method=POST path=/49892026/11/11 23:55:30 INFO Received complete push request method=POST path=/49902026/11/11 23:55:30 INFO Completed push id=35 objects=6 duration=195.083µs49912026/11/11 23:55:30 INFO Completed push id=32 objects=7 duration=3.131541ms49922026/11/11 23:55:30 INFO Aborted multipart uploads count=0 kept=049932026/11/11 23:55:30 WARN Force mode enabled - objects will be deleted immediately without grace period49942026/11/11 23:55:30 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=049952026/11/11 23:55:30 INFO Received complete upload request method=POST path=/49962026/11/11 23:55:30 INFO Completed upload id=30 objects=6 duration=144.75µs49972026/11/11 23:55:30 INFO Vacuumed table table=pending_closures49982026/11/11 23:55:30 INFO Received complete push request method=POST path=/49992026/11/11 23:55:30 INFO Vacuumed table table=pending_objects50002026/11/11 23:55:30 INFO Completed push id=31 objects=5 duration=153.833µs50012026/11/11 23:55:30 INFO Vacuumed table table=multipart_uploads50022026/11/11 23:55:30 INFO Vacuumed table table=closures50032026/11/11 23:55:30 INFO Vacuumed table table=objects50042026/11/11 23:55:30 INFO Received complete upload request method=POST path=/50052026/11/11 23:55:30 INFO Completed upload id=33 objects=6 duration=167.333µs50062026/11/11 23:55:30 INFO Received complete upload request method=POST path=/50072026/11/11 23:55:30 INFO Completed upload id=34 objects=3 duration=132.042µs50082026/11/11 23:55:30 INFO Aborted multipart uploads count=0 kept=050092026/11/11 23:55:30 WARN Force mode enabled - objects will be deleted immediately without grace period50102026/11/11 23:55:30 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=050112026/11/11 23:55:30 INFO Vacuumed table table=pending_closures50122026/11/11 23:55:30 INFO Vacuumed table table=pending_objects50132026/11/11 23:55:30 INFO Vacuumed table table=multipart_uploads50142026/11/11 23:55:30 INFO Vacuumed table table=closures50152026/11/11 23:55:30 INFO Vacuumed table table=objects50162026/11/11 23:55:30 INFO Received complete push request method=POST path=/50172026/11/11 23:55:30 INFO Completed push id=32 objects=26 duration=333.542µs50182026/11/11 23:55:30 INFO Received complete upload request method=POST path=/50192026/11/11 23:55:30 INFO Completed upload id=33 objects=2 duration=127.042µs50202026/11/11 23:55:30 INFO Received complete upload request method=POST path=/50212026/11/11 23:55:30 INFO Completed upload id=34 objects=5 duration=134.584µs50222026/11/11 23:55:30 INFO Received complete upload request method=POST path=/50232026/11/11 23:55:30 INFO Completed upload id=35 objects=11 duration=117.083µs50242026/11/11 23:55:30 INFO Received complete upload request method=POST path=/50252026/11/11 23:55:30 INFO Completed upload id=36 objects=3 duration=112.791µs50262026/11/11 23:55:30 INFO Aborted multipart uploads count=0 kept=050272026/11/11 23:55:30 WARN Force mode enabled - objects will be deleted immediately without grace period50282026/11/11 23:55:30 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=050292026/11/11 23:55:30 INFO Vacuumed table table=pending_closures50302026/11/11 23:55:30 INFO Vacuumed table table=pending_objects50312026/11/11 23:55:30 INFO Vacuumed table table=multipart_uploads50322026/11/11 23:55:30 INFO Vacuumed table table=closures50332026/11/11 23:55:30 INFO Vacuumed table table=objects5034--- PASS: FuzzPushGC (0.01s)5035 --- PASS: FuzzPushGC/seed#0 (6.21s)5036 --- PASS: FuzzPushGC/seed#8 (7.51s)5037 --- PASS: FuzzPushGC/seed#7 (7.85s)5038 --- PASS: FuzzPushGC/seed#4 (11.03s)5039 --- PASS: FuzzPushGC/seed#1 (11.72s)5040 --- PASS: FuzzPushGC/seed#14 (12.02s)5041 --- PASS: FuzzPushGC/seed#3 (12.69s)5042 --- PASS: FuzzPushGC/seed#15 (13.32s)5043 --- PASS: FuzzPushGC/seed#2 (13.32s)5044 --- PASS: FuzzPushGC/seed#6 (13.53s)5045 --- PASS: FuzzPushGC/seed#9 (13.68s)5046 --- PASS: FuzzPushGC/seed#13 (13.95s)5047 --- PASS: FuzzPushGC/seed#5 (14.04s)5048 --- PASS: FuzzPushGC/seed#12 (14.83s)5049 --- PASS: FuzzPushGC/seed#10 (14.86s)5050 --- PASS: FuzzPushGC/seed#11 (14.90s)5051PASS5052{"timestamp":"2026-11-11T23:55:30.687929Z","level":"ERROR","message":"HTTP transport failed","event":"http_transport_failed","component":"server","subsystem":"transport","peer_addr":"127.0.0.1:60670","error_kind":"io_error","error":"Cancelled","result":"transport_error","target":"rustfs::server::http","filename":"rustfs/src/server/http.rs","line_number":2561,"threadName":"rustfs-worker","threadId":"ThreadId(11)"}5053{"timestamp":"2026-11-11T23:55:30.688029Z","level":"ERROR","message":"HTTP transport failed","event":"http_transport_failed","component":"server","subsystem":"transport","peer_addr":"127.0.0.1:60597","error_kind":"io_error","error":"Cancelled","result":"transport_error","target":"rustfs::server::http","filename":"rustfs/src/server/http.rs","line_number":2561,"threadName":"rustfs-worker","threadId":"ThreadId(11)"}5054{"timestamp":"2026-11-11T23:55:30.688081Z","level":"ERROR","message":"HTTP transport failed","event":"http_transport_failed","component":"server","subsystem":"transport","peer_addr":"127.0.0.1:60673","error_kind":"io_error","error":"Cancelled","result":"transport_error","target":"rustfs::server::http","filename":"rustfs/src/server/http.rs","line_number":2561,"threadName":"rustfs-worker","threadId":"ThreadId(7)"}5055{"timestamp":"2026-11-11T23:55:30.688454Z","level":"ERROR","message":"HTTP transport failed","event":"http_transport_failed","component":"server","subsystem":"transport","peer_addr":"127.0.0.1:60408","error_kind":"io_error","error":"Cancelled","result":"transport_error","target":"rustfs::server::http","filename":"rustfs/src/server/http.rs","line_number":2561,"threadName":"rustfs-worker","threadId":"ThreadId(3)"}50562026-11-11 23:55:30.827 UTC [94789] LOG: received smart shutdown request50572026-11-11 23:55:30.828 UTC [94789] LOG: background worker "logical replication launcher" (PID 94799) exited with exit code 150582026-11-11 23:55:31.786 UTC [94794] LOG: checkpoint complete: wrote 3623 buffers (22.1%), wrote 5 SLRU buffers; 0 WAL file(s) added, 0 removed, 33 recycled; write=28.516 s, sync=0.837 s, total=29.557 s; sync files=42365, longest=0.017 s, average=0.001 s; distance=533556 kB, estimate=533556 kB; lsn=0/278C3D88, redo lsn=0/2209A32850592026-11-11 23:55:31.788 UTC [94794] LOG: shutting down50602026-11-11 23:55:31.788 UTC [94794] LOG: checkpoint starting: shutdown immediate50612026-11-11 23:55:32.280 UTC [94794] LOG: checkpoint complete: wrote 8954 buffers (54.7%), wrote 2 SLRU buffers; 0 WAL file(s) added, 0 removed, 5 recycled; write=0.436 s, sync=0.049 s, total=0.493 s; sync files=2897, longest=0.001 s, average=0.001 s; distance=90278 kB, estimate=489229 kB; lsn=0/278C3E00, redo lsn=0/278C3E0050622026-11-11 23:55:32.287 UTC [94789] LOG: database system is shut down5063Running OIDC tests...5064=== RUN TestAudienceForIssuer5065=== PAUSE TestAudienceForIssuer5066=== RUN TestGlobMatch5067=== PAUSE TestGlobMatch5068=== RUN TestValidateToken_ValidToken5069=== PAUSE TestValidateToken_ValidToken5070=== RUN TestValidateToken_WrongAudience5071=== PAUSE TestValidateToken_WrongAudience5072=== RUN TestValidateToken_Expired5073=== PAUSE TestValidateToken_Expired5074=== RUN TestValidateToken_BoundClaimsMismatch5075=== PAUSE TestValidateToken_BoundClaimsMismatch5076=== RUN TestValidateToken_BoundSubjectMismatch5077=== PAUSE TestValidateToken_BoundSubjectMismatch5078=== RUN TestValidateToken_MultipleProviders5079=== PAUSE TestValidateToken_MultipleProviders5080=== RUN TestValidateToken_NoMatchingProvider5081=== PAUSE TestValidateToken_NoMatchingProvider5082=== RUN TestValidateToken_KubernetesServiceAccount5083=== PAUSE TestValidateToken_KubernetesServiceAccount5084=== RUN TestNewValidator_KubernetesRequiresCA5085=== PAUSE TestNewValidator_KubernetesRequiresCA5086=== RUN TestValidateToken_KubernetesIssuerFromOwnToken5087=== PAUSE TestValidateToken_KubernetesIssuerFromOwnToken5088=== RUN TestPins_ReservedForMatchingRule5089=== PAUSE TestPins_ReservedForMatchingRule5090=== RUN TestPins_TopLevelShorthand5091=== PAUSE TestPins_TopLevelShorthand5092=== RUN TestPins_ConfigValidation5093=== PAUSE TestPins_ConfigValidation5094=== RUN TestScopes_LegacyProviderDefaultsToWrite5095=== PAUSE TestScopes_LegacyProviderDefaultsToWrite5096=== RUN TestScopes_Rules5097=== PAUSE TestScopes_Rules5098=== RUN TestScopes_ConfigValidation5099=== PAUSE TestScopes_ConfigValidation5100=== CONT TestAudienceForIssuer5101--- PASS: TestAudienceForIssuer (0.00s)5102=== CONT TestPins_ConfigValidation5103=== CONT TestValidateToken_NoMatchingProvider5104=== CONT TestScopes_Rules5105=== CONT TestValidateToken_MultipleProviders5106=== CONT TestValidateToken_BoundSubjectMismatch5107=== CONT TestValidateToken_BoundClaimsMismatch5108=== CONT TestValidateToken_Expired5109=== CONT TestValidateToken_WrongAudience5110=== CONT TestValidateToken_ValidToken5111=== CONT TestGlobMatch5112=== RUN TestGlobMatch/foo_foo5113=== PAUSE TestGlobMatch/foo_foo5114=== RUN TestGlobMatch/foo_bar5115=== PAUSE TestGlobMatch/foo_bar5116=== RUN TestGlobMatch/*_5117=== PAUSE TestGlobMatch/*_5118=== RUN TestGlobMatch/*_anything5119=== PAUSE TestGlobMatch/*_anything5120=== RUN TestGlobMatch/foo*_foo5121=== PAUSE TestGlobMatch/foo*_foo5122=== RUN TestGlobMatch/foo*_foobar5123=== PAUSE TestGlobMatch/foo*_foobar5124=== RUN TestGlobMatch/foo*_bar5125=== PAUSE TestGlobMatch/foo*_bar5126=== RUN TestGlobMatch/*bar_bar5127=== PAUSE TestGlobMatch/*bar_bar5128=== RUN TestGlobMatch/*bar_foobar5129=== PAUSE TestGlobMatch/*bar_foobar5130=== RUN TestGlobMatch/*bar_foo5131=== PAUSE TestGlobMatch/*bar_foo5132=== RUN TestGlobMatch/foo*bar_foobar5133=== PAUSE TestGlobMatch/foo*bar_foobar5134=== RUN TestGlobMatch/foo*bar_foo123bar5135=== PAUSE TestGlobMatch/foo*bar_foo123bar5136=== RUN TestGlobMatch/foo*bar_foobarbaz5137=== PAUSE TestGlobMatch/foo*bar_foobarbaz5138=== RUN TestGlobMatch/*/*_foo/bar5139=== PAUSE TestGlobMatch/*/*_foo/bar5140=== RUN TestGlobMatch/*/*_foo5141=== PAUSE TestGlobMatch/*/*_foo5142=== RUN TestGlobMatch/refs/heads/*_refs/heads/main5143=== PAUSE TestGlobMatch/refs/heads/*_refs/heads/main5144=== RUN TestGlobMatch/refs/heads/*_refs/tags/v1.05145--- PASS: TestPins_ConfigValidation (0.01s)5146=== PAUSE TestGlobMatch/refs/heads/*_refs/tags/v1.05147=== CONT TestScopes_ConfigValidation5148=== CONT TestPins_ReservedForMatchingRule5149=== CONT TestPins_TopLevelShorthand5150=== CONT TestValidateToken_KubernetesIssuerFromOwnToken5151=== CONT TestNewValidator_KubernetesRequiresCA5152=== CONT TestScopes_LegacyProviderDefaultsToWrite5153=== CONT TestValidateToken_KubernetesServiceAccount5154=== RUN TestGlobMatch/refs/*/main_refs/heads/main5155=== PAUSE TestGlobMatch/refs/*/main_refs/heads/main5156=== RUN TestGlobMatch/fo?_foo5157=== PAUSE TestGlobMatch/fo?_foo5158=== RUN TestGlobMatch/fo?_fo5159=== PAUSE TestGlobMatch/fo?_fo5160=== RUN TestGlobMatch/fo?_fooo5161=== PAUSE TestGlobMatch/fo?_fooo5162=== RUN TestGlobMatch/?oo_foo5163=== PAUSE TestGlobMatch/?oo_foo5164=== RUN TestGlobMatch/?oo_boo5165=== PAUSE TestGlobMatch/?oo_boo5166=== RUN TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main5167=== PAUSE TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main5168=== RUN TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main5169=== PAUSE TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main5170=== CONT TestGlobMatch/foo_foo5171=== CONT TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main5172=== CONT TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main5173=== CONT TestGlobMatch/?oo_boo5174=== CONT TestGlobMatch/?oo_foo5175=== CONT TestGlobMatch/fo?_fooo5176=== CONT TestGlobMatch/fo?_fo5177=== CONT TestGlobMatch/fo?_foo5178=== CONT TestGlobMatch/refs/*/main_refs/heads/main5179=== CONT TestGlobMatch/refs/heads/*_refs/tags/v1.05180=== CONT TestGlobMatch/refs/heads/*_refs/heads/main5181=== CONT TestGlobMatch/*/*_foo5182=== CONT TestGlobMatch/*/*_foo/bar5183=== CONT TestGlobMatch/foo*bar_foobarbaz5184=== CONT TestGlobMatch/foo*bar_foo123bar5185=== CONT TestGlobMatch/foo*bar_foobar5186=== CONT TestGlobMatch/*bar_foo5187=== CONT TestGlobMatch/*bar_foobar5188=== CONT TestGlobMatch/*bar_bar5189=== CONT TestGlobMatch/foo*_bar5190=== CONT TestGlobMatch/foo*_foobar5191=== CONT TestGlobMatch/foo*_foo5192=== CONT TestGlobMatch/*_anything5193=== CONT TestGlobMatch/*_5194=== CONT TestGlobMatch/foo_bar5195--- PASS: TestGlobMatch (0.00s)5196 --- PASS: TestGlobMatch/foo_foo (0.00s)5197 --- PASS: TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main (0.00s)5198 --- PASS: TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main (0.00s)5199 --- PASS: TestGlobMatch/?oo_boo (0.00s)5200 --- PASS: TestGlobMatch/?oo_foo (0.00s)5201 --- PASS: TestGlobMatch/fo?_fooo (0.00s)5202 --- PASS: TestGlobMatch/fo?_fo (0.00s)5203 --- PASS: TestGlobMatch/fo?_foo (0.00s)5204 --- PASS: TestGlobMatch/refs/*/main_refs/heads/main (0.00s)5205 --- PASS: TestGlobMatch/refs/heads/*_refs/tags/v1.0 (0.00s)5206 --- PASS: TestGlobMatch/refs/heads/*_refs/heads/main (0.00s)5207 --- PASS: TestGlobMatch/*/*_foo (0.00s)5208 --- PASS: TestGlobMatch/*/*_foo/bar (0.00s)5209 --- PASS: TestGlobMatch/foo*bar_foobarbaz (0.00s)5210 --- PASS: TestGlobMatch/foo*bar_foo123bar (0.00s)5211 --- PASS: TestGlobMatch/foo*bar_foobar (0.00s)5212 --- PASS: TestGlobMatch/*bar_foo (0.00s)5213 --- PASS: TestGlobMatch/*bar_foobar (0.00s)5214 --- PASS: TestGlobMatch/*bar_bar (0.00s)5215 --- PASS: TestGlobMatch/foo*_bar (0.00s)5216 --- PASS: TestGlobMatch/foo*_foobar (0.00s)5217 --- PASS: TestGlobMatch/foo*_foo (0.00s)5218 --- PASS: TestGlobMatch/*_anything (0.00s)5219 --- PASS: TestGlobMatch/*_ (0.00s)5220 --- PASS: TestGlobMatch/foo_bar (0.00s)5221--- PASS: TestScopes_ConfigValidation (0.00s)52222026/11/11 23:55:34 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:61077/oidc5223--- PASS: TestPins_TopLevelShorthand (0.07s)52242026/11/11 23:55:34 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:61080/oidc52252026/11/11 23:55:34 INFO OIDC provider initialized name=kubernetes issuer=https://oidc.eks.invalid/id/ABC1235226--- PASS: TestScopes_Rules (0.09s)52272026/11/11 23:55:34 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:61083/oidc52282026/11/11 23:55:34 INFO OIDC provider initialized name=provider1 issuer=http://127.0.0.1:61079/oidc5229--- PASS: TestValidateToken_KubernetesIssuerFromOwnToken (0.08s)52302026/11/11 23:55:34 INFO OIDC provider initialized name=provider2 issuer=http://127.0.0.1:61084/oidc5231--- PASS: TestValidateToken_Expired (0.10s)5232--- PASS: TestValidateToken_MultipleProviders (0.10s)52332026/11/11 23:55:34 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:61091/oidc5234--- PASS: TestValidateToken_BoundClaimsMismatch (0.10s)52352026/11/11 23:55:34 INFO OIDC provider initialized name=kubernetes issuer=https://127.0.0.1:610935236--- PASS: TestValidateToken_KubernetesServiceAccount (0.12s)52372026/11/11 23:55:34 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:61095/oidc5238--- PASS: TestScopes_LegacyProviderDefaultsToWrite (0.12s)52392026/11/11 23:55:34 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:61097/oidc5240--- PASS: TestValidateToken_WrongAudience (0.13s)52412026/11/11 23:55:34 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:61100/oidc5242--- PASS: TestValidateToken_ValidToken (0.14s)52432026/11/11 23:55:34 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:61102/oidc5244--- PASS: TestValidateToken_BoundSubjectMismatch (0.14s)52452026/11/11 23:55:34 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:61106/oidc52462026/11/11 23:55:34 INFO OIDC provider initialized name=provider1 issuer=http://127.0.0.1:61099/oidc5247--- PASS: TestPins_ReservedForMatchingRule (0.19s)5248--- PASS: TestValidateToken_NoMatchingProvider (0.20s)52492026/11/11 23:55:34 http: TLS handshake error from 127.0.0.1:61105: read tcp 127.0.0.1:61104->127.0.0.1:61105: use of closed network connection5250--- PASS: TestNewValidator_KubernetesRequiresCA (0.19s)5251PASS5252Running hook tests...5253=== RUN TestSendPathsEmpty5254=== PAUSE TestSendPathsEmpty5255=== RUN TestQueueEnqueueAndFetch5256=== PAUSE TestQueueEnqueueAndFetch5257=== RUN TestQueueDeduplication5258=== PAUSE TestQueueDeduplication5259=== RUN TestQueueRemove5260=== PAUSE TestQueueRemove5261=== RUN TestQueueFetchBatchLimit5262=== PAUSE TestQueueFetchBatchLimit5263=== RUN TestQueueRetryMovesToBack5264=== PAUSE TestQueueRetryMovesToBack5265=== RUN TestQueueFetchRemoveLifecycle5266=== PAUSE TestQueueFetchRemoveLifecycle5267=== RUN TestQueueConcurrentWriters5268=== PAUSE TestQueueConcurrentWriters5269=== RUN TestQueueRemoveLargeClosure5270=== PAUSE TestQueueRemoveLargeClosure5271=== RUN TestServerClientIntegration5272--- PASS: TestServerClientIntegration (0.00s)5273=== RUN TestServerQueueError52742026/11/11 23:55:34 ERROR Failed to queue paths error="permission denied" count=15275--- PASS: TestServerQueueError (0.00s)5276=== RUN TestGetListenerSocketActivation5277 server_test.go:147: systemd socket activation does not exist on darwin5278--- SKIP: TestGetListenerSocketActivation (0.00s)5279=== RUN TestServerStalledClientDoesNotBlockShutdown5280=== PAUSE TestServerStalledClientDoesNotBlockShutdown5281=== RUN TestServerBacksOffOnAcceptErrors5282=== PAUSE TestServerBacksOffOnAcceptErrors5283=== RUN TestDrainIsolatesPoisonPath5284=== PAUSE TestDrainIsolatesPoisonPath5285=== RUN TestRunNotBlockedByPoisonHead5286=== PAUSE TestRunNotBlockedByPoisonHead5287=== RUN TestDrainGivesUpWhenServerDown5288=== PAUSE TestDrainGivesUpWhenServerDown5289=== RUN TestFailedPathPrunedByLaterClosure5290=== PAUSE TestFailedPathPrunedByLaterClosure5291=== RUN TestWorkerUploadsAndRemoves5292=== PAUSE TestWorkerUploadsAndRemoves5293=== RUN TestWorkerSkipsGCdPaths5294=== PAUSE TestWorkerSkipsGCdPaths5295=== RUN TestWorkerPrunesClosureDeps5296=== PAUSE TestWorkerPrunesClosureDeps5297=== RUN TestDrainTimeout5298=== PAUSE TestDrainTimeout5299=== RUN TestWorkerRemoveFailureIsNotProgress5300=== PAUSE TestWorkerRemoveFailureIsNotProgress5301=== RUN TestWorkerKeepsPathItCannotStat5302=== PAUSE TestWorkerKeepsPathItCannotStat5303=== CONT TestSendPathsEmpty5304--- PASS: TestSendPathsEmpty (0.00s)5305=== CONT TestDrainGivesUpWhenServerDown5306=== CONT TestQueueFetchBatchLimit5307=== CONT TestWorkerKeepsPathItCannotStat5308=== CONT TestWorkerRemoveFailureIsNotProgress5309=== CONT TestDrainTimeout5310=== CONT TestWorkerPrunesClosureDeps5311=== CONT TestWorkerSkipsGCdPaths5312=== CONT TestWorkerUploadsAndRemoves5313=== CONT TestFailedPathPrunedByLaterClosure5314=== CONT TestQueueRemove5315=== CONT TestQueueDeduplication5316=== CONT TestQueueRetryMovesToBack5317=== CONT TestQueueEnqueueAndFetch5318=== CONT TestDrainIsolatesPoisonPath5319=== CONT TestServerBacksOffOnAcceptErrors53202000/01/01 00:00:00 ERROR Accept failed error="too many open files"53212000/01/01 00:00:00 ERROR Accept failed error="too many open files"53222000/01/01 00:00:00 ERROR Accept failed error="too many open files"53232000/01/01 00:00:00 ERROR Accept failed error="too many open files"53242000/01/01 00:00:00 ERROR Accept failed error="too many open files"5325=== CONT TestServerStalledClientDoesNotBlockShutdown5326=== CONT TestQueueConcurrentWriters53272000/01/01 00:00:00 ERROR Accept failed error="too many open files"53282000/01/01 00:00:00 ERROR Accept failed error="too many open files"53292000/01/01 00:00:00 ERROR Accept failed error="too many open files"5330--- PASS: TestServerBacksOffOnAcceptErrors (0.00s)5331=== CONT TestQueueFetchRemoveLifecycle5332=== CONT TestQueueRemoveLargeClosure5333=== CONT TestRunNotBlockedByPoisonHead53342026/11/11 23:55:34 WARN Cannot stat store path, will retry later path=/private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestWorkerKeepsPathItCannotStat215152217/002/locked/aaa error="stat /private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestWorkerKeepsPathItCannotStat215152217/002/locked/aaa: permission denied"53352026/11/11 23:55:34 INFO Upload queue status pending=253362026/11/11 23:55:34 INFO Uploading batch count=253372026/11/11 23:55:34 WARN Cannot stat store path, will retry later path=/private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestWorkerKeepsPathItCannotStat215152217/002/locked/aaa error="stat /private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestWorkerKeepsPathItCannotStat215152217/002/locked/aaa: permission denied"53382026/11/11 23:55:34 INFO Upload queue status pending=35339--- PASS: TestQueueRetryMovesToBack (0.01s)53402026/11/11 23:55:34 INFO Uploading batch count=153412026/11/11 23:55:34 ERROR Upload failed error="upload failed" count=15342--- PASS: TestQueueFetchBatchLimit (0.01s)53432026/11/11 23:55:34 WARN Cannot stat store path, will retry later path=/private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestWorkerKeepsPathItCannotStat215152217/002/locked/aaa error="stat /private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestWorkerKeepsPathItCannotStat215152217/002/locked/aaa: permission denied"53442026/11/11 23:55:34 INFO Upload queue status pending=253452026/11/11 23:55:34 INFO Uploading batch count=153462026/11/11 23:55:34 ERROR Upload failed error="upload failed" count=153472026/11/11 23:55:34 WARN Store path no longer exists (garbage collected?), removing from queue path=/private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestWorkerSkipsGCdPaths2756344895/002/nonexistent5348--- PASS: TestQueueRemove (0.01s)53492026/11/11 23:55:34 INFO Uploading batch count=453502026/11/11 23:55:34 ERROR Upload failed error="upload failed" count=453512026/11/11 23:55:34 ERROR Drain finished with paths left in queue remaining=153522026/11/11 23:55:34 INFO Uploading batch count=153532000/01/01 00:00:00 INFO Uploading batch count=253542000/01/01 00:00:00 ERROR Upload failed error="context deadline exceeded" count=25355--- PASS: TestQueueEnqueueAndFetch (0.01s)53562026/11/11 23:55:34 INFO Uploading batch count=153572000/01/01 00:00:00 ERROR Drain finished with paths left in queue remaining=453582026/11/11 23:55:34 ERROR Upload failed, will retry later error="upload failed" path=/private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestDrainIsolatesPoisonPath2305383677/002/bbb53592026/11/11 23:55:34 INFO Uploading batch count=153602026/11/11 23:55:34 INFO Upload queue status pending=253612026/11/11 23:55:34 INFO Uploading batch count=153622026/11/11 23:55:34 WARN Store path no longer exists (garbage collected?), removing from queue path=/private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestWorkerRemoveFailureIsNotProgress3888077152/002/nonexistent53632026/11/11 23:55:34 ERROR Failed to remove paths from queue error="deleting paths: attempt to write a readonly database (8)" count=153642026/11/11 23:55:34 WARN Store path no longer exists (garbage collected?), removing from queue path=/private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestWorkerRemoveFailureIsNotProgress3888077152/002/nonexistent53652026/11/11 23:55:34 ERROR Failed to remove paths from queue error="deleting paths: attempt to write a readonly database (8)" count=153662026/11/11 23:55:34 INFO Uploading batch count=153672026/11/11 23:55:34 ERROR Upload failed error="upload failed" count=15368--- PASS: TestQueueFetchRemoveLifecycle (0.01s)53692026/11/11 23:55:34 WARN Store path no longer exists (garbage collected?), removing from queue path=/private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestWorkerRemoveFailureIsNotProgress3888077152/002/nonexistent5370--- PASS: TestWorkerKeepsPathItCannotStat (0.02s)53712026/11/11 23:55:34 ERROR Failed to remove paths from queue error="deleting paths: attempt to write a readonly database (8)" count=153722026/11/11 23:55:34 ERROR Drain finished with paths left in queue remaining=15373--- PASS: TestQueueDeduplication (0.02s)53742026/11/11 23:55:34 INFO Uploading batch count=253752026/11/11 23:55:34 ERROR Upload failed error="upload failed" count=253762026/11/11 23:55:34 ERROR Upload failed, will retry later error="upload failed" path=/private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestDrainGivesUpWhenServerDown93791484/002/a53772026/11/11 23:55:34 INFO Uploading batch count=153782026/11/11 23:55:34 ERROR Upload failed error="upload failed" count=153792026/11/11 23:55:34 ERROR Upload failed, will retry later error="upload failed" path=/private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestDrainGivesUpWhenServerDown93791484/002/b5380--- PASS: TestDrainTimeout (0.02s)53812026/11/11 23:55:34 INFO Uploading batch count=253822026/11/11 23:55:34 ERROR Upload failed error="upload failed" count=253832026/11/11 23:55:34 ERROR Upload failed, will retry later error="upload failed" path=/private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestDrainGivesUpWhenServerDown93791484/002/c53842026/11/11 23:55:34 INFO Uploading batch count=153852026/11/11 23:55:34 ERROR Upload failed error="upload failed" count=153862026/11/11 23:55:34 ERROR Upload failed, will retry later error="upload failed" path=/private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestDrainGivesUpWhenServerDown93791484/002/d53872026/11/11 23:55:34 ERROR Drain finished with paths left in queue remaining=153882026/11/11 23:55:34 INFO Uploading batch count=253892026/11/11 23:55:34 ERROR Upload failed error="upload failed" count=253902026/11/11 23:55:34 ERROR Upload failed, will retry later error="upload failed" path=/private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestDrainGivesUpWhenServerDown93791484/002/e5391--- PASS: TestWorkerRemoveFailureIsNotProgress (0.02s)53922026/11/11 23:55:34 ERROR Upload failed, will retry later error="upload failed" path=/private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestDrainGivesUpWhenServerDown93791484/002/f5393--- PASS: TestFailedPathPrunedByLaterClosure (0.02s)53942026/11/11 23:55:34 ERROR Drain finished with paths left in queue remaining=105395--- PASS: TestDrainIsolatesPoisonPath (0.02s)5396--- PASS: TestDrainGivesUpWhenServerDown (0.02s)5397--- PASS: TestWorkerUploadsAndRemoves (0.03s)5398--- PASS: TestWorkerSkipsGCdPaths (0.03s)5399--- PASS: TestWorkerPrunesClosureDeps (0.04s)5400--- PASS: TestQueueRemoveLargeClosure (0.05s)5401--- PASS: TestQueueConcurrentWriters (0.05s)54022026/11/11 23:55:34 ERROR Failed to decode request error="read unix /private/var/tb/5/scratch/0f12ee7d684ae0cb/build/hook3767899901/test.sock->: i/o timeout"54032026/11/11 23:55:34 ERROR Failed to write response error="write unix /private/var/tb/5/scratch/0f12ee7d684ae0cb/build/hook3767899901/test.sock->: i/o timeout"5404--- PASS: TestServerStalledClientDoesNotBlockShutdown (0.20s)54052026/11/11 23:55:35 INFO Uploading batch count=154062026/11/11 23:55:35 INFO Uploading batch count=154072026/11/11 23:55:35 INFO Uploading batch count=154082026/11/11 23:55:35 ERROR Upload failed error="upload failed" count=154092026/11/11 23:55:35 INFO Uploading batch count=154102026/11/11 23:55:35 ERROR Upload failed error="upload failed" count=154112026/11/11 23:55:35 INFO Uploading batch count=154122026/11/11 23:55:35 ERROR Upload failed error="upload failed" count=154132026/11/11 23:55:35 INFO Uploading batch count=154142026/11/11 23:55:35 ERROR Upload failed error="upload failed" count=154152026/11/11 23:55:35 ERROR Drain finished with paths left in queue remaining=15416--- PASS: TestRunNotBlockedByPoisonHead (1.04s)5417PASS5418Running signing tests...5419=== RUN TestExternalSigner5420=== PAUSE TestExternalSigner5421=== RUN TestExternalSignerWrongPublicKey5422=== PAUSE TestExternalSignerWrongPublicKey5423=== RUN TestExternalSignerErrors5424=== PAUSE TestExternalSignerErrors5425=== RUN TestExternalSignerRestartsAfterCrash5426=== PAUSE TestExternalSignerRestartsAfterCrash5427=== RUN TestExternalSignerProgramErrorKeepsProcess5428=== PAUSE TestExternalSignerProgramErrorKeepsProcess5429=== RUN TestExternalSignerClose5430=== PAUSE TestExternalSignerClose5431=== RUN TestExternalSignerRejectsInvalidPublicKey5432=== PAUSE TestExternalSignerRejectsInvalidPublicKey5433=== RUN TestExternalSignerCancellation5434=== PAUSE TestExternalSignerCancellation5435=== RUN TestGenerateFingerprint5436=== PAUSE TestGenerateFingerprint5437=== RUN TestParseSigningKey5438=== PAUSE TestParseSigningKey5439=== RUN TestSign5440=== PAUSE TestSign5441=== RUN TestSignBatch5442=== PAUSE TestSignBatch5443=== RUN TestNilKeyPublicKey5444=== PAUSE TestNilKeyPublicKey5445=== RUN TestSignErrors5446=== PAUSE TestSignErrors5447=== CONT TestExternalSigner5448=== CONT TestExternalSignerCancellation5449=== CONT TestSignBatch5450=== CONT TestExternalSignerProgramErrorKeepsProcess5451=== CONT TestExternalSignerRejectsInvalidPublicKey5452=== RUN TestExternalSignerRejectsInvalidPublicKey/#005453=== CONT TestExternalSignerRestartsAfterCrash5454=== PAUSE TestExternalSignerRejectsInvalidPublicKey/#005455=== RUN TestExternalSignerRejectsInvalidPublicKey/no-colon5456=== CONT TestExternalSignerWrongPublicKey5457=== PAUSE TestExternalSignerRejectsInvalidPublicKey/no-colon5458=== CONT TestNilKeyPublicKey5459--- PASS: TestNilKeyPublicKey (0.00s)5460=== CONT TestSign5461=== CONT TestGenerateFingerprint5462=== CONT TestSignErrors5463=== CONT TestExternalSignerErrors5464=== CONT TestExternalSignerClose5465=== CONT TestParseSigningKey5466=== RUN TestGenerateFingerprint/basic_with_references5467=== RUN TestExternalSignerErrors/invalid_JSON5468=== RUN TestParseSigningKey/valid_32-byte_key5469=== PAUSE TestGenerateFingerprint/basic_with_references5470=== RUN TestGenerateFingerprint/no_references5471=== PAUSE TestExternalSignerErrors/invalid_JSON5472=== PAUSE TestGenerateFingerprint/no_references5473=== RUN TestExternalSignerRejectsInvalidPublicKey/:AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA=5474=== RUN TestGenerateFingerprint/unsorted_references_get_sorted5475=== PAUSE TestExternalSignerRejectsInvalidPublicKey/:AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA=5476=== PAUSE TestGenerateFingerprint/unsorted_references_get_sorted5477=== RUN TestExternalSignerRejectsInvalidPublicKey/test-key:invalid!5478=== PAUSE TestParseSigningKey/valid_32-byte_key5479=== PAUSE TestExternalSignerRejectsInvalidPublicKey/test-key:invalid!5480=== RUN TestParseSigningKey/valid_32-byte_key_with_different_name5481=== RUN TestExternalSignerErrors/wrong_shape5482=== PAUSE TestParseSigningKey/valid_32-byte_key_with_different_name5483=== RUN TestGenerateFingerprint/invalid_nar_hash_prefix5484=== PAUSE TestExternalSignerErrors/wrong_shape5485=== RUN TestExternalSignerErrors/too_few_signatures5486=== PAUSE TestGenerateFingerprint/invalid_nar_hash_prefix5487=== PAUSE TestExternalSignerErrors/too_few_signatures5488=== RUN TestExternalSignerErrors/wrong_signature_name5489=== PAUSE TestExternalSignerErrors/wrong_signature_name5490=== RUN TestExternalSignerErrors/program_error5491=== PAUSE TestExternalSignerErrors/program_error5492=== RUN TestExternalSignerErrors/exit_on_request5493=== PAUSE TestExternalSignerErrors/exit_on_request5494=== RUN TestExternalSignerErrors/unrequested_key5495=== PAUSE TestExternalSignerErrors/unrequested_key5496=== RUN TestExternalSignerErrors/missing_signature_name5497=== RUN TestGenerateFingerprint/invalid_nar_hash_length5498=== RUN TestParseSigningKey/no_colon5499=== RUN TestExternalSignerRejectsInvalidPublicKey/test-key:YQ==5500=== PAUSE TestParseSigningKey/no_colon5501=== PAUSE TestGenerateFingerprint/invalid_nar_hash_length5502=== RUN TestParseSigningKey/empty_name5503=== RUN TestGenerateFingerprint/invalid_store_path_prefix5504=== PAUSE TestGenerateFingerprint/invalid_store_path_prefix5505=== PAUSE TestExternalSignerRejectsInvalidPublicKey/test-key:YQ==5506=== PAUSE TestExternalSignerErrors/missing_signature_name5507=== CONT TestExternalSignerRejectsInvalidPublicKey/#005508=== RUN TestExternalSignerErrors/wrong_signature_length5509=== PAUSE TestExternalSignerErrors/wrong_signature_length5510=== RUN TestGenerateFingerprint/invalid_reference_prefix5511=== PAUSE TestGenerateFingerprint/invalid_reference_prefix5512=== CONT TestGenerateFingerprint/invalid_store_path_prefix5513=== CONT TestGenerateFingerprint/invalid_nar_hash_length5514=== CONT TestGenerateFingerprint/basic_with_references5515=== CONT TestGenerateFingerprint/unsorted_references_get_sorted5516=== PAUSE TestParseSigningKey/empty_name5517=== RUN TestParseSigningKey/invalid_base645518=== PAUSE TestParseSigningKey/invalid_base645519=== RUN TestParseSigningKey/wrong_length5520=== CONT TestGenerateFingerprint/invalid_reference_prefix5521=== CONT TestExternalSignerRejectsInvalidPublicKey/:AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA=5522=== CONT TestExternalSignerRejectsInvalidPublicKey/no-colon5523=== RUN TestExternalSignerErrors/null5524=== PAUSE TestExternalSignerErrors/null5525=== CONT TestGenerateFingerprint/invalid_nar_hash_prefix5526=== CONT TestExternalSignerRejectsInvalidPublicKey/test-key:invalid!5527=== RUN TestExternalSignerErrors/wrong_id5528=== CONT TestExternalSignerRejectsInvalidPublicKey/test-key:YQ==5529=== CONT TestGenerateFingerprint/no_references5530--- PASS: TestExternalSignerRejectsInvalidPublicKey (0.00s)5531 --- PASS: TestExternalSignerRejectsInvalidPublicKey/#00 (0.00s)5532 --- PASS: TestExternalSignerRejectsInvalidPublicKey/:AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA= (0.00s)5533 --- PASS: TestExternalSignerRejectsInvalidPublicKey/no-colon (0.00s)5534 --- PASS: TestExternalSignerRejectsInvalidPublicKey/test-key:invalid! (0.00s)5535 --- PASS: TestExternalSignerRejectsInvalidPublicKey/test-key:YQ== (0.00s)5536=== PAUSE TestExternalSignerErrors/wrong_id5537--- PASS: TestGenerateFingerprint (0.00s)5538 --- PASS: TestGenerateFingerprint/invalid_store_path_prefix (0.00s)5539 --- PASS: TestGenerateFingerprint/invalid_nar_hash_length (0.00s)5540 --- PASS: TestGenerateFingerprint/basic_with_references (0.00s)5541 --- PASS: TestGenerateFingerprint/unsorted_references_get_sorted (0.00s)5542 --- PASS: TestGenerateFingerprint/invalid_reference_prefix (0.00s)5543 --- PASS: TestGenerateFingerprint/invalid_nar_hash_prefix (0.00s)5544 --- PASS: TestGenerateFingerprint/no_references (0.00s)5545=== RUN TestExternalSignerErrors/missing_signatures5546=== PAUSE TestExternalSignerErrors/missing_signatures5547=== RUN TestExternalSignerErrors/null_signatures5548=== RUN TestSignErrors/nil_key5549=== PAUSE TestSignErrors/nil_key5550=== RUN TestSignErrors/nil_narinfo5551=== PAUSE TestSignErrors/nil_narinfo5552=== RUN TestSignErrors/invalid_narinfo5553=== PAUSE TestSignErrors/invalid_narinfo5554--- PASS: TestSign (0.00s)5555=== RUN TestSignErrors/canceled5556=== PAUSE TestExternalSignerErrors/null_signatures5557=== PAUSE TestParseSigningKey/wrong_length5558=== PAUSE TestSignErrors/canceled5559=== CONT TestSignErrors/nil_key5560=== CONT TestParseSigningKey/valid_32-byte_key5561=== CONT TestParseSigningKey/empty_name5562=== CONT TestParseSigningKey/wrong_length5563=== CONT TestParseSigningKey/invalid_base645564=== CONT TestParseSigningKey/no_colon5565=== RUN TestExternalSignerErrors/wrong_signatures_shape5566=== PAUSE TestExternalSignerErrors/wrong_signatures_shape5567=== RUN TestExternalSignerErrors/invalid_signature_base645568=== PAUSE TestExternalSignerErrors/invalid_signature_base645569=== RUN TestExternalSignerErrors/exit_at_startup5570=== PAUSE TestExternalSignerErrors/exit_at_startup5571=== CONT TestExternalSignerErrors/invalid_JSON5572=== CONT TestExternalSignerErrors/exit_on_request5573=== CONT TestExternalSignerErrors/invalid_signature_base645574=== CONT TestExternalSignerErrors/null_signatures5575=== CONT TestExternalSignerErrors/wrong_signature_length5576=== CONT TestExternalSignerErrors/program_error5577=== CONT TestExternalSignerErrors/too_few_signatures5578=== CONT TestExternalSignerErrors/missing_signatures5579=== CONT TestExternalSignerErrors/wrong_signature_name5580=== CONT TestExternalSignerErrors/null5581=== CONT TestExternalSignerErrors/wrong_shape5582--- PASS: TestSignBatch (0.00s)5583=== CONT TestSignErrors/invalid_narinfo5584=== CONT TestExternalSignerErrors/wrong_id5585=== CONT TestSignErrors/nil_narinfo5586=== CONT TestParseSigningKey/valid_32-byte_key_with_different_name5587=== CONT TestExternalSignerErrors/wrong_signatures_shape5588--- PASS: TestParseSigningKey (0.00s)5589 --- PASS: TestParseSigningKey/empty_name (0.00s)5590 --- PASS: TestParseSigningKey/wrong_length (0.00s)5591 --- PASS: TestParseSigningKey/valid_32-byte_key (0.00s)5592 --- PASS: TestParseSigningKey/invalid_base64 (0.00s)5593 --- PASS: TestParseSigningKey/no_colon (0.00s)5594 --- PASS: TestParseSigningKey/valid_32-byte_key_with_different_name (0.00s)5595=== CONT TestSignErrors/canceled5596=== CONT TestExternalSignerErrors/exit_at_startup5597--- PASS: TestSignErrors (0.00s)5598 --- PASS: TestSignErrors/nil_key (0.00s)5599 --- PASS: TestSignErrors/invalid_narinfo (0.00s)5600 --- PASS: TestSignErrors/nil_narinfo (0.00s)5601 --- PASS: TestSignErrors/canceled (0.00s)5602=== CONT TestExternalSignerErrors/missing_signature_name5603=== CONT TestExternalSignerErrors/unrequested_key5604--- PASS: TestExternalSignerCancellation (0.24s)5605--- PASS: TestExternalSignerWrongPublicKey (0.41s)5606--- PASS: TestExternalSigner (0.61s)5607--- PASS: TestExternalSignerProgramErrorKeepsProcess (0.79s)5608--- PASS: TestExternalSignerRestartsAfterCrash (0.99s)5609/private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestExternalSignerRestartsAfterCrash2796830694/001/sign program: line 7: /private/var/tb/5/scratch/0f12ee7d684ae0cb/build/TestExternalSignerRestartsAfterCrash2796830694/001/sign program.starts: No such file or directory5610--- PASS: TestExternalSignerClose (1.16s)5611--- PASS: TestExternalSignerErrors (0.00s)5612 --- PASS: TestExternalSignerErrors/missing_signature_name (1.35s)5613 --- PASS: TestExternalSignerErrors/unrequested_key (1.54s)5614 --- PASS: TestExternalSignerErrors/exit_at_startup (1.72s)5615 --- PASS: TestExternalSignerErrors/wrong_id (1.92s)5616 --- PASS: TestExternalSignerErrors/null (2.10s)5617 --- PASS: TestExternalSignerErrors/too_few_signatures (2.29s)5618 --- PASS: TestExternalSignerErrors/null_signatures (2.48s)5619 --- PASS: TestExternalSignerErrors/wrong_signatures_shape (2.67s)5620 --- PASS: TestExternalSignerErrors/invalid_signature_base64 (2.86s)5621 --- PASS: TestExternalSignerErrors/exit_on_request (3.05s)5622 --- PASS: TestExternalSignerErrors/wrong_shape (3.24s)5623 --- PASS: TestExternalSignerErrors/program_error (3.42s)5624 --- PASS: TestExternalSignerErrors/wrong_signature_name (3.61s)5625 --- PASS: TestExternalSignerErrors/invalid_JSON (3.80s)5626 --- PASS: TestExternalSignerErrors/wrong_signature_length (3.99s)5627 --- PASS: TestExternalSignerErrors/missing_signatures (4.18s)5628PASS5629Running OpenBao signer tests...5630=== RUN TestSign5631=== PAUSE TestSign5632=== RUN TestSignErrors5633=== PAUSE TestSignErrors5634=== RUN TestServe5635=== PAUSE TestServe5636=== RUN TestServeRejectsGarbage5637=== PAUSE TestServeRejectsGarbage5638=== CONT TestSign5639=== CONT TestServeRejectsGarbage5640=== CONT TestSignErrors5641--- PASS: TestServeRejectsGarbage (0.00s)5642=== RUN TestSignErrors/http_error5643=== CONT TestServe5644=== PAUSE TestSignErrors/http_error5645=== RUN TestSignErrors/invalid_json5646=== PAUSE TestSignErrors/invalid_json5647=== RUN TestSignErrors/no_prefix5648=== PAUSE TestSignErrors/no_prefix5649=== RUN TestSignErrors/invalid_base645650=== PAUSE TestSignErrors/invalid_base645651=== CONT TestSignErrors/http_error5652=== CONT TestSignErrors/no_prefix5653=== CONT TestSignErrors/invalid_json5654=== CONT TestSignErrors/invalid_base645655--- PASS: TestServe (0.00s)5656--- PASS: TestSign (0.00s)5657--- PASS: TestSignErrors (0.00s)5658 --- PASS: TestSignErrors/no_prefix (0.00s)5659 --- PASS: TestSignErrors/http_error (0.00s)5660 --- PASS: TestSignErrors/invalid_json (0.00s)5661 --- PASS: TestSignErrors/invalid_base64 (0.00s)5662PASS