niks3-go-unit-tests
checks.aarch64-darwin.go-unit-tests
· build #487
· raw
1tribuchet: building on mac022Running client tests...3=== RUN TestDoServerRequestAttachesToken4=== PAUSE TestDoServerRequestAttachesToken5=== RUN TestUploadBuildLog_FileBodyReplayedOnRetry6=== PAUSE TestUploadBuildLog_FileBodyReplayedOnRetry7=== RUN TestRegisterUploadedObjectReusesConnections8=== PAUSE TestRegisterUploadedObjectReusesConnections9=== RUN TestRunGarbageCollection_FinishedOnAnotherReplica10=== PAUSE TestRunGarbageCollection_FinishedOnAnotherReplica11=== RUN TestRunGarbageCollection_NotFoundAfterLocalRun12=== PAUSE TestRunGarbageCollection_NotFoundAfterLocalRun13=== RUN TestCaseHackSuffix14=== PAUSE TestCaseHackSuffix15=== RUN TestFilterOversizedClosures16=== PAUSE TestFilterOversizedClosures17=== RUN TestUploadMultipart_PartsInParallel18=== PAUSE TestUploadMultipart_PartsInParallel19=== RUN TestUploadMultipart_ReturnsAfterDroppedBody20=== PAUSE TestUploadMultipart_ReturnsAfterDroppedBody21=== RUN TestPartSizeForNAR22=== PAUSE TestPartSizeForNAR23=== RUN TestDumpPathCaseHackMatchesNix24--- PASS: TestDumpPathCaseHackMatchesNix (0.04s)25=== RUN TestDumpPathCaseHackCollision26--- PASS: TestDumpPathCaseHackCollision (0.00s)27=== RUN TestDumpPathMatchesNix28=== PAUSE TestDumpPathMatchesNix29=== RUN TestDumpPathSingleFile30=== PAUSE TestDumpPathSingleFile31=== RUN TestDumpPathWriterError32=== PAUSE TestDumpPathWriterError33=== RUN TestEncodeNixBase3234=== PAUSE TestEncodeNixBase3235=== RUN TestEncodeNixBase32WithRealHash36=== PAUSE TestEncodeNixBase32WithRealHash37=== RUN TestConvertHashToNix3238=== PAUSE TestConvertHashToNix3239=== RUN TestGetStorePathHash40=== PAUSE TestGetStorePathHash41=== RUN TestPathInfoHashCompatibility42=== PAUSE TestPathInfoHashCompatibility43=== RUN TestParsePathInfoJSON44=== PAUSE TestParsePathInfoJSON45=== RUN TestParsePathInfoJSONMultiplePaths46=== PAUSE TestParsePathInfoJSONMultiplePaths47=== RUN TestPathInfoCACompatibility48=== PAUSE TestPathInfoCACompatibility49=== RUN TestRateLimiterFeedback50=== PAUSE TestRateLimiterFeedback51=== RUN TestRateLimiterFeedback_400DoesNotCountAsSuccess52=== PAUSE TestRateLimiterFeedback_400DoesNotCountAsSuccess53=== RUN TestRegisterUploadedObject_BoundedAgainstSilentServer54=== PAUSE TestRegisterUploadedObject_BoundedAgainstSilentServer55=== RUN TestRegisterUploadedObject_OutlivesPush56=== PAUSE TestRegisterUploadedObject_OutlivesPush57=== RUN TestResolveStorePath58=== PAUSE TestResolveStorePath59=== RUN TestDoWithRetry_BodyReplayedViaGetBody60=== PAUSE TestDoWithRetry_BodyReplayedViaGetBody61=== RUN TestRetryTimeoutOutlastsMaxRetries62=== PAUSE TestRetryTimeoutOutlastsMaxRetries63=== RUN TestDoWithRetry_FinalResponseBodyReadable64=== PAUSE TestDoWithRetry_FinalResponseBodyReadable65=== RUN TestShellSplit66=== PAUSE TestShellSplit67=== RUN TestShellSplitErrors68=== PAUSE TestShellSplitErrors69=== RUN TestStreamPushReportsEveryPath70=== PAUSE TestStreamPushReportsEveryPath71=== RUN TestStreamPushBatchesUnderLoad72=== PAUSE TestStreamPushBatchesUnderLoad73=== RUN TestStreamPushIsolatesFailures74=== PAUSE TestStreamPushIsolatesFailures75=== RUN TestStreamPushGivesUpOnDeadServer76=== PAUSE TestStreamPushGivesUpOnDeadServer77=== RUN TestStreamPushRequestLine78=== PAUSE TestStreamPushRequestLine79=== RUN TestStreamPushReportsSignatures80=== PAUSE TestStreamPushReportsSignatures81=== RUN TestStreamPushReportsSkippedPaths82=== PAUSE TestStreamPushReportsSkippedPaths83=== RUN TestClientSignaturesByStorePath84=== PAUSE TestClientSignaturesByStorePath85=== RUN TestStreamPushStopsWhenCanceled86=== PAUSE TestStreamPushStopsWhenCanceled87=== RUN TestSetClientTLS88=== PAUSE TestSetClientTLS89=== RUN TestSetClientTLSDoesNotMutateDefaultTransport90=== PAUSE TestSetClientTLSDoesNotMutateDefaultTransport91=== RUN TestSetClientTLSErrors92=== PAUSE TestSetClientTLSErrors93=== RUN TestStaticToken94=== PAUSE TestStaticToken95=== RUN TestFileTokenReadsAndCaches96=== PAUSE TestFileTokenReadsAndCaches97=== RUN TestFileTokenMissing98=== PAUSE TestFileTokenMissing99=== RUN TestFileTokenEmpty100=== PAUSE TestFileTokenEmpty101=== RUN TestScriptTokenNoExpiryRerunsEveryCall102=== PAUSE TestScriptTokenNoExpiryRerunsEveryCall103=== RUN TestScriptTokenCachesUntilRefresh104=== PAUSE TestScriptTokenCachesUntilRefresh105=== RUN TestScriptTokenEmptyToken106=== PAUSE TestScriptTokenEmptyToken107=== RUN TestScriptTokenBadJSON108=== PAUSE TestScriptTokenBadJSON109=== RUN TestScriptTokenScriptFails110=== PAUSE TestScriptTokenScriptFails111=== RUN TestScriptTokenEmptyCommand112=== PAUSE TestScriptTokenEmptyCommand113=== CONT TestDoServerRequestAttachesToken114=== CONT TestRetryTimeoutOutlastsMaxRetries115=== CONT TestScriptTokenEmptyCommand116=== CONT TestStreamPushGivesUpOnDeadServer117--- PASS: TestScriptTokenEmptyCommand (0.00s)118=== CONT TestEncodeNixBase32WithRealHash119--- PASS: TestEncodeNixBase32WithRealHash (0.00s)120=== CONT TestDoWithRetry_BodyReplayedViaGetBody121=== CONT TestStreamPushStopsWhenCanceled122=== CONT TestStreamPushReportsEveryPath123--- PASS: TestStreamPushStopsWhenCanceled (0.00s)124=== CONT TestRegisterUploadedObject_OutlivesPush125=== CONT TestRegisterUploadedObject_BoundedAgainstSilentServer126=== CONT TestRateLimiterFeedback_400DoesNotCountAsSuccess127=== CONT TestRateLimiterFeedback128=== CONT TestPathInfoCACompatibility129=== CONT TestParsePathInfoJSONMultiplePaths130=== CONT TestParsePathInfoJSON131=== CONT TestPathInfoHashCompatibility132=== CONT TestGetStorePathHash133=== CONT TestConvertHashToNix32134=== CONT TestFileTokenEmpty135=== CONT TestScriptTokenScriptFails1362026/11/11 23:05:19 WARN Rate limiter enabled after throttle name=server-test rate=5137=== CONT TestScriptTokenBadJSON138=== CONT TestScriptTokenEmptyToken139=== CONT TestScriptTokenCachesUntilRefresh140=== CONT TestScriptTokenNoExpiryRerunsEveryCall141=== CONT TestResolveStorePath142=== CONT TestStreamPushIsolatesFailures143=== CONT TestSetClientTLS1442026/11/11 23:05:19 ERROR Upload failed error="connection refused" count=201452026/11/11 23:05:19 ERROR Server seems unavailable, giving up on batch untried=17146=== RUN TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)147=== RUN TestGetStorePathHash/valid_store_path148=== RUN TestPathInfoCACompatibility/null_ca_field149=== PAUSE TestPathInfoCACompatibility/null_ca_field150=== RUN TestPathInfoCACompatibility/old_string_format_-_text151=== PAUSE TestPathInfoCACompatibility/old_string_format_-_text152=== RUN TestPathInfoCACompatibility/old_string_format_-_fixed_recursive153=== PAUSE TestPathInfoCACompatibility/old_string_format_-_fixed_recursive154=== RUN TestPathInfoCACompatibility/new_structured_format_-_text155=== PAUSE TestPathInfoCACompatibility/new_structured_format_-_text156=== RUN TestPathInfoCACompatibility/new_structured_format_-_nar_method157=== PAUSE TestPathInfoCACompatibility/new_structured_format_-_nar_method158--- PASS: TestStreamPushGivesUpOnDeadServer (0.00s)159=== CONT TestStreamPushBatchesUnderLoad160=== RUN TestStreamPushBatchesUnderLoad/oneAtATime=false161=== PAUSE TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)162=== RUN TestPathInfoHashCompatibility/old_string_format_with_colon163=== RUN TestRateLimiterFeedback/429_enables_limiter164=== PAUSE TestStreamPushBatchesUnderLoad/oneAtATime=false165=== PAUSE TestGetStorePathHash/valid_store_path166=== RUN TestParsePathInfoJSON/Nix_format167=== PAUSE TestParsePathInfoJSON/Nix_format168=== RUN TestParsePathInfoJSON/Lix_format169=== RUN TestConvertHashToNix32/SRI_format_to_Nix32170=== CONT TestUploadMultipart_PartsInParallel171=== PAUSE TestRateLimiterFeedback/429_enables_limiter172=== PAUSE TestPathInfoHashCompatibility/old_string_format_with_colon173=== RUN TestStreamPushBatchesUnderLoad/oneAtATime=true174=== RUN TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths175=== RUN TestGetStorePathHash/basename_without_hyphen_should_error176=== PAUSE TestParsePathInfoJSON/Lix_format1772026/11/11 23:05:19 ERROR Upload failed error="bad path" count=3178=== PAUSE TestConvertHashToNix32/SRI_format_to_Nix32179--- PASS: TestStreamPushIsolatesFailures (0.00s)180=== CONT TestEncodeNixBase32181--- PASS: TestRegisterUploadedObject_OutlivesPush (0.00s)182=== CONT TestDumpPathWriterError183--- PASS: TestStreamPushReportsEveryPath (0.00s)184=== RUN TestParsePathInfoJSON/empty_input185=== RUN TestRateLimiterFeedback/503_enables_limiter186=== CONT TestDumpPathSingleFile187=== RUN TestConvertHashToNix32/already_Nix32_format188=== PAUSE TestConvertHashToNix32/already_Nix32_format1892026/11/11 23:05:19 WARN Request returned retryable status, retrying attempt=1 backoff=1ms status=502 url=http://127.0.0.1:56487190=== PAUSE TestRateLimiterFeedback/503_enables_limiter191=== RUN TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI192=== RUN TestRateLimiterFeedback/200_does_not_enable_limiter193=== PAUSE TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI194=== PAUSE TestRateLimiterFeedback/200_does_not_enable_limiter195=== PAUSE TestParsePathInfoJSON/empty_input196=== PAUSE TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths197=== RUN TestPathInfoHashCompatibility/new_structured_format_with_sha512198=== RUN TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths1992026/11/11 23:05:19 WARN Rate limiter enabled after throttle name=server-test rate=52002026/11/11 23:05:19 WARN Request returned retryable status, retrying attempt=1 backoff=0s status=503 url=http://127.0.0.1:56488201=== PAUSE TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths202=== PAUSE TestStreamPushBatchesUnderLoad/oneAtATime=true203=== CONT TestUploadMultipart_ReturnsAfterDroppedBody204=== PAUSE TestPathInfoHashCompatibility/new_structured_format_with_sha512205=== CONT TestShellSplit206=== CONT TestRunGarbageCollection_NotFoundAfterLocalRun207=== PAUSE TestGetStorePathHash/basename_without_hyphen_should_error208=== RUN TestGetStorePathHash/hash_with_invalid_characters_should_error209=== PAUSE TestGetStorePathHash/hash_with_invalid_characters_should_error210=== RUN TestGetStorePathHash/hash_with_wrong_length_should_error211=== PAUSE TestGetStorePathHash/hash_with_wrong_length_should_error212=== CONT TestShellSplitErrors213=== CONT TestCaseHackSuffix214=== RUN TestRateLimiterFeedback/400_does_not_enable_limiter215=== PAUSE TestRateLimiterFeedback/400_does_not_enable_limiter216=== RUN TestParsePathInfoJSON/whitespace_only217=== RUN TestConvertHashToNix32/invalid_format218--- PASS: TestDoServerRequestAttachesToken (0.00s)219=== CONT TestDumpPathMatchesNix220=== CONT TestStreamPushReportsSignatures221--- PASS: TestShellSplit (0.00s)222--- PASS: TestShellSplitErrors (0.00s)223--- PASS: TestFileTokenEmpty (0.00s)224=== CONT TestPartSizeForNAR225=== RUN TestPartSizeForNAR/zero_stays_at_minimum226=== RUN TestEncodeNixBase32/test_string_hash2272026/11/11 23:05:19 ERROR Upload failed error=boom count=1228=== PAUSE TestPartSizeForNAR/zero_stays_at_minimum229=== RUN TestPartSizeForNAR/small_stays_at_minimum230=== PAUSE TestPartSizeForNAR/small_stays_at_minimum231=== RUN TestPartSizeForNAR/80_GiB_fits_at_minimum232=== PAUSE TestPartSizeForNAR/80_GiB_fits_at_minimum233=== RUN TestPartSizeForNAR/115_GiB_needs_larger_parts234=== PAUSE TestPartSizeForNAR/115_GiB_needs_larger_parts235=== RUN TestPartSizeForNAR/1_TiB236=== PAUSE TestPartSizeForNAR/1_TiB237=== RUN TestPartSizeForNAR/5_TiB_S3_max_object238=== PAUSE TestPartSizeForNAR/5_TiB_S3_max_object239=== RUN TestPartSizeForNAR/capped_at_5_GiB240=== PAUSE TestPartSizeForNAR/capped_at_5_GiB241--- PASS: TestScriptTokenScriptFails (0.00s)242--- PASS: TestStreamPushReportsSignatures (0.00s)243=== CONT TestFileTokenMissing2442026/11/11 23:05:19 WARN Rate limiter backed off name=server-test rate=52452026/11/11 23:05:19 WARN Request returned retryable status, retrying attempt=2 backoff=0s status=503 url=http://127.0.0.1:56488246=== CONT TestClientSignaturesByStorePath247--- PASS: TestClientSignaturesByStorePath (0.00s)248=== CONT TestFilterOversizedClosures249=== PAUSE TestParsePathInfoJSON/whitespace_only250=== PAUSE TestEncodeNixBase32/test_string_hash251=== CONT TestStreamPushReportsSkippedPaths252=== PAUSE TestConvertHashToNix32/invalid_format253=== RUN TestSetClientTLS/rejects_connection_without_client_cert2542026/11/11 23:05:19 WARN Request returned retryable status, retrying attempt=2 backoff=1ms status=502 url=http://127.0.0.1:56487255=== CONT TestRegisterUploadedObjectReusesConnections256=== RUN TestFilterOversizedClosures/no_limit_keeps_everything257=== RUN TestParsePathInfoJSON/invalid_JSON258=== PAUSE TestParsePathInfoJSON/invalid_JSON259=== PAUSE TestFilterOversizedClosures/no_limit_keeps_everything260=== RUN TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped261=== RUN TestEncodeNixBase32/empty_input262=== PAUSE TestEncodeNixBase32/empty_input263=== PAUSE TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped264=== RUN TestFilterOversizedClosures/all_closures_skipped265=== PAUSE TestFilterOversizedClosures/all_closures_skipped266=== CONT TestFileTokenReadsAndCaches267=== CONT TestUploadBuildLog_FileBodyReplayedOnRetry268=== CONT TestSetClientTLSErrors269=== PAUSE TestSetClientTLS/rejects_connection_without_client_cert270=== RUN TestSetClientTLS/succeeds_with_client_cert_and_CA271=== PAUSE TestSetClientTLS/succeeds_with_client_cert_and_CA272=== RUN TestSetClientTLS/preserves_debug_logging_transport273=== PAUSE TestSetClientTLS/preserves_debug_logging_transport274=== CONT TestStaticToken275=== CONT TestPathInfoCACompatibility/null_ca_field276=== CONT TestPathInfoCACompatibility/new_structured_format_-_nar_method2772026/11/11 23:05:19 INFO Garbage collection started278=== CONT TestSetClientTLSDoesNotMutateDefaultTransport279=== CONT TestPathInfoCACompatibility/new_structured_format_-_text280=== CONT TestPathInfoCACompatibility/old_string_format_-_fixed_recursive281=== CONT TestPathInfoCACompatibility/old_string_format_-_text282=== CONT TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths283=== CONT TestStreamPushBatchesUnderLoad/oneAtATime=false284=== CONT TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths285=== CONT TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)286=== CONT TestStreamPushBatchesUnderLoad/oneAtATime=true287=== CONT TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI288=== CONT TestGetStorePathHash/valid_store_path289=== CONT TestPathInfoHashCompatibility/old_string_format_with_colon290=== CONT TestGetStorePathHash/hash_with_wrong_length_should_error291=== CONT TestRateLimiterFeedback/429_enables_limiter292=== CONT TestGetStorePathHash/hash_with_invalid_characters_should_error293=== CONT TestRateLimiterFeedback/400_does_not_enable_limiter294=== CONT TestDoWithRetry_FinalResponseBodyReadable295=== CONT TestGetStorePathHash/basename_without_hyphen_should_error296=== CONT TestRateLimiterFeedback/200_does_not_enable_limiter2972026/11/11 23:05:19 WARN Request returned retryable status, retrying attempt=1 backoff=1ms status=502 url=http://127.0.0.1:56487298=== CONT TestStreamPushRequestLine299=== CONT TestRateLimiterFeedback/503_enables_limiter300=== CONT TestRunGarbageCollection_FinishedOnAnotherReplica3012026/11/11 23:05:19 WARN Rate limiter enabled after throttle name=server-test rate=53022026/11/11 23:05:19 WARN Request returned retryable status, retrying attempt=1 backoff=0s status=429 url=http://127.0.0.1:56550303=== CONT TestPathInfoHashCompatibility/new_structured_format_with_sha512304=== CONT TestPartSizeForNAR/zero_stays_at_minimum305=== CONT TestPartSizeForNAR/80_GiB_fits_at_minimum306=== CONT TestPartSizeForNAR/capped_at_5_GiB307=== CONT TestPartSizeForNAR/5_TiB_S3_max_object308=== CONT TestPartSizeForNAR/1_TiB309=== CONT TestPartSizeForNAR/115_GiB_needs_larger_parts3102026/11/11 23:05:19 WARN Rate limiter enabled after throttle name=server-test rate=5311=== CONT TestPartSizeForNAR/small_stays_at_minimum312=== CONT TestConvertHashToNix32/invalid_format313=== CONT TestConvertHashToNix32/SRI_format_to_Nix32314=== CONT TestConvertHashToNix32/already_Nix32_format315=== CONT TestParsePathInfoJSON/Nix_format316=== CONT TestParsePathInfoJSON/whitespace_only317=== CONT TestParsePathInfoJSON/invalid_JSON318=== CONT TestParsePathInfoJSON/Lix_format319--- PASS: TestStreamPushReportsSkippedPaths (0.00s)320--- PASS: TestDoWithRetry_BodyReplayedViaGetBody (0.01s)321=== CONT TestParsePathInfoJSON/empty_input322=== CONT TestEncodeNixBase32/test_string_hash323=== CONT TestEncodeNixBase32/empty_input324=== CONT TestFilterOversizedClosures/all_closures_skipped325--- PASS: TestScriptTokenBadJSON (0.01s)326--- PASS: TestStaticToken (0.00s)327=== CONT TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped328--- PASS: TestScriptTokenEmptyToken (0.01s)329=== CONT TestSetClientTLS/rejects_connection_without_client_cert330=== CONT TestFilterOversizedClosures/no_limit_keeps_everything331=== CONT TestSetClientTLS/succeeds_with_client_cert_and_CA332--- PASS: TestFileTokenMissing (0.01s)333--- PASS: TestFileTokenReadsAndCaches (0.00s)334--- PASS: TestStreamPushBatchesUnderLoad (0.00s)335 --- PASS: TestStreamPushBatchesUnderLoad/oneAtATime=false (0.00s)336 --- PASS: TestStreamPushBatchesUnderLoad/oneAtATime=true (0.00s)337--- PASS: TestParsePathInfoJSONMultiplePaths (0.00s)338 --- PASS: TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths (0.00s)339 --- PASS: TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths (0.00s)340--- PASS: TestResolveStorePath (0.01s)341--- PASS: TestPathInfoCACompatibility (0.00s)342 --- PASS: TestPathInfoCACompatibility/null_ca_field (0.00s)343 --- PASS: TestPathInfoCACompatibility/old_string_format_-_fixed_recursive (0.00s)344 --- PASS: TestPathInfoCACompatibility/old_string_format_-_text (0.00s)345 --- PASS: TestPathInfoCACompatibility/new_structured_format_-_text (0.00s)346 --- PASS: TestPathInfoCACompatibility/new_structured_format_-_nar_method (0.00s)347--- PASS: TestGetStorePathHash (0.00s)348 --- PASS: TestGetStorePathHash/valid_store_path (0.00s)349 --- PASS: TestGetStorePathHash/hash_with_wrong_length_should_error (0.00s)350 --- PASS: TestGetStorePathHash/hash_with_invalid_characters_should_error (0.00s)351 --- PASS: TestGetStorePathHash/basename_without_hyphen_should_error (0.00s)352--- PASS: TestPathInfoHashCompatibility (0.00s)353 --- PASS: TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI) (0.00s)354 --- PASS: TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI (0.00s)355 --- PASS: TestPathInfoHashCompatibility/old_string_format_with_colon (0.00s)356 --- PASS: TestPathInfoHashCompatibility/new_structured_format_with_sha512 (0.00s)357--- PASS: TestPartSizeForNAR (0.00s)358 --- PASS: TestPartSizeForNAR/zero_stays_at_minimum (0.00s)359 --- PASS: TestPartSizeForNAR/80_GiB_fits_at_minimum (0.00s)360 --- PASS: TestPartSizeForNAR/capped_at_5_GiB (0.00s)361 --- PASS: TestPartSizeForNAR/5_TiB_S3_max_object (0.00s)362 --- PASS: TestPartSizeForNAR/1_TiB (0.00s)363 --- PASS: TestPartSizeForNAR/115_GiB_needs_larger_parts (0.00s)364 --- PASS: TestPartSizeForNAR/small_stays_at_minimum (0.00s)365--- PASS: TestConvertHashToNix32 (0.01s)366 --- PASS: TestConvertHashToNix32/invalid_format (0.00s)367 --- PASS: TestConvertHashToNix32/SRI_format_to_Nix32 (0.00s)368 --- PASS: TestConvertHashToNix32/already_Nix32_format (0.00s)369--- PASS: TestRunGarbageCollection_NotFoundAfterLocalRun (0.01s)370--- PASS: TestParsePathInfoJSON (0.01s)371 --- PASS: TestParsePathInfoJSON/Nix_format (0.00s)372 --- PASS: TestParsePathInfoJSON/whitespace_only (0.00s)373 --- PASS: TestParsePathInfoJSON/invalid_JSON (0.00s)374 --- PASS: TestParsePathInfoJSON/Lix_format (0.00s)375 --- PASS: TestParsePathInfoJSON/empty_input (0.00s)376=== CONT TestSetClientTLS/preserves_debug_logging_transport377--- PASS: TestUploadMultipart_ReturnsAfterDroppedBody (0.01s)378--- PASS: TestEncodeNixBase32 (0.01s)379 --- PASS: TestEncodeNixBase32/test_string_hash (0.00s)380 --- PASS: TestEncodeNixBase32/empty_input (0.00s)381=== RUN TestSetClientTLSErrors/missing_cert_file382=== PAUSE TestSetClientTLSErrors/missing_cert_file383=== RUN TestSetClientTLSErrors/missing_key_file384=== PAUSE TestSetClientTLSErrors/missing_key_file385=== RUN TestSetClientTLSErrors/missing_ca_file386=== PAUSE TestSetClientTLSErrors/missing_ca_file387=== RUN TestSetClientTLSErrors/invalid_ca_file388=== PAUSE TestSetClientTLSErrors/invalid_ca_file389=== CONT TestSetClientTLSErrors/missing_cert_file390=== CONT TestSetClientTLSErrors/invalid_ca_file391=== CONT TestSetClientTLSErrors/missing_ca_file392=== CONT TestSetClientTLSErrors/missing_key_file3932026/11/11 23:05:19 WARN Request returned retryable status, retrying attempt=1 backoff=0s status=503 url=http://127.0.0.1:565603942026/11/11 23:05:19 WARN Skipping closure: path exceeds server max NAR size top_level_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper oversized_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper nar_size=100 max_nar_size=503952026/11/11 23:05:19 ERROR Upload failed error=boom count=13962026/11/11 23:05:19 WARN Rate limiter backed off name=server-test rate=53972026/11/11 23:05:19 WARN Request returned retryable status, retrying attempt=2 backoff=1ms status=502 url=http://127.0.0.1:564873982026/11/11 23:05:19 WARN Skipping closure: path exceeds server max NAR size top_level_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper oversized_path=/nix/store/bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb-vm-image nar_size=5000 max_nar_size=2000399--- PASS: TestFilterOversizedClosures (0.00s)400 --- PASS: TestFilterOversizedClosures/no_limit_keeps_everything (0.00s)401 --- PASS: TestFilterOversizedClosures/all_closures_skipped (0.00s)402 --- PASS: TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped (0.00s)4032026/11/11 23:05:19 INFO Garbage collection started4042026/11/11 23:05:19 WARN Rate limiter enabled after throttle name=server-test rate=54052026/11/11 23:05:19 WARN Request returned retryable status, retrying attempt=1 backoff=0s status=503 url=http://127.0.0.1:565564062026/11/11 23:05:19 WARN Rate limiter backed off name=server-test rate=54072026/11/11 23:05:19 WARN Rate limiter enabled after throttle name=s3-test rate=54082026/11/11 23:05:19 WARN Request returned retryable status, retrying attempt=1 backoff=0s status=503 url=http://127.0.0.1:56569409--- PASS: TestRateLimiterFeedback (0.00s)410 --- PASS: TestRateLimiterFeedback/400_does_not_enable_limiter (0.00s)411 --- PASS: TestRateLimiterFeedback/200_does_not_enable_limiter (0.00s)412 --- PASS: TestRateLimiterFeedback/503_enables_limiter (0.00s)413 --- PASS: TestRateLimiterFeedback/429_enables_limiter (0.00s)4142026/11/11 23:05:19 WARN Rate limiter backed off name=server-test rate=5415--- PASS: TestDoWithRetry_FinalResponseBodyReadable (0.00s)4162026/11/11 23:05:19 WARN Request returned retryable status, retrying attempt=3 backoff=1ms status=502 url=http://127.0.0.1:564874172026/11/11 23:05:19 INFO Garbage collection progress phase=running_on_another_replica failed_uploads_deleted=0 old_closures_deleted=0 objects_marked=0 objects_deleted=0 objects_failed=0418--- PASS: TestUploadBuildLog_FileBodyReplayedOnRetry (0.01s)419--- PASS: TestSetClientTLSErrors (0.01s)420 --- PASS: TestSetClientTLSErrors/missing_cert_file (0.00s)421 --- PASS: TestSetClientTLSErrors/invalid_ca_file (0.00s)422 --- PASS: TestSetClientTLSErrors/missing_ca_file (0.00s)423 --- PASS: TestSetClientTLSErrors/missing_key_file (0.00s)424--- PASS: TestSetClientTLSDoesNotMutateDefaultTransport (0.01s)4252026/11/11 23:05:19 WARN Request returned retryable status, retrying attempt=4 backoff=1ms status=502 url=http://127.0.0.1:564874262026/11/11 23:05:19 WARN Garbage collection finished on another replica. Its statistics are not available here427--- PASS: TestRunGarbageCollection_FinishedOnAnotherReplica (0.01s)4282026/11/11 23:05:19 WARN Request returned retryable status, retrying attempt=5 backoff=1ms status=502 url=http://127.0.0.1:564874292026/11/11 23:05:19 WARN Request returned retryable status, retrying attempt=6 backoff=1ms status=502 url=http://127.0.0.1:56487430--- PASS: TestStreamPushRequestLine (0.01s)4312026/11/11 23:05:19 WARN Request returned retryable status, retrying attempt=7 backoff=1ms status=502 url=http://127.0.0.1:564874322026/11/11 23:05:19 WARN Request returned retryable status, retrying attempt=8 backoff=1ms status=502 url=http://127.0.0.1:564874332026/11/11 23:05:19 WARN Request returned retryable status, retrying attempt=9 backoff=1ms status=502 url=http://127.0.0.1:564874342026/11/11 23:05:19 http: TLS handshake error from 127.0.0.1:56585: remote error: tls: bad certificate4352026/11/11 23:05:19 WARN Request returned retryable status, retrying attempt=10 backoff=1ms status=502 url=http://127.0.0.1:56487436--- PASS: TestSetClientTLS (0.01s)437 --- PASS: TestSetClientTLS/preserves_debug_logging_transport (0.01s)438 --- PASS: TestSetClientTLS/succeeds_with_client_cert_and_CA (0.01s)439 --- PASS: TestSetClientTLS/rejects_connection_without_client_cert (0.02s)4402026/11/11 23:05:19 WARN Request returned retryable status, retrying attempt=11 backoff=1ms status=502 url=http://127.0.0.1:564874412026/11/11 23:05:19 WARN Request returned retryable status, retrying attempt=12 backoff=1ms status=502 url=http://127.0.0.1:564874422026/11/11 23:05:19 WARN Request returned retryable status, retrying attempt=13 backoff=1ms status=502 url=http://127.0.0.1:56487443--- PASS: TestRegisterUploadedObjectReusesConnections (0.03s)4442026/11/11 23:05:19 WARN Request returned retryable status, retrying attempt=14 backoff=1ms status=502 url=http://127.0.0.1:564874452026/11/11 23:05:19 WARN Request returned retryable status, retrying attempt=15 backoff=1ms status=502 url=http://127.0.0.1:564874462026/11/11 23:05:19 WARN Request returned retryable status, retrying attempt=16 backoff=1ms status=502 url=http://127.0.0.1:564874472026/11/11 23:05:19 WARN Request returned retryable status, retrying attempt=17 backoff=1ms status=502 url=http://127.0.0.1:56487448--- PASS: TestRetryTimeoutOutlastsMaxRetries (0.05s)449--- PASS: TestScriptTokenNoExpiryRerunsEveryCall (0.05s)450--- PASS: TestScriptTokenCachesUntilRefresh (0.05s)451--- PASS: TestDumpPathWriterError (0.05s)452--- PASS: TestCaseHackSuffix (0.06s)453--- PASS: TestDumpPathSingleFile (0.06s)454--- PASS: TestDumpPathMatchesNix (0.08s)4552026/11/11 23:05:19 WARN Request failed, retrying attempt=1 backoff=100ms error="Post \"http://127.0.0.1:56490/api/uploads/complete\": context deadline exceeded" url=http://127.0.0.1:56490/api/uploads/complete4562026/11/11 23:05:19 WARN Failed to register uploaded object key=abc.narinfo error="sending request: context canceled during retry: context deadline exceeded"4572026/11/11 23:05:19 WARN Request failed, retrying attempt=1 backoff=100ms error="Post \"http://127.0.0.1:56490/api/uploads/complete\": context deadline exceeded" url=http://127.0.0.1:56490/api/uploads/complete4582026/11/11 23:05:19 WARN Request failed, retrying attempt=1 backoff=100ms error="Post \"http://127.0.0.1:56490/api/uploads/complete\": context deadline exceeded" url=http://127.0.0.1:56490/api/uploads/complete4592026/11/11 23:05:19 WARN Failed to register uploaded object key=abc.narinfo error="sending request: context canceled during retry: context deadline exceeded"4602026/11/11 23:05:19 WARN Failed to register uploaded object key=abc.narinfo error="sending request: context canceled during retry: context deadline exceeded"461--- PASS: TestRegisterUploadedObject_BoundedAgainstSilentServer (0.10s)462--- PASS: TestUploadMultipart_PartsInParallel (0.62s)463--- PASS: TestRateLimiterFeedback_400DoesNotCountAsSuccess (1.00s)464PASS465Running server tests...466The files belonging to this database system will be owned by user "_tribuchetbld8".467This user must also own the server process.468469The database cluster will be initialized with locale "C".470The default database encoding has accordingly been set to "SQL_ASCII".471The default text search configuration will be set to "english".472473Data page checksums are enabled.474475creating directory /private/var/tb/8/scratch/9bf71896e68fdfe3/build/postgres1175498165/data ... ok476creating subdirectories ... ok477selecting dynamic shared memory implementation ... posix478selecting default "max_connections" ... 100479selecting default "shared_buffers" ... 128MB480selecting default time zone ... UTC481creating configuration files ... ok482running bootstrap script ... ok483performing post-bootstrap initialization ... ok484syncing data to disk ... ok485486initdb: warning: enabling "trust" authentication for local connections487initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.488489Success. You can now start the database server using:490491 pg_ctl -D /private/var/tb/8/scratch/9bf71896e68fdfe3/build/postgres1175498165/data -l logfile start492493/private/var/tb/8/scratch/9bf71896e68fdfe3/build/postgres1175498165:5432 - no response4942026-11-11 23:05:21.594 UTC [72184] LOG: starting PostgreSQL 18.6 on aarch64-apple-darwin25.6.0, compiled by clang version 21.1.8, 64-bit4952026-11-11 23:05:21.594 UTC [72184] LOG: listening on Unix socket "/private/var/tb/8/scratch/9bf71896e68fdfe3/build/postgres1175498165/.s.PGSQL.5432"4962026-11-11 23:05:21.596 UTC [72191] LOG: database system was shut down at 2026-11-11 23:05:21 UTC4972026-11-11 23:05:21.597 UTC [72184] LOG: database system is ready to accept connections498/private/var/tb/8/scratch/9bf71896e68fdfe3/build/postgres1175498165:5432 - accepting connections499{"timestamp":"2026-11-11T23:05:21.813508Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"4a6e242e-d1f4-44dc-aa54-5725544119c1","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"GET","uri":"/health/ready","status_code":503,"suppressed_errors":0,"duration_ms":0,"result":"server_error","target":"rustfs::server::http","filename":"rustfs/src/server/layer.rs","line_number":502,"threadName":"rustfs-worker","threadId":"ThreadId(4)"}500=== RUN TestAbortSucceeded501=== PAUSE TestAbortSucceeded502=== RUN TestService_AuthMiddleware503=== PAUSE TestService_AuthMiddleware504=== RUN TestService_AuthMiddleware_MTLSProxyHeader505=== PAUSE TestService_AuthMiddleware_MTLSProxyHeader506=== RUN TestService_AuthMiddleware_MTLSBoundSubjects507=== PAUSE TestService_AuthMiddleware_MTLSBoundSubjects508=== RUN TestService_ReadAuthMiddleware509=== PAUSE TestService_ReadAuthMiddleware510=== RUN TestService_AuthMiddleware_OIDC511=== PAUSE TestService_AuthMiddleware_OIDC512=== RUN TestService_RequireScope_OIDC513=== PAUSE TestService_RequireScope_OIDC514=== RUN TestService_ReadScope_PublicByDefault515=== PAUSE TestService_ReadScope_PublicByDefault516=== RUN TestCacheConfigHandler517=== PAUSE TestCacheConfigHandler518=== RUN TestCacheStatsHandler519=== PAUSE TestCacheStatsHandler520=== RUN TestClientCADerivations521=== PAUSE TestClientCADerivations522=== RUN TestClientErrorHandling523=== PAUSE TestClientErrorHandling524=== RUN TestClientIntegration525=== PAUSE TestClientIntegration526=== RUN TestClientMultipleUploads527=== PAUSE TestClientMultipleUploads528=== RUN TestClientWithDependencies529=== PAUSE TestClientWithDependencies530=== RUN TestClientSharedPathCommittedMidPush531=== PAUSE TestClientSharedPathCommittedMidPush532=== RUN TestPinProtectsFromGC533=== PAUSE TestPinProtectsFromGC534=== RUN TestClientPushesUseOnePush535=== PAUSE TestClientPushesUseOnePush536=== RUN TestClientFallsBackToClosures537=== PAUSE TestClientFallsBackToClosures538=== RUN TestDeleteClosuresRacingPins539=== PAUSE TestDeleteClosuresRacingPins540=== RUN TestConcurrentCommitsSharingObjectsDoNotDeadlock541=== PAUSE TestConcurrentCommitsSharingObjectsDoNotDeadlock542=== RUN TestResolveDBConnectionString543=== PAUSE TestResolveDBConnectionString544=== RUN TestConnectWaitsForAPeerMigration545=== PAUSE TestConnectWaitsForAPeerMigration546=== RUN TestLeadElectsOneAndHandsOver547=== PAUSE TestLeadElectsOneAndHandsOver548=== RUN TestLeadIncumbentWinsAfterRestart5492026/11/11 23:05:22 INFO lead: acquired remote=192.0.2.1:1234 generation=15502026/11/11 23:05:22 INFO lead: released remote=192.0.2.1:1234 generation=15512026/11/11 23:05:22 INFO lead: acquired remote=192.0.2.1:1234 generation=25522026/11/11 23:05:23 INFO lead: released remote=192.0.2.1:1234 generation=2553--- PASS: TestLeadIncumbentWinsAfterRestart (1.88s)554=== RUN TestLeadUnannouncedStandbyYieldsToIncumbent555=== PAUSE TestLeadUnannouncedStandbyYieldsToIncumbent556=== RUN TestLeadIncumbentAnnouncesAtOnce557=== PAUSE TestLeadIncumbentAnnouncesAtOnce558=== RUN TestLeadGenerationGrowsWithEveryGrant559=== PAUSE TestLeadGenerationGrowsWithEveryGrant560=== RUN TestLeadEndsOnShutdown561=== PAUSE TestLeadEndsOnShutdown562=== RUN TestLeadEndsWhenItsConnectionHangs5632026/11/11 23:05:23 INFO lead: acquired remote=192.0.2.1:1234 generation=15642026-11-11 23:05:25.366 UTC [72227] FATAL: terminating connection due to administrator command5652026/11/11 23:05:25 INFO lead: acquired remote=192.0.2.1:1234 generation=25662026/11/11 23:05:26 WARN lead: lock connection lost error="timeout: context deadline exceeded"5672026/11/11 23:05:26 INFO lead: released remote=192.0.2.1:1234 generation=15682026/11/11 23:05:26 INFO lead: released remote=192.0.2.1:1234 generation=2569--- PASS: TestLeadEndsWhenItsConnectionHangs (2.96s)570=== RUN TestGCAdvisoryLockBlocksConcurrentRun571=== PAUSE TestGCAdvisoryLockBlocksConcurrentRun572=== RUN TestGCBugBareHashReferences573=== PAUSE TestGCBugBareHashReferences574=== RUN TestGCMetrics575=== PAUSE TestGCMetrics576=== RUN TestPushDedupSurvivesConcurrentGC577=== PAUSE TestPushDedupSurvivesConcurrentGC578=== RUN TestDeduplicatedObjectsRecordedAsPending579=== PAUSE TestDeduplicatedObjectsRecordedAsPending580=== RUN TestGCSweepSkipsPendingObjects581=== PAUSE TestGCSweepSkipsPendingObjects582=== RUN TestTombstonedObjectOfferedWithoutWaiting583=== PAUSE TestTombstonedObjectOfferedWithoutWaiting584=== RUN TestGCSweepDeliversEachKeyOnce585=== PAUSE TestGCSweepDeliversEachKeyOnce586=== RUN TestCreatePendingClosureVerifyS3FailureReleasesConnection587=== PAUSE TestCreatePendingClosureVerifyS3FailureReleasesConnection588=== RUN TestForceGCDuringPushOffersSweptObject589=== PAUSE TestForceGCDuringPushOffersSweptObject590=== RUN TestFailedS3DeleteKeepsTombstone591=== PAUSE TestFailedS3DeleteKeepsTombstone592=== RUN TestSweepSkipsRowsLockedByPush593=== PAUSE TestSweepSkipsRowsLockedByPush594=== RUN TestRegisterCompletedObjectNeedsPendingRow595=== PAUSE TestRegisterCompletedObjectNeedsPendingRow596=== RUN TestGetExistingObjectsLocksRows597=== PAUSE TestGetExistingObjectsLocksRows598=== RUN TestSweepRechecksPendingAfterLocking599=== PAUSE TestSweepRechecksPendingAfterLocking600=== RUN TestPushWaitsForSweepHoldingRow601=== PAUSE TestPushWaitsForSweepHoldingRow602=== RUN TestCommitRacingPendingCleanupKeepsObjects603=== PAUSE TestCommitRacingPendingCleanupKeepsObjects604=== RUN TestGCEndsOnShutdown605=== PAUSE TestGCEndsOnShutdown606=== RUN TestGCTaskStore_StartNew607=== PAUSE TestGCTaskStore_StartNew608=== RUN TestGCTaskStore_DeduplicateSameParams609=== PAUSE TestGCTaskStore_DeduplicateSameParams610=== RUN TestGCTaskStore_ConflictDifferentParams611=== PAUSE TestGCTaskStore_ConflictDifferentParams612=== RUN TestGCTaskStore_GetEmpty613=== PAUSE TestGCTaskStore_GetEmpty614=== RUN TestGCTaskStore_GetReturnsLatest615=== PAUSE TestGCTaskStore_GetReturnsLatest616=== RUN TestGCTaskStore_CompletedAllowsNewTask617=== PAUSE TestGCTaskStore_CompletedAllowsNewTask618=== RUN TestGCTaskStore_PhaseUpdates619=== PAUSE TestGCTaskStore_PhaseUpdates620=== RUN TestGCTaskStore_Fail621=== PAUSE TestGCTaskStore_Fail622=== RUN TestGracefulShutdownDrainsInflight623=== PAUSE TestGracefulShutdownDrainsInflight624=== RUN TestService_healthCheckHandler625=== PAUSE TestService_healthCheckHandler626=== RUN TestService_readinessHandler627=== PAUSE TestService_readinessHandler628=== RUN TestGenerateLandingPage629=== PAUSE TestGenerateLandingPage630=== RUN TestEnsureAbortUploadsRule631=== PAUSE TestEnsureAbortUploadsRule632=== RUN TestCacheConfigHandlerMaxNarSize633=== PAUSE TestCacheConfigHandlerMaxNarSize634=== RUN TestCreatePendingClosureRejectsOversizedNAR635=== PAUSE TestCreatePendingClosureRejectsOversizedNAR636=== RUN TestNARDeduplicationMetadataUploadBug637=== PAUSE TestNARDeduplicationMetadataUploadBug638=== RUN TestMetricsInventory639=== PAUSE TestMetricsInventory640=== RUN TestMetricsCommit641=== PAUSE TestMetricsCommit642=== RUN TestService_NativeMTLS643=== PAUSE TestService_NativeMTLS644=== RUN TestServerTLSConfig645=== PAUSE TestServerTLSConfig646=== RUN TestMultipartCleanup647=== PAUSE TestMultipartCleanup648=== RUN TestMultipartUploadAbortedWhenCancelledBeforeRecorded649=== PAUSE TestMultipartUploadAbortedWhenCancelledBeforeRecorded650=== RUN TestPendingCleanupUsesOneCutoff651=== PAUSE TestPendingCleanupUsesOneCutoff652=== RUN TestObjectStatsTrigger653=== PAUSE TestObjectStatsTrigger654=== RUN TestObjectStatsUpdatedOncePerCommit655=== PAUSE TestObjectStatsUpdatedOncePerCommit656=== RUN TestOrphanedObjectsGC657=== PAUSE TestOrphanedObjectsGC658=== RUN TestOrphanedObjectsGCStressTest659=== PAUSE TestOrphanedObjectsGCStressTest660=== RUN TestCreatePin_ReservedPins661=== PAUSE TestCreatePin_ReservedPins662=== RUN TestPresentReportsOnlyClosureRoots663=== PAUSE TestPresentReportsOnlyClosureRoots664=== RUN TestPresentRefreshesOnlyStaleClosures665=== PAUSE TestPresentRefreshesOnlyStaleClosures666=== RUN TestPresentNotReportedWhileGCDeletesClosure667=== PAUSE TestPresentNotReportedWhileGCDeletesClosure668=== RUN TestParseSingleRange669=== PAUSE TestParseSingleRange670=== RUN TestProxyHeadersOnlyTrustedOnSocket6712026/11/11 23:05:26 INFO Starting HTTP server address=127.0.0.1:566096722026/11/11 23:05:26 INFO Starting HTTP server address=proxy.sock6732026/11/11 23:05:26 WARN mTLS auth: subject not in bound subjects subject="CN=someone"6742026/11/11 23:05:26 INFO Shutdown signal received, draining in-flight requests timeout=10s675--- PASS: TestProxyHeadersOnlyTrustedOnSocket (0.16s)676=== RUN TestIsValidCachePath677=== PAUSE TestIsValidCachePath678=== RUN TestReadProxyNarinfo679=== PAUSE TestReadProxyNarinfo680=== RUN TestReadProxyNarinfoAlreadyDecompressed681=== PAUSE TestReadProxyNarinfoAlreadyDecompressed682=== RUN TestReadProxyContentNegotiation683=== PAUSE TestReadProxyContentNegotiation684=== RUN TestReadProxyNarStreaming685=== PAUSE TestReadProxyNarStreaming686=== RUN TestReadProxy404687=== PAUSE TestReadProxy404688=== RUN TestReadProxyInvalidPath689=== PAUSE TestReadProxyInvalidPath690=== RUN TestReadProxyHead691=== PAUSE TestReadProxyHead692=== RUN TestReadProxyOutlastsServerWriteTimeout693=== PAUSE TestReadProxyOutlastsServerWriteTimeout694=== RUN TestReadProxyConditionalGet695=== PAUSE TestReadProxyConditionalGet696=== RUN TestReadProxyRootRedirectsToIndexHTML697=== PAUSE TestReadProxyRootRedirectsToIndexHTML698=== RUN TestReadProxyDisabled699=== PAUSE TestReadProxyDisabled700=== RUN TestReadRedirectNar701=== PAUSE TestReadRedirectNar702=== RUN TestReadRedirectKeepsNarinfoProxied703=== PAUSE TestReadRedirectKeepsNarinfoProxied704=== RUN TestReadProxyRangeRequest705=== PAUSE TestReadProxyRangeRequest706=== RUN TestReadRedirectUsesPublicS3URL707=== PAUSE TestReadRedirectUsesPublicS3URL708=== RUN TestPush_OverlappingRootsStoreOneRowPerKey709=== PAUSE TestPush_OverlappingRootsStoreOneRowPerKey710=== RUN TestPush_CompleteCommitsEveryRoot711=== PAUSE TestPush_CompleteCommitsEveryRoot712=== RUN TestPush_RepeatedRootCommitsOnce713=== PAUSE TestPush_RepeatedRootCommitsOnce714=== RUN TestPush_CompleteWaitsForCleanupOfThePush715=== PAUSE TestPush_CompleteWaitsForCleanupOfThePush716=== RUN TestPush_RootsAreLockedInByteOrder717=== PAUSE TestPush_RootsAreLockedInByteOrder718=== RUN TestPush_SkippedKeySurvivesGCBeforeCommit719=== PAUSE TestPush_SkippedKeySurvivesGCBeforeCommit720=== RUN TestPush_RejectsBadRequests721=== PAUSE TestPush_RejectsBadRequests722=== RUN TestPush_SignsNarinfosOfItsPendingObjects723=== PAUSE TestPush_SignsNarinfosOfItsPendingObjects724=== RUN TestSharedNarBothUploadsComplete725=== PAUSE TestSharedNarBothUploadsComplete726=== RUN TestCompleteMultipartUpload_ErrorButObjectExists727=== PAUSE TestCompleteMultipartUpload_ErrorButObjectExists728=== RUN TestCompletedNarNotReofferedAcrossClosures729=== PAUSE TestCompletedNarNotReofferedAcrossClosures730=== RUN TestPresignedUploadRegisteredBeforeCommit731=== PAUSE TestPresignedUploadRegisteredBeforeCommit732=== RUN TestService_Rustfstest733=== PAUSE TestService_Rustfstest734=== RUN TestParseSize735=== PAUSE TestParseSize736=== RUN TestSkippedUploadsHandler737=== PAUSE TestSkippedUploadsHandler738=== RUN TestSystemdListenerNotActivated739--- PASS: TestSystemdListenerNotActivated (0.00s)740=== RUN TestWatchdogBeatsWhenHealthy741--- PASS: TestWatchdogBeatsWhenHealthy (0.03s)742=== RUN TestWatchdogSkipsWhenUnhealthy7432026/11/11 23:05:26 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7442026/11/11 23:05:27 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7452026/11/11 23:05:27 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7462026/11/11 23:05:27 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7472026/11/11 23:05:27 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7482026/11/11 23:05:27 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7492026/11/11 23:05:27 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7502026/11/11 23:05:27 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7512026/11/11 23:05:27 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7522026/11/11 23:05:27 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"753--- PASS: TestWatchdogSkipsWhenUnhealthy (0.21s)754=== RUN TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle755=== PAUSE TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle756=== RUN TestProxyWriteTimeout757=== PAUSE TestProxyWriteTimeout758=== RUN TestPendingClosureWriteTimeout759=== PAUSE TestPendingClosureWriteTimeout760=== RUN TestIsValidUploadKey761=== PAUSE TestIsValidUploadKey762=== RUN TestUploadHandlersRejectInvalidKeys763=== PAUSE TestUploadHandlersRejectInvalidKeys764=== RUN TestUploadHandlersRejectOversizedBody765=== PAUSE TestUploadHandlersRejectOversizedBody766=== RUN TestService_cleanupPendingClosuresHandler767=== PAUSE TestService_cleanupPendingClosuresHandler768=== RUN TestService_createPendingClosureHandler769=== PAUSE TestService_createPendingClosureHandler770=== RUN TestService_verifyS3Integrity771=== PAUSE TestService_verifyS3Integrity772=== RUN TestService_verifyS3ReuploadsStaleNarinfo773=== PAUSE TestService_verifyS3ReuploadsStaleNarinfo774=== RUN TestCompleteMultipartUnregistered775=== PAUSE TestCompleteMultipartUnregistered776=== RUN TestCreatePendingClosure_SmallNARUsesSimplePUT777=== PAUSE TestCreatePendingClosure_SmallNARUsesSimplePUT778=== CONT TestReadProxyContentNegotiation779=== CONT TestPresentNotReportedWhileGCDeletesClosure780=== RUN TestPresentNotReportedWhileGCDeletesClosure/stale781=== PAUSE TestPresentNotReportedWhileGCDeletesClosure/stale782=== RUN TestPresentNotReportedWhileGCDeletesClosure/fresh783=== PAUSE TestPresentNotReportedWhileGCDeletesClosure/fresh784=== CONT TestPush_SignsNarinfosOfItsPendingObjects785=== CONT TestReadProxyNarinfoAlreadyDecompressed786=== CONT TestReadProxyNarinfo787=== CONT TestIsValidCachePath788=== RUN TestIsValidCachePath/narinfo789=== CONT TestParseSingleRange790=== PAUSE TestIsValidCachePath/narinfo791=== CONT TestCreatePendingClosure_SmallNARUsesSimplePUT792=== RUN TestIsValidCachePath/narinfo_all_nix_base32_chars793=== PAUSE TestIsValidCachePath/narinfo_all_nix_base32_chars794=== RUN TestIsValidCachePath/nar_zst795=== RUN TestParseSingleRange/none796=== PAUSE TestIsValidCachePath/nar_zst797=== RUN TestIsValidCachePath/nar_xz798=== PAUSE TestIsValidCachePath/nar_xz799=== RUN TestIsValidCachePath/nar_bz2800=== PAUSE TestParseSingleRange/none801=== CONT TestCompleteMultipartUnregistered802=== CONT TestService_verifyS3ReuploadsStaleNarinfo803=== RUN TestService_verifyS3ReuploadsStaleNarinfo/lost,_other_NAR_pushed804=== CONT TestService_verifyS3Integrity805=== CONT TestService_createPendingClosureHandler806=== CONT TestService_cleanupPendingClosuresHandler807=== CONT TestUploadHandlersRejectOversizedBody808=== CONT TestUploadHandlersRejectInvalidKeys809=== CONT TestIsValidUploadKey810=== CONT TestPendingClosureWriteTimeout811=== CONT TestProxyWriteTimeout812=== CONT TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle813=== CONT TestSkippedUploadsHandler814=== CONT TestParseSize815=== CONT TestService_Rustfstest816=== CONT TestPresignedUploadRegisteredBeforeCommit817=== CONT TestCompletedNarNotReofferedAcrossClosures818=== CONT TestAbortSucceeded819=== PAUSE TestIsValidCachePath/nar_bz2820--- PASS: TestParseSize (0.00s)821=== CONT TestCompleteMultipartUpload_ErrorButObjectExists822=== RUN TestPendingClosureWriteTimeout/empty823=== RUN TestIsValidCachePath/nar_uncompressed824=== PAUSE TestPendingClosureWriteTimeout/empty825=== PAUSE TestIsValidCachePath/nar_uncompressed826=== PAUSE TestService_verifyS3ReuploadsStaleNarinfo/lost,_other_NAR_pushed827=== RUN TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info828=== PAUSE TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info829=== RUN TestParseSingleRange/unknown_unit830--- PASS: TestAbortSucceeded (0.00s)831=== CONT TestSharedNarBothUploadsComplete832=== RUN TestProxyWriteTimeout/narinfo833=== PAUSE TestProxyWriteTimeout/narinfo834=== RUN TestService_verifyS3ReuploadsStaleNarinfo/intact,_other_NAR_pushed835=== RUN TestIsValidUploadKey/narinfo836=== RUN TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal837=== RUN TestPendingClosureWriteTimeout/400_objects838=== RUN TestIsValidCachePath/ls839=== RUN TestProxyWriteTimeout/1_GiB_nar840=== PAUSE TestParseSingleRange/unknown_unit841=== PAUSE TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal842=== PAUSE TestIsValidUploadKey/narinfo843=== RUN TestIsValidUploadKey/nar_zst844=== RUN TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key845=== RUN TestParseSingleRange/multi-range_ignored8462026/11/11 23:05:27 INFO Client skipped oversized paths paths=3 nar_bytes=5000000000847=== PAUSE TestPendingClosureWriteTimeout/400_objects848=== RUN TestPendingClosureWriteTimeout/670k_objects849=== PAUSE TestPendingClosureWriteTimeout/670k_objects850=== RUN TestPendingClosureWriteTimeout/handler_extends_the_server's_deadline851=== PAUSE TestPendingClosureWriteTimeout/handler_extends_the_server's_deadline852=== PAUSE TestService_verifyS3ReuploadsStaleNarinfo/intact,_other_NAR_pushed853=== RUN TestService_verifyS3ReuploadsStaleNarinfo/first_of_two_lost854=== PAUSE TestService_verifyS3ReuploadsStaleNarinfo/first_of_two_lost855=== RUN TestService_verifyS3ReuploadsStaleNarinfo/first_of_two_lost,_second_pushed856=== PAUSE TestService_verifyS3ReuploadsStaleNarinfo/first_of_two_lost,_second_pushed857=== RUN TestService_verifyS3ReuploadsStaleNarinfo/lost,_same_NAR_pushed858=== PAUSE TestService_verifyS3ReuploadsStaleNarinfo/lost,_same_NAR_pushed859=== CONT TestGenerateLandingPage860=== CONT TestPresentRefreshesOnlyStaleClosures861=== PAUSE TestIsValidCachePath/ls862=== PAUSE TestProxyWriteTimeout/1_GiB_nar863=== RUN TestProxyWriteTimeout/10_GiB_nar864=== PAUSE TestProxyWriteTimeout/10_GiB_nar865=== RUN TestProxyWriteTimeout/unknown_size866=== PAUSE TestProxyWriteTimeout/unknown_size867=== PAUSE TestIsValidUploadKey/nar_zst868=== RUN TestIsValidUploadKey/nar_xz869=== PAUSE TestIsValidUploadKey/nar_xz870=== RUN TestIsValidUploadKey/nar_plain871=== PAUSE TestIsValidUploadKey/nar_plain872=== RUN TestIsValidUploadKey/listing873=== PAUSE TestIsValidUploadKey/listing874=== RUN TestIsValidUploadKey/build_log875=== PAUSE TestIsValidUploadKey/build_log876=== RUN TestIsValidUploadKey/build_log_home-manager_file877=== PAUSE TestIsValidUploadKey/build_log_home-manager_file878=== RUN TestIsValidUploadKey/build_log_plus_in_name879=== PAUSE TestIsValidUploadKey/build_log_plus_in_name880=== RUN TestIsValidUploadKey/build_log_question_mark881=== PAUSE TestIsValidUploadKey/build_log_question_mark882=== RUN TestIsValidUploadKey/build_log_equals883=== PAUSE TestIsValidUploadKey/build_log_equals884=== RUN TestIsValidUploadKey/realisation885=== PAUSE TestIsValidUploadKey/realisation886=== RUN TestIsValidUploadKey/realisation_plus_in_output887=== PAUSE TestIsValidUploadKey/realisation_plus_in_output888=== RUN TestIsValidUploadKey/nix-cache-info889=== PAUSE TestIsValidUploadKey/nix-cache-info890=== RUN TestIsValidUploadKey/index.html891=== PAUSE TestIsValidUploadKey/index.html892=== RUN TestIsValidUploadKey/narinfo_key,_nar_type893=== PAUSE TestIsValidUploadKey/narinfo_key,_nar_type894=== RUN TestIsValidUploadKey/nar_key,_narinfo_type895=== PAUSE TestIsValidUploadKey/nar_key,_narinfo_type896=== RUN TestIsValidUploadKey/listing_key,_narinfo_type897=== PAUSE TestIsValidUploadKey/listing_key,_narinfo_type898=== RUN TestIsValidUploadKey/traversal899=== PAUSE TestIsValidUploadKey/traversal900=== RUN TestIsValidUploadKey/traversal_nar901=== PAUSE TestIsValidUploadKey/traversal_nar902=== RUN TestIsValidUploadKey/absolute903=== PAUSE TestIsValidUploadKey/absolute904=== RUN TestIsValidUploadKey/empty_key905=== PAUSE TestIsValidUploadKey/empty_key906=== RUN TestIsValidUploadKey/unknown_type907=== PAUSE TestIsValidUploadKey/unknown_type908=== RUN TestIsValidCachePath/log909=== PAUSE TestIsValidCachePath/log910=== RUN TestIsValidCachePath/realisation911=== PAUSE TestIsValidCachePath/realisation912=== RUN TestIsValidCachePath/nix-cache-info913=== PAUSE TestIsValidCachePath/nix-cache-info914=== RUN TestIsValidCachePath/index.html915=== PAUSE TestIsValidCachePath/index.html916=== RUN TestIsValidCachePath/traversal_parent917=== PAUSE TestIsValidCachePath/traversal_parent918=== RUN TestIsValidCachePath/traversal_in_middle919=== PAUSE TestIsValidCachePath/traversal_in_middle920=== RUN TestIsValidCachePath/invalid_char_e921=== PAUSE TestIsValidCachePath/invalid_char_e922=== RUN TestIsValidCachePath/invalid_char_u923=== PAUSE TestIsValidCachePath/invalid_char_u924--- PASS: TestSkippedUploadsHandler (0.04s)925=== RUN TestIsValidCachePath/random_path926=== CONT TestFailedS3DeleteKeepsTombstone927=== PAUSE TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key928=== RUN TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key929=== PAUSE TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key930=== CONT TestPresentReportsOnlyClosureRoots931--- PASS: TestGenerateLandingPage (0.00s)932=== PAUSE TestIsValidCachePath/random_path933=== CONT TestOrphanedObjectsGCStressTest934=== RUN TestIsValidCachePath/empty935=== PAUSE TestIsValidCachePath/empty936=== RUN TestIsValidCachePath/leading_slash937=== PAUSE TestIsValidCachePath/leading_slash938=== RUN TestIsValidCachePath/wrong_extension939=== PAUSE TestIsValidCachePath/wrong_extension940=== RUN TestIsValidCachePath/short_hash941=== CONT TestCreatePin_ReservedPins942=== CONT TestService_readinessHandler943=== PAUSE TestIsValidCachePath/short_hash944=== CONT TestService_healthCheckHandler945=== PAUSE TestParseSingleRange/multi-range_ignored946=== RUN TestParseSingleRange/malformed_no_dash947=== PAUSE TestParseSingleRange/malformed_no_dash948=== RUN TestParseSingleRange/malformed_both_empty949=== PAUSE TestParseSingleRange/malformed_both_empty950=== RUN TestParseSingleRange/malformed_end_before_start951=== PAUSE TestParseSingleRange/malformed_end_before_start952=== RUN TestParseSingleRange/closed953=== PAUSE TestParseSingleRange/closed954=== RUN TestParseSingleRange/open-ended955=== PAUSE TestParseSingleRange/open-ended956=== RUN TestParseSingleRange/end_clamped_to_size957=== PAUSE TestParseSingleRange/end_clamped_to_size958=== RUN TestParseSingleRange/suffix959=== PAUSE TestParseSingleRange/suffix960=== RUN TestParseSingleRange/suffix_exceeds_size961=== PAUSE TestParseSingleRange/suffix_exceeds_size962=== RUN TestParseSingleRange/single_byte963=== PAUSE TestParseSingleRange/single_byte964=== RUN TestParseSingleRange/start_past_EOF965=== PAUSE TestParseSingleRange/start_past_EOF966=== RUN TestParseSingleRange/start_far_past_EOF967=== PAUSE TestParseSingleRange/start_far_past_EOF968=== CONT TestOrphanedObjectsGC969=== RUN TestUploadHandlersRejectOversizedBody/create_pending_closure970=== PAUSE TestUploadHandlersRejectOversizedBody/create_pending_closure971=== RUN TestUploadHandlersRejectOversizedBody/complete_multipart972=== PAUSE TestUploadHandlersRejectOversizedBody/complete_multipart973=== RUN TestUploadHandlersRejectOversizedBody/request_more_parts974=== PAUSE TestUploadHandlersRejectOversizedBody/request_more_parts975=== CONT TestObjectStatsUpdatedOncePerCommit9762026/11/11 23:05:27 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:56612/oidc9772026/11/11 23:05:28 INFO Received push request method=POST path=/api/pushes9782026/11/11 23:05:28 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign9792026/11/11 23:05:28 INFO Signed narinfos id=1 count=19802026/11/11 23:05:28 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign9812026/11/11 23:05:28 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign9822026/11/11 23:05:28 ERROR Failed to sign narinfos signer="index 1" error="signing key cannot be nil"9832026/11/11 23:05:28 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign9842026/11/11 23:05:28 ERROR Failed to sign narinfos signer=niks3-test-1 error="signer failed"9852026/11/11 23:05:28 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign9862026/11/11 23:05:28 ERROR Signer returned unexpected signature count signer=niks3-test-1 got=0 want=19872026/11/11 23:05:28 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign9882026/11/11 23:05:28 ERROR Signer returned unexpected object key signer=niks3-test-1 object_key=unexpected.narinfo989--- PASS: TestPush_SignsNarinfosOfItsPendingObjects (1.00s)990=== CONT TestObjectStatsTrigger991--- PASS: TestReadProxyContentNegotiation (1.23s)992=== CONT TestPendingCleanupUsesOneCutoff9932026/11/11 23:05:28 INFO Received uploads request method=POST path=/api/pending_closures994--- PASS: TestCreatePendingClosure_SmallNARUsesSimplePUT (1.47s)995=== CONT TestGracefulShutdownDrainsInflight9962026/11/11 23:05:28 INFO Starting HTTP server address=127.0.0.1:566209972026/11/11 23:05:28 INFO Shutdown signal received, draining in-flight requests timeout=10s998--- PASS: TestGracefulShutdownDrainsInflight (0.08s)999=== CONT TestGCTaskStore_Fail1000--- PASS: TestGCTaskStore_Fail (0.00s)1001=== CONT TestGCTaskStore_PhaseUpdates1002--- PASS: TestGCTaskStore_PhaseUpdates (0.00s)1003=== CONT TestMultipartUploadAbortedWhenCancelledBeforeRecorded10042026/11/11 23:05:28 INFO Received uploads request method=POST path=/api/pending_closures10052026/11/11 23:05:29 ERROR Failed to decode narinfo key=3hcdxyjf9yiq7qf3i4548drb6sjmwa1v.narinfo limit=16777216 error=<nil>1006--- PASS: TestReadProxyNarinfo (2.07s)1007=== CONT TestGCTaskStore_CompletedAllowsNewTask1008--- PASS: TestGCTaskStore_CompletedAllowsNewTask (0.00s)1009=== CONT TestMultipartCleanup1010--- PASS: TestService_Rustfstest (2.30s)1011=== CONT TestServerTLSConfig1012=== RUN TestServerTLSConfig/no_client_CA1013=== PAUSE TestServerTLSConfig/no_client_CA1014=== RUN TestServerTLSConfig/missing_CA_file1015=== PAUSE TestServerTLSConfig/missing_CA_file1016=== RUN TestServerTLSConfig/not_a_PEM_file1017=== PAUSE TestServerTLSConfig/not_a_PEM_file1018=== CONT TestService_NativeMTLS10192026/11/11 23:05:29 INFO Received complete multipart upload request method=POST path=/api/multipart/complete10202026/11/11 23:05:29 ERROR Failed to get multipart upload error="no rows in result set" upload_id=does-not-exist object_key=nar/0000000000000000000000000000000000000000000000000000.nar.zst1021--- PASS: TestCompleteMultipartUnregistered (2.54s)1022=== CONT TestMetricsCommit10232026/11/11 23:05:29 INFO Received uploads request method=POST path=/api/pending_closures10242026/11/11 23:05:29 INFO Received uploads request method=POST path=/api/pending_closures10252026/11/11 23:05:29 INFO Received uploads request method=POST path=/api/pending_closures1026--- PASS: TestReadProxyNarinfoAlreadyDecompressed (3.02s)1027=== CONT TestMetricsInventory10282026/11/11 23:05:30 INFO Received complete multipart upload request method=POST path=/api/multipart/complete10292026/11/11 23:05:30 INFO Completed multipart upload object_key=nar/dadb44fdadb44fdadb44fdadb44f000000000000000000000000.nar.zst upload_id=ZWQwMTIzZTAtNzI2My00MDAzLWExZjgtNWI1MTIzZGNhYTRhLjJiNmNiZmIxLWE2ZTEtNGU0YS05NjE2LWZiZjc4M2ZhNDUzZngxNzk0NDM4MzI4ODg0MzY1MDAw parts=1010302026/11/11 23:05:30 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete10312026/11/11 23:05:30 INFO Completed upload id=1 objects=2 duration=21.869667ms10322026/11/11 23:05:30 INFO Received uploads request method=POST path=/api/pending_closures10332026/11/11 23:05:30 INFO Received uploads request method=POST path=/api/pending_closures10342026/11/11 23:05:30 INFO Object in database but missing from S3 key=dadb44fdadb44fdadb44fdadb44f0000.narinfo10352026/11/11 23:05:30 WARN Found objects in DB but missing from S3, will re-upload count=11036--- PASS: TestService_verifyS3Integrity (3.20s)1037=== CONT TestReadRedirectKeepsNarinfoProxied10382026/11/11 23:05:30 INFO Received cleanup request method=DELETE path=/api/pending_closures10392026/11/11 23:05:30 INFO Aborted multipart uploads count=0 kept=010402026/11/11 23:05:30 INFO Received uploads request method=POST path=/api/pending_closures10412026/11/11 23:05:30 INFO Received cleanup request method=DELETE path=/api/pending_closures10422026/11/11 23:05:30 INFO Aborted multipart uploads count=1 kept=010432026/11/11 23:05:30 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete10442026-11-11 23:05:30.540 UTC [72299] ERROR: Closure does not exist: id=110452026-11-11 23:05:30.540 UTC [72299] CONTEXT: PL/pgSQL function commit_pending_closure(bigint) line 13 at RAISE10462026-11-11 23:05:30.540 UTC [72299] STATEMENT: -- name: CommitPendingClosure :one1047 SELECT commit_pending_closure($1::bigint)::bigint1048 1049--- PASS: TestService_cleanupPendingClosuresHandler (3.36s)1050=== CONT TestPush_RejectsBadRequests10512026/11/11 23:05:30 INFO Received uploads request method=POST path=/api/pending_closures10522026/11/11 23:05:30 INFO Received uploads request method=POST path=/api/pending_closures10532026/11/11 23:05:31 INFO Received complete multipart upload request method=POST path=/api/multipart/complete10542026/11/11 23:05:31 WARN CompleteMultipartUpload errored but object exists; treating as success error="The specified key does not exist." object_key=nar/gggggggggggggggggggggggggggggg0300000000000000000000.nar.zst upload_id=ZWQwMTIzZTAtNzI2My00MDAzLWExZjgtNWI1MTIzZGNhYTRhLjc5YWYxMzMzLTI3NjItNGZkZi1hMTRiLTNjZTMxMjVjYzQ0MXgxNzk0NDM4MzMwOTcxNzk4MDAw10552026/11/11 23:05:31 INFO Completed multipart upload object_key=nar/gggggggggggggggggggggggggggggg0300000000000000000000.nar.zst upload_id=ZWQwMTIzZTAtNzI2My00MDAzLWExZjgtNWI1MTIzZGNhYTRhLjc5YWYxMzMzLTI3NjItNGZkZi1hMTRiLTNjZTMxMjVjYzQ0MXgxNzk0NDM4MzMwOTcxNzk4MDAw parts=11056--- PASS: TestCompleteMultipartUpload_ErrorButObjectExists (4.12s)1057=== CONT TestNARDeduplicationMetadataUploadBug1058--- PASS: TestPresentRefreshesOnlyStaleClosures (4.10s)1059=== CONT TestGCTaskStore_GetReturnsLatest1060--- PASS: TestGCTaskStore_GetReturnsLatest (0.00s)1061=== CONT TestCreatePendingClosureRejectsOversizedNAR10622026/11/11 23:05:31 INFO Received uploads request method=POST path=/api/pending_closures1063--- PASS: TestCreatePendingClosureRejectsOversizedNAR (0.01s)1064=== CONT TestPush_SkippedKeySurvivesGCBeforeCommit10652026/11/11 23:05:31 INFO Received complete multipart upload request method=POST path=/api/multipart/complete10662026/11/11 23:05:31 INFO Completed multipart upload object_key=nar/0000000000000000000000000000000000000000000000000000.nar.zst upload_id=ZWQwMTIzZTAtNzI2My00MDAzLWExZjgtNWI1MTIzZGNhYTRhLjA1NWZmMDY2LTU2NTItNDZmYS1hZWFkLWE2ZjI3ZDY1ODNmOHgxNzk0NDM4MzI5OTcyNzY5MDAw parts=1010672026/11/11 23:05:31 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete10682026/11/11 23:05:31 INFO Completed upload id=1 objects=2 duration=21.857583ms10692026/11/11 23:05:31 INFO Received get closure request method=GET path=/api/closures/0000000000000000000000000000000010702026/11/11 23:05:31 INFO Received uploads request method=POST path=/api/pending_closures10712026/11/11 23:05:31 INFO Starting cleanup of old closures method=DELETE path=/api/closures10722026/11/11 23:05:31 INFO Received uploads request method=POST path=/api/pending_closures10732026/11/11 23:05:31 INFO Aborted multipart uploads count=0 kept=010742026/11/11 23:05:31 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=010752026/11/11 23:05:31 INFO Vacuumed table table=pending_closures10762026/11/11 23:05:31 INFO Vacuumed table table=pending_objects10772026/11/11 23:05:31 INFO Registered completed upload object_key=nar/jjjjjjjjjjjjjjjjjjjjjjjjjjjjjj0100000000000000000000.nar.zst10782026/11/11 23:05:31 INFO Received uploads request method=POST path=/api/pending_closures1079--- PASS: TestPresignedUploadRegisteredBeforeCommit (4.49s)1080=== CONT TestGCTaskStore_GetEmpty1081--- PASS: TestGCTaskStore_GetEmpty (0.00s)10822026/11/11 23:05:31 INFO Vacuumed table table=multipart_uploads1083=== CONT TestCacheConfigHandlerMaxNarSize1084--- PASS: TestCacheConfigHandlerMaxNarSize (0.00s)1085=== CONT TestPush_RootsAreLockedInByteOrder10862026/11/11 23:05:31 INFO Vacuumed table table=closures10872026/11/11 23:05:31 INFO Vacuumed table table=objects10882026/11/11 23:05:31 INFO Received get closure request method=GET path=/api/closures/000000000000000000000000000000001089--- PASS: TestService_createPendingClosureHandler (4.60s)1090=== CONT TestGCTaskStore_ConflictDifferentParams1091--- PASS: TestGCTaskStore_ConflictDifferentParams (0.00s)1092=== CONT TestPush_CompleteWaitsForCleanupOfThePush10932026/11/11 23:05:31 INFO Received uploads request method=POST path=/api/pending_closures10942026/11/11 23:05:31 INFO Received uploads request method=POST path=/api/pending_closures10952026/11/11 23:05:32 WARN readiness check failed error="closed pool"1096--- PASS: TestService_readinessHandler (4.85s)1097=== CONT TestGCTaskStore_DeduplicateSameParams1098--- PASS: TestGCTaskStore_DeduplicateSameParams (0.00s)1099=== CONT TestPush_RepeatedRootCommitsOnce11002026/11/11 23:05:32 INFO Received complete multipart upload request method=POST path=/api/multipart/complete11012026/11/11 23:05:32 INFO Received uploads request method=POST path=/api/pending_closures11022026/11/11 23:05:32 INFO Completed multipart upload object_key=nar/hhhhhhhhhhhhhhhhhhhhhhhhhhhhhh0100000000000000000000.nar.zst upload_id=ZWQwMTIzZTAtNzI2My00MDAzLWExZjgtNWI1MTIzZGNhYTRhLmZlYTI1ZGMwLWJhYWMtNDEyMC05OGY3LWUyNzI0NjRlZDgwYngxNzk0NDM4MzMwNjkyNTQ0MDAw parts=1211032026/11/11 23:05:32 INFO Received uploads request method=POST path=/api/pending_closures1104--- PASS: TestCompletedNarNotReofferedAcrossClosures (5.29s)1105=== CONT TestPush_CompleteCommitsEveryRoot11062026/11/11 23:05:32 INFO Aborted multipart uploads count=0 kept=011072026/11/11 23:05:32 WARN Force mode enabled - objects will be deleted immediately without grace period11082026/11/11 23:05:32 ERROR failed to remove object object=nar/dddddddddddddddddddddddddddddddddddddddddddddddddddd.nar.zst error="Access Denied."11092026/11/11 23:05:32 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.narinfo error="Access Denied."1110--- PASS: TestFailedS3DeleteKeepsTombstone (5.44s)1111=== CONT TestPush_OverlappingRootsStoreOneRowPerKey11122026/11/11 23:05:32 INFO Received uploads request method=POST path=/api/pending_closures1113--- PASS: TestService_healthCheckHandler (5.68s)1114=== CONT TestEnsureAbortUploadsRule11152026/11/11 23:05:32 INFO Received complete multipart upload request method=POST path=/api/multipart/complete11162026/11/11 23:05:33 INFO Received complete multipart upload request method=POST path=/api/multipart/complete11172026/11/11 23:05:33 INFO Completed multipart upload object_key=nar/gggggggggggggggggggggggggggggg0100000000000000000000.nar.zst upload_id=ZWQwMTIzZTAtNzI2My00MDAzLWExZjgtNWI1MTIzZGNhYTRhLmFkYjI1YzI3LWM2NDAtNDcxYS04OGE1LWVhNGNmMmI4YmI4NHgxNzk0NDM4MzMxODQ1NDcxMDAw parts=121118--- PASS: TestObjectStatsUpdatedOncePerCommit (6.95s)1119=== CONT TestReadRedirectUsesPublicS3URL1120--- PASS: TestPresentReportsOnlyClosureRoots (7.09s)1121=== CONT TestGCTaskStore_StartNew1122--- PASS: TestGCTaskStore_StartNew (0.00s)1123=== CONT TestReadProxyRangeRequest11242026/11/11 23:05:34 INFO Received create pin request method=POST path=/api/pins/worker-x86_64-linux11252026/11/11 23:05:34 WARN Refused reserved pin name=worker-x86_64-linux11262026/11/11 23:05:34 INFO Received create pin request method=POST path=/api/pins/worker-x86_64-linux11272026/11/11 23:05:34 INFO Received create pin request method=POST path=/api/pins/my-app11282026/11/11 23:05:34 INFO Received create pin request method=POST path=/api/pins/worker-x86_64-linux1129--- PASS: TestCreatePin_ReservedPins (7.47s)1130=== CONT TestSweepRechecksPendingAfterLocking11312026/11/11 23:05:35 INFO Received uploads request method=POST path=/api/pending_closures11322026/11/11 23:05:35 INFO Received uploads request method=POST path=/api/pending_closures11332026/11/11 23:05:35 INFO Received cleanup request method=DELETE path=/api/pending_closures1134=== NAME TestOrphanedObjectsGC1135 orphaned_objects_gc_test.go:287: GC Test Summary:1136 orphaned_objects_gc_test.go:288: - Kept: 2 objects from closure A1137 orphaned_objects_gc_test.go:289: - Deleted: 2 objects from closure B1138 orphaned_objects_gc_test.go:290: - Deleted: 6 orphaned chain objects (X1->X2->X3)1139 orphaned_objects_gc_test.go:291: - Deleted: 2 orphaned single objects (Y)1140 orphaned_objects_gc_test.go:292: - Total deleted: 10 objects1141--- PASS: TestOrphanedObjectsGC (8.29s)1142=== CONT TestGetExistingObjectsLocksRows11432026/11/11 23:05:35 INFO Received uploads request method=POST path=/api/pending_closures1144--- PASS: TestMultipartUploadAbortedWhenCancelledBeforeRecorded (7.06s)1145=== CONT TestRegisterCompletedObjectNeedsPendingRow11462026/11/11 23:05:36 INFO Received complete multipart upload request method=POST path=/api/multipart/complete1147--- PASS: TestObjectStatsTrigger (7.99s)1148=== CONT TestGCEndsOnShutdown1149=== RUN TestGCEndsOnShutdown/before_the_run1150=== PAUSE TestGCEndsOnShutdown/before_the_run1151=== RUN TestGCEndsOnShutdown/blocked_in_the_sweep's_S3_delete1152=== PAUSE TestGCEndsOnShutdown/blocked_in_the_sweep's_S3_delete1153=== RUN TestGCEndsOnShutdown/blocked_on_a_row_lock_in_the_mark1154=== PAUSE TestGCEndsOnShutdown/blocked_on_a_row_lock_in_the_mark1155=== CONT TestSweepSkipsRowsLockedByPush11562026/11/11 23:05:36 INFO Completed multipart upload object_key=nar/gggggggggggggggggggggggggggggg0100000000000000000000.nar.zst upload_id=ZWQwMTIzZTAtNzI2My00MDAzLWExZjgtNWI1MTIzZGNhYTRhLjA2MmViMzMzLTM1NDgtNGQxMi05YjE5LTc5ODgxYTMyNTQ3YXgxNzk0NDM4MzMxODgwNTcxMDAw parts=121157--- PASS: TestSharedNarBothUploadsComplete (9.04s)1158=== CONT TestCommitRacingPendingCleanupKeepsObjects11592026/11/11 23:05:36 INFO Received uploads request method=POST path=/api/pending_closures11602026/11/11 23:05:36 INFO Received cleanup request method=DELETE path=/api/pending_closures11612026/11/11 23:05:36 WARN Failed to abort upload, keeping its closure key=nar/dadb44fdadb44fdadb44fdadb44f000000000000000000000000.nar.zst error="Get \"http://127.0.0.1:1/bucket31/?location=\": dial tcp 127.0.0.1:1: connect: connection refused" code=""11622026/11/11 23:05:36 INFO Aborted multipart uploads count=0 kept=111632026/11/11 23:05:36 INFO Received cleanup request method=DELETE path=/api/pending_closures11642026/11/11 23:05:36 INFO Aborted multipart uploads count=1 kept=01165--- PASS: TestMultipartCleanup (7.44s)1166=== CONT TestPushWaitsForSweepHoldingRow11672026/11/11 23:05:36 WARN mTLS auth: subject not in bound subjects subject="CN=reader"11682026/11/11 23:05:36 WARN mTLS auth: subject not in bound subjects subject="CN=reader"1169--- PASS: TestService_NativeMTLS (7.26s)1170=== CONT TestDeleteClosuresRacingPins11712026/11/11 23:05:37 INFO Received push request method=POST path=/api/pushes11722026/11/11 23:05:37 INFO Received complete push request method=POST path=/api/pushes/1/complete11732026/11/11 23:05:37 INFO Completed push id=1 objects=4 duration=92.4255ms11742026/11/11 23:05:37 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete11752026/11/11 23:05:37 INFO Completed upload id=2 objects=2 duration=2.503625ms1176--- PASS: TestMetricsCommit (7.62s)1177=== CONT TestForceGCDuringPushOffersSweptObject1178=== RUN TestForceGCDuringPushOffersSweptObject/before_pending_rows1179=== PAUSE TestForceGCDuringPushOffersSweptObject/before_pending_rows1180=== RUN TestForceGCDuringPushOffersSweptObject/after_presence_check1181=== PAUSE TestForceGCDuringPushOffersSweptObject/after_presence_check1182=== CONT TestCreatePendingClosureVerifyS3FailureReleasesConnection11832026/11/11 23:05:37 WARN Rate limiter enabled after throttle name=s3-test rate=511842026/11/11 23:05:37 WARN S3 rate limit hit operation="complete multipart upload" error="Please reduce your request rate."1185=== NAME TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle1186 throttle_test.go:213: Proxy stats: total=13, throttled=10, completeMultipart=101187 throttle_test.go:215: Rate limiter: enabled=true, rate=5.001188--- PASS: TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle (10.21s)1189=== CONT TestCacheStatsHandler1190--- PASS: TestMetricsInventory (7.34s)1191=== CONT TestGCSweepDeliversEachKeyOnce1192--- PASS: TestReadRedirectKeepsNarinfoProxied (7.48s)1193=== CONT TestClientFallsBackToClosures1194=== RUN TestPush_RejectsBadRequests/no_roots1195=== PAUSE TestPush_RejectsBadRequests/no_roots1196=== RUN TestPush_RejectsBadRequests/no_objects1197=== PAUSE TestPush_RejectsBadRequests/no_objects1198=== RUN TestPush_RejectsBadRequests/bad_root1199=== PAUSE TestPush_RejectsBadRequests/bad_root1200=== RUN TestPush_RejectsBadRequests/root_not_in_objects1201=== PAUSE TestPush_RejectsBadRequests/root_not_in_objects1202=== CONT TestTombstonedObjectOfferedWithoutWaiting12032026/11/11 23:05:38 INFO Received push request method=POST path=/api/pushes12042026/11/11 23:05:38 INFO Received complete push request method=POST path=/api/pushes/1/complete12052026/11/11 23:05:38 INFO Completed push id=1 objects=4 duration=50.677792ms12062026/11/11 23:05:38 INFO Received push request method=POST path=/api/pushes12072026/11/11 23:05:38 INFO Aborted multipart uploads count=0 kept=012082026/11/11 23:05:38 WARN Force mode enabled - objects will be deleted immediately without grace period12092026/11/11 23:05:38 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=2 objects-deleted-after-grace-period=2 objects-failed-to-delete=012102026/11/11 23:05:39 INFO Vacuumed table table=pending_closures12112026/11/11 23:05:39 INFO Vacuumed table table=pending_objects12122026/11/11 23:05:39 INFO Vacuumed table table=multipart_uploads12132026/11/11 23:05:39 INFO Vacuumed table table=closures12142026/11/11 23:05:39 INFO Vacuumed table table=objects12152026/11/11 23:05:39 INFO Received complete push request method=POST path=/api/pushes/2/complete12162026/11/11 23:05:39 INFO Completed push id=2 objects=4 duration=6.937042ms1217--- PASS: TestPush_SkippedKeySurvivesGCBeforeCommit (7.84s)1218=== CONT TestService_ReadAuthMiddleware1219=== NAME TestNARDeduplicationMetadataUploadBug1220 metadata_upload_test.go:48: First store path: /private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestNARDeduplicationMetadataUploadBug529796189/001/store/mqsv3b16vkwgr4wmb0fajp9vhivr34vq-file1.txt12212026/11/11 23:05:39 INFO Received push request method=POST path=/api/pushes12222026/11/11 23:05:39 INFO Received push request method=POST path=/api/pushes12232026/11/11 23:05:39 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)12242026/11/11 23:05:39 INFO Uploading mqsv3b16vkwgr4wmb0fajp9vhivr34vq-file1.txt (160B)12252026/11/11 23:05:39 WARN Failed to register uploaded object key=nar/1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf.nar.zst error="server returned 404: 404 page not found\n"12262026-11-11 23:05:39.465 UTC [72407] ERROR: could not obtain lock on row in relation "closures"12272026-11-11 23:05:39.465 UTC [72407] STATEMENT: SELECT 1 FROM closures WHERE key = $1 FOR UPDATE NOWAIT12282026-11-11 23:05:39.473 UTC [72407] ERROR: could not obtain lock on row in relation "closures"12292026-11-11 23:05:39.473 UTC [72407] STATEMENT: SELECT 1 FROM closures WHERE key = $1 FOR UPDATE NOWAIT12302026/11/11 23:05:39 WARN Failed to register uploaded object key=mqsv3b16vkwgr4wmb0fajp9vhivr34vq.ls error="server returned 404: 404 page not found\n"12312026/11/11 23:05:39 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign12322026-11-11 23:05:39.474 UTC [72407] ERROR: could not obtain lock on row in relation "closures"12332026-11-11 23:05:39.474 UTC [72407] STATEMENT: SELECT 1 FROM closures WHERE key = $1 FOR UPDATE NOWAIT12342026/11/11 23:05:39 INFO Signed narinfos id=1 count=112352026/11/11 23:05:39 INFO Uploading 1 narinfos12362026-11-11 23:05:39.478 UTC [72407] ERROR: could not obtain lock on row in relation "closures"12372026-11-11 23:05:39.478 UTC [72407] STATEMENT: SELECT 1 FROM closures WHERE key = $1 FOR UPDATE NOWAIT12382026-11-11 23:05:39.479 UTC [72407] ERROR: could not obtain lock on row in relation "closures"12392026-11-11 23:05:39.479 UTC [72407] STATEMENT: SELECT 1 FROM closures WHERE key = $1 FOR UPDATE NOWAIT1240--- PASS: TestPush_RootsAreLockedInByteOrder (7.83s)1241=== CONT TestClientPushesUseOnePush12422026/11/11 23:05:39 INFO Received complete push request method=POST path=/api/pushes/1/complete12432026/11/11 23:05:39 WARN Failed to register uploaded object key=mqsv3b16vkwgr4wmb0fajp9vhivr34vq.narinfo error="server returned 404: 404 page not found\n"12442026/11/11 23:05:39 INFO Completed push id=1 objects=3 duration=30.713958ms12452026/11/11 23:05:39 INFO Upload complete. (312ms)1246=== NAME TestNARDeduplicationMetadataUploadBug1247 metadata_upload_test.go:54: Retrieved narinfo from S3:1248 StorePath: /private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestNARDeduplicationMetadataUploadBug529796189/001/store/mqsv3b16vkwgr4wmb0fajp9vhivr34vq-file1.txt1249 URL: nar/1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf.nar.zst1250 Compression: zstd1251 NarHash: sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf1252 NarSize: 1601253 References: 1254 CA: fixed:r:sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf1255 metadata_upload_test.go:55: Retrieved .ls file from S3 (compressed size: 77 bytes)1256 metadata_upload_test.go:55: Decompressed .ls content (64 bytes):1257 {"version":1,"root":{"type":"regular","size":44,"narOffset":96}}12582026/11/11 23:05:39 INFO Received push request method=POST path=/api/pushes1259 metadata_upload_test.go:64: Second store path (same content): /private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestNARDeduplicationMetadataUploadBug529796189/001/store/8w9ijz8v5ssxs7frszxv53qkca2icci8-file2.txt12602026/11/11 23:05:39 INFO Received push request method=POST path=/api/pushes12612026/11/11 23:05:39 INFO Uploading 0 paths to 127.0.0.1 (1 already cached)12622026/11/11 23:05:39 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign12632026/11/11 23:05:39 WARN Failed to register uploaded object key=8w9ijz8v5ssxs7frszxv53qkca2icci8.ls error="server returned 404: 404 page not found\n"12642026/11/11 23:05:39 INFO Signed narinfos id=2 count=112652026/11/11 23:05:39 INFO Uploading 1 narinfos12662026/11/11 23:05:39 INFO Received complete push request method=POST path=/api/pushes/2/complete12672026/11/11 23:05:39 WARN Failed to register uploaded object key=8w9ijz8v5ssxs7frszxv53qkca2icci8.narinfo error="server returned 404: 404 page not found\n"12682026/11/11 23:05:39 INFO Completed push id=2 objects=3 duration=1.534916ms12692026/11/11 23:05:39 INFO Upload complete. (181ms)1270 metadata_upload_test.go:76: Retrieved narinfo from S3:1271 StorePath: /private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestNARDeduplicationMetadataUploadBug529796189/001/store/8w9ijz8v5ssxs7frszxv53qkca2icci8-file2.txt1272 URL: nar/1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf.nar.zst1273 Compression: zstd1274 NarHash: sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf1275 NarSize: 1601276 References: 1277 CA: fixed:r:sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf1278 metadata_upload_test.go:77: Retrieved .ls file from S3 (compressed size: 62 bytes)1279 metadata_upload_test.go:77: Decompressed .ls content (49 bytes):1280 {"version":1,"root":{"type":"regular","size":44}}12812026/11/11 23:05:39 INFO Received push request method=POST path=/api/pushes1282--- PASS: TestNARDeduplicationMetadataUploadBug (8.70s)1283=== CONT TestGCSweepSkipsPendingObjects12842026-11-11 23:05:40.050 UTC [72413] ERROR: Push does not exist: id=112852026-11-11 23:05:40.050 UTC [72413] CONTEXT: PL/pgSQL function commit_push(bigint) line 11 at RAISE12862026-11-11 23:05:40.050 UTC [72413] STATEMENT: SELECT commit_push($1)1287--- PASS: TestPush_CompleteWaitsForCleanupOfThePush (8.28s)1288=== CONT TestCacheConfigHandler1289=== RUN TestCacheConfigHandler/full_config,_no_issuer1290=== PAUSE TestCacheConfigHandler/full_config,_no_issuer1291=== RUN TestCacheConfigHandler/no_cache_url_configured1292=== PAUSE TestCacheConfigHandler/no_cache_url_configured1293=== RUN TestCacheConfigHandler/no_signing_keys1294=== PAUSE TestCacheConfigHandler/no_signing_keys1295=== RUN TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator1296=== PAUSE TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator1297=== CONT TestPinProtectsFromGC12982026/11/11 23:05:40 INFO Received complete push request method=POST path=/api/pushes/1/complete12992026/11/11 23:05:40 INFO Completed push id=1 objects=4 duration=30.023541ms1300--- PASS: TestPush_RepeatedRootCommitsOnce (8.04s)1301=== CONT TestDeduplicatedObjectsRecordedAsPending13022026/11/11 23:05:40 INFO Received push request method=POST path=/api/pushes13032026/11/11 23:05:40 INFO Received complete push request method=POST path=/api/pushes/1/complete13042026/11/11 23:05:40 INFO Completed push id=1 objects=6 duration=27.487167ms1305--- PASS: TestPush_CompleteCommitsEveryRoot (8.00s)1306=== CONT TestService_ReadScope_PublicByDefault13072026/11/11 23:05:40 INFO Received push request method=POST path=/api/pushes1308--- PASS: TestPush_OverlappingRootsStoreOneRowPerKey (8.03s)1309=== CONT TestPushDedupSurvivesConcurrentGC13102026/11/11 23:05:41 INFO Installed lifecycle rule aborting incomplete NAR uploads bucket=bucket44 days=21311--- PASS: TestEnsureAbortUploadsRule (8.12s)1312=== CONT TestService_RequireScope_OIDC13132026/11/11 23:05:41 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:56703/oidc1314--- PASS: TestReadRedirectUsesPublicS3URL (7.02s)1315=== CONT TestService_AuthMiddleware_OIDC13162026/11/11 23:05:41 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:56708/oidc1317--- PASS: TestReadProxyRangeRequest (7.11s)1318=== CONT TestClientSharedPathCommittedMidPush13192026/11/11 23:05:41 INFO Aborted multipart uploads count=1 kept=013202026/11/11 23:05:41 INFO Received cleanup request method=DELETE path=/api/pending_closures13212026/11/11 23:05:41 INFO Aborted multipart uploads count=1 kept=01322--- PASS: TestPendingCleanupUsesOneCutoff (13.09s)1323=== CONT TestClientIntegration13242026/11/11 23:05:41 INFO Aborted multipart uploads count=0 kept=013252026/11/11 23:05:41 WARN Force mode enabled - objects will be deleted immediately without grace period13262026/11/11 23:05:41 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=013272026/11/11 23:05:41 INFO Vacuumed table table=pending_closures13282026/11/11 23:05:41 INFO Vacuumed table table=pending_objects13292026/11/11 23:05:41 INFO Vacuumed table table=multipart_uploads13302026/11/11 23:05:41 INFO Vacuumed table table=closures13312026/11/11 23:05:42 INFO Vacuumed table table=objects1332--- PASS: TestSweepRechecksPendingAfterLocking (7.31s)1333=== CONT TestClientErrorHandling1334=== RUN TestClientErrorHandling/InvalidStorePath1335=== PAUSE TestClientErrorHandling/InvalidStorePath1336=== RUN TestClientErrorHandling/InvalidAuthToken1337=== PAUSE TestClientErrorHandling/InvalidAuthToken1338=== RUN TestClientErrorHandling/ServerNotAvailable1339=== PAUSE TestClientErrorHandling/ServerNotAvailable1340=== CONT TestClientWithDependencies1341--- PASS: TestGetExistingObjectsLocksRows (6.54s)1342=== CONT TestClientCADerivations1343--- PASS: TestRegisterCompletedObjectNeedsPendingRow (6.52s)1344=== CONT TestClientMultipleUploads13452026/11/11 23:05:42 INFO Aborted multipart uploads count=0 kept=013462026/11/11 23:05:42 WARN Force mode enabled - objects will be deleted immediately without grace period13472026/11/11 23:05:42 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=013482026/11/11 23:05:42 INFO Vacuumed table table=pending_closures13492026/11/11 23:05:42 INFO Vacuumed table table=pending_objects13502026/11/11 23:05:42 INFO Vacuumed table table=multipart_uploads13512026/11/11 23:05:42 INFO Vacuumed table table=closures13522026/11/11 23:05:43 INFO Vacuumed table table=objects1353--- PASS: TestCommitRacingPendingCleanupKeepsObjects (6.82s)1354=== CONT TestGCMetrics13552026/11/11 23:05:43 INFO Aborted multipart uploads count=0 kept=013562026/11/11 23:05:43 WARN Force mode enabled - objects will be deleted immediately without grace period13572026/11/11 23:05:43 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=013582026/11/11 23:05:43 INFO Vacuumed table table=pending_closures13592026/11/11 23:05:43 INFO Vacuumed table table=pending_objects13602026/11/11 23:05:43 INFO Vacuumed table table=multipart_uploads13612026/11/11 23:05:43 INFO Vacuumed table table=closures13622026/11/11 23:05:43 INFO Vacuumed table table=objects13632026/11/11 23:05:43 INFO Aborted multipart uploads count=0 kept=013642026/11/11 23:05:43 WARN Force mode enabled - objects will be deleted immediately without grace period13652026/11/11 23:05:43 INFO Received uploads request method=POST path=/api/pending_closures13662026/11/11 23:05:43 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=013672026/11/11 23:05:43 INFO Vacuumed table table=pending_closures13682026/11/11 23:05:43 INFO Vacuumed table table=pending_objects13692026/11/11 23:05:43 INFO Vacuumed table table=multipart_uploads13702026/11/11 23:05:43 INFO Vacuumed table table=closures13712026/11/11 23:05:43 INFO Vacuumed table table=objects1372--- PASS: TestSweepSkipsRowsLockedByPush (7.34s)1373=== CONT TestLeadUnannouncedStandbyYieldsToIncumbent1374--- PASS: TestPushWaitsForSweepHoldingRow (7.20s)1375=== CONT TestService_AuthMiddleware_MTLSProxyHeader13762026/11/11 23:05:44 INFO Received uploads request method=POST path=/api/pending_closures1377--- PASS: TestCreatePendingClosureVerifyS3FailureReleasesConnection (7.00s)1378=== CONT TestLeadElectsOneAndHandsOver1379--- PASS: TestCacheStatsHandler (7.06s)1380=== CONT TestService_AuthMiddleware_MTLSBoundSubjects13812026/11/11 23:05:44 INFO Aborted multipart uploads count=0 kept=013822026/11/11 23:05:44 WARN Force mode enabled - objects will be deleted immediately without grace period13832026/11/11 23:05:45 INFO Received uploads request method=POST path=/api/pending_closures13842026/11/11 23:05:45 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=3 objects-deleted-after-grace-period=3 objects-failed-to-delete=013852026/11/11 23:05:45 INFO Vacuumed table table=pending_closures13862026/11/11 23:05:45 INFO Vacuumed table table=pending_objects1387--- PASS: TestTombstonedObjectOfferedWithoutWaiting (7.28s)1388=== CONT TestConnectWaitsForAPeerMigration13892026/11/11 23:05:45 INFO Vacuumed table table=multipart_uploads13902026/11/11 23:05:45 INFO Vacuumed table table=closures13912026/11/11 23:05:45 INFO Vacuumed table table=objects1392--- PASS: TestGCSweepDeliversEachKeyOnce (8.01s)1393=== CONT TestReadProxyInvalidPath1394--- PASS: TestService_ReadAuthMiddleware (6.60s)1395=== CONT TestResolveDBConnectionString1396=== RUN TestResolveDBConnectionString/flag_wins1397=== PAUSE TestResolveDBConnectionString/flag_wins1398=== RUN TestResolveDBConnectionString/file_when_flag_empty1399=== PAUSE TestResolveDBConnectionString/file_when_flag_empty1400=== RUN TestResolveDBConnectionString/missing_file_is_an_error1401=== PAUSE TestResolveDBConnectionString/missing_file_is_an_error1402=== RUN TestResolveDBConnectionString/PGHOST_allows_empty1403=== PAUSE TestResolveDBConnectionString/PGHOST_allows_empty1404=== RUN TestResolveDBConnectionString/nothing_configured1405=== PAUSE TestResolveDBConnectionString/nothing_configured1406=== CONT TestLeadIncumbentAnnouncesAtOnce14072026/11/11 23:05:45 INFO Received uploads request method=POST path=/api/pending_closures14082026/11/11 23:05:45 INFO Received uploads request method=POST path=/api/pending_closures14092026/11/11 23:05:45 INFO Uploading 2 paths to 127.0.0.1 (1 already cached)14102026/11/11 23:05:45 INFO Uploading qzw33fazchz70w0cz7zrfkd4fpnnmxms-b (256B)14112026/11/11 23:05:45 INFO Uploading wc9m21rcvqqsfkjlv0im09yh2d5jnhwn-shared-dep (136B)14122026/11/11 23:05:45 WARN Failed to register uploaded object key=qzw33fazchz70w0cz7zrfkd4fpnnmxms.ls error="server returned 404: 404 page not found\n"14132026/11/11 23:05:45 WARN Failed to register uploaded object key=wmp4ypyakw0id4zgddnpfimg84gnsd28.ls error="server returned 404: 404 page not found\n"14142026/11/11 23:05:46 WARN Failed to register uploaded object key=nar/1qymzqykxvp0nz6xbcp3jz9xzalqffnkh4hm72b1fglg9kdyscyw.nar.zst error="server returned 404: 404 page not found\n"14152026/11/11 23:05:46 WARN Failed to register uploaded object key=wc9m21rcvqqsfkjlv0im09yh2d5jnhwn.ls error="server returned 404: 404 page not found\n"14162026/11/11 23:05:46 WARN Failed to register uploaded object key=nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst error="server returned 404: 404 page not found\n"14172026/11/11 23:05:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign14182026/11/11 23:05:46 INFO Signed narinfos id=1 count=214192026/11/11 23:05:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign14202026/11/11 23:05:46 INFO Signed narinfos id=2 count=214212026/11/11 23:05:46 INFO Uploading 4 narinfos14222026/11/11 23:05:46 WARN Failed to register uploaded object key=wmp4ypyakw0id4zgddnpfimg84gnsd28.narinfo error="server returned 404: 404 page not found\n"14232026/11/11 23:05:46 WARN Failed to register uploaded object key=wc9m21rcvqqsfkjlv0im09yh2d5jnhwn.narinfo error="server returned 404: 404 page not found\n"14242026/11/11 23:05:46 WARN Failed to register uploaded object key=qzw33fazchz70w0cz7zrfkd4fpnnmxms.narinfo error="server returned 404: 404 page not found\n"14252026/11/11 23:05:46 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete14262026/11/11 23:05:46 WARN Failed to register uploaded object key=wc9m21rcvqqsfkjlv0im09yh2d5jnhwn.narinfo error="server returned 404: 404 page not found\n"14272026/11/11 23:05:46 INFO Completed upload id=1 objects=6 duration=29.322209ms14282026/11/11 23:05:46 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete14292026/11/11 23:05:46 INFO Completed upload id=2 objects=6 duration=1.064417ms14302026/11/11 23:05:46 INFO Upload complete. (394ms)1431=== NAME TestClientFallsBackToClosures1432 client_pushes_test.go:112: Retrieved narinfo from S3:1433 StorePath: /private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestClientFallsBackToClosures4050905731/001/store/wc9m21rcvqqsfkjlv0im09yh2d5jnhwn-shared-dep1434 URL: nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst1435 Compression: zstd1436 NarHash: sha256:1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y821437 NarSize: 1361438 References: 1439 CA: text:sha256:08nxw05k7b0pzzy0f3swvnw4ldxdbclkdnklpidwmrxdhvfrmv7n1440 client_pushes_test.go:112: Retrieved narinfo from S3:1441 StorePath: /private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestClientFallsBackToClosures4050905731/001/store/wmp4ypyakw0id4zgddnpfimg84gnsd28-a1442 URL: nar/1qymzqykxvp0nz6xbcp3jz9xzalqffnkh4hm72b1fglg9kdyscyw.nar.zst1443 Compression: zstd1444 NarHash: sha256:1qymzqykxvp0nz6xbcp3jz9xzalqffnkh4hm72b1fglg9kdyscyw1445 NarSize: 2561446 References: /private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestClientFallsBackToClosures4050905731/001/store/wc9m21rcvqqsfkjlv0im09yh2d5jnhwn-shared-dep1447 CA: text:sha256:0fbm039hw4cq4m1vjbr4lxrf30vj3my3053076j2bj41rqw30pbk1448 client_pushes_test.go:112: Retrieved narinfo from S3:1449 StorePath: /private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestClientFallsBackToClosures4050905731/001/store/qzw33fazchz70w0cz7zrfkd4fpnnmxms-b1450 URL: nar/1qymzqykxvp0nz6xbcp3jz9xzalqffnkh4hm72b1fglg9kdyscyw.nar.zst1451 Compression: zstd1452 NarHash: sha256:1qymzqykxvp0nz6xbcp3jz9xzalqffnkh4hm72b1fglg9kdyscyw1453 NarSize: 2561454 References: /private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestClientFallsBackToClosures4050905731/001/store/wc9m21rcvqqsfkjlv0im09yh2d5jnhwn-shared-dep1455 CA: text:sha256:0fbm039hw4cq4m1vjbr4lxrf30vj3my3053076j2bj41rqw30pbk1456--- PASS: TestClientFallsBackToClosures (8.40s)1457=== CONT TestReadProxyOutlastsServerWriteTimeout1458=== NAME TestOrphanedObjectsGCStressTest1459 orphaned_objects_gc_test.go:422: Created 10 active closures, 5 to-delete closures, 20 orphaned chains14602026/11/11 23:05:46 INFO Received uploads request method=POST path=/api/pending_closures1461 orphaned_objects_gc_test.go:440: Marked 210 objects for deletion14622026/11/11 23:05:46 INFO Aborted multipart uploads count=0 kept=014632026/11/11 23:05:46 WARN Force mode enabled - objects will be deleted immediately without grace period14642026/11/11 23:05:46 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=014652026/11/11 23:05:46 INFO Received push request method=POST path=/api/pushes14662026/11/11 23:05:46 INFO Vacuumed table table=pending_closures14672026/11/11 23:05:46 INFO Uploading 2 paths to 127.0.0.1 (1 already cached)14682026/11/11 23:05:46 INFO Uploading l614a9qrds9662772scgsy7r5fvshvli-a (256B)14692026/11/11 23:05:46 INFO Uploading r922d2wls5f9b6lz77x91c62k3jrr1dk-shared-dep (136B)14702026/11/11 23:05:46 INFO Vacuumed table table=pending_objects14712026/11/11 23:05:46 INFO Vacuumed table table=multipart_uploads14722026/11/11 23:05:46 INFO Vacuumed table table=closures14732026/11/11 23:05:46 WARN Failed to register uploaded object key=r922d2wls5f9b6lz77x91c62k3jrr1dk.ls error="server returned 404: 404 page not found\n"14742026/11/11 23:05:46 INFO Vacuumed table table=objects14752026/11/11 23:05:46 WARN Failed to register uploaded object key=l614a9qrds9662772scgsy7r5fvshvli.ls error="server returned 404: 404 page not found\n"14762026/11/11 23:05:46 WARN Failed to register uploaded object key=nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst error="server returned 404: 404 page not found\n"14772026/11/11 23:05:46 WARN Failed to register uploaded object key=nar/1f9i3h8pmcak2f7s39zhf0ncsigb7sb3nmsdc93ibk6d4wddzdim.nar.zst error="server returned 404: 404 page not found\n"14782026/11/11 23:05:46 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign14792026/11/11 23:05:46 WARN Failed to register uploaded object key=yc9mrrzd796wmq1czw9vpga7m3sl2w3w.ls error="server returned 404: 404 page not found\n"14802026/11/11 23:05:46 INFO Signed narinfos id=1 count=314812026/11/11 23:05:46 INFO Uploading 3 narinfos14822026/11/11 23:05:46 WARN Failed to register uploaded object key=yc9mrrzd796wmq1czw9vpga7m3sl2w3w.narinfo error="server returned 404: 404 page not found\n"14832026/11/11 23:05:46 WARN Failed to register uploaded object key=r922d2wls5f9b6lz77x91c62k3jrr1dk.narinfo error="server returned 404: 404 page not found\n"14842026/11/11 23:05:46 INFO Received complete push request method=POST path=/api/pushes/1/complete14852026/11/11 23:05:46 WARN Failed to register uploaded object key=l614a9qrds9662772scgsy7r5fvshvli.narinfo error="server returned 404: 404 page not found\n"1486--- PASS: TestGCSweepSkipsPendingObjects (6.78s)1487=== CONT TestConcurrentCommitsSharingObjectsDoNotDeadlock14882026/11/11 23:05:46 INFO Completed push id=1 objects=8 duration=33.85775ms14892026/11/11 23:05:46 INFO Upload complete. (281ms)1490=== NAME TestClientPushesUseOnePush1491 client_pushes_test.go:97: Retrieved narinfo from S3:1492 StorePath: /private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestClientPushesUseOnePush1401103020/001/store/r922d2wls5f9b6lz77x91c62k3jrr1dk-shared-dep1493 URL: nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst1494 Compression: zstd1495 NarHash: sha256:1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y821496 NarSize: 1361497 References: 1498 CA: text:sha256:08nxw05k7b0pzzy0f3swvnw4ldxdbclkdnklpidwmrxdhvfrmv7n1499 client_pushes_test.go:97: Retrieved narinfo from S3:1500 StorePath: /private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestClientPushesUseOnePush1401103020/001/store/l614a9qrds9662772scgsy7r5fvshvli-a1501 URL: nar/1f9i3h8pmcak2f7s39zhf0ncsigb7sb3nmsdc93ibk6d4wddzdim.nar.zst1502 Compression: zstd1503 NarHash: sha256:1f9i3h8pmcak2f7s39zhf0ncsigb7sb3nmsdc93ibk6d4wddzdim1504 NarSize: 2561505 References: /private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestClientPushesUseOnePush1401103020/001/store/r922d2wls5f9b6lz77x91c62k3jrr1dk-shared-dep1506 CA: text:sha256:1w4ji1ds5y6br42bkdvxlgp7s6s44kk23f7f31qwvxd6bx1c6vc51507 client_pushes_test.go:97: Retrieved narinfo from S3:1508 StorePath: /private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestClientPushesUseOnePush1401103020/001/store/yc9mrrzd796wmq1czw9vpga7m3sl2w3w-b1509 URL: nar/1f9i3h8pmcak2f7s39zhf0ncsigb7sb3nmsdc93ibk6d4wddzdim.nar.zst1510 Compression: zstd1511 NarHash: sha256:1f9i3h8pmcak2f7s39zhf0ncsigb7sb3nmsdc93ibk6d4wddzdim1512 NarSize: 2561513 References: /private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestClientPushesUseOnePush1401103020/001/store/r922d2wls5f9b6lz77x91c62k3jrr1dk-shared-dep1514 CA: text:sha256:1w4ji1ds5y6br42bkdvxlgp7s6s44kk23f7f31qwvxd6bx1c6vc51515--- PASS: TestClientPushesUseOnePush (7.39s)1516=== CONT TestGCBugBareHashReferences15172026/11/11 23:05:47 INFO Received uploads request method=POST path=/api/pending_closures1518--- PASS: TestDeduplicatedObjectsRecordedAsPending (6.96s)1519=== CONT TestReadRedirectNar1520=== NAME TestPinProtectsFromGC1521 client_integration_test.go:778: Pinned store path: /private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestPinProtectsFromGC2642584946/001/store/8rzs2vcx80xrib4nn9pw0c0iir6hbk2d-pinned-file.txt1522 client_integration_test.go:779: Unpinned store path: /private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestPinProtectsFromGC2642584946/001/store/lklbm9dhk80qvvcmws2yqdlsgc2pcphr-unpinned-file.txt15232026/11/11 23:05:47 INFO Received push request method=POST path=/api/pushes15242026/11/11 23:05:47 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)15252026/11/11 23:05:47 INFO Uploading 8rzs2vcx80xrib4nn9pw0c0iir6hbk2d-pinned-file.txt (128B)15262026/11/11 23:05:47 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign15272026/11/11 23:05:47 WARN Failed to register uploaded object key=nar/0qmhsg42pqsz7x6hh02j8gznnac3yi3qpjhrqbwvz88i194jbb5s.nar.zst error="server returned 404: 404 page not found\n"15282026/11/11 23:05:47 WARN Failed to register uploaded object key=8rzs2vcx80xrib4nn9pw0c0iir6hbk2d.ls error="server returned 404: 404 page not found\n"15292026/11/11 23:05:47 INFO Signed narinfos id=1 count=115302026/11/11 23:05:47 INFO Uploading 1 narinfos1531--- PASS: TestService_ReadScope_PublicByDefault (6.81s)1532=== CONT TestGCAdvisoryLockBlocksConcurrentRun15332026/11/11 23:05:47 INFO Received complete push request method=POST path=/api/pushes/1/complete15342026/11/11 23:05:47 WARN Failed to register uploaded object key=8rzs2vcx80xrib4nn9pw0c0iir6hbk2d.narinfo error="server returned 404: 404 page not found\n"15352026/11/11 23:05:47 INFO Completed push id=1 objects=3 duration=32.04625ms15362026/11/11 23:05:47 INFO Upload complete. (235ms)15372026/11/11 23:05:47 INFO Received push request method=POST path=/api/pushes15382026/11/11 23:05:47 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)15392026/11/11 23:05:47 INFO Uploading lklbm9dhk80qvvcmws2yqdlsgc2pcphr-unpinned-file.txt (128B)15402026/11/11 23:05:47 WARN Failed to register uploaded object key=nar/0gh0wdnr6gmk4r5sfzzh12isnl14rgmkrwy1ws41hpsrlndclg5h.nar.zst error="server returned 404: 404 page not found\n"15412026/11/11 23:05:47 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign15422026/11/11 23:05:47 WARN Failed to register uploaded object key=lklbm9dhk80qvvcmws2yqdlsgc2pcphr.ls error="server returned 404: 404 page not found\n"15432026/11/11 23:05:47 INFO Signed narinfos id=2 count=115442026/11/11 23:05:47 INFO Uploading 1 narinfos15452026/11/11 23:05:47 INFO Received complete push request method=POST path=/api/pushes/2/complete15462026/11/11 23:05:47 WARN Failed to register uploaded object key=lklbm9dhk80qvvcmws2yqdlsgc2pcphr.narinfo error="server returned 404: 404 page not found\n"15472026/11/11 23:05:47 INFO Completed push id=2 objects=3 duration=1.550375ms15482026/11/11 23:05:47 INFO Upload complete. (193ms)15492026/11/11 23:05:47 INFO Starting cleanup of old closures method=DELETE path=/api/closures15502026/11/11 23:05:47 INFO Garbage collection started15512026/11/11 23:05:47 INFO Aborted multipart uploads count=0 kept=015522026/11/11 23:05:47 WARN Force mode enabled - objects will be deleted immediately without grace period15532026/11/11 23:05:47 INFO Received uploads request method=POST path=/api/pending_closures1554=== RUN TestService_RequireScope_OIDC/builder_may_write1555=== PAUSE TestService_RequireScope_OIDC/builder_may_write1556=== RUN TestService_RequireScope_OIDC/builder_may_not_admin1557=== PAUSE TestService_RequireScope_OIDC/builder_may_not_admin1558=== RUN TestService_RequireScope_OIDC/ops_may_admin1559=== PAUSE TestService_RequireScope_OIDC/ops_may_admin1560=== RUN TestService_RequireScope_OIDC/ops_may_not_write1561=== PAUSE TestService_RequireScope_OIDC/ops_may_not_write1562=== RUN TestService_RequireScope_OIDC/reader_may_not_write1563=== PAUSE TestService_RequireScope_OIDC/reader_may_not_write1564=== RUN TestService_RequireScope_OIDC/static_token_may_admin1565=== PAUSE TestService_RequireScope_OIDC/static_token_may_admin1566=== RUN TestService_RequireScope_OIDC/static_token_may_write1567=== PAUSE TestService_RequireScope_OIDC/static_token_may_write1568=== RUN TestService_RequireScope_OIDC/reader_may_read1569=== PAUSE TestService_RequireScope_OIDC/reader_may_read1570=== RUN TestService_RequireScope_OIDC/writer_implies_read1571=== PAUSE TestService_RequireScope_OIDC/writer_implies_read1572=== RUN TestService_RequireScope_OIDC/anonymous_may_not_read1573=== PAUSE TestService_RequireScope_OIDC/anonymous_may_not_read1574=== RUN TestService_RequireScope_OIDC/reader_may_read_with_netrc1575=== PAUSE TestService_RequireScope_OIDC/reader_may_read_with_netrc1576=== RUN TestService_RequireScope_OIDC/static_token_may_admin_with_netrc1577=== PAUSE TestService_RequireScope_OIDC/static_token_may_admin_with_netrc15782026/11/11 23:05:48 INFO Aborted multipart uploads count=0 kept=01579=== RUN TestService_RequireScope_OIDC/wrong_netrc_password_may_not_read1580=== PAUSE TestService_RequireScope_OIDC/wrong_netrc_password_may_not_read1581=== RUN TestService_RequireScope_OIDC/empty_netrc_password_may_not_read1582=== PAUSE TestService_RequireScope_OIDC/empty_netrc_password_may_not_read1583=== CONT TestReadProxyRootRedirectsToIndexHTML15842026/11/11 23:05:48 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=015852026/11/11 23:05:48 INFO Vacuumed table table=pending_closures15862026/11/11 23:05:48 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=3 objects-deleted-after-grace-period=3 objects-failed-to-delete=015872026/11/11 23:05:48 INFO Vacuumed table table=pending_objects15882026/11/11 23:05:48 INFO Vacuumed table table=multipart_uploads15892026/11/11 23:05:48 INFO Vacuumed table table=pending_closures15902026/11/11 23:05:48 INFO Vacuumed table table=pending_objects15912026/11/11 23:05:48 INFO Vacuumed table table=closures15922026/11/11 23:05:48 INFO Vacuumed table table=multipart_uploads15932026/11/11 23:05:48 INFO Vacuumed table table=objects15942026/11/11 23:05:48 INFO Vacuumed table table=closures15952026/11/11 23:05:48 INFO Aborted multipart uploads count=0 kept=015962026/11/11 23:05:48 WARN Force mode enabled - objects will be deleted immediately without grace period15972026/11/11 23:05:48 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=015982026/11/11 23:05:48 INFO Vacuumed table table=objects1599=== RUN TestService_AuthMiddleware_OIDC/valid_OIDC_token1600=== PAUSE TestService_AuthMiddleware_OIDC/valid_OIDC_token16012026/11/11 23:05:48 INFO Vacuumed table table=pending_closures1602=== RUN TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected1603=== PAUSE TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected1604=== RUN TestService_AuthMiddleware_OIDC/malformed_token_rejected1605=== PAUSE TestService_AuthMiddleware_OIDC/malformed_token_rejected1606=== RUN TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured1607=== PAUSE TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured1608=== CONT TestReadProxyConditionalGet16092026/11/11 23:05:48 INFO Vacuumed table table=pending_objects16102026/11/11 23:05:48 INFO Vacuumed table table=multipart_uploads16112026/11/11 23:05:48 INFO Vacuumed table table=closures16122026/11/11 23:05:48 INFO Vacuumed table table=objects1613--- PASS: TestPushDedupSurvivesConcurrentGC (7.77s)1614=== CONT TestLeadEndsOnShutdown1615--- PASS: TestDeleteClosuresRacingPins (11.91s)1616=== CONT TestReadProxyDisabled1617=== NAME TestClientIntegration1618 client_integration_test.go:291: Created store path: /private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestClientIntegration4222719942/002/store/c064w1pv8kd317w6fvx3g6gydcckc0x5-test-file.txt16192026/11/11 23:05:49 INFO Received push request method=POST path=/api/pushes16202026/11/11 23:05:49 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)16212026/11/11 23:05:49 INFO Uploading c064w1pv8kd317w6fvx3g6gydcckc0x5-test-file.txt (152B)16222026/11/11 23:05:49 WARN Failed to register uploaded object key=c064w1pv8kd317w6fvx3g6gydcckc0x5.ls error="server returned 404: 404 page not found\n"16232026/11/11 23:05:49 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign16242026/11/11 23:05:49 WARN Failed to register uploaded object key=nar/11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk1.nar.zst error="server returned 404: 404 page not found\n"16252026/11/11 23:05:49 INFO Signed narinfos id=1 count=116262026/11/11 23:05:49 INFO Uploading 1 narinfos16272026/11/11 23:05:49 INFO Received complete push request method=POST path=/api/pushes/1/complete16282026/11/11 23:05:49 WARN Failed to register uploaded object key=c064w1pv8kd317w6fvx3g6gydcckc0x5.narinfo error="server returned 404: 404 page not found\n"16292026/11/11 23:05:49 INFO Completed push id=1 objects=3 duration=20.424541ms16302026/11/11 23:05:49 INFO Upload complete. (280ms)16312026/11/11 23:05:49 INFO All 1 paths already cached1632 client_integration_test.go:317: Retrieved narinfo from S3:1633 StorePath: /private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestClientIntegration4222719942/002/store/c064w1pv8kd317w6fvx3g6gydcckc0x5-test-file.txt1634 URL: nar/11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk1.nar.zst1635 Compression: zstd1636 NarHash: sha256:11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk11637 NarSize: 1521638 References: 1639 CA: fixed:r:sha256:11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk11640 client_integration_test.go:318: Retrieved .ls file from S3 (compressed size: 77 bytes)1641 client_integration_test.go:318: Decompressed .ls content (64 bytes):1642 {"version":1,"root":{"type":"regular","size":39,"narOffset":96}}16432026/11/11 23:05:49 INFO Received push request method=POST path=/api/pushes16442026/11/11 23:05:49 INFO Garbage collection progress phase="" failed_uploads_deleted=0 old_closures_deleted=1 objects_marked=3 objects_deleted=3 objects_failed=016452026/11/11 23:05:49 INFO Uploading 2 paths to 127.0.0.1 (0 already cached)16462026/11/11 23:05:49 INFO Uploading hvni26lv4si748yshjzx6bw3s6179nhs-top (264B)16472026/11/11 23:05:49 INFO Uploading 9h3r41yqxg6pd7ldz3bq772h2ad2jy2z-shared-dep (136B)16482026/11/11 23:05:49 INFO Received create pin request method=POST path=/api/pins/myapp16492026/11/11 23:05:49 WARN Failed to register uploaded object key=hvni26lv4si748yshjzx6bw3s6179nhs.ls error="server returned 404: 404 page not found\n"16502026/11/11 23:05:49 WARN Failed to register uploaded object key=9h3r41yqxg6pd7ldz3bq772h2ad2jy2z.ls error="server returned 404: 404 page not found\n"16512026/11/11 23:05:49 WARN Failed to register uploaded object key=nar/0blq01s1f3w0kyrq0nq77v3vwbnj9qc27a157gkgm0lpwwwd0r2n.nar.zst error="server returned 404: 404 page not found\n"16522026/11/11 23:05:49 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign16532026/11/11 23:05:49 WARN Failed to register uploaded object key=nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst error="server returned 404: 404 page not found\n"16542026/11/11 23:05:49 INFO Signed narinfos id=1 count=216552026/11/11 23:05:49 INFO Uploading 2 narinfos16562026/11/11 23:05:49 INFO Created/updated pin name=myapp store_path=/private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestPinProtectsFromGC2642584946/001/store/8rzs2vcx80xrib4nn9pw0c0iir6hbk2d-pinned-file.txt narinfo_key=8rzs2vcx80xrib4nn9pw0c0iir6hbk2d.narinfo16572026/11/11 23:05:49 INFO Starting cleanup of old closures method=DELETE path=/api/closures16582026/11/11 23:05:49 INFO Garbage collection started16592026/11/11 23:05:49 INFO Aborted multipart uploads count=0 kept=016602026/11/11 23:05:49 WARN Force mode enabled - objects will be deleted immediately without grace period16612026/11/11 23:05:49 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=016622026/11/11 23:05:49 INFO Vacuumed table table=pending_closures16632026/11/11 23:05:49 INFO Vacuumed table table=pending_objects16642026/11/11 23:05:49 INFO Vacuumed table table=multipart_uploads16652026/11/11 23:05:49 INFO Vacuumed table table=closures16662026/11/11 23:05:49 WARN Failed to register uploaded object key=hvni26lv4si748yshjzx6bw3s6179nhs.narinfo error="server returned 404: 404 page not found\n"16672026/11/11 23:05:49 WARN Failed to register uploaded object key=9h3r41yqxg6pd7ldz3bq772h2ad2jy2z.narinfo error="server returned 404: 404 page not found\n"16682026/11/11 23:05:49 INFO Received complete push request method=POST path=/api/pushes/1/complete16692026/11/11 23:05:49 INFO Vacuumed table table=objects16702026/11/11 23:05:49 INFO Completed push id=1 objects=6 duration=42.199584ms16712026/11/11 23:05:49 INFO Upload complete. (373ms)1672=== NAME TestClientSharedPathCommittedMidPush1673 client_integration_test.go:727: Retrieved narinfo from S3:1674 StorePath: /private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestClientSharedPathCommittedMidPush876051999/001/store/9h3r41yqxg6pd7ldz3bq772h2ad2jy2z-shared-dep1675 URL: nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst1676 Compression: zstd1677 NarHash: sha256:1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y821678 NarSize: 1361679 References: 1680 CA: text:sha256:08nxw05k7b0pzzy0f3swvnw4ldxdbclkdnklpidwmrxdhvfrmv7n1681 client_integration_test.go:727: Retrieved narinfo from S3:1682 StorePath: /private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestClientSharedPathCommittedMidPush876051999/001/store/hvni26lv4si748yshjzx6bw3s6179nhs-top1683 URL: nar/0blq01s1f3w0kyrq0nq77v3vwbnj9qc27a157gkgm0lpwwwd0r2n.nar.zst1684 Compression: zstd1685 NarHash: sha256:0blq01s1f3w0kyrq0nq77v3vwbnj9qc27a157gkgm0lpwwwd0r2n1686 NarSize: 2641687 References: /private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestClientSharedPathCommittedMidPush876051999/001/store/9h3r41yqxg6pd7ldz3bq772h2ad2jy2z-shared-dep1688 CA: text:sha256:1vfdh4ijb20lihq3kc14cppd8vvz19s8w8c6kwmp2hbks65znag816892026/11/11 23:05:49 INFO Received push request method=POST path=/api/pushes16902026/11/11 23:05:49 INFO Object in database but missing from S3 key=c064w1pv8kd317w6fvx3g6gydcckc0x5.ls16912026/11/11 23:05:49 WARN Found objects in DB but missing from S3, will re-upload count=116922026/11/11 23:05:49 INFO Uploading 0 paths to 127.0.0.1 (1 already cached)16932026/11/11 23:05:49 INFO Received complete push request method=POST path=/api/pushes/2/complete16942026/11/11 23:05:49 WARN Failed to register uploaded object key=c064w1pv8kd317w6fvx3g6gydcckc0x5.ls error="server returned 404: 404 page not found\n"16952026/11/11 23:05:49 INFO Completed push id=2 objects=3 duration=852µs1696--- PASS: TestClientSharedPathCommittedMidPush (8.53s)1697=== CONT TestLeadGenerationGrowsWithEveryGrant16982026/11/11 23:05:49 INFO Upload complete. (141ms)1699=== NAME TestClientIntegration1700 client_integration_test.go:335: Retrieved .ls file from S3 (compressed size: 62 bytes)1701 client_integration_test.go:335: Decompressed .ls content (49 bytes):1702 {"version":1,"root":{"type":"regular","size":39}}1703=== NAME TestClientWithDependencies1704 client_integration_test.go:660: Built derivation: /private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestClientWithDependencies193954136/001/store/kj8fjsblz0vkcxfa7zhlb2b1xids4d0x-test-script1705 client_integration_test.go:662: Found 1 dependencies (including self)17062026/11/11 23:05:50 INFO Received push request method=POST path=/api/pushes17072026/11/11 23:05:50 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)17082026/11/11 23:05:50 INFO Uploading kj8fjsblz0vkcxfa7zhlb2b1xids4d0x-test-script (136B)17092026/11/11 23:05:50 INFO Received push request method=POST path=/api/pushes17102026/11/11 23:05:50 INFO Uploading 0 paths to 127.0.0.1 (1 already cached)17112026/11/11 23:05:50 WARN Failed to register uploaded object key=nar/1s7yghixzpinyqm7g59kyn3sav81pmnsdi5v63m6x4r2vacy907j.nar.zst error="server returned 404: 404 page not found\n"17122026/11/11 23:05:50 WARN Failed to register uploaded object key=kj8fjsblz0vkcxfa7zhlb2b1xids4d0x.ls error="server returned 404: 404 page not found\n"17132026/11/11 23:05:50 WARN Failed to register uploaded object key=log/z7axm9gzz5181kiyi46k9pmfrpigp8ml-test-script.drv error="server returned 404: 404 page not found\n"17142026/11/11 23:05:50 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign17152026/11/11 23:05:50 INFO Signed narinfos id=1 count=117162026/11/11 23:05:50 INFO Uploading 1 narinfos1717=== NAME TestClientCADerivations1718 client_ca_test.go:136: Built CA derivation: /private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestClientCADerivations2155451520/001/store/6zl232dl0h6crv1x529kmnlxk3jbn2s7-ca-test17192026/11/11 23:05:50 INFO Received complete push request method=POST path=/api/pushes/3/complete17202026/11/11 23:05:50 WARN Failed to register uploaded object key=c064w1pv8kd317w6fvx3g6gydcckc0x5.ls error="server returned 404: 404 page not found\n"17212026/11/11 23:05:50 INFO Completed push id=3 objects=3 duration=832.584µs17222026/11/11 23:05:50 INFO Upload complete. (145ms)1723=== NAME TestClientIntegration1724 client_integration_test.go:352: Retrieved .ls file from S3 (compressed size: 62 bytes)1725 client_integration_test.go:352: Decompressed .ls content (49 bytes):1726 {"version":1,"root":{"type":"regular","size":39}}1727 client_integration_test.go:363: Testing garbage collection...17282026/11/11 23:05:50 INFO Received complete push request method=POST path=/api/pushes/1/complete17292026/11/11 23:05:50 WARN Failed to register uploaded object key=kj8fjsblz0vkcxfa7zhlb2b1xids4d0x.narinfo error="server returned 404: 404 page not found\n"1730=== NAME TestClientMultipleUploads1731 client_integration_test.go:405: Created store path 0: /private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestClientMultipleUploads3297306575/001/store/hb8nqrds8zkndf30znw8p8rppbamkajj-test-file-0.txt17322026/11/11 23:05:50 INFO Starting cleanup of old closures method=DELETE path=/api/closures17332026/11/11 23:05:50 INFO Garbage collection started1734=== NAME TestClientCADerivations1735 client_ca_test.go:139: Found 1 dependencies (including self)17362026/11/11 23:05:50 INFO Aborted multipart uploads count=0 kept=017372026/11/11 23:05:50 INFO Completed push id=1 objects=4 duration=46.797917ms17382026/11/11 23:05:50 INFO Upload complete. (329ms)17392026/11/11 23:05:50 INFO Aborted multipart uploads count=0 kept=01740=== NAME TestClientWithDependencies1741 client_integration_test.go:664: Skipping nix copy test - isolated store (/private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestClientWithDependencies193954136/001/store) requires matching store prefix17422026/11/11 23:05:50 WARN Force mode enabled - objects will be deleted immediately without grace period17432026/11/11 23:05:50 WARN Force mode enabled - objects will be deleted immediately without grace period17442026/11/11 23:05:50 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=017452026/11/11 23:05:50 INFO Vacuumed table table=pending_closures17462026/11/11 23:05:50 INFO Vacuumed table table=pending_objects17472026/11/11 23:05:50 INFO Vacuumed table table=multipart_uploads17482026/11/11 23:05:50 INFO Vacuumed table table=closures17492026/11/11 23:05:50 INFO Vacuumed table table=objects1750--- PASS: TestGCMetrics (7.54s)1751=== CONT TestService_AuthMiddleware1752=== NAME TestClientMultipleUploads1753 client_integration_test.go:405: Created store path 1: /private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestClientMultipleUploads3297306575/001/store/9rn0h36yn1rp0q6myv95cwgsb9kisdjq-test-file-1.txt1754--- PASS: TestClientWithDependencies (8.67s)1755=== CONT TestReadProxy40417562026/11/11 23:05:50 INFO Received push request method=POST path=/api/pushes1757=== NAME TestClientMultipleUploads1758 client_integration_test.go:405: Created store path 2: /private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestClientMultipleUploads3297306575/001/store/w1afj0lqzwpzvpgyp65hs3sarw152g3v-test-file-2.txt17592026/11/11 23:05:50 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)17602026/11/11 23:05:50 INFO Uploading 6zl232dl0h6crv1x529kmnlxk3jbn2s7-ca-test (144B)17612026/11/11 23:05:50 WARN Failed to register uploaded object key=nar/04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n.nar.zst error="server returned 404: 404 page not found\n"17622026/11/11 23:05:50 WARN Failed to register uploaded object key=6zl232dl0h6crv1x529kmnlxk3jbn2s7.ls error="server returned 404: 404 page not found\n"17632026/11/11 23:05:50 WARN Failed to register uploaded object key=log/52swrcbi2yhvizvppssp9a2b4cvs0n7h-ca-test.drv error="server returned 404: 404 page not found\n"17642026/11/11 23:05:50 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign17652026/11/11 23:05:50 INFO Signed narinfos id=1 count=117662026/11/11 23:05:50 INFO Uploading 1 narinfos17672026/11/11 23:05:50 INFO lead: acquired remote=192.0.2.1:1234 generation=117682026/11/11 23:05:50 INFO Received push request method=POST path=/api/pushes17692026/11/11 23:05:50 INFO Received complete push request method=POST path=/api/pushes/1/complete17702026/11/11 23:05:50 WARN Failed to register uploaded object key=6zl232dl0h6crv1x529kmnlxk3jbn2s7.narinfo error="server returned 404: 404 page not found\n"17712026/11/11 23:05:51 INFO Uploading 3 paths to 127.0.0.1 (0 already cached)17722026/11/11 23:05:51 INFO Uploading w1afj0lqzwpzvpgyp65hs3sarw152g3v-test-file-2.txt (160B)17732026/11/11 23:05:51 INFO Uploading 9rn0h36yn1rp0q6myv95cwgsb9kisdjq-test-file-1.txt (160B)17742026/11/11 23:05:51 INFO Uploading hb8nqrds8zkndf30znw8p8rppbamkajj-test-file-0.txt (160B)17752026/11/11 23:05:51 INFO Completed push id=1 objects=4 duration=83.425125ms17762026/11/11 23:05:51 INFO Upload complete. (564ms)17772026/11/11 23:05:51 WARN Failed to register uploaded object key=9rn0h36yn1rp0q6myv95cwgsb9kisdjq.ls error="server returned 404: 404 page not found\n"1778=== NAME TestClientCADerivations1779 client_ca_test.go:180: Narinfo contains CA field: StorePath: /private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestClientCADerivations2155451520/001/store/6zl232dl0h6crv1x529kmnlxk3jbn2s7-ca-test17802026/11/11 23:05:51 WARN Failed to register uploaded object key=nar/0ahq3izw3h0b0c08p3xdfclh758fwxnp85ccvflasb4vnfsv50ri.nar.zst error="server returned 404: 404 page not found\n"1781 URL: nar/04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n.nar.zst1782 Compression: zstd1783 NarHash: sha256:04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n17842026/11/11 23:05:51 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=3 objects-deleted-after-grace-period=3 objects-failed-to-delete=01785 NarSize: 1441786 References: 1787 Deriver: /private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestClientCADerivations2155451520/001/store/52swrcbi2yhvizvppssp9a2b4cvs0n7h-ca-test.drv1788 CA: fixed:r:sha256:04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n1789 client_ca_test.go:185: Checking for realisation files in S3...17902026/11/11 23:05:51 WARN Failed to register uploaded object key=hb8nqrds8zkndf30znw8p8rppbamkajj.ls error="server returned 404: 404 page not found\n"1791 client_ca_test.go:207: No realisation files uploaded - this is expected for locally built CA derivations17922026/11/11 23:05:51 WARN Failed to register uploaded object key=nar/13p9pqi0ga6fx2apcwls9hjnv7nmf740ggpn5zvfzdsp5vz2bbg4.nar.zst error="server returned 404: 404 page not found\n"1793 client_ca_test.go:208: Locally built CA derivations don't have DrvOutput IDs until they're substituted from a cache17942026/11/11 23:05:51 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign17952026/11/11 23:05:51 WARN Failed to register uploaded object key=nar/1823g6vx4q5zqvr73m7lkq1wpk40fin7bsc792di430yk7sg4lka.nar.zst error="server returned 404: 404 page not found\n"17962026/11/11 23:05:51 WARN Failed to register uploaded object key=w1afj0lqzwpzvpgyp65hs3sarw152g3v.ls error="server returned 404: 404 page not found\n"17972026/11/11 23:05:51 INFO Signed narinfos id=1 count=317982026/11/11 23:05:51 INFO Uploading 3 narinfos17992026/11/11 23:05:51 INFO Vacuumed table table=pending_closures18002026/11/11 23:05:51 WARN Failed to register uploaded object key=hb8nqrds8zkndf30znw8p8rppbamkajj.narinfo error="server returned 404: 404 page not found\n"18012026/11/11 23:05:51 WARN Failed to register uploaded object key=9rn0h36yn1rp0q6myv95cwgsb9kisdjq.narinfo error="server returned 404: 404 page not found\n"18022026/11/11 23:05:51 INFO Received complete push request method=POST path=/api/pushes/1/complete18032026/11/11 23:05:51 WARN Failed to register uploaded object key=w1afj0lqzwpzvpgyp65hs3sarw152g3v.narinfo error="server returned 404: 404 page not found\n"18042026/11/11 23:05:51 INFO Vacuumed table table=pending_objects18052026/11/11 23:05:51 INFO Vacuumed table table=multipart_uploads18062026/11/11 23:05:51 INFO Completed push id=1 objects=9 duration=42.326916ms18072026/11/11 23:05:51 INFO Vacuumed table table=closures18082026/11/11 23:05:51 INFO Upload complete. (465ms)1809=== NAME TestClientMultipleUploads1810 client_integration_test.go:416: Uploaded 3 paths in 495.338166ms1811=== NAME TestClientCADerivations1812 client_ca_test.go:258: nix copy output: error: binary cache 's3://bucket71?endpoint=http://localhost:56594®ion=eu-west-1' is for Nix stores with prefix '/nix/store', not '/private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestClientCADerivations2155451520/001/store'1813 client_ca_test.go:259: nix copy failed (might be expected with isolated stores): exit status 118142026/11/11 23:05:51 INFO Vacuumed table table=objects1815--- PASS: TestService_AuthMiddleware_MTLSProxyHeader (7.40s)1816=== CONT TestReadProxyNarStreaming1817--- PASS: TestClientMultipleUploads (9.07s)1818=== CONT TestPresentNotReportedWhileGCDeletesClosure/stale1819--- PASS: TestClientCADerivations (9.34s)1820=== CONT TestPresentNotReportedWhileGCDeletesClosure/fresh18212026/11/11 23:05:51 INFO lead: acquired remote=192.0.2.1:1234 generation=11822=== NAME TestPinProtectsFromGC1823 client_integration_test.go:887: Pin successfully protected closure from garbage collection1824--- PASS: TestPinProtectsFromGC (11.84s)1825=== CONT TestReadProxyHead18262026/11/11 23:05:52 INFO lead: released remote=192.0.2.1:1234 generation=118272026/11/11 23:05:52 WARN mTLS auth: subject not in bound subjects subject="CN=untrusted,O=Other"18282026/11/11 23:05:52 WARN mTLS auth: bound subjects configured but subject DN unavailable18292026/11/11 23:05:52 WARN mTLS auth: subject not in bound subjects subject="CN=untrusted"1830--- PASS: TestService_AuthMiddleware_MTLSBoundSubjects (7.53s)1831=== CONT TestPendingClosureWriteTimeout/empty1832=== CONT TestService_verifyS3ReuploadsStaleNarinfo/lost,_other_NAR_pushed18332026/11/11 23:05:52 INFO lead: acquired remote=192.0.2.1:1234 generation=218342026/11/11 23:05:52 INFO lead: given back to the incumbent remote=192.0.2.1:1234 generation=218352026/11/11 23:05:52 INFO lead: acquired remote=192.0.2.1:1234 generation=31836--- PASS: TestReadProxyInvalidPath (6.80s)1837=== CONT TestPendingClosureWriteTimeout/670k_objects1838=== CONT TestPendingClosureWriteTimeout/handler_extends_the_server's_deadline18392026/11/11 23:05:52 INFO Garbage collection progress phase="" failed_uploads_deleted=0 old_closures_deleted=1 objects_marked=3 objects_deleted=3 objects_failed=01840=== NAME TestClientIntegration1841 client_integration_test.go:370: Objects in database after GC:1842 client_integration_test.go:370: Successfully deleted all objects with GC --force1843--- PASS: TestClientIntegration (11.06s)1844=== CONT TestService_verifyS3ReuploadsStaleNarinfo/first_of_two_lost,_second_pushed18452026/11/11 23:05:52 INFO lead: acquired remote=192.0.2.1:1234 generation=118462026/11/11 23:05:52 INFO lead: released remote=192.0.2.1:1234 generation=11847--- PASS: TestLeadIncumbentAnnouncesAtOnce (6.86s)1848=== CONT TestService_verifyS3ReuploadsStaleNarinfo/lost,_same_NAR_pushed18492026/11/11 23:05:52 INFO lead: released remote=192.0.2.1:1234 generation=118502026/11/11 23:05:52 INFO lead: acquired remote=192.0.2.1:1234 generation=21851--- PASS: TestConnectWaitsForAPeerMigration (8.19s)1852=== CONT TestService_verifyS3ReuploadsStaleNarinfo/first_of_two_lost18532026/11/11 23:05:53 INFO lead: released remote=192.0.2.1:1234 generation=31854--- PASS: TestLeadUnannouncedStandbyYieldsToIncumbent (10.47s)1855=== CONT TestService_verifyS3ReuploadsStaleNarinfo/intact,_other_NAR_pushed18562026/11/11 23:05:54 INFO lead: released remote=192.0.2.1:1234 generation=21857--- PASS: TestLeadElectsOneAndHandsOver (9.67s)1858=== CONT TestPendingClosureWriteTimeout/400_objects1859=== CONT TestProxyWriteTimeout/narinfo1860=== CONT TestProxyWriteTimeout/unknown_size1861=== CONT TestProxyWriteTimeout/1_GiB_nar1862=== CONT TestProxyWriteTimeout/10_GiB_nar1863--- PASS: TestProxyWriteTimeout (0.04s)1864 --- PASS: TestProxyWriteTimeout/narinfo (0.00s)1865 --- PASS: TestProxyWriteTimeout/unknown_size (0.00s)1866 --- PASS: TestProxyWriteTimeout/1_GiB_nar (0.00s)1867 --- PASS: TestProxyWriteTimeout/10_GiB_nar (0.00s)1868=== CONT TestIsValidUploadKey/narinfo1869=== CONT TestIsValidUploadKey/unknown_type1870=== CONT TestIsValidUploadKey/empty_key1871=== CONT TestIsValidUploadKey/absolute1872=== CONT TestIsValidUploadKey/traversal_nar1873=== CONT TestIsValidUploadKey/traversal1874=== CONT TestIsValidUploadKey/listing_key,_narinfo_type1875=== CONT TestIsValidUploadKey/nar_key,_narinfo_type1876=== CONT TestIsValidUploadKey/narinfo_key,_nar_type1877=== CONT TestIsValidUploadKey/index.html1878=== CONT TestIsValidUploadKey/nix-cache-info1879=== CONT TestIsValidUploadKey/realisation_plus_in_output1880=== CONT TestIsValidUploadKey/realisation1881=== CONT TestIsValidUploadKey/build_log_equals1882=== CONT TestIsValidUploadKey/build_log_question_mark1883=== CONT TestIsValidUploadKey/build_log_plus_in_name1884=== CONT TestIsValidUploadKey/build_log_home-manager_file1885=== CONT TestIsValidUploadKey/build_log1886=== CONT TestIsValidUploadKey/listing1887=== CONT TestIsValidUploadKey/nar_plain1888=== CONT TestIsValidUploadKey/nar_xz1889=== CONT TestIsValidUploadKey/nar_zst1890--- PASS: TestIsValidUploadKey (0.04s)1891 --- PASS: TestIsValidUploadKey/narinfo (0.00s)1892 --- PASS: TestIsValidUploadKey/unknown_type (0.00s)1893 --- PASS: TestIsValidUploadKey/empty_key (0.00s)1894 --- PASS: TestIsValidUploadKey/absolute (0.00s)1895 --- PASS: TestIsValidUploadKey/traversal_nar (0.00s)1896 --- PASS: TestIsValidUploadKey/traversal (0.00s)1897 --- PASS: TestIsValidUploadKey/listing_key,_narinfo_type (0.00s)1898 --- PASS: TestIsValidUploadKey/nar_key,_narinfo_type (0.00s)1899 --- PASS: TestIsValidUploadKey/narinfo_key,_nar_type (0.00s)1900 --- PASS: TestIsValidUploadKey/index.html (0.00s)1901 --- PASS: TestIsValidUploadKey/nix-cache-info (0.00s)1902 --- PASS: TestIsValidUploadKey/realisation_plus_in_output (0.00s)1903 --- PASS: TestIsValidUploadKey/realisation (0.00s)1904 --- PASS: TestIsValidUploadKey/build_log_equals (0.00s)1905 --- PASS: TestIsValidUploadKey/build_log_question_mark (0.00s)1906 --- PASS: TestIsValidUploadKey/build_log_plus_in_name (0.00s)1907 --- PASS: TestIsValidUploadKey/build_log_home-manager_file (0.00s)1908 --- PASS: TestIsValidUploadKey/build_log (0.00s)1909 --- PASS: TestIsValidUploadKey/listing (0.00s)1910 --- PASS: TestIsValidUploadKey/nar_plain (0.00s)1911 --- PASS: TestIsValidUploadKey/nar_xz (0.00s)1912 --- PASS: TestIsValidUploadKey/nar_zst (0.00s)1913=== CONT TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info19142026/11/11 23:05:54 INFO Received uploads request method=POST path=/1915=== CONT TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key19162026/11/11 23:05:54 INFO Received request for more parts method=POST path=/1917=== CONT TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal19182026/11/11 23:05:54 INFO Received uploads request method=POST path=/1919=== CONT TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key19202026/11/11 23:05:54 INFO Received complete multipart upload request method=POST path=/1921--- PASS: TestUploadHandlersRejectInvalidKeys (0.04s)1922 --- PASS: TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info (0.01s)1923 --- PASS: TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key (0.00s)1924 --- PASS: TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal (0.00s)1925 --- PASS: TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key (0.00s)1926=== CONT TestIsValidCachePath/narinfo1927=== CONT TestIsValidCachePath/short_hash1928=== CONT TestIsValidCachePath/wrong_extension1929=== CONT TestIsValidCachePath/leading_slash1930=== CONT TestIsValidCachePath/empty1931=== CONT TestIsValidCachePath/random_path1932=== CONT TestIsValidCachePath/invalid_char_u1933=== CONT TestIsValidCachePath/invalid_char_e1934=== CONT TestIsValidCachePath/traversal_in_middle1935=== CONT TestIsValidCachePath/traversal_parent1936=== CONT TestIsValidCachePath/index.html1937=== CONT TestIsValidCachePath/nix-cache-info1938=== CONT TestIsValidCachePath/realisation1939=== CONT TestIsValidCachePath/log1940=== CONT TestIsValidCachePath/ls1941=== CONT TestIsValidCachePath/nar_uncompressed1942=== CONT TestIsValidCachePath/nar_xz1943--- PASS: TestGCBugBareHashReferences (7.20s)1944=== CONT TestIsValidCachePath/nar_bz21945=== CONT TestIsValidCachePath/nar_zst1946=== CONT TestParseSingleRange/none1947=== CONT TestIsValidCachePath/narinfo_all_nix_base32_chars1948--- PASS: TestIsValidCachePath (0.04s)1949 --- PASS: TestIsValidCachePath/narinfo (0.00s)1950 --- PASS: TestIsValidCachePath/short_hash (0.00s)1951 --- PASS: TestIsValidCachePath/wrong_extension (0.00s)1952 --- PASS: TestIsValidCachePath/leading_slash (0.00s)1953 --- PASS: TestIsValidCachePath/empty (0.00s)1954 --- PASS: TestIsValidCachePath/random_path (0.00s)1955 --- PASS: TestIsValidCachePath/invalid_char_u (0.00s)1956 --- PASS: TestIsValidCachePath/invalid_char_e (0.00s)1957 --- PASS: TestIsValidCachePath/traversal_in_middle (0.00s)1958 --- PASS: TestIsValidCachePath/traversal_parent (0.00s)1959 --- PASS: TestIsValidCachePath/index.html (0.00s)1960 --- PASS: TestIsValidCachePath/nix-cache-info (0.00s)1961 --- PASS: TestIsValidCachePath/realisation (0.00s)1962 --- PASS: TestIsValidCachePath/log (0.00s)1963 --- PASS: TestIsValidCachePath/ls (0.00s)1964 --- PASS: TestIsValidCachePath/nar_uncompressed (0.00s)1965 --- PASS: TestIsValidCachePath/nar_xz (0.00s)1966 --- PASS: TestIsValidCachePath/nar_bz2 (0.00s)1967 --- PASS: TestIsValidCachePath/nar_zst (0.00s)1968 --- PASS: TestIsValidCachePath/narinfo_all_nix_base32_chars (0.00s)1969=== CONT TestParseSingleRange/open-ended1970=== CONT TestParseSingleRange/start_far_past_EOF1971=== CONT TestParseSingleRange/single_byte1972=== CONT TestParseSingleRange/start_past_EOF1973=== CONT TestParseSingleRange/suffix_exceeds_size1974=== CONT TestParseSingleRange/suffix1975=== CONT TestParseSingleRange/malformed_both_empty1976=== CONT TestParseSingleRange/end_clamped_to_size1977=== CONT TestParseSingleRange/malformed_end_before_start1978=== CONT TestParseSingleRange/closed1979=== CONT TestParseSingleRange/malformed_no_dash1980=== CONT TestParseSingleRange/multi-range_ignored1981=== CONT TestUploadHandlersRejectOversizedBody/create_pending_closure19822026/11/11 23:05:54 INFO Received uploads request method=POST path=/1983=== CONT TestParseSingleRange/unknown_unit1984--- PASS: TestParseSingleRange (0.05s)1985 --- PASS: TestParseSingleRange/none (0.00s)1986 --- PASS: TestParseSingleRange/open-ended (0.00s)1987 --- PASS: TestParseSingleRange/start_far_past_EOF (0.00s)1988 --- PASS: TestParseSingleRange/start_past_EOF (0.00s)1989 --- PASS: TestParseSingleRange/suffix_exceeds_size (0.00s)1990 --- PASS: TestParseSingleRange/single_byte (0.00s)1991 --- PASS: TestParseSingleRange/suffix (0.00s)1992 --- PASS: TestParseSingleRange/malformed_both_empty (0.00s)1993 --- PASS: TestParseSingleRange/end_clamped_to_size (0.00s)1994 --- PASS: TestParseSingleRange/malformed_end_before_start (0.00s)1995 --- PASS: TestParseSingleRange/closed (0.00s)1996 --- PASS: TestParseSingleRange/malformed_no_dash (0.00s)1997 --- PASS: TestParseSingleRange/multi-range_ignored (0.00s)1998 --- PASS: TestParseSingleRange/unknown_unit (0.00s)1999=== CONT TestUploadHandlersRejectOversizedBody/request_more_parts20002026/11/11 23:05:54 INFO Received request for more parts method=POST path=/
loading 652 hidden lines…
26532026/11/11 23:06:13 INFO Vacuumed table table=pending_objects26542026/11/11 23:06:13 INFO Vacuumed table table=multipart_uploads26552026/11/11 23:06:13 INFO Received complete push request method=POST path=/26562026/11/11 23:06:13 INFO Vacuumed table table=closures26572026/11/11 23:06:13 INFO Received complete upload request method=POST path=/26582026/11/11 23:06:13 INFO Vacuumed table table=objects26592026/11/11 23:06:13 INFO Completed upload id=10 objects=2 duration=15.95175ms26602026/11/11 23:06:13 INFO Received push request method=POST path=/26612026/11/11 23:06:13 INFO Completed push id=1 objects=8 duration=29.717833ms26622026/11/11 23:06:13 INFO Received uploads request method=POST path=/26632026/11/11 23:06:13 INFO Aborted multipart uploads count=0 kept=026642026/11/11 23:06:13 INFO Received complete upload request method=POST path=/26652026/11/11 23:06:13 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=6 objects-failed-to-delete=026662026/11/11 23:06:13 INFO Completed upload id=14 objects=6 duration=348µs26672026/11/11 23:06:13 INFO Vacuumed table table=pending_closures26682026/11/11 23:06:13 INFO Received complete push request method=POST path=/26692026/11/11 23:06:13 INFO Received push request method=POST path=/26702026/11/11 23:06:13 INFO Vacuumed table table=pending_objects26712026/11/11 23:06:13 INFO Completed push id=8 objects=13 duration=5.859583ms26722026/11/11 23:06:13 INFO Vacuumed table table=multipart_uploads26732026/11/11 23:06:13 INFO Aborted multipart uploads count=0 kept=026742026/11/11 23:06:13 INFO Vacuumed table table=closures26752026/11/11 23:06:13 INFO Vacuumed table table=objects26762026/11/11 23:06:14 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=026772026/11/11 23:06:14 INFO Received push request method=POST path=/26782026/11/11 23:06:14 INFO Received complete upload request method=POST path=/26792026/11/11 23:06:14 INFO Vacuumed table table=pending_closures26802026/11/11 23:06:14 INFO Completed upload id=9 objects=2 duration=10.044917ms26812026/11/11 23:06:14 INFO Received complete push request method=POST path=/26822026/11/11 23:06:14 INFO Received complete push request method=POST path=/26832026/11/11 23:06:14 INFO Completed push id=2 objects=10 duration=9.913833ms26842026/11/11 23:06:14 INFO Completed push id=8 objects=3 duration=1.439833ms26852026/11/11 23:06:14 INFO Received complete upload request method=POST path=/26862026/11/11 23:06:14 INFO Vacuumed table table=pending_objects26872026/11/11 23:06:14 INFO Completed upload id=7 objects=3 duration=301.417µs26882026/11/11 23:06:14 INFO Vacuumed table table=multipart_uploads26892026/11/11 23:06:14 INFO Received push request method=POST path=/26902026/11/11 23:06:14 INFO Received push request method=POST path=/26912026/11/11 23:06:14 INFO Received complete push request method=POST path=/26922026/11/11 23:06:14 INFO Completed push id=8 objects=7 duration=638.417µs26932026/11/11 23:06:14 INFO Received uploads request method=POST path=/26942026/11/11 23:06:14 INFO Received uploads request method=POST path=/26952026/11/11 23:06:14 INFO Received complete upload request method=POST path=/26962026/11/11 23:06:14 INFO Completed upload id=13 objects=10 duration=782.75µs26972026/11/11 23:06:14 INFO Vacuumed table table=closures26982026/11/11 23:06:14 INFO Aborted multipart uploads count=0 kept=026992026/11/11 23:06:14 WARN Force mode enabled - objects will be deleted immediately without grace period27002026/11/11 23:06:14 INFO Received complete upload request method=POST path=/27012026/11/11 23:06:14 INFO Vacuumed table table=objects27022026/11/11 23:06:14 INFO Completed upload id=6 objects=7 duration=9.757875ms27032026/11/11 23:06:14 INFO Received push request method=POST path=/27042026/11/11 23:06:14 INFO Received uploads request method=POST path=/27052026/11/11 23:06:14 INFO Received complete push request method=POST path=/27062026/11/11 23:06:14 INFO Completed push id=18 objects=23 duration=574.958µs27072026/11/11 23:06:14 INFO Received push request method=POST path=/27082026/11/11 23:06:14 INFO Received uploads request method=POST path=/27092026/11/11 23:06:14 INFO Received complete push request method=POST path=/27102026/11/11 23:06:14 INFO Aborted multipart uploads count=0 kept=027112026/11/11 23:06:14 INFO Received complete upload request method=POST path=/27122026/11/11 23:06:14 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=027132026/11/11 23:06:14 INFO Completed upload id=9 objects=16 duration=592.417µs27142026/11/11 23:06:14 INFO Completed push id=1 objects=6 duration=29.863792ms27152026/11/11 23:06:14 INFO Received push request method=POST path=/27162026/11/11 23:06:14 INFO Received push request method=POST path=/27172026/11/11 23:06:14 INFO Vacuumed table table=pending_closures27182026/11/11 23:06:14 INFO Received complete push request method=POST path=/27192026/11/11 23:06:14 INFO Completed push id=10 objects=3 duration=439.167µs27202026/11/11 23:06:14 INFO Received uploads request method=POST path=/27212026/11/11 23:06:14 INFO Received push request method=POST path=/27222026/11/11 23:06:14 INFO Received complete push request method=POST path=/27232026/11/11 23:06:14 INFO Received complete upload request method=POST path=/27242026/11/11 23:06:14 INFO Completed push id=11 objects=9 duration=507.042µs27252026/11/11 23:06:14 INFO Aborted multipart uploads count=0 kept=027262026/11/11 23:06:14 INFO Vacuumed table table=pending_objects27272026/11/11 23:06:14 INFO Completed upload id=10 objects=4 duration=695.958µs27282026/11/11 23:06:14 INFO Received complete push request method=POST path=/27292026/11/11 23:06:14 INFO Vacuumed table table=multipart_uploads27302026/11/11 23:06:14 WARN Force mode enabled - objects will be deleted immediately without grace period27312026/11/11 23:06:14 INFO Received push request method=POST path=/27322026/11/11 23:06:14 INFO Received push request method=POST path=/27332026/11/11 23:06:14 INFO Vacuumed table table=closures27342026/11/11 23:06:14 INFO Received complete push request method=POST path=/27352026/11/11 23:06:14 INFO Completed push id=1 objects=11 duration=667.791µs27362026/11/11 23:06:14 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=027372026/11/11 23:06:14 INFO Received push request method=POST path=/27382026/11/11 23:06:14 INFO Received push request method=POST path=/27392026/11/11 23:06:14 INFO Vacuumed table table=objects27402026/11/11 23:06:14 INFO Vacuumed table table=pending_closures27412026/11/11 23:06:14 INFO Completed push id=11 objects=8 duration=1.36475ms27422026/11/11 23:06:14 INFO Received push request method=POST path=/27432026/11/11 23:06:14 INFO Received uploads request method=POST path=/27442026/11/11 23:06:14 INFO Vacuumed table table=pending_objects27452026/11/11 23:06:14 INFO Aborted multipart uploads count=0 kept=027462026/11/11 23:06:14 INFO Received uploads request method=POST path=/27472026/11/11 23:06:14 INFO Vacuumed table table=multipart_uploads27482026/11/11 23:06:14 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=027492026/11/11 23:06:14 INFO Aborted multipart uploads count=0 kept=027502026/11/11 23:06:14 INFO Received push request method=POST path=/27512026/11/11 23:06:14 INFO Vacuumed table table=closures27522026/11/11 23:06:14 INFO Vacuumed table table=pending_closures27532026/11/11 23:06:14 WARN Force mode enabled - objects will be deleted immediately without grace period27542026/11/11 23:06:14 INFO Received uploads request method=POST path=/27552026/11/11 23:06:14 INFO Vacuumed table table=objects27562026/11/11 23:06:14 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=027572026/11/11 23:06:14 INFO Vacuumed table table=pending_objects27582026/11/11 23:06:14 INFO Received uploads request method=POST path=/27592026/11/11 23:06:14 INFO Vacuumed table table=multipart_uploads27602026/11/11 23:06:14 INFO Vacuumed table table=pending_closures27612026/11/11 23:06:14 INFO Vacuumed table table=closures27622026/11/11 23:06:14 INFO Received uploads request method=POST path=/27632026/11/11 23:06:14 INFO Vacuumed table table=objects27642026/11/11 23:06:14 INFO Vacuumed table table=pending_objects27652026/11/11 23:06:14 INFO Vacuumed table table=multipart_uploads27662026/11/11 23:06:14 INFO Vacuumed table table=closures27672026/11/11 23:06:14 INFO Received push request method=POST path=/27682026/11/11 23:06:14 INFO Vacuumed table table=objects27692026/11/11 23:06:14 INFO Received complete upload request method=POST path=/27702026/11/11 23:06:14 INFO Received uploads request method=POST path=/27712026/11/11 23:06:14 INFO Received uploads request method=POST path=/27722026/11/11 23:06:14 INFO Completed upload id=16 objects=3 duration=251.75µs27732026/11/11 23:06:14 INFO Received push request method=POST path=/27742026/11/11 23:06:14 INFO Received push request method=POST path=/27752026/11/11 23:06:14 INFO Received push request method=POST path=/27762026/11/11 23:06:14 INFO Received complete upload request method=POST path=/27772026/11/11 23:06:14 INFO Completed upload id=23 objects=15 duration=666.042µs27782026/11/11 23:06:14 INFO Received complete upload request method=POST path=/27792026/11/11 23:06:14 INFO Received complete upload request method=POST path=/27802026/11/11 23:06:14 INFO Completed upload id=17 objects=6 duration=653.667µs27812026/11/11 23:06:14 INFO Completed upload id=11 objects=14 duration=727.542µs27822026/11/11 23:06:14 INFO Received push request method=POST path=/27832026/11/11 23:06:14 INFO Received complete upload request method=POST path=/27842026/11/11 23:06:14 INFO Received push request method=POST path=/27852026/11/11 23:06:14 INFO Completed upload id=19 objects=6 duration=472.625µs27862026/11/11 23:06:14 INFO Received push request method=POST path=/27872026/11/11 23:06:14 INFO Received push request method=POST path=/27882026/11/11 23:06:14 INFO Received push request method=POST path=/27892026/11/11 23:06:14 INFO Aborted multipart uploads count=0 kept=027902026/11/11 23:06:14 WARN Force mode enabled - objects will be deleted immediately without grace period27912026/11/11 23:06:14 INFO Received uploads request method=POST path=/27922026/11/11 23:06:14 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=027932026/11/11 23:06:14 INFO Vacuumed table table=pending_closures27942026/11/11 23:06:14 INFO Vacuumed table table=pending_objects27952026/11/11 23:06:14 INFO Received push request method=POST path=/27962026/11/11 23:06:14 INFO Vacuumed table table=multipart_uploads27972026/11/11 23:06:14 INFO Received complete push request method=POST path=/27982026/11/11 23:06:14 INFO Received uploads request method=POST path=/27992026/11/11 23:06:14 INFO Completed push id=2 objects=4 duration=544.958µs28002026/11/11 23:06:14 INFO Received complete upload request method=POST path=/28012026/11/11 23:06:14 INFO Completed upload id=15 objects=9 duration=329.666µs28022026/11/11 23:06:14 INFO Vacuumed table table=closures28032026/11/11 23:06:14 INFO Aborted multipart uploads count=0 kept=028042026/11/11 23:06:14 INFO Vacuumed table table=objects28052026/11/11 23:06:14 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=028062026/11/11 23:06:14 INFO Received uploads request method=POST path=/28072026/11/11 23:06:14 INFO Received complete upload request method=POST path=/28082026/11/11 23:06:14 INFO Received complete push request method=POST path=/28092026/11/11 23:06:14 INFO Completed upload id=22 objects=7 duration=256.042µs28102026/11/11 23:06:14 INFO Completed push id=14 objects=3 duration=893.792µs28112026/11/11 23:06:14 INFO Received push request method=POST path=/28122026/11/11 23:06:14 INFO Received complete push request method=POST path=/28132026/11/11 23:06:14 INFO Received complete push request method=POST path=/28142026/11/11 23:06:14 INFO Completed push id=5 objects=6 duration=573.083µs28152026/11/11 23:06:14 INFO Completed push id=24 objects=9 duration=487.417µs28162026/11/11 23:06:14 INFO Vacuumed table table=pending_closures28172026/11/11 23:06:14 INFO Aborted multipart uploads count=0 kept=028182026/11/11 23:06:14 INFO Received push request method=POST path=/28192026/11/11 23:06:14 INFO Received push request method=POST path=/28202026/11/11 23:06:14 WARN Force mode enabled - objects will be deleted immediately without grace period28212026/11/11 23:06:14 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=028222026/11/11 23:06:14 INFO Received uploads request method=POST path=/28232026/11/11 23:06:14 INFO Vacuumed table table=pending_closures28242026/11/11 23:06:14 INFO Aborted multipart uploads count=0 kept=028252026/11/11 23:06:14 INFO Received uploads request method=POST path=/28262026/11/11 23:06:14 INFO Received complete push request method=POST path=/28272026/11/11 23:06:14 INFO Vacuumed table table=pending_objects28282026/11/11 23:06:14 INFO Received complete push request method=POST path=/28292026/11/11 23:06:14 INFO Vacuumed table table=multipart_uploads28302026/11/11 23:06:14 INFO Vacuumed table table=pending_objects28312026/11/11 23:06:14 INFO Completed push id=13 objects=6 duration=1.151541ms28322026/11/11 23:06:14 WARN Force mode enabled - objects will be deleted immediately without grace period28332026/11/11 23:06:14 INFO Completed push id=21 objects=17 duration=471.75µs28342026/11/11 23:06:14 INFO Vacuumed table table=closures28352026/11/11 23:06:14 INFO Received complete push request method=POST path=/28362026/11/11 23:06:14 INFO Vacuumed table table=multipart_uploads28372026/11/11 23:06:14 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=028382026/11/11 23:06:14 INFO Received push request method=POST path=/28392026/11/11 23:06:14 INFO Received complete push request method=POST path=/28402026/11/11 23:06:14 INFO Vacuumed table table=objects28412026/11/11 23:06:14 INFO Completed push id=21 objects=3 duration=371.416µs28422026/11/11 23:06:14 INFO Completed push id=19 objects=7 duration=605.917µs28432026/11/11 23:06:14 INFO Received push request method=POST path=/28442026/11/11 23:06:14 INFO Received uploads request method=POST path=/28452026/11/11 23:06:14 INFO Received push request method=POST path=/28462026/11/11 23:06:14 INFO Vacuumed table table=closures28472026/11/11 23:06:14 INFO Vacuumed table table=pending_closures28482026/11/11 23:06:14 INFO Aborted multipart uploads count=0 kept=028492026/11/11 23:06:14 INFO Garbage collection completed failed-uploads-deleted=3 old-closures-deleted=3 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=028502026/11/11 23:06:14 INFO Vacuumed table table=pending_closures28512026/11/11 23:06:15 INFO Received complete upload request method=POST path=/28522026/11/11 23:06:15 INFO Aborted multipart uploads count=0 kept=028532026/11/11 23:06:15 INFO Vacuumed table table=pending_objects28542026/11/11 23:06:15 INFO Vacuumed table table=multipart_uploads28552026/11/11 23:06:15 INFO Vacuumed table table=objects28562026/11/11 23:06:15 WARN Force mode enabled - objects will be deleted immediately without grace period28572026/11/11 23:06:15 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=11 objects-failed-to-delete=028582026/11/11 23:06:15 INFO Vacuumed table table=closures28592026/11/11 23:06:15 INFO Vacuumed table table=pending_objects28602026/11/11 23:06:15 INFO Vacuumed table table=objects28612026/11/11 23:06:15 INFO Vacuumed table table=pending_closures28622026/11/11 23:06:15 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=2 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=028632026/11/11 23:06:15 INFO Vacuumed table table=multipart_uploads28642026/11/11 23:06:15 INFO Completed upload id=3 objects=6 duration=30.884333ms28652026/11/11 23:06:15 INFO Vacuumed table table=closures28662026/11/11 23:06:15 INFO Vacuumed table table=pending_objects28672026/11/11 23:06:15 INFO Vacuumed table table=pending_closures28682026/11/11 23:06:15 INFO Vacuumed table table=objects28692026/11/11 23:06:15 INFO Aborted multipart uploads count=0 kept=028702026/11/11 23:06:15 INFO Vacuumed table table=multipart_uploads28712026/11/11 23:06:15 INFO Received push request method=POST path=/28722026/11/11 23:06:15 INFO Vacuumed table table=pending_objects28732026/11/11 23:06:15 INFO Vacuumed table table=closures28742026/11/11 23:06:15 INFO Vacuumed table table=multipart_uploads28752026/11/11 23:06:15 INFO Received push request method=POST path=/28762026/11/11 23:06:15 ERROR failed to remove object object=aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa.narinfo error="Access Denied."28772026/11/11 23:06:15 ERROR failed to remove object object=bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb.ls error="Access Denied."28782026/11/11 23:06:15 ERROR failed to remove object object=bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb.narinfo error="Access Denied."28792026/11/11 23:06:15 ERROR failed to remove object object=cccccccccccccccccccccccccccccccc.narinfo error="Access Denied."28802026/11/11 23:06:15 INFO Received push request method=POST path=/28812026/11/11 23:06:15 INFO Vacuumed table table=closures28822026/11/11 23:06:15 INFO Vacuumed table table=objects28832026/11/11 23:06:15 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.ls error="Access Denied."28842026/11/11 23:06:15 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.narinfo error="Access Denied."28852026/11/11 23:06:15 ERROR failed to remove object object=ffffffffffffffffffffffffffffffff.ls error="Access Denied."28862026/11/11 23:06:15 ERROR failed to remove object object=ffffffffffffffffffffffffffffffff.narinfo error="Access Denied."28872026/11/11 23:06:15 INFO Vacuumed table table=objects28882026/11/11 23:06:15 INFO Received complete push request method=POST path=/28892026/11/11 23:06:15 INFO Aborted multipart uploads count=0 kept=028902026/11/11 23:06:15 INFO Received push request method=POST path=/28912026/11/11 23:06:15 INFO Received push request method=POST path=/28922026/11/11 23:06:15 ERROR failed to remove object object=nar/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa.nar.zst error="Access Denied."28932026/11/11 23:06:15 INFO Completed push id=30 objects=4 duration=873.167µs28942026/11/11 23:06:15 INFO Received uploads request method=POST path=/28952026/11/11 23:06:15 ERROR failed to remove object object=nar/bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb.nar.zst error="Access Denied."28962026/11/11 23:06:15 ERROR failed to remove object object=nar/cccccccccccccccccccccccccccccccccccccccccccccccccccc.nar.zst error="Access Denied."28972026/11/11 23:06:15 ERROR failed to remove object object=nar/dddddddddddddddddddddddddddddddddddddddddddddddddddd.nar.zst error="Access Denied."28982026/11/11 23:06:15 ERROR failed to remove object object=nar/ffffffffffffffffffffffffffffffffffffffffffffffffffff.nar.zst error="Access Denied."28992026/11/11 23:06:15 ERROR failed to remove object object=realisations/sha256:cccccccc!out.doi error="Access Denied."29002026/11/11 23:06:15 ERROR failed to remove object object=realisations/sha256:dddddddd!out.doi error="Access Denied."29012026/11/11 23:06:15 ERROR failed to remove object object=realisations/sha256:ffffffff!out.doi error="Access Denied."29022026/11/11 23:06:15 WARN Force mode enabled - objects will be deleted immediately without grace period29032026/11/11 23:06:15 INFO Received push request method=POST path=/29042026/11/11 23:06:15 INFO Received uploads request method=POST path=/29052026/11/11 23:06:15 INFO Received uploads request method=POST path=/29062026/11/11 23:06:15 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=029072026/11/11 23:06:15 INFO Aborted multipart uploads count=0 kept=029082026/11/11 23:06:15 INFO Received push request method=POST path=/29092026/11/11 23:06:15 INFO Vacuumed table table=pending_closures29102026/11/11 23:06:15 INFO Vacuumed table table=pending_objects29112026/11/11 23:06:15 INFO Received push request method=POST path=/29122026/11/11 23:06:15 INFO Vacuumed table table=multipart_uploads29132026/11/11 23:06:15 INFO Received push request method=POST path=/29142026/11/11 23:06:15 INFO Vacuumed table table=closures29152026/11/11 23:06:15 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=16 objects-failed-to-delete=029162026/11/11 23:06:15 INFO Received complete push request method=POST path=/29172026/11/11 23:06:15 INFO Received complete push request method=POST path=/29182026/11/11 23:06:15 INFO Vacuumed table table=objects29192026/11/11 23:06:15 INFO Vacuumed table table=pending_closures29202026/11/11 23:06:15 INFO Completed push id=6 objects=7 duration=818µs29212026/11/11 23:06:15 INFO Completed push id=32 objects=7 duration=404.458µs29222026/11/11 23:06:15 INFO Vacuumed table table=pending_objects29232026/11/11 23:06:15 INFO Aborted multipart uploads count=0 kept=029242026/11/11 23:06:15 INFO Received uploads request method=POST path=/29252026/11/11 23:06:15 INFO Received complete push request method=POST path=/29262026/11/11 23:06:15 INFO Vacuumed table table=multipart_uploads29272026/11/11 23:06:15 WARN Force mode enabled - objects will be deleted immediately without grace period29282026/11/11 23:06:15 INFO Completed push id=26 objects=4 duration=245.333µs29292026/11/11 23:06:15 INFO Received push request method=POST path=/29302026/11/11 23:06:15 INFO Received complete push request method=POST path=/29312026/11/11 23:06:15 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=029322026/11/11 23:06:15 INFO Received uploads request method=POST path=/29332026/11/11 23:06:15 INFO Vacuumed table table=pending_closures29342026/11/11 23:06:15 INFO Received complete upload request method=POST path=/29352026/11/11 23:06:15 INFO Completed push id=14 objects=4 duration=1.148334ms29362026/11/11 23:06:15 INFO Completed upload id=28 objects=13 duration=406.584µs29372026/11/11 23:06:15 INFO Vacuumed table table=closures29382026/11/11 23:06:15 INFO Received complete push request method=POST path=/29392026/11/11 23:06:15 INFO Received push request method=POST path=/29402026/11/11 23:06:15 INFO Vacuumed table table=pending_objects29412026/11/11 23:06:15 INFO Aborted multipart uploads count=0 kept=029422026/11/11 23:06:15 INFO Completed push id=29 objects=3 duration=403.459µs29432026/11/11 23:06:15 INFO Received uploads request method=POST path=/29442026/11/11 23:06:15 INFO Vacuumed table table=multipart_uploads29452026/11/11 23:06:15 WARN Force mode enabled - objects will be deleted immediately without grace period29462026/11/11 23:06:15 INFO Received complete upload request method=POST path=/29472026/11/11 23:06:15 INFO Vacuumed table table=objects29482026/11/11 23:06:15 INFO Vacuumed table table=closures29492026/11/11 23:06:15 INFO Aborted multipart uploads count=0 kept=029502026/11/11 23:06:15 INFO Completed upload id=31 objects=2 duration=274.959µs29512026/11/11 23:06:15 INFO Vacuumed table table=objects29522026/11/11 23:06:15 WARN Force mode enabled - objects will be deleted immediately without grace period29532026/11/11 23:06:15 INFO Received complete push request method=POST path=/29542026/11/11 23:06:15 INFO Received complete upload request method=POST path=/29552026/11/11 23:06:15 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=029562026/11/11 23:06:15 INFO Completed push id=33 objects=6 duration=338.75µs29572026/11/11 23:06:15 INFO Completed upload id=12 objects=26 duration=850.167µs29582026/11/11 23:06:15 INFO Received complete push request method=POST path=/29592026/11/11 23:06:15 INFO Vacuumed table table=pending_closures29602026/11/11 23:06:15 INFO Aborted multipart uploads count=0 kept=029612026/11/11 23:06:15 INFO Completed push id=4 objects=6 duration=499.208µs29622026/11/11 23:06:15 INFO Received uploads request method=POST path=/29632026/11/11 23:06:15 WARN Force mode enabled - objects will be deleted immediately without grace period29642026/11/11 23:06:15 INFO Received uploads request method=POST path=/29652026/11/11 23:06:15 INFO Received complete push request method=POST path=/29662026/11/11 23:06:15 INFO Completed push id=16 objects=8 duration=484.083µs29672026/11/11 23:06:15 INFO Vacuumed table table=pending_objects29682026/11/11 23:06:15 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=029692026/11/11 23:06:15 INFO Vacuumed table table=multipart_uploads29702026/11/11 23:06:15 INFO Received push request method=POST path=/29712026/11/11 23:06:15 INFO Aborted multipart uploads count=0 kept=029722026/11/11 23:06:15 INFO Vacuumed table table=closures29732026/11/11 23:06:15 WARN Force mode enabled - objects will be deleted immediately without grace period29742026/11/11 23:06:15 INFO Vacuumed table table=objects29752026/11/11 23:06:15 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=029762026/11/11 23:06:15 INFO Aborted multipart uploads count=0 kept=029772026/11/11 23:06:15 INFO Vacuumed table table=pending_closures29782026/11/11 23:06:15 INFO Vacuumed table table=pending_closures29792026/11/11 23:06:15 WARN Force mode enabled - objects will be deleted immediately without grace period29802026/11/11 23:06:15 INFO Garbage collection completed failed-uploads-deleted=3 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=029812026/11/11 23:06:15 INFO Vacuumed table table=pending_objects29822026/11/11 23:06:15 INFO Received complete push request method=POST path=/29832026/11/11 23:06:15 INFO Vacuumed table table=pending_closures29842026/11/11 23:06:15 INFO Vacuumed table table=multipart_uploads29852026/11/11 23:06:15 INFO Completed push id=17 objects=6 duration=589.5µs29862026/11/11 23:06:15 INFO Aborted multipart uploads count=0 kept=029872026/11/11 23:06:15 INFO Vacuumed table table=pending_objects29882026/11/11 23:06:15 INFO Vacuumed table table=pending_objects29892026/11/11 23:06:15 INFO Vacuumed table table=closures29902026/11/11 23:06:15 INFO Vacuumed table table=multipart_uploads29912026/11/11 23:06:15 INFO Vacuumed table table=multipart_uploads29922026/11/11 23:06:15 WARN Force mode enabled - objects will be deleted immediately without grace period29932026/11/11 23:06:15 INFO Vacuumed table table=closures29942026/11/11 23:06:15 INFO Vacuumed table table=closures29952026/11/11 23:06:15 INFO Vacuumed table table=objects29962026/11/11 23:06:15 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=029972026/11/11 23:06:15 INFO Vacuumed table table=objects29982026/11/11 23:06:15 INFO Vacuumed table table=objects29992026/11/11 23:06:15 INFO Vacuumed table table=pending_closures30002026/11/11 23:06:15 INFO Vacuumed table table=pending_objects30012026/11/11 23:06:15 INFO Received uploads request method=POST path=/30022026/11/11 23:06:15 INFO Vacuumed table table=multipart_uploads30032026/11/11 23:06:15 INFO Vacuumed table table=closures30042026/11/11 23:06:15 INFO Vacuumed table table=objects30052026/11/11 23:06:15 INFO Received push request method=POST path=/30062026/11/11 23:06:15 INFO Aborted multipart uploads count=0 kept=030072026/11/11 23:06:15 WARN Force mode enabled - objects will be deleted immediately without grace period30082026/11/11 23:06:15 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=030092026/11/11 23:06:15 INFO Vacuumed table table=pending_closures30102026/11/11 23:06:15 INFO Vacuumed table table=pending_objects30112026/11/11 23:06:15 INFO Vacuumed table table=multipart_uploads30122026/11/11 23:06:15 INFO Vacuumed table table=closures30132026/11/11 23:06:15 INFO Vacuumed table table=objects30142026/11/11 23:06:15 INFO Received uploads request method=POST path=/30152026/11/11 23:06:15 INFO Aborted multipart uploads count=0 kept=030162026/11/11 23:06:15 WARN Force mode enabled - objects will be deleted immediately without grace period30172026/11/11 23:06:15 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=030182026/11/11 23:06:15 INFO Received push request method=POST path=/30192026/11/11 23:06:15 INFO Vacuumed table table=pending_closures30202026/11/11 23:06:15 INFO Received complete upload request method=POST path=/30212026/11/11 23:06:15 INFO Received uploads request method=POST path=/30222026/11/11 23:06:15 INFO Vacuumed table table=pending_objects30232026/11/11 23:06:15 INFO Completed upload id=3 objects=24 duration=506.75µs30242026/11/11 23:06:15 INFO Vacuumed table table=multipart_uploads30252026/11/11 23:06:15 INFO Vacuumed table table=closures30262026/11/11 23:06:15 INFO Received complete push request method=POST path=/30272026/11/11 23:06:15 INFO Vacuumed table table=objects30282026/11/11 23:06:15 INFO Completed push id=11 objects=6 duration=1.074709ms30292026/11/11 23:06:15 INFO Received complete push request method=POST path=/30302026/11/11 23:06:15 INFO Completed push id=18 objects=6 duration=550.583µs30312026/11/11 23:06:15 INFO Aborted multipart uploads count=0 kept=030322026/11/11 23:06:15 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=030332026/11/11 23:06:15 INFO Vacuumed table table=pending_closures30342026/11/11 23:06:15 INFO Vacuumed table table=pending_objects30352026/11/11 23:06:15 INFO Vacuumed table table=multipart_uploads30362026/11/11 23:06:15 INFO Received complete push request method=POST path=/30372026/11/11 23:06:15 INFO Vacuumed table table=closures30382026/11/11 23:06:15 INFO Completed push id=4 objects=7 duration=760.25µs30392026/11/11 23:06:15 INFO Vacuumed table table=objects30402026/11/11 23:06:15 INFO Received uploads request method=POST path=/30412026/11/11 23:06:15 INFO Received uploads request method=POST path=/30422026/11/11 23:06:15 INFO Received complete upload request method=POST path=/30432026/11/11 23:06:15 INFO Received complete upload request method=POST path=/30442026/11/11 23:06:15 INFO Completed upload id=20 objects=3 duration=1.502ms30452026/11/11 23:06:15 INFO Completed upload id=17 objects=25 duration=2.618625ms30462026/11/11 23:06:15 INFO Received push request method=POST path=/30472026/11/11 23:06:15 INFO Received push request method=POST path=/30482026/11/11 23:06:15 INFO Received complete upload request method=POST path=/30492026/11/11 23:06:15 INFO Received complete upload request method=POST path=/30502026/11/11 23:06:15 INFO Completed upload id=24 objects=7 duration=5.951167ms30512026/11/11 23:06:15 INFO Completed upload id=21 objects=2 duration=6.24025ms30522026/11/11 23:06:15 INFO Aborted multipart uploads count=0 kept=030532026/11/11 23:06:15 INFO Aborted multipart uploads count=0 kept=030542026/11/11 23:06:15 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=030552026/11/11 23:06:15 WARN Force mode enabled - objects will be deleted immediately without grace period30562026/11/11 23:06:15 INFO Vacuumed table table=pending_closures30572026/11/11 23:06:15 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=030582026/11/11 23:06:15 INFO Vacuumed table table=pending_closures30592026/11/11 23:06:15 INFO Vacuumed table table=pending_objects30602026/11/11 23:06:15 INFO Vacuumed table table=multipart_uploads30612026/11/11 23:06:15 INFO Vacuumed table table=pending_objects30622026/11/11 23:06:15 INFO Vacuumed table table=multipart_uploads30632026/11/11 23:06:15 INFO Vacuumed table table=closures30642026/11/11 23:06:15 INFO Vacuumed table table=objects30652026/11/11 23:06:16 INFO Vacuumed table table=closures30662026/11/11 23:06:16 INFO Received complete push request method=POST path=/30672026/11/11 23:06:16 INFO Vacuumed table table=objects30682026/11/11 23:06:16 INFO Received uploads request method=POST path=/30692026/11/11 23:06:16 INFO Completed push id=16 objects=16 duration=2.770667ms30702026/11/11 23:06:16 INFO Aborted multipart uploads count=0 kept=030712026/11/11 23:06:16 WARN Force mode enabled - objects will be deleted immediately without grace period30722026/11/11 23:06:16 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=030732026/11/11 23:06:16 INFO Vacuumed table table=pending_closures30742026/11/11 23:06:16 INFO Aborted multipart uploads count=0 kept=030752026/11/11 23:06:16 INFO Aborted multipart uploads count=0 kept=030762026/11/11 23:06:16 ERROR failed to remove object object=bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb.ls error="Access Denied."30772026/11/11 23:06:16 ERROR failed to remove object object=bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb.narinfo error="Access Denied."30782026/11/11 23:06:16 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.ls error="Access Denied."30792026/11/11 23:06:16 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.narinfo error="Access Denied."30802026/11/11 23:06:16 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=030812026/11/11 23:06:16 ERROR failed to remove object object=cccccccccccccccccccccccccccccccc.ls error="Access Denied."30822026/11/11 23:06:16 INFO Received complete upload request method=POST path=/30832026/11/11 23:06:16 ERROR failed to remove object object=ffffffffffffffffffffffffffffffff.ls error="Access Denied."30842026/11/11 23:06:16 INFO Vacuumed table table=pending_objects30852026/11/11 23:06:16 ERROR failed to remove object object=iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.ls error="Access Denied."30862026/11/11 23:06:16 ERROR failed to remove object object=iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.narinfo error="Access Denied."30872026/11/11 23:06:16 ERROR failed to remove object object=nar/iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.nar.zst error="Access Denied."30882026/11/11 23:06:16 ERROR failed to remove object object=ffffffffffffffffffffffffffffffff.narinfo error="Access Denied."30892026/11/11 23:06:16 INFO Vacuumed table table=multipart_uploads30902026/11/11 23:06:16 INFO Vacuumed table table=pending_closures30912026/11/11 23:06:16 ERROR failed to remove object object=gggggggggggggggggggggggggggggggg.ls error="Access Denied."30922026/11/11 23:06:16 ERROR failed to remove object object=realisations/sha256:ffffffff!out.doi error="Access Denied."30932026/11/11 23:06:16 ERROR failed to remove object object=realisations/sha256:hhhhhhhh!out.doi error="Access Denied."30942026/11/11 23:06:16 ERROR failed to remove object object=realisations/sha256:iiiiiiii!out.doi error="Access Denied."30952026/11/11 23:06:16 INFO Vacuumed table table=closures30962026/11/11 23:06:16 INFO Vacuumed table table=pending_objects30972026/11/11 23:06:16 ERROR failed to remove object object=gggggggggggggggggggggggggggggggg.narinfo error="Access Denied."30982026/11/11 23:06:16 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.ls error="Access Denied."30992026/11/11 23:06:16 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.narinfo error="Access Denied."31002026/11/11 23:06:16 ERROR failed to remove object object=iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.ls error="Access Denied."31012026/11/11 23:06:16 ERROR failed to remove object object=iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.narinfo error="Access Denied."31022026/11/11 23:06:16 INFO Completed upload id=2 objects=7 duration=21.270125ms31032026/11/11 23:06:16 ERROR failed to remove object object=nar/bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb.nar.zst error="Access Denied."31042026/11/11 23:06:16 ERROR failed to remove object object=nar/dddddddddddddddddddddddddddddddddddddddddddddddddddd.nar.zst error="Access Denied."31052026/11/11 23:06:16 ERROR failed to remove object object=nar/ffffffffffffffffffffffffffffffffffffffffffffffffffff.nar.zst error="Access Denied."31062026/11/11 23:06:16 ERROR failed to remove object object=nar/gggggggggggggggggggggggggggggggggggggggggggggggggggg.nar.zst error="Access Denied."31072026/11/11 23:06:16 ERROR failed to remove object object=nar/hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.nar.zst error="Access Denied."31082026/11/11 23:06:16 ERROR failed to remove object object=nar/iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.nar.zst error="Access Denied."31092026/11/11 23:06:16 ERROR failed to remove object object=realisations/sha256:bbbbbbbb!out.doi error="Access Denied."31102026/11/11 23:06:16 ERROR failed to remove object object=realisations/sha256:cccccccc!out.doi error="Access Denied."31112026/11/11 23:06:16 ERROR failed to remove object object=realisations/sha256:ffffffff!out.doi error="Access Denied."31122026/11/11 23:06:16 ERROR failed to remove object object=realisations/sha256:iiiiiiii!out.doi error="Access Denied."31132026/11/11 23:06:16 ERROR failed to remove object object=cccccccccccccccccccccccccccccccc.ls error="Access Denied."31142026/11/11 23:06:16 ERROR failed to remove object object=cccccccccccccccccccccccccccccccc.narinfo error="Access Denied."31152026/11/11 23:06:16 ERROR failed to remove object object=nar/cccccccccccccccccccccccccccccccccccccccccccccccccccc.nar.zst error="Access Denied."31162026/11/11 23:06:16 INFO Vacuumed table table=multipart_uploads31172026/11/11 23:06:16 INFO Vacuumed table table=objects31182026/11/11 23:06:16 INFO Received uploads request method=POST path=/31192026/11/11 23:06:16 INFO Vacuumed table table=closures31202026/11/11 23:06:16 INFO Received uploads request method=POST path=/31212026/11/11 23:06:16 INFO Vacuumed table table=objects31222026/11/11 23:06:16 INFO Received push request method=POST path=/31232026/11/11 23:06:16 INFO Received complete push request method=POST path=/31242026/11/11 23:06:16 INFO Received uploads request method=POST path=/31252026/11/11 23:06:16 INFO Aborted multipart uploads count=0 kept=031262026/11/11 23:06:16 INFO Received uploads request method=POST path=/31272026/11/11 23:06:16 WARN Force mode enabled - objects will be deleted immediately without grace period31282026/11/11 23:06:16 INFO Received push request method=POST path=/31292026/11/11 23:06:16 INFO Received push request method=POST path=/31302026/11/11 23:06:16 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=031312026/11/11 23:06:16 INFO Received push request method=POST path=/31322026/11/11 23:06:16 INFO Completed push id=3 objects=5 duration=28.786375ms31332026/11/11 23:06:16 INFO Vacuumed table table=pending_closures31342026/11/11 23:06:16 INFO Aborted multipart uploads count=0 kept=031352026/11/11 23:06:16 INFO Vacuumed table table=pending_objects31362026/11/11 23:06:16 INFO Received uploads request method=POST path=/31372026/11/11 23:06:16 INFO Vacuumed table table=multipart_uploads31382026/11/11 23:06:16 WARN Force mode enabled - objects will be deleted immediately without grace period31392026/11/11 23:06:16 INFO Vacuumed table table=closures31402026/11/11 23:06:16 INFO Aborted multipart uploads count=0 kept=031412026/11/11 23:06:16 ERROR failed to remove object object=bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb.ls error="Access Denied."31422026/11/11 23:06:16 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.ls error="Access Denied."31432026/11/11 23:06:16 INFO Vacuumed table table=objects31442026/11/11 23:06:16 WARN Force mode enabled - objects will be deleted immediately without grace period31452026/11/11 23:06:16 INFO Received complete push request method=POST path=/31462026/11/11 23:06:16 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.ls error="Access Denied."31472026/11/11 23:06:16 INFO Received complete push request method=POST path=/31482026/11/11 23:06:16 ERROR failed to remove object object=iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.ls error="Access Denied."31492026/11/11 23:06:16 ERROR failed to remove object object=iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.narinfo error="Access Denied."31502026/11/11 23:06:16 ERROR failed to remove object object=nar/iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.nar.zst error="Access Denied."31512026/11/11 23:06:16 ERROR failed to remove object object=realisations/sha256:bbbbbbbb!out.doi error="Access Denied."31522026/11/11 23:06:16 ERROR failed to remove object object=realisations/sha256:ffffffff!out.doi error="Access Denied."31532026/11/11 23:06:16 ERROR failed to remove object object=realisations/sha256:iiiiiiii!out.doi error="Access Denied."31542026/11/11 23:06:16 INFO Completed push id=23 objects=28 duration=1.295209ms31552026/11/11 23:06:16 INFO Completed push id=2 objects=7 duration=1.842916ms31562026/11/11 23:06:16 INFO Received push request method=POST path=/31572026/11/11 23:06:16 ERROR failed to remove object object=cccccccccccccccccccccccccccccccc.ls error="Access Denied."31582026/11/11 23:06:16 ERROR failed to remove object object=iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.ls error="Access Denied."31592026/11/11 23:06:16 ERROR failed to remove object object=iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.narinfo error="Access Denied."31602026/11/11 23:06:16 ERROR failed to remove object object=nar/iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.nar.zst error="Access Denied."31612026/11/11 23:06:16 ERROR failed to remove object object=realisations/sha256:ffffffff!out.doi error="Access Denied."31622026/11/11 23:06:16 ERROR failed to remove object object=realisations/sha256:hhhhhhhh!out.doi error="Access Denied."31632026/11/11 23:06:16 ERROR failed to remove object object=realisations/sha256:iiiiiiii!out.doi error="Access Denied."31642026/11/11 23:06:16 INFO Aborted multipart uploads count=0 kept=031652026/11/11 23:06:16 INFO Aborted multipart uploads count=0 kept=031662026/11/11 23:06:16 INFO Received complete upload request method=POST path=/31672026/11/11 23:06:16 WARN Force mode enabled - objects will be deleted immediately without grace period31682026/11/11 23:06:16 INFO Received complete upload request method=POST path=/31692026/11/11 23:06:16 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=031702026/11/11 23:06:16 INFO Completed upload id=21 objects=3 duration=379.333µs31712026/11/11 23:06:16 INFO Completed upload id=27 objects=8 duration=445.334µs31722026/11/11 23:06:16 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=9 objects-failed-to-delete=031732026/11/11 23:06:16 INFO Received complete push request method=POST path=/31742026/11/11 23:06:16 INFO Aborted multipart uploads count=0 kept=031752026/11/11 23:06:16 WARN Force mode enabled - objects will be deleted immediately without grace period31762026/11/11 23:06:16 INFO Vacuumed table table=pending_closures31772026/11/11 23:06:16 INFO Completed push id=1 objects=2 duration=6.015125ms31782026/11/11 23:06:16 INFO Received push request method=POST path=/31792026/11/11 23:06:16 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=7 objects-failed-to-delete=031802026/11/11 23:06:16 INFO Aborted multipart uploads count=0 kept=031812026/11/11 23:06:16 INFO Aborted multipart uploads count=0 kept=031822026/11/11 23:06:16 INFO Vacuumed table table=pending_closures31832026/11/11 23:06:16 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=031842026/11/11 23:06:16 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=031852026/11/11 23:06:16 INFO Vacuumed table table=pending_closures31862026/11/11 23:06:16 INFO Vacuumed table table=pending_objects31872026/11/11 23:06:16 INFO Vacuumed table table=pending_closures31882026/11/11 23:06:16 INFO Vacuumed table table=pending_objects31892026/11/11 23:06:16 INFO Vacuumed table table=multipart_uploads31902026/11/11 23:06:16 INFO Vacuumed table table=pending_objects31912026/11/11 23:06:16 INFO Vacuumed table table=multipart_uploads31922026/11/11 23:06:16 INFO Vacuumed table table=pending_closures31932026/11/11 23:06:16 INFO Vacuumed table table=multipart_uploads31942026/11/11 23:06:16 INFO Vacuumed table table=closures31952026/11/11 23:06:16 INFO Vacuumed table table=closures31962026/11/11 23:06:16 INFO Vacuumed table table=closures31972026/11/11 23:06:16 INFO Vacuumed table table=pending_objects31982026/11/11 23:06:16 INFO Vacuumed table table=objects31992026/11/11 23:06:16 INFO Vacuumed table table=multipart_uploads32002026/11/11 23:06:16 INFO Received complete upload request method=POST path=/32012026/11/11 23:06:16 INFO Vacuumed table table=objects32022026/11/11 23:06:16 INFO Vacuumed table table=objects32032026/11/11 23:06:16 INFO Vacuumed table table=pending_objects32042026/11/11 23:06:16 INFO Vacuumed table table=closures32052026/11/11 23:06:16 INFO Completed upload id=3 objects=25 duration=949.166µs32062026/11/11 23:06:16 INFO Aborted multipart uploads count=0 kept=032072026/11/11 23:06:16 INFO Vacuumed table table=multipart_uploads32082026/11/11 23:06:16 INFO Vacuumed table table=objects32092026/11/11 23:06:16 INFO Received uploads request method=POST path=/32102026/11/11 23:06:16 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=032112026/11/11 23:06:16 INFO Vacuumed table table=pending_closures32122026/11/11 23:06:16 INFO Received push request method=POST path=/32132026/11/11 23:06:16 INFO Vacuumed table table=pending_objects32142026/11/11 23:06:16 INFO Aborted multipart uploads count=0 kept=032152026/11/11 23:06:16 INFO Aborted multipart uploads count=0 kept=032162026/11/11 23:06:16 INFO Aborted multipart uploads count=0 kept=032172026/11/11 23:06:16 INFO Received uploads request method=POST path=/32182026/11/11 23:06:16 INFO Vacuumed table table=multipart_uploads32192026/11/11 23:06:16 WARN Force mode enabled - objects will be deleted immediately without grace period32202026/11/11 23:06:16 INFO Received complete push request method=POST path=/32212026/11/11 23:06:16 INFO Vacuumed table table=closures32222026/11/11 23:06:16 INFO Vacuumed table table=closures32232026/11/11 23:06:16 WARN Force mode enabled - objects will be deleted immediately without grace period32242026/11/11 23:06:16 WARN Force mode enabled - objects will be deleted immediately without grace period32252026/11/11 23:06:16 INFO Received push request method=POST path=/32262026/11/11 23:06:16 INFO Vacuumed table table=objects32272026/11/11 23:06:16 INFO Completed push id=7 objects=24 duration=6.084375ms32282026/11/11 23:06:16 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=032292026/11/11 23:06:16 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=032302026/11/11 23:06:16 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=3 objects-failed-to-delete=032312026/11/11 23:06:16 INFO Vacuumed table table=pending_closures32322026/11/11 23:06:16 INFO Received uploads request method=POST path=/32332026/11/11 23:06:16 INFO Received uploads request method=POST path=/32342026/11/11 23:06:16 INFO Received complete upload request method=POST path=/32352026/11/11 23:06:16 INFO Vacuumed table table=pending_objects32362026/11/11 23:06:16 INFO Received push request method=POST path=/32372026/11/11 23:06:16 INFO Vacuumed table table=pending_closures32382026/11/11 23:06:16 INFO Vacuumed table table=multipart_uploads32392026/11/11 23:06:16 INFO Received uploads request method=POST path=/32402026/11/11 23:06:16 INFO Completed upload id=25 objects=16 duration=1.864791ms32412026/11/11 23:06:16 INFO Vacuumed table table=objects32422026/11/11 23:06:16 INFO Vacuumed table table=closures32432026/11/11 23:06:16 INFO Received uploads request method=POST path=/32442026/11/11 23:06:16 INFO Received uploads request method=POST path=/32452026/11/11 23:06:16 INFO Vacuumed table table=pending_objects32462026/11/11 23:06:16 INFO Aborted multipart uploads count=0 kept=032472026/11/11 23:06:16 INFO Vacuumed table table=objects32482026/11/11 23:06:16 INFO Vacuumed table table=pending_closures32492026/11/11 23:06:16 INFO Vacuumed table table=multipart_uploads32502026/11/11 23:06:16 INFO Received push request method=POST path=/32512026/11/11 23:06:16 WARN Force mode enabled - objects will be deleted immediately without grace period32522026/11/11 23:06:16 INFO Aborted multipart uploads count=0 kept=032532026/11/11 23:06:16 INFO Received push request method=POST path=/32542026/11/11 23:06:16 INFO Vacuumed table table=closures32552026/11/11 23:06:16 INFO Received uploads request method=POST path=/32562026/11/11 23:06:16 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=032572026/11/11 23:06:16 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=032582026/11/11 23:06:16 INFO Received push request method=POST path=/32592026/11/11 23:06:16 INFO Vacuumed table table=pending_objects32602026/11/11 23:06:16 INFO Vacuumed table table=objects32612026/11/11 23:06:16 INFO Vacuumed table table=pending_closures32622026/11/11 23:06:16 INFO Vacuumed table table=pending_closures32632026/11/11 23:06:16 INFO Received complete push request method=POST path=/32642026/11/11 23:06:16 INFO Received complete push request method=POST path=/32652026/11/11 23:06:16 INFO Received push request method=POST path=/32662026/11/11 23:06:16 INFO Vacuumed table table=multipart_uploads32672026/11/11 23:06:16 INFO Vacuumed table table=pending_objects32682026/11/11 23:06:16 INFO Vacuumed table table=pending_objects32692026/11/11 23:06:16 INFO Completed push id=22 objects=3 duration=1.0585ms32702026/11/11 23:06:16 INFO Completed push id=13 objects=2 duration=330.583µs32712026/11/11 23:06:16 INFO Vacuumed table table=multipart_uploads32722026/11/11 23:06:16 INFO Vacuumed table table=multipart_uploads32732026/11/11 23:06:16 INFO Received complete push request method=POST path=/32742026/11/11 23:06:16 INFO Received uploads request method=POST path=/32752026/11/11 23:06:16 INFO Vacuumed table table=closures32762026/11/11 23:06:16 INFO Received complete upload request method=POST path=/32772026/11/11 23:06:16 INFO Completed push id=7 objects=7 duration=469.5µs32782026/11/11 23:06:16 INFO Vacuumed table table=closures32792026/11/11 23:06:16 INFO Vacuumed table table=objects32802026/11/11 23:06:16 INFO Vacuumed table table=closures32812026/11/11 23:06:16 INFO Completed upload id=27 objects=13 duration=743.5µs32822026/11/11 23:06:16 INFO Received push request method=POST path=/32832026/11/11 23:06:16 INFO Received uploads request method=POST path=/32842026/11/11 23:06:16 INFO Vacuumed table table=objects32852026/11/11 23:06:16 INFO Received uploads request method=POST path=/32862026/11/11 23:06:16 INFO Received complete push request method=POST path=/32872026/11/11 23:06:16 INFO Aborted multipart uploads count=0 kept=032882026/11/11 23:06:16 INFO Received push request method=POST path=/32892026/11/11 23:06:16 INFO Completed push id=24 objects=3 duration=577.166µs32902026/11/11 23:06:16 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=032912026/11/11 23:06:16 INFO Aborted multipart uploads count=0 kept=032922026/11/11 23:06:16 INFO Received push request method=POST path=/32932026/11/11 23:06:16 INFO Received push request method=POST path=/32942026/11/11 23:06:16 WARN Force mode enabled - objects will be deleted immediately without grace period32952026/11/11 23:06:16 INFO Vacuumed table table=pending_closures32962026/11/11 23:06:16 INFO Vacuumed table table=objects32972026/11/11 23:06:16 INFO Aborted multipart uploads count=0 kept=032982026/11/11 23:06:16 INFO Received uploads request method=POST path=/32992026/11/11 23:06:16 INFO Vacuumed table table=pending_objects33002026/11/11 23:06:16 WARN Force mode enabled - objects will be deleted immediately without grace period33012026/11/11 23:06:16 INFO Received complete upload request method=POST path=/33022026/11/11 23:06:16 INFO Vacuumed table table=multipart_uploads33032026/11/11 23:06:16 INFO Received uploads request method=POST path=/33042026/11/11 23:06:16 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=033052026/11/11 23:06:16 INFO Completed upload id=22 objects=5 duration=558.375µs33062026/11/11 23:06:16 INFO Vacuumed table table=closures33072026/11/11 23:06:16 INFO Received push request method=POST path=/33082026/11/11 23:06:16 INFO Vacuumed table table=objects33092026/11/11 23:06:16 INFO Received complete push request method=POST path=/33102026/11/11 23:06:16 INFO Vacuumed table table=pending_closures33112026/11/11 23:06:16 INFO Completed push id=28 objects=3 duration=6.291084ms33122026/11/11 23:06:16 INFO Received uploads request method=POST path=/33132026/11/11 23:06:16 INFO Received complete push request method=POST path=/33142026/11/11 23:06:16 INFO Received complete push request method=POST path=/33152026/11/11 23:06:16 INFO Received push request method=POST path=/33162026/11/11 23:06:16 INFO Vacuumed table table=pending_objects33172026/11/11 23:06:16 INFO Completed push id=7 objects=20 duration=628.875µs33182026/11/11 23:06:16 INFO Completed push id=29 objects=15 duration=301.834µs33192026/11/11 23:06:16 INFO Received push request method=POST path=/33202026/11/11 23:06:16 INFO Vacuumed table table=multipart_uploads33212026/11/11 23:06:16 INFO Received complete push request method=POST path=/33222026/11/11 23:06:16 INFO Received uploads request method=POST path=/33232026/11/11 23:06:16 INFO Aborted multipart uploads count=0 kept=033242026/11/11 23:06:16 INFO Completed push id=30 objects=6 duration=335.459µs33252026/11/11 23:06:16 INFO Vacuumed table table=closures33262026/11/11 23:06:16 INFO Received uploads request method=POST path=/33272026/11/11 23:06:16 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=033282026/11/11 23:06:16 INFO Vacuumed table table=objects33292026/11/11 23:06:16 INFO Received complete upload request method=POST path=/33302026/11/11 23:06:16 INFO Vacuumed table table=pending_closures33312026/11/11 23:06:16 INFO Received complete upload request method=POST path=/33322026/11/11 23:06:16 INFO Completed upload id=31 objects=3 duration=364.666µs33332026/11/11 23:06:16 INFO Completed upload id=29 objects=4 duration=6.936958ms33342026/11/11 23:06:16 INFO Received complete push request method=POST path=/33352026/11/11 23:06:16 INFO Received complete push request method=POST path=/33362026/11/11 23:06:16 INFO Aborted multipart uploads count=0 kept=033372026/11/11 23:06:16 INFO Vacuumed table table=pending_objects33382026/11/11 23:06:16 INFO Received uploads request method=POST path=/33392026/11/11 23:06:16 INFO Completed push id=6 objects=8 duration=1.502042ms33402026/11/11 23:06:16 INFO Aborted multipart uploads count=0 kept=033412026/11/11 23:06:16 WARN Force mode enabled - objects will be deleted immediately without grace period33422026/11/11 23:06:16 INFO Vacuumed table table=multipart_uploads33432026/11/11 23:06:16 INFO Received uploads request method=POST path=/33442026/11/11 23:06:17 INFO Vacuumed table table=closures33452026/11/11 23:06:17 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=033462026/11/11 23:06:17 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=2 objects-failed-to-delete=033472026/11/11 23:06:17 INFO Received uploads request method=POST path=/33482026/11/11 23:06:17 INFO Received complete upload request method=POST path=/33492026/11/11 23:06:17 INFO Completed push id=1 objects=7 duration=27.990166ms33502026/11/11 23:06:17 INFO Vacuumed table table=objects33512026/11/11 23:06:17 INFO Received uploads request method=POST path=/33522026/11/11 23:06:17 INFO Completed upload id=4 objects=7 duration=353.208µs33532026/11/11 23:06:17 INFO Vacuumed table table=pending_closures33542026/11/11 23:06:17 INFO Vacuumed table table=pending_closures33552026/11/11 23:06:17 INFO Received uploads request method=POST path=/33562026/11/11 23:06:17 INFO Received push request method=POST path=/33572026/11/11 23:06:17 INFO Received uploads request method=POST path=/33582026/11/11 23:06:17 INFO Received uploads request method=POST path=/33592026/11/11 23:06:17 INFO Received complete upload request method=POST path=/33602026/11/11 23:06:17 INFO Vacuumed table table=pending_objects33612026/11/11 23:06:17 INFO Received push request method=POST path=/33622026/11/11 23:06:17 INFO Completed upload id=7 objects=4 duration=280.292µs33632026/11/11 23:06:17 INFO Vacuumed table table=multipart_uploads33642026/11/11 23:06:17 INFO Vacuumed table table=pending_objects33652026/11/11 23:06:17 INFO Received complete upload request method=POST path=/33662026/11/11 23:06:17 INFO Received uploads request method=POST path=/33672026/11/11 23:06:17 INFO Vacuumed table table=closures33682026/11/11 23:06:17 INFO Received push request method=POST path=/33692026/11/11 23:06:17 INFO Vacuumed table table=multipart_uploads33702026/11/11 23:06:17 INFO Completed upload id=18 objects=11 duration=501.834µs33712026/11/11 23:06:17 INFO Vacuumed table table=objects33722026/11/11 23:06:17 INFO Received complete push request method=POST path=/33732026/11/11 23:06:17 INFO Vacuumed table table=closures33742026/11/11 23:06:17 INFO Received uploads request method=POST path=/33752026/11/11 23:06:17 INFO Aborted multipart uploads count=0 kept=033762026/11/11 23:06:17 INFO Completed push id=6 objects=26 duration=1.332916ms33772026/11/11 23:06:17 INFO Received push request method=POST path=/33782026/11/11 23:06:17 INFO Vacuumed table table=objects33792026/11/11 23:06:17 WARN Force mode enabled - objects will be deleted immediately without grace period33802026/11/11 23:06:17 INFO Received push request method=POST path=/33812026/11/11 23:06:17 INFO Received complete push request method=POST path=/33822026/11/11 23:06:17 INFO Aborted multipart uploads count=0 kept=033832026/11/11 23:06:17 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=033842026/11/11 23:06:17 INFO Received uploads request method=POST path=/33852026/11/11 23:06:17 INFO Completed push id=11 objects=6 duration=864.666µs33862026/11/11 23:06:17 INFO Aborted multipart uploads count=0 kept=033872026/11/11 23:06:17 INFO Aborted multipart uploads count=0 kept=033882026/11/11 23:06:17 WARN Force mode enabled - objects will be deleted immediately without grace period33892026/11/11 23:06:17 INFO Received complete push request method=POST path=/33902026/11/11 23:06:17 INFO Vacuumed table table=pending_closures33912026/11/11 23:06:17 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=033922026/11/11 23:06:17 INFO Completed push id=5 objects=3 duration=9.983667ms33932026/11/11 23:06:17 WARN Force mode enabled - objects will be deleted immediately without grace period33942026/11/11 23:06:17 INFO Received uploads request method=POST path=/33952026/11/11 23:06:17 WARN Force mode enabled - objects will be deleted immediately without grace period33962026/11/11 23:06:17 INFO Vacuumed table table=pending_objects33972026/11/11 23:06:17 INFO Received complete upload request method=POST path=/33982026/11/11 23:06:17 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=033992026/11/11 23:06:17 INFO Vacuumed table table=multipart_uploads34002026/11/11 23:06:17 INFO Completed upload id=26 objects=2 duration=6.627875ms34012026/11/11 23:06:17 INFO Vacuumed table table=pending_closures34022026/11/11 23:06:17 INFO Vacuumed table table=closures34032026/11/11 23:06:17 INFO Vacuumed table table=pending_objects34042026/11/11 23:06:17 INFO Aborted multipart uploads count=0 kept=034052026/11/11 23:06:17 INFO Vacuumed table table=pending_closures34062026/11/11 23:06:17 INFO Vacuumed table table=objects34072026/11/11 23:06:17 INFO Vacuumed table table=multipart_uploads34082026/11/11 23:06:17 INFO Received push request method=POST path=/34092026/11/11 23:06:17 INFO Vacuumed table table=closures34102026/11/11 23:06:17 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=034112026/11/11 23:06:17 INFO Vacuumed table table=objects34122026/11/11 23:06:17 INFO Vacuumed table table=pending_objects34132026/11/11 23:06:17 INFO Vacuumed table table=multipart_uploads34142026/11/11 23:06:17 INFO Received uploads request method=POST path=/34152026/11/11 23:06:17 INFO Received complete push request method=POST path=/34162026/11/11 23:06:17 INFO Received uploads request method=POST path=/34172026/11/11 23:06:17 INFO Received complete push request method=POST path=/34182026/11/11 23:06:17 INFO Received uploads request method=POST path=/34192026/11/11 23:06:17 INFO Received complete upload request method=POST path=/34202026/11/11 23:06:17 INFO Completed push id=8 objects=6 duration=361.125µs34212026/11/11 23:06:17 INFO Completed push id=20 objects=13 duration=361.208µs34222026/11/11 23:06:17 INFO Vacuumed table table=pending_closures34232026/11/11 23:06:17 INFO Completed upload id=9 objects=7 duration=636.541µs34242026/11/11 23:06:17 INFO Aborted multipart uploads count=0 kept=034252026/11/11 23:06:17 INFO Aborted multipart uploads count=0 kept=034262026/11/11 23:06:17 INFO Received push request method=POST path=/34272026/11/11 23:06:17 INFO Received complete push request method=POST path=/34282026/11/11 23:06:17 WARN Force mode enabled - objects will be deleted immediately without grace period34292026/11/11 23:06:17 INFO Completed push id=22 objects=4 duration=725.583µs34302026/11/11 23:06:17 INFO Vacuumed table table=closures34312026/11/11 23:06:17 INFO Received uploads request method=POST path=/34322026/11/11 23:06:17 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=034332026/11/11 23:06:17 INFO Received push request method=POST path=/34342026/11/11 23:06:17 INFO Received complete push request method=POST path=/34352026/11/11 23:06:17 INFO Vacuumed table table=pending_objects34362026/11/11 23:06:17 INFO Aborted multipart uploads count=0 kept=034372026/11/11 23:06:17 INFO Received push request method=POST path=/34382026/11/11 23:06:17 INFO Vacuumed table table=multipart_uploads34392026/11/11 23:06:17 INFO Vacuumed table table=closures34402026/11/11 23:06:17 ERROR failed to remove object object=aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa.ls error="Access Denied."34412026/11/11 23:06:17 ERROR failed to remove object object=realisations/sha256:bbbbbbbb!out.doi error="Access Denied."34422026/11/11 23:06:17 ERROR failed to remove object object=gggggggggggggggggggggggggggggggg.ls error="Access Denied."34432026/11/11 23:06:17 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.ls error="Access Denied."34442026/11/11 23:06:17 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.ls error="Access Denied."34452026/11/11 23:06:17 INFO Vacuumed table table=objects34462026/11/11 23:06:17 INFO Vacuumed table table=objects34472026/11/11 23:06:17 INFO Vacuumed table table=pending_closures34482026/11/11 23:06:17 INFO Received uploads request method=POST path=/34492026/11/11 23:06:17 INFO Completed push id=3 objects=8 duration=38.450333ms34502026/11/11 23:06:17 INFO Received push request method=POST path=/34512026/11/11 23:06:17 INFO Received complete push request method=POST path=/34522026/11/11 23:06:17 INFO Completed push id=10 objects=2 duration=625.041µs34532026/11/11 23:06:17 INFO Received uploads request method=POST path=/34542026/11/11 23:06:17 INFO Vacuumed table table=pending_objects34552026/11/11 23:06:17 INFO Vacuumed table table=multipart_uploads34562026/11/11 23:06:17 INFO Received push request method=POST path=/34572026/11/11 23:06:17 INFO Received uploads request method=POST path=/34582026/11/11 23:06:17 INFO Aborted multipart uploads count=0 kept=034592026/11/11 23:06:17 INFO Vacuumed table table=closures34602026/11/11 23:06:17 INFO Received complete upload request method=POST path=/34612026/11/11 23:06:17 ERROR failed to remove object object=cccccccccccccccccccccccccccccccc.ls error="Access Denied."34622026/11/11 23:06:17 ERROR failed to remove object object=ffffffffffffffffffffffffffffffff.ls error="Access Denied."34632026/11/11 23:06:17 INFO Received complete push request method=POST path=/34642026/11/11 23:06:17 INFO Received uploads request method=POST path=/34652026/11/11 23:06:17 INFO Completed upload id=23 objects=7 duration=308.916µs34662026/11/11 23:06:17 ERROR failed to remove object object=realisations/sha256:ffffffff!out.doi error="Access Denied."34672026/11/11 23:06:17 INFO Completed push id=4 objects=7 duration=512.875µs34682026/11/11 23:06:17 INFO Received uploads request method=POST path=/34692026/11/11 23:06:17 INFO Received push request method=POST path=/34702026/11/11 23:06:17 INFO Received complete push request method=POST path=/34712026/11/11 23:06:17 INFO Received uploads request method=POST path=/34722026/11/11 23:06:17 INFO Aborted multipart uploads count=0 kept=034732026/11/11 23:06:17 INFO Completed push id=24 objects=5 duration=611.083µs34742026/11/11 23:06:17 INFO Received push request method=POST path=/34752026/11/11 23:06:17 INFO Received complete upload request method=POST path=/34762026/11/11 23:06:17 INFO Received uploads request method=POST path=/34772026/11/11 23:06:17 INFO Vacuumed table table=objects34782026/11/11 23:06:17 INFO Received complete push request method=POST path=/34792026/11/11 23:06:17 WARN Force mode enabled - objects will be deleted immediately without grace period34802026/11/11 23:06:17 INFO Received complete push request method=POST path=/34812026/11/11 23:06:17 INFO Received complete upload request method=POST path=/34822026/11/11 23:06:17 INFO Completed upload id=2 objects=10 duration=491.709µs34832026/11/11 23:06:17 INFO Completed push id=13 objects=12 duration=1.099208ms34842026/11/11 23:06:17 INFO Received push request method=POST path=/34852026/11/11 23:06:17 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=4 objects-failed-to-delete=034862026/11/11 23:06:17 INFO Completed upload id=25 objects=2 duration=257.375µs34872026/11/11 23:06:17 INFO Completed push id=28 objects=11 duration=582.583µs34882026/11/11 23:06:17 INFO Received push request method=POST path=/34892026/11/11 23:06:17 INFO Aborted multipart uploads count=0 kept=034902026/11/11 23:06:17 INFO Received complete upload request method=POST path=/34912026/11/11 23:06:17 INFO Aborted multipart uploads count=0 kept=034922026/11/11 23:06:17 INFO Vacuumed table table=pending_closures34932026/11/11 23:06:17 INFO Completed upload id=12 objects=21 duration=496.25µs34942026/11/11 23:06:17 INFO Received complete upload request method=POST path=/34952026/11/11 23:06:17 INFO Received complete upload request method=POST path=/34962026/11/11 23:06:17 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=6 objects-failed-to-delete=034972026/11/11 23:06:17 INFO Received push request method=POST path=/34982026/11/11 23:06:17 INFO Completed upload id=10 objects=17 duration=335.75µs34992026/11/11 23:06:17 WARN Force mode enabled - objects will be deleted immediately without grace period35002026/11/11 23:06:17 INFO Completed upload id=26 objects=20 duration=241.542µs35012026/11/11 23:06:17 INFO Vacuumed table table=pending_objects35022026/11/11 23:06:17 INFO Vacuumed table table=pending_closures35032026/11/11 23:06:17 INFO Vacuumed table table=multipart_uploads35042026/11/11 23:06:17 INFO Vacuumed table table=closures35052026/11/11 23:06:17 ERROR failed to remove object object=realisations/sha256:cccccccc!out.doi error="Access Denied."35062026/11/11 23:06:17 INFO Vacuumed table table=pending_objects35072026/11/11 23:06:17 INFO Vacuumed table table=objects35082026/11/11 23:06:17 INFO Received push request method=POST path=/35092026/11/11 23:06:17 ERROR failed to remove object object=bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb.ls error="Access Denied."35102026/11/11 23:06:17 ERROR failed to remove object object=gggggggggggggggggggggggggggggggg.ls error="Access Denied."35112026/11/11 23:06:17 ERROR failed to remove object object=gggggggggggggggggggggggggggggggg.narinfo error="Access Denied."35122026/11/11 23:06:17 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.ls error="Access Denied."35132026/11/11 23:06:17 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.narinfo error="Access Denied."35142026/11/11 23:06:17 ERROR failed to remove object object=nar/gggggggggggggggggggggggggggggggggggggggggggggggggggg.nar.zst error="Access Denied."35152026/11/11 23:06:17 ERROR failed to remove object object=nar/hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.nar.zst error="Access Denied."35162026/11/11 23:06:17 ERROR failed to remove object object=realisations/sha256:bbbbbbbb!out.doi error="Access Denied."35172026/11/11 23:06:17 ERROR failed to remove object object=realisations/sha256:dddddddd!out.doi error="Access Denied."35182026/11/11 23:06:17 ERROR failed to remove object object=realisations/sha256:gggggggg!out.doi error="Access Denied."35192026/11/11 23:06:17 ERROR failed to remove object object=realisations/sha256:hhhhhhhh!out.doi error="Access Denied."35202026/11/11 23:06:17 INFO Received uploads request method=POST path=/35212026/11/11 23:06:17 INFO Vacuumed table table=multipart_uploads35222026/11/11 23:06:17 INFO Received complete upload request method=POST path=/35232026/11/11 23:06:17 INFO Vacuumed table table=closures35242026/11/11 23:06:17 INFO Completed upload id=10 objects=6 duration=1.129083ms35252026/11/11 23:06:17 INFO Received push request method=POST path=/35262026/11/11 23:06:17 INFO Received push request method=POST path=/35272026/11/11 23:06:17 INFO Aborted multipart uploads count=0 kept=035282026/11/11 23:06:17 INFO Vacuumed table table=objects35292026/11/11 23:06:17 WARN Force mode enabled - objects will be deleted immediately without grace period35302026/11/11 23:06:17 INFO Received complete push request method=POST path=/35312026/11/11 23:06:17 INFO Received complete push request method=POST path=/35322026/11/11 23:06:17 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=035332026/11/11 23:06:17 INFO Received push request method=POST path=/35342026/11/11 23:06:17 INFO Completed push id=8 objects=2 duration=503.084µs35352026/11/11 23:06:17 INFO Vacuumed table table=pending_closures35362026/11/11 23:06:17 INFO Completed push id=14 objects=6 duration=5.556083ms35372026/11/11 23:06:17 INFO Received complete upload request method=POST path=/35382026/11/11 23:06:17 INFO Received complete push request method=POST path=/35392026/11/11 23:06:17 INFO Received uploads request method=POST path=/35402026/11/11 23:06:17 INFO Vacuumed table table=pending_objects35412026/11/11 23:06:17 INFO Received push request method=POST path=/35422026/11/11 23:06:17 INFO Completed upload id=3 objects=8 duration=647.458µs35432026/11/11 23:06:17 INFO Completed push id=13 objects=23 duration=382.875µs35442026/11/11 23:06:17 INFO Vacuumed table table=multipart_uploads35452026/11/11 23:06:17 INFO Received push request method=POST path=/35462026/11/11 23:06:17 INFO Received push request method=POST path=/35472026/11/11 23:06:17 INFO Received complete push request method=POST path=/35482026/11/11 23:06:17 INFO Aborted multipart uploads count=0 kept=035492026/11/11 23:06:17 INFO Received uploads request method=POST path=/35502026/11/11 23:06:17 INFO Completed push id=28 objects=7 duration=444.25µs35512026/11/11 23:06:17 INFO Vacuumed table table=closures35522026/11/11 23:06:17 INFO Aborted multipart uploads count=0 kept=035532026/11/11 23:06:17 INFO Received uploads request method=POST path=/35542026/11/11 23:06:17 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=2 objects-failed-to-delete=035552026/11/11 23:06:17 INFO Vacuumed table table=objects35562026/11/11 23:06:17 INFO Received complete push request method=POST path=/35572026/11/11 23:06:17 INFO Aborted multipart uploads count=0 kept=035582026/11/11 23:06:17 INFO Completed push id=15 objects=4 duration=469.625µs35592026/11/11 23:06:17 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=1 objects-deleted-after-grace-period=0 objects-failed-to-delete=035602026/11/11 23:06:17 INFO Aborted multipart uploads count=0 kept=035612026/11/11 23:06:17 ERROR failed to remove object object=aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa.ls error="Access Denied."35622026/11/11 23:06:17 ERROR failed to remove object object=realisations/sha256:bbbbbbbb!out.doi error="Access Denied."35632026/11/11 23:06:17 ERROR failed to remove object object=realisations/sha256:iiiiiiii!out.doi error="Access Denied."35642026/11/11 23:06:17 INFO Received push request method=POST path=/35652026/11/11 23:06:17 INFO Vacuumed table table=pending_closures35662026/11/11 23:06:17 INFO Vacuumed table table=pending_closures35672026/11/11 23:06:17 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=035682026/11/11 23:06:17 ERROR failed to remove object object=cccccccccccccccccccccccccccccccc.ls error="Access Denied."35692026/11/11 23:06:17 ERROR failed to remove object object=cccccccccccccccccccccccccccccccc.narinfo error="Access Denied."35702026/11/11 23:06:17 ERROR failed to remove object object=ffffffffffffffffffffffffffffffff.ls error="Access Denied."35712026/11/11 23:06:17 ERROR failed to remove object object=ffffffffffffffffffffffffffffffff.narinfo error="Access Denied."35722026/11/11 23:06:17 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.ls error="Access Denied."35732026/11/11 23:06:17 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.narinfo error="Access Denied."35742026/11/11 23:06:17 INFO Vacuumed table table=pending_closures35752026/11/11 23:06:17 INFO Vacuumed table table=pending_objects35762026/11/11 23:06:17 INFO Received uploads request method=POST path=/35772026/11/11 23:06:17 ERROR failed to remove object object=iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.narinfo error="Access Denied."35782026/11/11 23:06:17 ERROR failed to remove object object=nar/cccccccccccccccccccccccccccccccccccccccccccccccccccc.nar.zst error="Access Denied."35792026/11/11 23:06:17 ERROR failed to remove object object=nar/ffffffffffffffffffffffffffffffffffffffffffffffffffff.nar.zst error="Access Denied."35802026/11/11 23:06:17 ERROR failed to remove object object=nar/hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.nar.zst error="Access Denied."35812026/11/11 23:06:17 ERROR failed to remove object object=nar/iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.nar.zst error="Access Denied."35822026/11/11 23:06:17 ERROR failed to remove object object=realisations/sha256:aaaaaaaa!out.doi error="Access Denied."35832026/11/11 23:06:17 ERROR failed to remove object object=realisations/sha256:cccccccc!out.doi error="Access Denied."35842026/11/11 23:06:17 ERROR failed to remove object object=realisations/sha256:dddddddd!out.doi error="Access Denied."35852026/11/11 23:06:17 ERROR failed to remove object object=realisations/sha256:ffffffff!out.doi error="Access Denied."35862026/11/11 23:06:17 ERROR failed to remove object object=realisations/sha256:gggggggg!out.doi error="Access Denied."35872026/11/11 23:06:17 ERROR failed to remove object object=realisations/sha256:hhhhhhhh!out.doi error="Access Denied."35882026/11/11 23:06:17 ERROR failed to remove object object=realisations/sha256:iiiiiiii!out.doi error="Access Denied."35892026/11/11 23:06:17 INFO Vacuumed table table=multipart_uploads35902026/11/11 23:06:17 INFO Vacuumed table table=pending_objects35912026/11/11 23:06:17 INFO Received push request method=POST path=/35922026/11/11 23:06:17 INFO Vacuumed table table=closures35932026/11/11 23:06:17 INFO Vacuumed table table=pending_objects35942026/11/11 23:06:17 INFO Vacuumed table table=multipart_uploads35952026/11/11 23:06:17 INFO Aborted multipart uploads count=0 kept=035962026/11/11 23:06:17 INFO Received uploads request method=POST path=/35972026/11/11 23:06:17 INFO Vacuumed table table=multipart_uploads35982026/11/11 23:06:17 INFO Vacuumed table table=closures35992026/11/11 23:06:17 INFO Vacuumed table table=objects36002026/11/11 23:06:17 WARN Force mode enabled - objects will be deleted immediately without grace period36012026/11/11 23:06:17 INFO Vacuumed table table=closures36022026/11/11 23:06:17 INFO Vacuumed table table=objects36032026/11/11 23:06:17 INFO Received push request method=POST path=/36042026/11/11 23:06:17 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=036052026/11/11 23:06:17 INFO Aborted multipart uploads count=0 kept=036062026/11/11 23:06:17 INFO Received complete upload request method=POST path=/36072026/11/11 23:06:17 INFO Received uploads request method=POST path=/36082026/11/11 23:06:17 INFO Vacuumed table table=objects36092026/11/11 23:06:17 INFO Received uploads request method=POST path=/36102026/11/11 23:06:17 INFO Vacuumed table table=pending_closures36112026/11/11 23:06:17 WARN Force mode enabled - objects will be deleted immediately without grace period36122026/11/11 23:06:17 INFO Completed upload id=30 objects=6 duration=420.416µs36132026/11/11 23:06:17 INFO Received push request method=POST path=/36142026/11/11 23:06:17 INFO Vacuumed table table=pending_objects36152026/11/11 23:06:17 INFO Received push request method=POST path=/36162026/11/11 23:06:17 INFO Received complete push request method=POST path=/36172026/11/11 23:06:17 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=16 objects-failed-to-delete=036182026/11/11 23:06:17 INFO Received uploads request method=POST path=/36192026/11/11 23:06:17 INFO Completed push id=31 objects=5 duration=282.167µs36202026/11/11 23:06:17 INFO Vacuumed table table=multipart_uploads36212026/11/11 23:06:17 INFO Vacuumed table table=closures36222026/11/11 23:06:17 INFO Received complete push request method=POST path=/36232026/11/11 23:06:17 INFO Vacuumed table table=objects36242026/11/11 23:06:17 INFO Completed push id=12 objects=2 duration=1.110333ms36252026/11/11 23:06:17 INFO Received uploads request method=POST path=/36262026/11/11 23:06:17 INFO Vacuumed table table=pending_closures36272026/11/11 23:06:17 INFO Received uploads request method=POST path=/36282026/11/11 23:06:17 INFO Received complete push request method=POST path=/36292026/11/11 23:06:17 INFO Received uploads request method=POST path=/36302026/11/11 23:06:17 INFO Received uploads request method=POST path=/36312026/11/11 23:06:17 INFO Received complete upload request method=POST path=/36322026/11/11 23:06:17 INFO Completed push id=3 objects=5 duration=550.708µs36332026/11/11 23:06:17 INFO Received uploads request method=POST path=/36342026/11/11 23:06:17 INFO Received complete push request method=POST path=/36352026/11/11 23:06:17 INFO Vacuumed table table=pending_objects36362026/11/11 23:06:17 INFO Completed upload id=4 objects=14 duration=1.290666ms36372026/11/11 23:06:17 INFO Received complete upload request method=POST path=/36382026/11/11 23:06:17 INFO Completed push id=29 objects=24 duration=468.417µs36392026/11/11 23:06:17 INFO Vacuumed table table=multipart_uploads36402026/11/11 23:06:17 INFO Completed upload id=15 objects=4 duration=962.584µs36412026/11/11 23:06:17 INFO Vacuumed table table=closures36422026/11/11 23:06:17 INFO Received push request method=POST path=/36432026/11/11 23:06:17 INFO Received uploads request method=POST path=/36442026/11/11 23:06:17 INFO Aborted multipart uploads count=0 kept=036452026/11/11 23:06:17 INFO Vacuumed table table=objects36462026/11/11 23:06:17 INFO Aborted multipart uploads count=0 kept=036472026/11/11 23:06:17 INFO Received push request method=POST path=/36482026/11/11 23:06:17 WARN Force mode enabled - objects will be deleted immediately without grace period36492026/11/11 23:06:17 INFO Aborted multipart uploads count=0 kept=036502026/11/11 23:06:17 WARN Force mode enabled - objects will be deleted immediately without grace period36512026/11/11 23:06:17 INFO Received push request method=POST path=/36522026/11/11 23:06:17 INFO Received uploads request method=POST path=/36532026/11/11 23:06:17 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=036542026/11/11 23:06:18 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=036552026/11/11 23:06:18 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=036562026/11/11 23:06:18 INFO Received push request method=POST path=/36572026/11/11 23:06:18 INFO Received complete upload request method=POST path=/36582026/11/11 23:06:18 INFO Vacuumed table table=pending_closures36592026/11/11 23:06:18 INFO Completed upload id=16 objects=3 duration=625.458µs36602026/11/11 23:06:18 INFO Vacuumed table table=pending_objects36612026/11/11 23:06:18 INFO Received push request method=POST path=/36622026/11/11 23:06:18 INFO Aborted multipart uploads count=0 kept=036632026/11/11 23:06:18 INFO Vacuumed table table=multipart_uploads36642026/11/11 23:06:18 INFO Vacuumed table table=pending_closures36652026/11/11 23:06:18 INFO Vacuumed table table=pending_closures36662026/11/11 23:06:18 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=036672026/11/11 23:06:18 INFO Received uploads request method=POST path=/36682026/11/11 23:06:18 INFO Vacuumed table table=closures36692026/11/11 23:06:18 INFO Received push request method=POST path=/36702026/11/11 23:06:18 INFO Vacuumed table table=objects36712026/11/11 23:06:18 INFO Received push request method=POST path=/36722026/11/11 23:06:18 INFO Received push request method=POST path=/36732026/11/11 23:06:18 INFO Vacuumed table table=pending_closures36742026/11/11 23:06:18 INFO Received complete push request method=POST path=/36752026/11/11 23:06:18 INFO Received uploads request method=POST path=/36762026/11/11 23:06:18 INFO Completed push id=14 objects=3 duration=371.375µs36772026/11/11 23:06:18 INFO Received complete push request method=POST path=/36782026/11/11 23:06:18 INFO Vacuumed table table=pending_objects36792026/11/11 23:06:18 INFO Received uploads request method=POST path=/36802026/11/11 23:06:18 INFO Vacuumed table table=pending_objects36812026/11/11 23:06:18 INFO Vacuumed table table=pending_objects36822026/11/11 23:06:18 INFO Completed push id=32 objects=26 duration=640.167µs36832026/11/11 23:06:18 INFO Received complete upload request method=POST path=/36842026/11/11 23:06:18 INFO Vacuumed table table=multipart_uploads36852026/11/11 23:06:18 INFO Vacuumed table table=multipart_uploads36862026/11/11 23:06:18 INFO Received complete push request method=POST path=/36872026/11/11 23:06:18 INFO Received complete push request method=POST path=/36882026/11/11 23:06:18 INFO Vacuumed table table=multipart_uploads36892026/11/11 23:06:18 INFO Completed upload id=20 objects=4 duration=596.958µs36902026/11/11 23:06:18 INFO Aborted multipart uploads count=0 kept=036912026/11/11 23:06:18 INFO Received push request method=POST path=/36922026/11/11 23:06:18 INFO Received complete upload request method=POST path=/36932026/11/11 23:06:18 INFO Vacuumed table table=closures36942026/11/11 23:06:18 INFO Vacuumed table table=closures36952026/11/11 23:06:18 INFO Completed push id=19 objects=6 duration=777.125µs36962026/11/11 23:06:18 INFO Completed push id=4 objects=4 duration=422.5µs36972026/11/11 23:06:18 INFO Vacuumed table table=closures36982026/11/11 23:06:18 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=036992026/11/11 23:06:18 INFO Completed upload id=33 objects=2 duration=321.208µs37002026/11/11 23:06:18 INFO Vacuumed table table=objects37012026/11/11 23:06:18 INFO Vacuumed table table=pending_closures37022026/11/11 23:06:18 INFO Vacuumed table table=objects37032026/11/11 23:06:18 INFO Vacuumed table table=objects37042026/11/11 23:06:18 INFO Received complete upload request method=POST path=/37052026/11/11 23:06:18 INFO Completed upload id=34 objects=5 duration=740.75µs37062026/11/11 23:06:18 INFO Aborted multipart uploads count=0 kept=037072026/11/11 23:06:18 INFO Aborted multipart uploads count=0 kept=037082026/11/11 23:06:18 INFO Received uploads request method=POST path=/37092026/11/11 23:06:18 INFO Received push request method=POST path=/37102026/11/11 23:06:18 INFO Vacuumed table table=pending_objects37112026/11/11 23:06:18 INFO Received push request method=POST path=/37122026/11/11 23:06:18 WARN Force mode enabled - objects will be deleted immediately without grace period37132026/11/11 23:06:18 INFO Garbage collection completed failed-uploads-deleted=4 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=037142026/11/11 23:06:18 INFO Received complete upload request method=POST path=/37152026/11/11 23:06:18 INFO Vacuumed table table=multipart_uploads37162026/11/11 23:06:18 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.ls error="Access Denied."37172026/11/11 23:06:18 ERROR failed to remove object object=realisations/sha256:bbbbbbbb!out.doi error="Access Denied."37182026/11/11 23:06:18 INFO Vacuumed table table=pending_closures37192026/11/11 23:06:18 INFO Received complete push request method=POST path=/37202026/11/11 23:06:18 INFO Received complete upload request method=POST path=/37212026/11/11 23:06:18 INFO Received complete upload request method=POST path=/37222026/11/11 23:06:18 INFO Vacuumed table table=closures37232026/11/11 23:06:18 INFO Completed upload id=35 objects=11 duration=444.791µs37242026/11/11 23:06:18 INFO Aborted multipart uploads count=0 kept=037252026/11/11 23:06:18 ERROR failed to remove object object=bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb.ls error="Access Denied."37262026/11/11 23:06:18 INFO Vacuumed table table=pending_objects37272026/11/11 23:06:18 INFO Completed push id=5 objects=3 duration=362.958µs37282026/11/11 23:06:18 INFO Completed upload id=18 objects=4 duration=525µs37292026/11/11 23:06:18 INFO Completed upload id=11 objects=6 duration=620.708µs37302026/11/11 23:06:18 INFO Vacuumed table table=objects37312026/11/11 23:06:18 INFO Vacuumed table table=multipart_uploads37322026/11/11 23:06:18 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=037332026/11/11 23:06:18 INFO Vacuumed table table=closures37342026/11/11 23:06:18 INFO Received uploads request method=POST path=/37352026/11/11 23:06:18 INFO Vacuumed table table=objects37362026/11/11 23:06:18 INFO Aborted multipart uploads count=0 kept=037372026/11/11 23:06:18 INFO Received complete upload request method=POST path=/37382026/11/11 23:06:18 INFO Received complete push request method=POST path=/37392026/11/11 23:06:18 INFO Received complete push request method=POST path=/37402026/11/11 23:06:18 INFO Aborted multipart uploads count=0 kept=037412026/11/11 23:06:18 INFO Received push request method=POST path=/37422026/11/11 23:06:18 INFO Completed upload id=36 objects=3 duration=246.292µs37432026/11/11 23:06:18 WARN Force mode enabled - objects will be deleted immediately without grace period37442026/11/11 23:06:18 INFO Vacuumed table table=pending_closures37452026/11/11 23:06:18 INFO Completed push id=22 objects=3 duration=776.916µs37462026/11/11 23:06:18 INFO Received uploads request method=POST path=/37472026/11/11 23:06:18 INFO Completed push id=17 objects=6 duration=377.791µs37482026/11/11 23:06:18 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=4 objects-deleted-after-grace-period=0 objects-failed-to-delete=037492026/11/11 23:06:18 INFO Received push request method=POST path=/37502026/11/11 23:06:18 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.ls error="Access Denied."37512026/11/11 23:06:18 ERROR failed to remove object object=realisations/sha256:bbbbbbbb!out.doi error="Access Denied."37522026/11/11 23:06:18 INFO Vacuumed table table=pending_objects37532026/11/11 23:06:18 INFO Received uploads request method=POST path=/37542026/11/11 23:06:18 INFO Aborted multipart uploads count=0 kept=037552026/11/11 23:06:18 INFO Aborted multipart uploads count=0 kept=037562026/11/11 23:06:18 INFO Received push request method=POST path=/37572026/11/11 23:06:18 INFO Received push request method=POST path=/37582026/11/11 23:06:18 ERROR failed to remove object object=bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb.ls error="Access Denied."37592026/11/11 23:06:18 INFO Vacuumed table table=multipart_uploads37602026/11/11 23:06:18 INFO Received uploads request method=POST path=/37612026/11/11 23:06:18 WARN Force mode enabled - objects will be deleted immediately without grace period37622026/11/11 23:06:18 WARN Force mode enabled - objects will be deleted immediately without grace period37632026/11/11 23:06:18 INFO Received complete upload request method=POST path=/37642026/11/11 23:06:18 INFO Received complete push request method=POST path=/37652026/11/11 23:06:18 INFO Aborted multipart uploads count=0 kept=037662026/11/11 23:06:18 INFO Vacuumed table table=closures37672026/11/11 23:06:18 INFO Completed push id=9 objects=5 duration=6.494042ms37682026/11/11 23:06:18 INFO Completed upload id=19 objects=25 duration=6.503792ms37692026/11/11 23:06:18 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=037702026/11/11 23:06:18 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=037712026/11/11 23:06:18 INFO Vacuumed table table=objects37722026/11/11 23:06:18 INFO Vacuumed table table=pending_closures37732026/11/11 23:06:18 INFO Vacuumed table table=pending_closures37742026/11/11 23:06:18 INFO Aborted multipart uploads count=0 kept=037752026/11/11 23:06:18 INFO Aborted multipart uploads count=0 kept=037762026/11/11 23:06:18 INFO Aborted multipart uploads count=0 kept=037772026/11/11 23:06:18 WARN Force mode enabled - objects will be deleted immediately without grace period37782026/11/11 23:06:18 INFO Vacuumed table table=pending_objects37792026/11/11 23:06:18 WARN Force mode enabled - objects will be deleted immediately without grace period37802026/11/11 23:06:18 WARN Force mode enabled - objects will be deleted immediately without grace period37812026/11/11 23:06:18 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=037822026/11/11 23:06:18 INFO Vacuumed table table=multipart_uploads37832026/11/11 23:06:18 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=037842026/11/11 23:06:18 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=037852026/11/11 23:06:18 INFO Vacuumed table table=pending_closures37862026/11/11 23:06:18 INFO Vacuumed table table=pending_closures37872026/11/11 23:06:18 INFO Vacuumed table table=pending_closures37882026/11/11 23:06:18 INFO Vacuumed table table=pending_closures37892026/11/11 23:06:18 INFO Vacuumed table table=closures37902026/11/11 23:06:18 INFO Vacuumed table table=objects37912026/11/11 23:06:18 INFO Vacuumed table table=pending_objects37922026/11/11 23:06:18 INFO Vacuumed table table=pending_objects37932026/11/11 23:06:18 INFO Vacuumed table table=multipart_uploads37942026/11/11 23:06:18 INFO Vacuumed table table=multipart_uploads37952026/11/11 23:06:18 INFO Vacuumed table table=closures37962026/11/11 23:06:18 INFO Vacuumed table table=pending_objects37972026/11/11 23:06:18 INFO Vacuumed table table=pending_objects37982026/11/11 23:06:18 INFO Vacuumed table table=closures37992026/11/11 23:06:18 INFO Vacuumed table table=objects38002026/11/11 23:06:18 INFO Vacuumed table table=multipart_uploads38012026/11/11 23:06:18 INFO Vacuumed table table=multipart_uploads38022026/11/11 23:06:18 INFO Vacuumed table table=closures38032026/11/11 23:06:18 INFO Vacuumed table table=pending_objects38042026/11/11 23:06:18 INFO Received push request method=POST path=/38052026/11/11 23:06:18 INFO Vacuumed table table=objects38062026/11/11 23:06:18 INFO Vacuumed table table=closures38072026/11/11 23:06:18 INFO Received complete push request method=POST path=/38082026/11/11 23:06:18 INFO Vacuumed table table=multipart_uploads38092026/11/11 23:06:18 INFO Vacuumed table table=objects38102026/11/11 23:06:18 INFO Vacuumed table table=objects38112026/11/11 23:06:18 INFO Completed push id=5 objects=8 duration=1.491541ms38122026/11/11 23:06:18 INFO Received push request method=POST path=/38132026/11/11 23:06:18 INFO Received push request method=POST path=/38142026/11/11 23:06:18 INFO Aborted multipart uploads count=0 kept=038152026/11/11 23:06:18 INFO Received push request method=POST path=/38162026/11/11 23:06:18 INFO Received push request method=POST path=/38172026/11/11 23:06:18 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=038182026/11/11 23:06:18 INFO Received uploads request method=POST path=/38192026/11/11 23:06:18 INFO Received uploads request method=POST path=/38202026/11/11 23:06:18 INFO Vacuumed table table=pending_closures38212026/11/11 23:06:18 INFO Received push request method=POST path=/38222026/11/11 23:06:18 INFO Vacuumed table table=closures38232026/11/11 23:06:18 INFO Aborted multipart uploads count=0 kept=038242026/11/11 23:06:18 INFO Received complete push request method=POST path=/38252026/11/11 23:06:18 INFO Vacuumed table table=pending_objects38262026/11/11 23:06:18 INFO Received uploads request method=POST path=/38272026/11/11 23:06:18 INFO Aborted multipart uploads count=0 kept=038282026/11/11 23:06:18 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=038292026/11/11 23:06:18 INFO Vacuumed table table=multipart_uploads38302026/11/11 23:06:18 INFO Completed push id=16 objects=5 duration=326.333µs38312026/11/11 23:06:18 INFO Received push request method=POST path=/38322026/11/11 23:06:18 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=2 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=038332026/11/11 23:06:18 INFO Vacuumed table table=closures38342026/11/11 23:06:18 INFO Vacuumed table table=pending_closures38352026/11/11 23:06:18 INFO Vacuumed table table=pending_closures38362026/11/11 23:06:18 INFO Received uploads request method=POST path=/38372026/11/11 23:06:18 INFO Vacuumed table table=objects38382026/11/11 23:06:18 INFO Received push request method=POST path=/38392026/11/11 23:06:18 INFO Vacuumed table table=objects38402026/11/11 23:06:18 INFO Vacuumed table table=pending_objects38412026/11/11 23:06:18 INFO Vacuumed table table=multipart_uploads38422026/11/11 23:06:18 INFO Received push request method=POST path=/38432026/11/11 23:06:18 INFO Vacuumed table table=pending_objects38442026/11/11 23:06:18 INFO Vacuumed table table=closures38452026/11/11 23:06:18 INFO Vacuumed table table=multipart_uploads38462026/11/11 23:06:18 INFO Aborted multipart uploads count=0 kept=038472026/11/11 23:06:18 INFO Vacuumed table table=objects38482026/11/11 23:06:18 INFO Received push request method=POST path=/38492026/11/11 23:06:18 INFO Received uploads request method=POST path=/38502026/11/11 23:06:18 INFO Vacuumed table table=closures38512026/11/11 23:06:18 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=038522026/11/11 23:06:18 INFO Received complete push request method=POST path=/38532026/11/11 23:06:18 INFO Received uploads request method=POST path=/38542026/11/11 23:06:18 INFO Vacuumed table table=pending_closures38552026/11/11 23:06:18 INFO Vacuumed table table=objects38562026/11/11 23:06:18 INFO Completed push id=16 objects=4 duration=769.625µs38572026/11/11 23:06:18 INFO Received uploads request method=POST path=/38582026/11/11 23:06:18 INFO Received uploads request method=POST path=/38592026/11/11 23:06:18 INFO Vacuumed table table=pending_objects38602026/11/11 23:06:18 INFO Vacuumed table table=multipart_uploads38612026/11/11 23:06:18 INFO Received uploads request method=POST path=/38622026/11/11 23:06:18 INFO Received push request method=POST path=/38632026/11/11 23:06:18 INFO Received push request method=POST path=/38642026/11/11 23:06:18 INFO Vacuumed table table=closures38652026/11/11 23:06:18 INFO Vacuumed table table=objects38662026/11/11 23:06:18 INFO Received complete upload request method=POST path=/38672026/11/11 23:06:18 INFO Received complete upload request method=POST path=/38682026/11/11 23:06:18 INFO Received uploads request method=POST path=/38692026/11/11 23:06:18 INFO Completed upload id=8 objects=3 duration=713.041µs38702026/11/11 23:06:18 INFO Aborted multipart uploads count=0 kept=038712026/11/11 23:06:18 INFO Received push request method=POST path=/38722026/11/11 23:06:18 INFO Completed upload id=20 objects=5 duration=318.042µs38732026/11/11 23:06:18 INFO Received push request method=POST path=/38742026/11/11 23:06:18 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=038752026/11/11 23:06:18 INFO Received uploads request method=POST path=/38762026/11/11 23:06:18 INFO Received uploads request method=POST path=/38772026/11/11 23:06:18 INFO Received uploads request method=POST path=/38782026/11/11 23:06:18 INFO Vacuumed table table=pending_closures38792026/11/11 23:06:18 INFO Received complete push request method=POST path=/38802026/11/11 23:06:18 INFO Received complete upload request method=POST path=/38812026/11/11 23:06:18 INFO Vacuumed table table=pending_objects38822026/11/11 23:06:18 INFO Completed push id=26 objects=14 duration=1.430167ms38832026/11/11 23:06:18 INFO Received uploads request method=POST path=/38842026/11/11 23:06:18 INFO Received complete push request method=POST path=/38852026/11/11 23:06:18 INFO Received push request method=POST path=/38862026/11/11 23:06:18 INFO Vacuumed table table=multipart_uploads38872026/11/11 23:06:18 INFO Received push request method=POST path=/38882026/11/11 23:06:18 INFO Completed push id=6 objects=6 duration=874.875µs38892026/11/11 23:06:18 INFO Received uploads request method=POST path=/38902026/11/11 23:06:18 INFO Received push request method=POST path=/38912026/11/11 23:06:18 INFO Vacuumed table table=closures38922026/11/11 23:06:18 ERROR failed to remove object object=realisations/sha256:iiiiiiii!out.doi error="Access Denied."38932026/11/11 23:06:18 INFO Completed upload id=1 objects=9 duration=26.211834ms38942026/11/11 23:06:18 INFO Received push request method=POST path=/38952026/11/11 23:06:18 INFO Vacuumed table table=objects38962026/11/11 23:06:18 INFO Received push request method=POST path=/38972026/11/11 23:06:18 INFO Received uploads request method=POST path=/38982026/11/11 23:06:18 INFO Received push request method=POST path=/38992026/11/11 23:06:18 INFO Received uploads request method=POST path=/39002026/11/11 23:06:18 INFO Received uploads request method=POST path=/39012026/11/11 23:06:18 INFO Received uploads request method=POST path=/39022026/11/11 23:06:18 INFO Aborted multipart uploads count=0 kept=039032026/11/11 23:06:18 INFO Received uploads request method=POST path=/39042026/11/11 23:06:18 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=039052026/11/11 23:06:18 INFO Aborted multipart uploads count=0 kept=039062026/11/11 23:06:18 INFO Received uploads request method=POST path=/39072026/11/11 23:06:18 INFO Received push request method=POST path=/39082026/11/11 23:06:18 INFO Vacuumed table table=pending_closures39092026/11/11 23:06:18 WARN Force mode enabled - objects will be deleted immediately without grace period39102026/11/11 23:06:18 INFO Vacuumed table table=pending_objects39112026/11/11 23:06:18 INFO Garbage collection completed failed-uploads-deleted=3 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=039122026/11/11 23:06:18 INFO Vacuumed table table=multipart_uploads39132026/11/11 23:06:18 INFO Vacuumed table table=pending_closures39142026/11/11 23:06:18 INFO Aborted multipart uploads count=0 kept=039152026/11/11 23:06:18 INFO Aborted multipart uploads count=0 kept=039162026/11/11 23:06:18 INFO Vacuumed table table=closures39172026/11/11 23:06:18 INFO Vacuumed table table=pending_objects39182026/11/11 23:06:18 INFO Vacuumed table table=multipart_uploads39192026/11/11 23:06:18 INFO Vacuumed table table=objects39202026/11/11 23:06:18 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=039212026/11/11 23:06:18 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.ls error="Access Denied."39222026/11/11 23:06:18 ERROR failed to remove object object=realisations/sha256:cccccccc!out.doi error="Access Denied."39232026/11/11 23:06:18 INFO Vacuumed table table=closures39242026/11/11 23:06:18 INFO Vacuumed table table=objects39252026/11/11 23:06:18 INFO Vacuumed table table=pending_closures39262026/11/11 23:06:18 INFO Received push request method=POST path=/39272026/11/11 23:06:18 INFO Aborted multipart uploads count=0 kept=039282026/11/11 23:06:18 INFO Aborted multipart uploads count=0 kept=039292026/11/11 23:06:18 WARN Force mode enabled - objects will be deleted immediately without grace period39302026/11/11 23:06:18 INFO Received push request method=POST path=/39312026/11/11 23:06:18 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=039322026/11/11 23:06:18 INFO Vacuumed table table=pending_objects39332026/11/11 23:06:18 INFO Received complete upload request method=POST path=/39342026/11/11 23:06:18 INFO Vacuumed table table=multipart_uploads39352026/11/11 23:06:18 INFO Vacuumed table table=pending_closures39362026/11/11 23:06:18 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=3 objects-failed-to-delete=039372026/11/11 23:06:18 INFO Completed upload id=10 objects=23 duration=515.5µs39382026/11/11 23:06:18 INFO Received push request method=POST path=/39392026/11/11 23:06:18 INFO Vacuumed table table=closures39402026/11/11 23:06:18 INFO Vacuumed table table=pending_objects39412026/11/11 23:06:18 INFO Vacuumed table table=pending_closures39422026/11/11 23:06:18 INFO Received uploads request method=POST path=/39432026/11/11 23:06:18 INFO Vacuumed table table=multipart_uploads39442026/11/11 23:06:18 INFO Vacuumed table table=objects39452026/11/11 23:06:18 INFO Vacuumed table table=closures39462026/11/11 23:06:18 INFO Vacuumed table table=pending_objects39472026/11/11 23:06:18 INFO Vacuumed table table=objects39482026/11/11 23:06:18 INFO Received push request method=POST path=/39492026/11/11 23:06:18 INFO Vacuumed table table=multipart_uploads39502026/11/11 23:06:18 INFO Vacuumed table table=closures39512026/11/11 23:06:18 INFO Aborted multipart uploads count=0 kept=039522026/11/11 23:06:18 INFO Received push request method=POST path=/39532026/11/11 23:06:18 INFO Vacuumed table table=objects39542026/11/11 23:06:18 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=039552026/11/11 23:06:18 INFO Received push request method=POST path=/39562026/11/11 23:06:18 INFO Vacuumed table table=pending_closures39572026/11/11 23:06:18 INFO Received complete upload request method=POST path=/39582026/11/11 23:06:18 INFO Vacuumed table table=pending_objects39592026/11/11 23:06:18 INFO Completed upload id=21 objects=7 duration=6.047542ms39602026/11/11 23:06:18 INFO Received complete push request method=POST path=/39612026/11/11 23:06:18 INFO Vacuumed table table=multipart_uploads39622026/11/11 23:06:19 INFO Aborted multipart uploads count=0 kept=039632026/11/11 23:06:19 INFO Vacuumed table table=closures39642026/11/11 23:06:19 INFO Completed push id=10 objects=15 duration=6.331875ms39652026/11/11 23:06:19 INFO Received complete push request method=POST path=/39662026/11/11 23:06:19 WARN Force mode enabled - objects will be deleted immediately without grace period39672026/11/11 23:06:19 INFO Vacuumed table table=objects39682026/11/11 23:06:19 INFO Completed push id=9 objects=4 duration=890.209µs39692026/11/11 23:06:19 INFO Received push request method=POST path=/39702026/11/11 23:06:19 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=039712026/11/11 23:06:19 INFO Vacuumed table table=pending_closures39722026/11/11 23:06:19 INFO Received complete upload request method=POST path=/39732026/11/11 23:06:19 INFO Received complete push request method=POST path=/39742026/11/11 23:06:19 INFO Received push request method=POST path=/39752026/11/11 23:06:19 INFO Received uploads request method=POST path=/39762026/11/11 23:06:19 INFO Completed upload id=11 objects=6 duration=380.625µs39772026/11/11 23:06:19 INFO Aborted multipart uploads count=0 kept=039782026/11/11 23:06:19 INFO Vacuumed table table=pending_objects39792026/11/11 23:06:19 INFO Completed push id=27 objects=25 duration=761.667µs39802026/11/11 23:06:19 INFO Received push request method=POST path=/39812026/11/11 23:06:19 INFO Received uploads request method=POST path=/39822026/11/11 23:06:19 INFO Vacuumed table table=multipart_uploads39832026/11/11 23:06:19 WARN Force mode enabled - objects will be deleted immediately without grace period39842026/11/11 23:06:19 INFO Received push request method=POST path=/39852026/11/11 23:06:19 INFO Aborted multipart uploads count=0 kept=039862026/11/11 23:06:19 INFO Received uploads request method=POST path=/39872026/11/11 23:06:19 INFO Vacuumed table table=closures39882026/11/11 23:06:19 INFO Received complete upload request method=POST path=/39892026/11/11 23:06:19 INFO Completed upload id=27 objects=4 duration=389.333µs39902026/11/11 23:06:19 INFO Garbage collection completed failed-uploads-deleted=3 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=039912026/11/11 23:06:19 INFO Garbage collection completed failed-uploads-deleted=4 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=039922026/11/11 23:06:19 INFO Received push request method=POST path=/39932026/11/11 23:06:19 INFO Vacuumed table table=objects39942026/11/11 23:06:19 INFO Received complete push request method=POST path=/39952026/11/11 23:06:19 INFO Vacuumed table table=pending_closures39962026/11/11 23:06:19 INFO Received complete push request method=POST path=/39972026/11/11 23:06:19 INFO Completed push id=13 objects=11 duration=719.625µs39982026/11/11 23:06:19 INFO Vacuumed table table=pending_closures39992026/11/11 23:06:19 INFO Vacuumed table table=pending_objects40002026/11/11 23:06:19 INFO Completed push id=15 objects=7 duration=7.111417ms40012026/11/11 23:06:19 INFO Vacuumed table table=multipart_uploads40022026/11/11 23:06:19 INFO Received uploads request method=POST path=/40032026/11/11 23:06:19 INFO Aborted multipart uploads count=0 kept=040042026/11/11 23:06:19 INFO Vacuumed table table=closures40052026/11/11 23:06:19 INFO Received uploads request method=POST path=/40062026/11/11 23:06:19 INFO Received push request method=POST path=/40072026/11/11 23:06:19 INFO Aborted multipart uploads count=0 kept=040082026/11/11 23:06:19 INFO Vacuumed table table=pending_objects40092026/11/11 23:06:19 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=040102026/11/11 23:06:19 INFO Received uploads request method=POST path=/40112026/11/11 23:06:19 INFO Vacuumed table table=objects40122026/11/11 23:06:19 INFO Vacuumed table table=multipart_uploads40132026/11/11 23:06:19 INFO Received push request method=POST path=/40142026/11/11 23:06:19 WARN Force mode enabled - objects will be deleted immediately without grace period40152026/11/11 23:06:19 INFO Vacuumed table table=pending_closures40162026/11/11 23:06:19 INFO Vacuumed table table=closures40172026/11/11 23:06:19 INFO Received push request method=POST path=/40182026/11/11 23:06:19 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=040192026/11/11 23:06:19 INFO Received complete push request method=POST path=/40202026/11/11 23:06:19 INFO Received complete push request method=POST path=/40212026/11/11 23:06:19 INFO Received complete upload request method=POST path=/40222026/11/11 23:06:19 INFO Vacuumed table table=pending_closures40232026/11/11 23:06:19 INFO Vacuumed table table=pending_objects40242026/11/11 23:06:19 INFO Vacuumed table table=objects40252026/11/11 23:06:19 INFO Completed push id=31 objects=14 duration=747.375µs40262026/11/11 23:06:19 INFO Completed push id=24 objects=5 duration=826µs40272026/11/11 23:06:19 INFO Received complete upload request method=POST path=/40282026/11/11 23:06:19 INFO Vacuumed table table=multipart_uploads40292026/11/11 23:06:19 INFO Completed upload id=22 objects=2 duration=443.292µs40302026/11/11 23:06:19 INFO Vacuumed table table=pending_objects40312026/11/11 23:06:19 INFO Completed upload id=10 objects=6 duration=805.833µs40322026/11/11 23:06:19 INFO Received push request method=POST path=/40332026/11/11 23:06:19 INFO Vacuumed table table=closures40342026/11/11 23:06:19 INFO Received uploads request method=POST path=/40352026/11/11 23:06:19 INFO Received uploads request method=POST path=/40362026/11/11 23:06:19 INFO Vacuumed table table=multipart_uploads40372026/11/11 23:06:19 INFO Aborted multipart uploads count=0 kept=040382026/11/11 23:06:19 INFO Vacuumed table table=closures40392026/11/11 23:06:19 INFO Vacuumed table table=objects40402026/11/11 23:06:19 INFO Received push request method=POST path=/40412026/11/11 23:06:19 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=040422026/11/11 23:06:19 INFO Vacuumed table table=objects40432026/11/11 23:06:19 INFO Received uploads request method=POST path=/40442026/11/11 23:06:19 INFO Vacuumed table table=pending_closures40452026/11/11 23:06:19 INFO Received complete push request method=POST path=/40462026/11/11 23:06:19 INFO Aborted multipart uploads count=0 kept=040472026/11/11 23:06:19 INFO Received uploads request method=POST path=/40482026/11/11 23:06:19 INFO Aborted multipart uploads count=0 kept=040492026/11/11 23:06:19 INFO Received complete push request method=POST path=/40502026/11/11 23:06:19 INFO Vacuumed table table=pending_objects40512026/11/11 23:06:19 INFO Completed push id=8 objects=6 duration=433.375µs40522026/11/11 23:06:19 INFO Vacuumed table table=multipart_uploads40532026/11/11 23:06:19 WARN Force mode enabled - objects will be deleted immediately without grace period40542026/11/11 23:06:19 INFO Completed push id=12 objects=15 duration=550.5µs40552026/11/11 23:06:19 WARN Force mode enabled - objects will be deleted immediately without grace period40562026/11/11 23:06:19 INFO Vacuumed table table=closures40572026/11/11 23:06:19 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=040582026/11/11 23:06:19 ERROR failed to remove object object=ffffffffffffffffffffffffffffffff.ls error="Access Denied."40592026/11/11 23:06:19 INFO Received push request method=POST path=/40602026/11/11 23:06:19 INFO Vacuumed table table=objects40612026/11/11 23:06:19 INFO Vacuumed table table=pending_closures40622026/11/11 23:06:19 INFO Vacuumed table table=pending_objects40632026/11/11 23:06:19 INFO Vacuumed table table=multipart_uploads40642026/11/11 23:06:19 INFO Received uploads request method=POST path=/40652026/11/11 23:06:19 INFO Vacuumed table table=closures40662026/11/11 23:06:19 INFO Vacuumed table table=objects40672026/11/11 23:06:19 INFO Received uploads request method=POST path=/40682026/11/11 23:06:19 INFO Received complete push request method=POST path=/40692026/11/11 23:06:19 INFO Received push request method=POST path=/40702026/11/11 23:06:19 INFO Received complete upload request method=POST path=/40712026/11/11 23:06:19 INFO Received complete push request method=POST path=/40722026/11/11 23:06:19 INFO Completed push id=12 objects=7 duration=496.709µs40732026/11/11 23:06:19 INFO Completed upload id=19 objects=2 duration=733.042µs40742026/11/11 23:06:19 INFO Received push request method=POST path=/40752026/11/11 23:06:19 INFO Completed push id=16 objects=14 duration=550.042µs40762026/11/11 23:06:19 INFO Aborted multipart uploads count=0 kept=040772026/11/11 23:06:19 INFO Received uploads request method=POST path=/40782026/11/11 23:06:19 INFO Received uploads request method=POST path=/40792026/11/11 23:06:19 INFO Received push request method=POST path=/40802026/11/11 23:06:19 INFO Garbage collection completed failed-uploads-deleted=4 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=6 objects-failed-to-delete=040812026/11/11 23:06:19 INFO Received complete push request method=POST path=/40822026/11/11 23:06:19 INFO Aborted multipart uploads count=0 kept=040832026/11/11 23:06:19 INFO Aborted multipart uploads count=0 kept=040842026/11/11 23:06:19 INFO Received complete upload request method=POST path=/40852026/11/11 23:06:19 INFO Completed push id=33 objects=7 duration=436.25µs40862026/11/11 23:06:19 INFO Received complete upload request method=POST path=/40872026/11/11 23:06:19 INFO Vacuumed table table=pending_closures40882026/11/11 23:06:19 WARN Force mode enabled - objects will be deleted immediately without grace period40892026/11/11 23:06:19 INFO Completed upload id=14 objects=8 duration=759.375µs40902026/11/11 23:06:19 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=040912026/11/11 23:06:19 INFO Completed upload id=15 objects=6 duration=755.209µs40922026/11/11 23:06:19 INFO Vacuumed table table=pending_closures40932026/11/11 23:06:19 INFO Received complete upload request method=POST path=/40942026/11/11 23:06:19 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=040952026/11/11 23:06:19 INFO Completed upload id=26 objects=3 duration=965.041µs40962026/11/11 23:06:19 INFO Vacuumed table table=pending_closures40972026/11/11 23:06:19 INFO Received uploads request method=POST path=/40982026/11/11 23:06:19 INFO Aborted multipart uploads count=0 kept=040992026/11/11 23:06:19 INFO Vacuumed table table=pending_objects41002026/11/11 23:06:19 INFO Received push request method=POST path=/41012026/11/11 23:06:19 WARN Force mode enabled - objects will be deleted immediately without grace period41022026/11/11 23:06:19 INFO Vacuumed table table=pending_objects41032026/11/11 23:06:19 INFO Vacuumed table table=pending_objects41042026/11/11 23:06:19 INFO Vacuumed table table=multipart_uploads41052026/11/11 23:06:19 INFO Aborted multipart uploads count=0 kept=041062026/11/11 23:06:19 INFO Vacuumed table table=closures41072026/11/11 23:06:19 WARN Force mode enabled - objects will be deleted immediately without grace period41082026/11/11 23:06:19 INFO Vacuumed table table=multipart_uploads41092026/11/11 23:06:19 INFO Vacuumed table table=multipart_uploads41102026/11/11 23:06:19 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=041112026/11/11 23:06:19 INFO Vacuumed table table=objects41122026/11/11 23:06:19 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=041132026/11/11 23:06:19 INFO Vacuumed table table=closures41142026/11/11 23:06:19 INFO Received complete push request method=POST path=/41152026/11/11 23:06:19 INFO Vacuumed table table=closures41162026/11/11 23:06:19 INFO Vacuumed table table=pending_closures41172026/11/11 23:06:19 INFO Aborted multipart uploads count=0 kept=041182026/11/11 23:06:19 INFO Vacuumed table table=objects41192026/11/11 23:06:19 INFO Completed push id=21 objects=26 duration=584.291µs41202026/11/11 23:06:19 INFO Vacuumed table table=objects41212026/11/11 23:06:19 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=041222026/11/11 23:06:19 INFO Vacuumed table table=pending_objects41232026/11/11 23:06:19 INFO Vacuumed table table=multipart_uploads41242026/11/11 23:06:19 INFO Vacuumed table table=pending_closures41252026/11/11 23:06:19 INFO Vacuumed table table=pending_closures41262026/11/11 23:06:19 INFO Received push request method=POST path=/41272026/11/11 23:06:19 INFO Received uploads request method=POST path=/41282026/11/11 23:06:19 INFO Vacuumed table table=closures41292026/11/11 23:06:19 INFO Vacuumed table table=pending_objects41302026/11/11 23:06:19 INFO Vacuumed table table=multipart_uploads41312026/11/11 23:06:19 INFO Vacuumed table table=objects41322026/11/11 23:06:19 INFO Vacuumed table table=pending_objects41332026/11/11 23:06:19 INFO Received push request method=POST path=/41342026/11/11 23:06:19 INFO Vacuumed table table=multipart_uploads41352026/11/11 23:06:19 INFO Vacuumed table table=closures41362026/11/11 23:06:19 INFO Received complete upload request method=POST path=/41372026/11/11 23:06:19 INFO Vacuumed table table=closures41382026/11/11 23:06:19 INFO Received uploads request method=POST path=/41392026/11/11 23:06:19 INFO Vacuumed table table=objects41402026/11/11 23:06:19 INFO Vacuumed table table=objects41412026/11/11 23:06:19 INFO Received uploads request method=POST path=/41422026/11/11 23:06:19 INFO Received uploads request method=POST path=/41432026/11/11 23:06:19 INFO Received push request method=POST path=/41442026/11/11 23:06:19 INFO Received uploads request method=POST path=/41452026/11/11 23:06:19 INFO Completed upload id=2 objects=26 duration=17.10725ms41462026/11/11 23:06:19 INFO Received uploads request method=POST path=/41472026/11/11 23:06:19 INFO Received uploads request method=POST path=/41482026/11/11 23:06:19 INFO Received uploads request method=POST path=/41492026/11/11 23:06:19 INFO Received push request method=POST path=/41502026/11/11 23:06:19 INFO Received complete upload request method=POST path=/41512026/11/11 23:06:19 INFO Completed upload id=28 objects=17 duration=823.709µs41522026/11/11 23:06:19 INFO Received push request method=POST path=/41532026/11/11 23:06:19 INFO Received complete upload request method=POST path=/41542026/11/11 23:06:19 INFO Received uploads request method=POST path=/41552026/11/11 23:06:19 INFO Received push request method=POST path=/41562026/11/11 23:06:19 INFO Received complete push request method=POST path=/41572026/11/11 23:06:19 INFO Aborted multipart uploads count=0 kept=041582026/11/11 23:06:19 INFO Completed push id=29 objects=2 duration=221.709µs41592026/11/11 23:06:19 INFO Completed upload id=25 objects=6 duration=831.542µs41602026/11/11 23:06:19 INFO Received push request method=POST path=/41612026/11/11 23:06:19 WARN Force mode enabled - objects will be deleted immediately without grace period41622026/11/11 23:06:19 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=041632026/11/11 23:06:19 INFO Received complete push request method=POST path=/41642026/11/11 23:06:19 INFO Received push request method=POST path=/41652026/11/11 23:06:19 INFO Aborted multipart uploads count=0 kept=041662026/11/11 23:06:19 INFO Vacuumed table table=pending_closures41672026/11/11 23:06:19 INFO Received push request method=POST path=/41682026/11/11 23:06:19 INFO Completed push id=31 objects=6 duration=277.792µs41692026/11/11 23:06:19 WARN Force mode enabled - objects will be deleted immediately without grace period41702026/11/11 23:06:19 INFO Vacuumed table table=pending_objects41712026/11/11 23:06:19 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=041722026/11/11 23:06:19 INFO Received complete push request method=POST path=/41732026/11/11 23:06:19 INFO Received uploads request method=POST path=/41742026/11/11 23:06:19 INFO Vacuumed table table=multipart_uploads41752026/11/11 23:06:19 INFO Received push request method=POST path=/41762026/11/11 23:06:19 INFO Vacuumed table table=closures41772026/11/11 23:06:19 INFO Received complete push request method=POST path=/41782026/11/11 23:06:19 INFO Completed push id=32 objects=9 duration=621.875µs41792026/11/11 23:06:19 INFO Received complete push request method=POST path=/41802026/11/11 23:06:19 INFO Aborted multipart uploads count=0 kept=041812026/11/11 23:06:19 INFO Vacuumed table table=objects41822026/11/11 23:06:19 INFO Completed push id=7 objects=7 duration=448.709µs41832026/11/11 23:06:19 INFO Completed push id=11 objects=9 duration=430.666µs41842026/11/11 23:06:19 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=1 objects-deleted-after-grace-period=0 objects-failed-to-delete=041852026/11/11 23:06:19 INFO Vacuumed table table=pending_closures41862026/11/11 23:06:19 INFO Vacuumed table table=pending_closures41872026/11/11 23:06:19 INFO Received complete push request method=POST path=/41882026/11/11 23:06:19 INFO Received uploads request method=POST path=/41892026/11/11 23:06:19 INFO Completed push id=12 objects=6 duration=311.75µs41902026/11/11 23:06:19 INFO Vacuumed table table=pending_objects41912026/11/11 23:06:19 INFO Vacuumed table table=pending_objects41922026/11/11 23:06:19 INFO Aborted multipart uploads count=0 kept=041932026/11/11 23:06:19 INFO Vacuumed table table=multipart_uploads41942026/11/11 23:06:19 INFO Vacuumed table table=multipart_uploads41952026/11/11 23:06:19 INFO Received complete push request method=POST path=/41962026/11/11 23:06:19 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=041972026/11/11 23:06:19 INFO Vacuumed table table=closures41982026/11/11 23:06:19 INFO Received complete upload request method=POST path=/41992026/11/11 23:06:19 INFO Completed push id=16 objects=27 duration=553.833µs42002026/11/11 23:06:19 INFO Vacuumed table table=pending_closures42012026/11/11 23:06:19 INFO Vacuumed table table=objects42022026/11/11 23:06:19 INFO Completed upload id=16 objects=17 duration=681.666µs42032026/11/11 23:06:19 INFO Received uploads request method=POST path=/42042026/11/11 23:06:19 INFO Vacuumed table table=pending_objects42052026/11/11 23:06:19 INFO Vacuumed table table=multipart_uploads42062026/11/11 23:06:19 INFO Aborted multipart uploads count=0 kept=042072026/11/11 23:06:19 INFO Received push request method=POST path=/42082026/11/11 23:06:19 INFO Received complete upload request method=POST path=/42092026/11/11 23:06:19 INFO Vacuumed table table=closures42102026/11/11 23:06:19 INFO Received complete push request method=POST path=/42112026/11/11 23:06:19 WARN Force mode enabled - objects will be deleted immediately without grace period42122026/11/11 23:06:19 INFO Completed upload id=33 objects=9 duration=279.792µs42132026/11/11 23:06:19 INFO Vacuumed table table=objects42142026/11/11 23:06:19 INFO Vacuumed table table=closures42152026/11/11 23:06:19 INFO Completed push id=15 objects=24 duration=572.5µs42162026/11/11 23:06:19 INFO Vacuumed table table=objects42172026/11/11 23:06:19 INFO Aborted multipart uploads count=0 kept=042182026/11/11 23:06:19 INFO Received complete upload request method=POST path=/42192026/11/11 23:06:19 WARN Force mode enabled - objects will be deleted immediately without grace period42202026/11/11 23:06:19 INFO Received push request method=POST path=/42212026/11/11 23:06:19 INFO Completed upload id=19 objects=2 duration=362.167µs42222026/11/11 23:06:19 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=042232026/11/11 23:06:19 INFO Received complete upload request method=POST path=/42242026/11/11 23:06:19 INFO Received push request method=POST path=/42252026/11/11 23:06:19 INFO Completed upload id=24 objects=7 duration=361.417µs42262026/11/11 23:06:19 INFO Received complete push request method=POST path=/42272026/11/11 23:06:19 INFO Received push request method=POST path=/42282026/11/11 23:06:19 INFO Completed push id=26 objects=3 duration=221.584µs42292026/11/11 23:06:19 INFO Vacuumed table table=pending_closures42302026/11/11 23:06:19 INFO Received complete upload request method=POST path=/42312026/11/11 23:06:19 INFO Completed upload id=28 objects=8 duration=173.667µs42322026/11/11 23:06:19 INFO Received complete upload request method=POST path=/42332026/11/11 23:06:19 INFO Completed upload id=33 objects=5 duration=1.044667ms42342026/11/11 23:06:19 INFO Received complete upload request method=POST path=/42352026/11/11 23:06:19 INFO Vacuumed table table=pending_objects42362026/11/11 23:06:19 INFO Received push request method=POST path=/42372026/11/11 23:06:19 INFO Vacuumed table table=multipart_uploads42382026/11/11 23:06:19 INFO Completed upload id=29 objects=10 duration=355.083µs42392026/11/11 23:06:19 INFO Received push request method=POST path=/42402026/11/11 23:06:19 INFO Vacuumed table table=closures42412026/11/11 23:06:19 INFO Vacuumed table table=objects42422026/11/11 23:06:19 INFO Received complete upload request method=POST path=/42432026/11/11 23:06:19 INFO Received push request method=POST path=/42442026/11/11 23:06:19 INFO Completed upload id=30 objects=20 duration=828.167µs42452026/11/11 23:06:19 INFO Received complete push request method=POST path=/42462026/11/11 23:06:19 INFO Completed push id=31 objects=11 duration=306.25µs42472026/11/11 23:06:19 INFO Received complete push request method=POST path=/42482026/11/11 23:06:19 INFO Completed push id=18 objects=10 duration=603µs42492026/11/11 23:06:19 INFO Received complete upload request method=POST path=/42502026/11/11 23:06:19 INFO Received uploads request method=POST path=/42512026/11/11 23:06:19 INFO Completed upload id=32 objects=2 duration=269.625µs42522026/11/11 23:06:19 INFO Aborted multipart uploads count=0 kept=042532026/11/11 23:06:19 WARN Force mode enabled - objects will be deleted immediately without grace period42542026/11/11 23:06:19 INFO Received complete push request method=POST path=/42552026/11/11 23:06:19 INFO Garbage collection completed failed-uploads-deleted=5 old-closures-deleted=2 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=042562026/11/11 23:06:19 INFO Received uploads request method=POST path=/42572026/11/11 23:06:19 INFO Received complete push request method=POST path=/42582026/11/11 23:06:19 INFO Completed push id=19 objects=8 duration=1.110416ms42592026/11/11 23:06:19 INFO Completed push id=33 objects=3 duration=292.375µs42602026/11/11 23:06:20 INFO Received uploads request method=POST path=/42612026/11/11 23:06:20 INFO Received push request method=POST path=/42622026/11/11 23:06:20 INFO Received complete upload request method=POST path=/42632026/11/11 23:06:20 INFO Aborted multipart uploads count=0 kept=042642026/11/11 23:06:20 INFO Received push request method=POST path=/42652026/11/11 23:06:20 INFO Completed upload id=34 objects=3 duration=188.125µs42662026/11/11 23:06:20 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=042672026/11/11 23:06:20 INFO Received complete push request method=POST path=/42682026/11/11 23:06:20 INFO Vacuumed table table=pending_closures42692026/11/11 23:06:20 INFO Received push request method=POST path=/42702026/11/11 23:06:20 INFO Vacuumed table table=pending_closures42712026/11/11 23:06:20 INFO Aborted multipart uploads count=0 kept=042722026/11/11 23:06:20 INFO Completed push id=15 objects=24 duration=1.749083ms42732026/11/11 23:06:20 INFO Received uploads request method=POST path=/42742026/11/11 23:06:20 WARN Force mode enabled - objects will be deleted immediately without grace period42752026/11/11 23:06:20 INFO Vacuumed table table=pending_objects42762026/11/11 23:06:20 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=042772026/11/11 23:06:20 INFO Received uploads request method=POST path=/42782026/11/11 23:06:20 INFO Received uploads request method=POST path=/42792026/11/11 23:06:20 INFO Vacuumed table table=multipart_uploads42802026/11/11 23:06:20 INFO Received uploads request method=POST path=/42812026/11/11 23:06:20 INFO Vacuumed table table=pending_objects42822026/11/11 23:06:20 INFO Received push request method=POST path=/42832026/11/11 23:06:20 INFO Vacuumed table table=multipart_uploads42842026/11/11 23:06:20 INFO Vacuumed table table=closures42852026/11/11 23:06:20 INFO Vacuumed table table=pending_closures42862026/11/11 23:06:20 INFO Vacuumed table table=objects42872026/11/11 23:06:20 INFO Received uploads request method=POST path=/42882026/11/11 23:06:20 INFO Received push request method=POST path=/42892026/11/11 23:06:20 INFO Vacuumed table table=closures42902026/11/11 23:06:20 INFO Aborted multipart uploads count=0 kept=042912026/11/11 23:06:20 INFO Received complete push request method=POST path=/42922026/11/11 23:06:20 WARN Force mode enabled - objects will be deleted immediately without grace period42932026/11/11 23:06:20 INFO Aborted multipart uploads count=0 kept=042942026/11/11 23:06:20 INFO Vacuumed table table=pending_objects42952026/11/11 23:06:20 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=042962026/11/11 23:06:20 WARN Force mode enabled - objects will be deleted immediately without grace period42972026/11/11 23:06:20 INFO Completed push id=2 objects=25 duration=1.046958ms42982026/11/11 23:06:20 INFO Vacuumed table table=multipart_uploads42992026/11/11 23:06:20 INFO Vacuumed table table=pending_closures43002026/11/11 23:06:20 INFO Vacuumed table table=objects43012026/11/11 23:06:20 INFO Vacuumed table table=closures43022026/11/11 23:06:20 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=043032026/11/11 23:06:20 INFO Vacuumed table table=objects43042026/11/11 23:06:20 INFO Vacuumed table table=pending_objects43052026/11/11 23:06:20 INFO Vacuumed table table=pending_closures43062026/11/11 23:06:20 INFO Received push request method=POST path=/43072026/11/11 23:06:20 INFO Vacuumed table table=multipart_uploads43082026/11/11 23:06:20 INFO Aborted multipart uploads count=0 kept=043092026/11/11 23:06:20 INFO Received push request method=POST path=/43102026/11/11 23:06:20 INFO Vacuumed table table=closures43112026/11/11 23:06:20 INFO Vacuumed table table=pending_objects43122026/11/11 23:06:20 INFO Vacuumed table table=objects43132026/11/11 23:06:20 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=043142026/11/11 23:06:20 INFO Vacuumed table table=multipart_uploads43152026/11/11 23:06:20 INFO Received complete push request method=POST path=/43162026/11/11 23:06:20 INFO Received push request method=POST path=/43172026/11/11 23:06:20 INFO Vacuumed table table=closures43182026/11/11 23:06:20 INFO Received complete upload request method=POST path=/43192026/11/11 23:06:20 INFO Completed push id=9 objects=9 duration=6.785ms43202026/11/11 23:06:20 INFO Vacuumed table table=objects43212026/11/11 23:06:20 INFO Completed upload id=6 objects=6 duration=508.875µs43222026/11/11 23:06:20 INFO Received push request method=POST path=/43232026/11/11 23:06:20 INFO Received push request method=POST path=/43242026/11/11 23:06:20 INFO Vacuumed table table=pending_closures43252026/11/11 23:06:20 INFO Received uploads request method=POST path=/43262026/11/11 23:06:20 INFO Aborted multipart uploads count=0 kept=043272026/11/11 23:06:20 WARN Force mode enabled - objects will be deleted immediately without grace period43282026/11/11 23:06:20 INFO Aborted multipart uploads count=0 kept=043292026/11/11 23:06:20 INFO Aborted multipart uploads count=0 kept=043302026/11/11 23:06:20 INFO Received uploads request method=POST path=/43312026/11/11 23:06:20 INFO Received complete push request method=POST path=/43322026/11/11 23:06:20 INFO Garbage collection completed failed-uploads-deleted=3 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=043332026/11/11 23:06:20 WARN Force mode enabled - objects will be deleted immediately without grace period43342026/11/11 23:06:20 INFO Completed push id=13 objects=22 duration=449.041µs43352026/11/11 23:06:20 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=043362026/11/11 23:06:20 INFO Received uploads request method=POST path=/43372026/11/11 23:06:20 INFO Vacuumed table table=pending_closures43382026/11/11 23:06:20 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=043392026/11/11 23:06:20 INFO Vacuumed table table=pending_objects43402026/11/11 23:06:20 INFO Vacuumed table table=pending_closures43412026/11/11 23:06:20 INFO Vacuumed table table=multipart_uploads43422026/11/11 23:06:20 INFO Vacuumed table table=pending_objects43432026/11/11 23:06:20 INFO Vacuumed table table=pending_closures43442026/11/11 23:06:20 INFO Received push request method=POST path=/43452026/11/11 23:06:20 INFO Received complete push request method=POST path=/43462026/11/11 23:06:20 INFO Vacuumed table table=multipart_uploads43472026/11/11 23:06:20 INFO Completed push id=21 objects=6 duration=6.97425ms43482026/11/11 23:06:20 INFO Vacuumed table table=closures43492026/11/11 23:06:20 INFO Vacuumed table table=objects43502026/11/11 23:06:20 INFO Received complete upload request method=POST path=/43512026/11/11 23:06:20 INFO Vacuumed table table=pending_objects43522026/11/11 23:06:20 INFO Received complete upload request method=POST path=/43532026/11/11 23:06:20 INFO Received uploads request method=POST path=/43542026/11/11 23:06:20 INFO Vacuumed table table=pending_objects43552026/11/11 23:06:20 INFO Vacuumed table table=closures43562026/11/11 23:06:20 INFO Completed upload id=21 objects=8 duration=353.708µs43572026/11/11 23:06:20 INFO Vacuumed table table=multipart_uploads43582026/11/11 23:06:20 INFO Vacuumed table table=multipart_uploads43592026/11/11 23:06:20 INFO Completed upload id=22 objects=7 duration=518.541µs43602026/11/11 23:06:20 INFO Vacuumed table table=closures43612026/11/11 23:06:20 INFO Received push request method=POST path=/43622026/11/11 23:06:20 INFO Vacuumed table table=closures43632026/11/11 23:06:20 INFO Vacuumed table table=objects43642026/11/11 23:06:20 INFO Received complete push request method=POST path=/43652026/11/11 23:06:20 INFO Received complete push request method=POST path=/43662026/11/11 23:06:20 INFO Received uploads request method=POST path=/43672026/11/11 23:06:20 INFO Vacuumed table table=objects43682026/11/11 23:06:20 INFO Completed push id=22 objects=6 duration=373.959µs43692026/11/11 23:06:20 INFO Completed push id=24 objects=4 duration=401.625µs43702026/11/11 23:06:20 INFO Received push request method=POST path=/43712026/11/11 23:06:20 INFO Vacuumed table table=objects43722026/11/11 23:06:20 INFO Aborted multipart uploads count=0 kept=043732026/11/11 23:06:20 INFO Received complete push request method=POST path=/43742026/11/11 23:06:20 INFO Received complete push request method=POST path=/43752026/11/11 23:06:20 INFO Completed push id=25 objects=9 duration=359.584µs43762026/11/11 23:06:20 INFO Completed push id=24 objects=8 duration=524.25µs43772026/11/11 23:06:20 INFO Received uploads request method=POST path=/43782026/11/11 23:06:20 WARN Force mode enabled - objects will be deleted immediately without grace period43792026/11/11 23:06:20 INFO Received push request method=POST path=/43802026/11/11 23:06:20 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=043812026/11/11 23:06:20 INFO Received complete upload request method=POST path=/43822026/11/11 23:06:20 INFO Received complete upload request method=POST path=/43832026/11/11 23:06:20 INFO Received uploads request method=POST path=/43842026/11/11 23:06:20 INFO Vacuumed table table=pending_closures43852026/11/11 23:06:20 INFO Received push request method=POST path=/43862026/11/11 23:06:20 INFO Completed upload id=26 objects=3 duration=397.167µs43872026/11/11 23:06:20 INFO Completed upload id=25 objects=9 duration=548.041µs43882026/11/11 23:06:20 INFO Aborted multipart uploads count=0 kept=043892026/11/11 23:06:20 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=043902026/11/11 23:06:20 INFO Vacuumed table table=pending_objects43912026/11/11 23:06:20 INFO Received complete upload request method=POST path=/43922026/11/11 23:06:20 INFO Received complete upload request method=POST path=/43932026/11/11 23:06:20 INFO Vacuumed table table=pending_closures43942026/11/11 23:06:20 INFO Vacuumed table table=multipart_uploads43952026/11/11 23:06:20 INFO Completed upload id=27 objects=3 duration=332.208µs43962026/11/11 23:06:20 INFO Completed upload id=21 objects=25 duration=451.166µs43972026/11/11 23:06:20 INFO Received uploads request method=POST path=/43982026/11/11 23:06:20 INFO Vacuumed table table=pending_objects43992026/11/11 23:06:20 INFO Received complete upload request method=POST path=/44002026/11/11 23:06:20 INFO Vacuumed table table=closures44012026/11/11 23:06:20 INFO Received complete upload request method=POST path=/44022026/11/11 23:06:20 INFO Received uploads request method=POST path=/44032026/11/11 23:06:20 INFO Vacuumed table table=multipart_uploads44042026/11/11 23:06:20 INFO Completed upload id=28 objects=6 duration=403.583µs44052026/11/11 23:06:20 INFO Completed upload id=23 objects=18 duration=5.6225ms44062026/11/11 23:06:20 INFO Vacuumed table table=closures44072026/11/11 23:06:20 INFO Vacuumed table table=objects44082026/11/11 23:06:20 INFO Vacuumed table table=objects44092026/11/11 23:06:20 INFO Received complete push request method=POST path=/44102026/11/11 23:06:20 INFO Completed push id=30 objects=4 duration=438.625µs44112026/11/11 23:06:20 INFO Received uploads request method=POST path=/44122026/11/11 23:06:20 INFO Received complete push request method=POST path=/44132026/11/11 23:06:20 INFO Received push request method=POST path=/44142026/11/11 23:06:20 INFO Received push request method=POST path=/44152026/11/11 23:06:20 INFO Received complete push request method=POST path=/44162026/11/11 23:06:20 INFO Completed push id=31 objects=7 duration=372.833µs44172026/11/11 23:06:20 INFO Received complete upload request method=POST path=/44182026/11/11 23:06:20 INFO Received uploads request method=POST path=/44192026/11/11 23:06:20 INFO Received complete upload request method=POST path=/44202026/11/11 23:06:20 INFO Completed push id=4 objects=4 duration=867.292µs44212026/11/11 23:06:20 INFO Completed upload id=27 objects=7 duration=228.792µs44222026/11/11 23:06:20 INFO Completed upload id=22 objects=22 duration=245.333µs44232026/11/11 23:06:20 INFO Received complete upload request method=POST path=/44242026/11/11 23:06:20 INFO Aborted multipart uploads count=0 kept=044252026/11/11 23:06:20 INFO Completed upload id=32 objects=5 duration=546µs44262026/11/11 23:06:20 WARN Force mode enabled - objects will be deleted immediately without grace period44272026/11/11 23:06:20 INFO Received complete upload request method=POST path=/44282026/11/11 23:06:20 INFO Received push request method=POST path=/44292026/11/11 23:06:20 INFO Completed upload id=28 objects=3 duration=292.416µs44302026/11/11 23:06:20 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=044312026/11/11 23:06:20 INFO Received complete push request method=POST path=/44322026/11/11 23:06:20 INFO Vacuumed table table=pending_closures44332026/11/11 23:06:20 INFO Completed push id=26 objects=5 duration=487.625µs44342026/11/11 23:06:20 INFO Vacuumed table table=pending_objects44352026/11/11 23:06:20 INFO Vacuumed table table=multipart_uploads44362026/11/11 23:06:20 INFO Received complete upload request method=POST path=/44372026/11/11 23:06:20 INFO Vacuumed table table=closures44382026/11/11 23:06:20 INFO Completed upload id=24 objects=14 duration=212.791µs44392026/11/11 23:06:20 INFO Vacuumed table table=objects44402026/11/11 23:06:20 INFO Received complete push request method=POST path=/44412026/11/11 23:06:20 INFO Completed push id=19 objects=3 duration=305.833µs44422026/11/11 23:06:20 INFO Aborted multipart uploads count=0 kept=044432026/11/11 23:06:20 INFO Received complete push request method=POST path=/44442026/11/11 23:06:20 WARN Force mode enabled - objects will be deleted immediately without grace period44452026/11/11 23:06:20 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=044462026/11/11 23:06:20 INFO Received uploads request method=POST path=/44472026/11/11 23:06:20 INFO Vacuumed table table=pending_closures44482026/11/11 23:06:20 INFO Completed push id=3 objects=21 duration=9.800833ms44492026/11/11 23:06:20 INFO Received complete push request method=POST path=/44502026/11/11 23:06:20 INFO Vacuumed table table=pending_objects44512026/11/11 23:06:20 INFO Received uploads request method=POST path=/44522026/11/11 23:06:20 INFO Vacuumed table table=multipart_uploads44532026/11/11 23:06:20 INFO Received uploads request method=POST path=/44542026/11/11 23:06:20 INFO Completed push id=29 objects=23 duration=551.5µs44552026/11/11 23:06:20 INFO Vacuumed table table=closures44562026/11/11 23:06:20 INFO Received push request method=POST path=/44572026/11/11 23:06:20 INFO Received complete push request method=POST path=/44582026/11/11 23:06:20 INFO Received complete upload request method=POST path=/44592026/11/11 23:06:20 INFO Vacuumed table table=objects44602026/11/11 23:06:20 INFO Completed push id=30 objects=6 duration=272.292µs44612026/11/11 23:06:20 INFO Received complete push request method=POST path=/44622026/11/11 23:06:20 INFO Received uploads request method=POST path=/44632026/11/11 23:06:20 INFO Completed upload id=25 objects=4 duration=211.166µs44642026/11/11 23:06:20 INFO Completed push id=17 objects=22 duration=561.459µs44652026/11/11 23:06:20 INFO Received push request method=POST path=/44662026/11/11 23:06:20 INFO Received push request method=POST path=/44672026/11/11 23:06:20 INFO Received uploads request method=POST path=/44682026/11/11 23:06:20 INFO Received complete push request method=POST path=/44692026/11/11 23:06:20 INFO Completed push id=6 objects=6 duration=591.125µs44702026/11/11 23:06:20 INFO Received complete push request method=POST path=/44712026/11/11 23:06:20 INFO Completed push id=15 objects=5 duration=666.333µs44722026/11/11 23:06:20 INFO Received push request method=POST path=/44732026/11/11 23:06:20 INFO Received complete push request method=POST path=/44742026/11/11 23:06:20 INFO Received uploads request method=POST path=/44752026/11/11 23:06:20 INFO Completed push id=20 objects=8 duration=451.083µs44762026/11/11 23:06:20 INFO Received push request method=POST path=/44772026/11/11 23:06:20 INFO Received uploads request method=POST path=/44782026/11/11 23:06:20 INFO Received push request method=POST path=/44792026/11/11 23:06:20 INFO Received uploads request method=POST path=/44802026/11/11 23:06:20 INFO Received complete push request method=POST path=/44812026/11/11 23:06:20 INFO Completed push id=27 objects=11 duration=413.917µs44822026/11/11 23:06:20 INFO Received complete upload request method=POST path=/44832026/11/11 23:06:20 INFO Received complete push request method=POST path=/44842026/11/11 23:06:20 INFO Completed upload id=29 objects=26 duration=214.209µs44852026/11/11 23:06:20 INFO Aborted multipart uploads count=0 kept=044862026/11/11 23:06:20 INFO Completed push id=33 objects=3 duration=319.542µs44872026/11/11 23:06:20 WARN Force mode enabled - objects will be deleted immediately without grace period44882026/11/11 23:06:20 INFO Garbage collection completed failed-uploads-deleted=4 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=044892026/11/11 23:06:20 INFO Received complete push request method=POST path=/44902026/11/11 23:06:20 INFO Vacuumed table table=pending_closures44912026/11/11 23:06:20 INFO Received complete push request method=POST path=/44922026/11/11 23:06:20 INFO Completed push id=34 objects=6 duration=293.583µs44932026/11/11 23:06:20 INFO Completed push id=30 objects=8 duration=343.875µs44942026/11/11 23:06:20 INFO Vacuumed table table=pending_objects44952026/11/11 23:06:20 INFO Received complete push request method=POST path=/44962026/11/11 23:06:20 INFO Received complete upload request method=POST path=/44972026/11/11 23:06:20 INFO Vacuumed table table=multipart_uploads44982026/11/11 23:06:20 INFO Completed upload id=31 objects=5 duration=279.666µs44992026/11/11 23:06:20 INFO Completed push id=35 objects=8 duration=13.809958ms45002026/11/11 23:06:20 INFO Vacuumed table table=closures45012026/11/11 23:06:20 INFO Received complete push request method=POST path=/45022026/11/11 23:06:20 INFO Vacuumed table table=objects45032026/11/11 23:06:20 INFO Received complete upload request method=POST path=/45042026/11/11 23:06:20 INFO Completed upload id=36 objects=9 duration=264.708µs45052026/11/11 23:06:20 INFO Completed push id=32 objects=3 duration=342.25µs45062026/11/11 23:06:20 INFO Aborted multipart uploads count=0 kept=045072026/11/11 23:06:20 INFO Aborted multipart uploads count=0 kept=045082026/11/11 23:06:20 WARN Force mode enabled - objects will be deleted immediately without grace period45092026/11/11 23:06:20 INFO Received uploads request method=POST path=/45102026/11/11 23:06:20 WARN Force mode enabled - objects will be deleted immediately without grace period45112026/11/11 23:06:20 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=045122026/11/11 23:06:20 INFO Received complete upload request method=POST path=/45132026/11/11 23:06:20 INFO Completed upload id=12 objects=6 duration=477.209µs45142026/11/11 23:06:20 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=045152026/11/11 23:06:20 INFO Received complete push request method=POST path=/45162026/11/11 23:06:20 INFO Vacuumed table table=pending_closures45172026/11/11 23:06:20 INFO Completed push id=17 objects=3 duration=6.316667ms45182026/11/11 23:06:20 INFO Vacuumed table table=pending_closures45192026/11/11 23:06:20 INFO Vacuumed table table=pending_objects45202026/11/11 23:06:20 INFO Vacuumed table table=multipart_uploads45212026/11/11 23:06:20 INFO Vacuumed table table=pending_objects45222026/11/11 23:06:20 INFO Received complete upload request method=POST path=/45232026/11/11 23:06:20 INFO Vacuumed table table=closures45242026/11/11 23:06:20 INFO Vacuumed table table=multipart_uploads45252026/11/11 23:06:20 INFO Completed upload id=23 objects=16 duration=6.12025ms45262026/11/11 23:06:20 INFO Vacuumed table table=objects45272026/11/11 23:06:20 INFO Vacuumed table table=closures45282026/11/11 23:06:20 INFO Aborted multipart uploads count=0 kept=045292026/11/11 23:06:20 INFO Vacuumed table table=objects45302026/11/11 23:06:20 INFO Received complete push request method=POST path=/45312026/11/11 23:06:20 WARN Force mode enabled - objects will be deleted immediately without grace period45322026/11/11 23:06:20 INFO Received complete push request method=POST path=/45332026/11/11 23:06:20 INFO Completed push id=14 objects=3 duration=1.434042ms45342026/11/11 23:06:20 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=045352026/11/11 23:06:20 INFO Vacuumed table table=pending_closures45362026/11/11 23:06:20 INFO Completed push id=23 objects=5 duration=5.226583ms45372026/11/11 23:06:20 INFO Vacuumed table table=pending_objects45382026/11/11 23:06:20 INFO Vacuumed table table=multipart_uploads45392026/11/11 23:06:20 INFO Received complete upload request method=POST path=/45402026/11/11 23:06:20 INFO Vacuumed table table=closures45412026/11/11 23:06:20 INFO Completed upload id=24 objects=3 duration=6.47975ms45422026/11/11 23:06:20 INFO Vacuumed table table=objects45432026/11/11 23:06:20 INFO Received complete push request method=POST path=/45442026/11/11 23:06:20 INFO Received uploads request method=POST path=/45452026/11/11 23:06:20 INFO Completed push id=25 objects=4 duration=524.791µs45462026/11/11 23:06:20 INFO Received complete upload request method=POST path=/45472026/11/11 23:06:21 INFO Completed upload id=14 objects=16 duration=1.137458ms45482026/11/11 23:06:21 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=8 objects-deleted-after-grace-period=8 objects-failed-to-delete=045492026/11/11 23:06:21 INFO Received complete push request method=POST path=/45502026/11/11 23:06:21 INFO Vacuumed table table=pending_closures45512026/11/11 23:06:21 INFO Vacuumed table table=pending_objects45522026/11/11 23:06:21 INFO Completed push id=21 objects=9 duration=5.743584ms45532026/11/11 23:06:21 INFO Vacuumed table table=multipart_uploads45542026/11/11 23:06:21 INFO Received complete push request method=POST path=/45552026/11/11 23:06:21 INFO Vacuumed table table=closures45562026/11/11 23:06:21 INFO Completed push id=7 objects=27 duration=570.916µs45572026/11/11 23:06:21 INFO Received uploads request method=POST path=/45582026/11/11 23:06:21 INFO Received complete upload request method=POST path=/45592026/11/11 23:06:21 INFO Vacuumed table table=objects45602026/11/11 23:06:21 INFO Completed upload id=34 objects=24 duration=508.917µs45612026/11/11 23:06:21 INFO Received push request method=POST path=/45622026/11/11 23:06:21 INFO Aborted multipart uploads count=0 kept=045632026/11/11 23:06:21 WARN Force mode enabled - objects will be deleted immediately without grace period45642026/11/11 23:06:21 INFO Received push request method=POST path=/45652026/11/11 23:06:21 INFO Aborted multipart uploads count=0 kept=045662026/11/11 23:06:21 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=045672026/11/11 23:06:21 WARN Force mode enabled - objects will be deleted immediately without grace period45682026/11/11 23:06:21 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=045692026/11/11 23:06:21 INFO Vacuumed table table=pending_closures45702026/11/11 23:06:21 INFO Vacuumed table table=pending_objects45712026/11/11 23:06:21 INFO Vacuumed table table=pending_closures45722026/11/11 23:06:21 INFO Vacuumed table table=multipart_uploads45732026/11/11 23:06:21 INFO Vacuumed table table=closures45742026/11/11 23:06:21 INFO Vacuumed table table=objects45752026/11/11 23:06:21 INFO Received complete upload request method=POST path=/45762026/11/11 23:06:21 INFO Vacuumed table table=pending_objects45772026/11/11 23:06:21 INFO Completed upload id=15 objects=3 duration=7.140375ms45782026/11/11 23:06:21 INFO Vacuumed table table=multipart_uploads45792026/11/11 23:06:21 INFO Vacuumed table table=closures45802026/11/11 23:06:21 INFO Received complete upload request method=POST path=/45812026/11/11 23:06:21 INFO Vacuumed table table=objects45822026/11/11 23:06:21 INFO Completed upload id=13 objects=8 duration=370.875µs45832026/11/11 23:06:21 INFO Received push request method=POST path=/45842026/11/11 23:06:21 INFO Received uploads request method=POST path=/45852026/11/11 23:06:21 INFO Received uploads request method=POST path=/45862026/11/11 23:06:21 INFO Received push request method=POST path=/45872026/11/11 23:06:21 INFO Received complete upload request method=POST path=/45882026/11/11 23:06:21 INFO Completed upload id=3 objects=9 duration=479.709µs45892026/11/11 23:06:21 INFO Received complete push request method=POST path=/45902026/11/11 23:06:21 INFO Completed push id=17 objects=11 duration=676.291µs45912026/11/11 23:06:21 INFO Received push request method=POST path=/45922026/11/11 23:06:21 INFO Received push request method=POST path=/45932026/11/11 23:06:21 INFO Received complete push request method=POST path=/45942026/11/11 23:06:21 INFO Completed push id=5 objects=6 duration=460.917µs45952026/11/11 23:06:21 INFO Received complete upload request method=POST path=/45962026/11/11 23:06:21 INFO Completed upload id=26 objects=6 duration=382.125µs45972026/11/11 23:06:21 INFO Aborted multipart uploads count=0 kept=045982026/11/11 23:06:21 INFO Received uploads request method=POST path=/45992026/11/11 23:06:21 WARN Force mode enabled - objects will be deleted immediately without grace period46002026/11/11 23:06:21 INFO Received complete upload request method=POST path=/46012026/11/11 23:06:21 INFO Completed upload id=29 objects=5 duration=310.334µs46022026/11/11 23:06:21 INFO Aborted multipart uploads count=0 kept=046032026/11/11 23:06:21 WARN Force mode enabled - objects will be deleted immediately without grace period46042026/11/11 23:06:21 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=046052026/11/11 23:06:21 INFO Vacuumed table table=pending_closures46062026/11/11 23:06:21 INFO Vacuumed table table=pending_objects46072026/11/11 23:06:21 INFO Vacuumed table table=multipart_uploads46082026/11/11 23:06:21 INFO Vacuumed table table=closures46092026/11/11 23:06:21 INFO Vacuumed table table=objects46102026/11/11 23:06:21 INFO Received push request method=POST path=/46112026/11/11 23:06:21 INFO Received uploads request method=POST path=/46122026/11/11 23:06:21 INFO Received complete upload request method=POST path=/46132026/11/11 23:06:21 INFO Completed upload id=31 objects=3 duration=642.833µs46142026/11/11 23:06:21 INFO Received complete upload request method=POST path=/46152026/11/11 23:06:21 INFO Received complete push request method=POST path=/46162026/11/11 23:06:21 INFO Completed upload id=22 objects=2 duration=275.541µs46172026/11/11 23:06:21 INFO Completed push id=26 objects=23 duration=307.375µs46182026/11/11 23:06:21 INFO Aborted multipart uploads count=0 kept=046192026/11/11 23:06:21 WARN Force mode enabled - objects will be deleted immediately without grace period46202026/11/11 23:06:21 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=046212026/11/11 23:06:21 INFO Vacuumed table table=pending_closures46222026/11/11 23:06:21 INFO Vacuumed table table=pending_objects46232026/11/11 23:06:21 INFO Vacuumed table table=multipart_uploads46242026/11/11 23:06:21 INFO Vacuumed table table=closures46252026/11/11 23:06:21 INFO Vacuumed table table=objects46262026/11/11 23:06:21 INFO Received complete upload request method=POST path=/46272026/11/11 23:06:21 INFO Completed upload id=18 objects=2 duration=580.375µs46282026/11/11 23:06:21 INFO Received complete upload request method=POST path=/46292026/11/11 23:06:21 INFO Received push request method=POST path=/46302026/11/11 23:06:21 INFO Received complete push request method=POST path=/46312026/11/11 23:06:21 INFO Completed upload id=7 objects=10 duration=429.042µs46322026/11/11 23:06:21 INFO Completed push id=5 objects=28 duration=478.709µs46332026/11/11 23:06:21 INFO Received complete push request method=POST path=/46342026/11/11 23:06:21 INFO Received complete push request method=POST path=/46352026/11/11 23:06:21 INFO Completed push id=17 objects=22 duration=569.584µs46362026/11/11 23:06:21 INFO Completed push id=10 objects=2 duration=673.583µs46372026/11/11 23:06:21 INFO Received uploads request method=POST path=/46382026/11/11 23:06:21 INFO Received push request method=POST path=/46392026/11/11 23:06:21 INFO Received complete push request method=POST path=/46402026/11/11 23:06:21 INFO Completed push id=19 objects=14 duration=454.125µs46412026/11/11 23:06:21 INFO Received uploads request method=POST path=/46422026/11/11 23:06:21 INFO Received complete push request method=POST path=/46432026/11/11 23:06:21 INFO Received complete upload request method=POST path=/46442026/11/11 23:06:21 INFO Completed push id=7 objects=15 duration=931.167µs46452026/11/11 23:06:21 INFO Completed upload id=17 objects=5 duration=272.625µs46462026/11/11 23:06:21 INFO Received complete upload request method=POST path=/46472026/11/11 23:06:21 INFO Completed upload id=13 objects=7 duration=368.375µs46482026/11/11 23:06:21 INFO Received push request method=POST path=/46492026/11/11 23:06:21 INFO Received complete upload request method=POST path=/46502026/11/11 23:06:21 INFO Completed upload id=20 objects=4 duration=302.458µs46512026/11/11 23:06:21 INFO Received push request method=POST path=/46522026/11/11 23:06:21 INFO Received complete push request method=POST path=/46532026/11/11 23:06:21 INFO Received complete upload request method=POST path=/46542026/11/11 23:06:21 INFO Received complete upload request method=POST path=/46552026/11/11 23:06:21 INFO Completed upload id=20 objects=6 duration=246.208µs46562026/11/11 23:06:21 INFO Completed upload id=23 objects=7 duration=6.18925ms46572026/11/11 23:06:21 INFO Completed push id=27 objects=15 duration=6.238166ms46582026/11/11 23:06:21 INFO Received uploads request method=POST path=/46592026/11/11 23:06:21 INFO Received complete upload request method=POST path=/46602026/11/11 23:06:21 INFO Completed upload id=21 objects=2 duration=193.75µs46612026/11/11 23:06:21 INFO Received uploads request method=POST path=/46622026/11/11 23:06:21 INFO Received complete push request method=POST path=/46632026/11/11 23:06:21 INFO Completed push id=19 objects=3 duration=291.334µs46642026/11/11 23:06:21 INFO Aborted multipart uploads count=0 kept=046652026/11/11 23:06:21 WARN Force mode enabled - objects will be deleted immediately without grace period46662026/11/11 23:06:21 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=046672026/11/11 23:06:21 INFO Vacuumed table table=pending_closures46682026/11/11 23:06:21 INFO Vacuumed table table=pending_objects46692026/11/11 23:06:21 INFO Vacuumed table table=multipart_uploads46702026/11/11 23:06:21 INFO Vacuumed table table=closures46712026/11/11 23:06:21 INFO Vacuumed table table=objects46722026/11/11 23:06:21 INFO Received uploads request method=POST path=/46732026/11/11 23:06:21 INFO Received push request method=POST path=/46742026/11/11 23:06:21 INFO Received complete push request method=POST path=/46752026/11/11 23:06:21 INFO Completed push id=24 objects=24 duration=842.292µs46762026/11/11 23:06:21 INFO Aborted multipart uploads count=0 kept=046772026/11/11 23:06:21 WARN Force mode enabled - objects will be deleted immediately without grace period46782026/11/11 23:06:21 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=046792026/11/11 23:06:21 INFO Vacuumed table table=pending_closures46802026/11/11 23:06:21 INFO Vacuumed table table=pending_objects46812026/11/11 23:06:21 INFO Vacuumed table table=multipart_uploads46822026/11/11 23:06:21 INFO Vacuumed table table=closures46832026/11/11 23:06:21 INFO Vacuumed table table=objects46842026/11/11 23:06:21 INFO Received uploads request method=POST path=/46852026/11/11 23:06:21 INFO Received uploads request method=POST path=/46862026/11/11 23:06:21 INFO Received push request method=POST path=/46872026/11/11 23:06:22 INFO Received uploads request method=POST path=/46882026/11/11 23:06:22 INFO Aborted multipart uploads count=0 kept=046892026/11/11 23:06:22 WARN Force mode enabled - objects will be deleted immediately without grace period46902026/11/11 23:06:22 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=046912026/11/11 23:06:22 INFO Received complete push request method=POST path=/46922026/11/11 23:06:22 INFO Vacuumed table table=pending_closures46932026/11/11 23:06:22 INFO Completed push id=20 objects=4 duration=232.417µs46942026/11/11 23:06:22 INFO Vacuumed table table=pending_objects46952026/11/11 23:06:22 INFO Vacuumed table table=multipart_uploads46962026/11/11 23:06:22 INFO Vacuumed table table=closures46972026/11/11 23:06:22 INFO Vacuumed table table=objects46982026/11/11 23:06:22 INFO Received push request method=POST path=/46992026/11/11 23:06:22 INFO Received complete upload request method=POST path=/47002026/11/11 23:06:22 INFO Completed upload id=23 objects=7 duration=839.375µs47012026/11/11 23:06:22 INFO Received complete upload request method=POST path=/47022026/11/11 23:06:22 INFO Completed upload id=26 objects=5 duration=265.75µs47032026/11/11 23:06:22 INFO Received complete push request method=POST path=/47042026/11/11 23:06:22 INFO Completed push id=27 objects=3 duration=533.083µs47052026/11/11 23:06:22 INFO Received complete upload request method=POST path=/47062026/11/11 23:06:22 INFO Completed upload id=28 objects=5 duration=198.167µs47072026/11/11 23:06:22 INFO Received complete push request method=POST path=/47082026/11/11 23:06:22 INFO Received complete upload request method=POST path=/47092026/11/11 23:06:22 INFO Completed push id=29 objects=17 duration=479.209µs47102026/11/11 23:06:22 INFO Completed upload id=11 objects=7 duration=6.706542ms47112026/11/11 23:06:22 INFO Received complete push request method=POST path=/47122026/11/11 23:06:22 INFO Completed push id=28 objects=19 duration=1.07525ms47132026/11/11 23:06:22 INFO Received uploads request method=POST path=/47142026/11/11 23:06:22 INFO Aborted multipart uploads count=0 kept=047152026/11/11 23:06:22 WARN Force mode enabled - objects will be deleted immediately without grace period47162026/11/11 23:06:22 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=047172026/11/11 23:06:22 INFO Received uploads request method=POST path=/47182026/11/11 23:06:22 INFO Vacuumed table table=pending_closures47192026/11/11 23:06:22 INFO Vacuumed table table=pending_objects47202026/11/11 23:06:22 INFO Vacuumed table table=multipart_uploads47212026/11/11 23:06:22 INFO Received complete upload request method=POST path=/47222026/11/11 23:06:22 INFO Vacuumed table table=closures47232026/11/11 23:06:22 INFO Completed upload id=24 objects=18 duration=6.900167ms47242026/11/11 23:06:22 INFO Vacuumed table table=objects47252026/11/11 23:06:22 INFO Received complete push request method=POST path=/47262026/11/11 23:06:22 INFO Completed push id=25 objects=2 duration=804.125µs47272026/11/11 23:06:22 INFO Received complete push request method=POST path=/47282026/11/11 23:06:22 INFO Completed push id=27 objects=4 duration=1.028584ms47292026/11/11 23:06:22 INFO Received complete upload request method=POST path=/47302026/11/11 23:06:22 INFO Completed upload id=22 objects=8 duration=328.166µs47312026/11/11 23:06:22 INFO Received complete push request method=POST path=/47322026/11/11 23:06:22 INFO Completed push id=23 objects=5 duration=242.625µs47332026/11/11 23:06:22 INFO Received complete upload request method=POST path=/47342026/11/11 23:06:22 INFO Completed upload id=24 objects=8 duration=240.5µs47352026/11/11 23:06:22 INFO Received complete push request method=POST path=/47362026/11/11 23:06:22 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=8 objects-deleted-after-grace-period=8 objects-failed-to-delete=047372026/11/11 23:06:22 INFO Received complete upload request method=POST path=/47382026/11/11 23:06:22 INFO Completed upload id=28 objects=5 duration=251.083µs47392026/11/11 23:06:22 INFO Completed push id=29 objects=10 duration=4.99425ms47402026/11/11 23:06:22 INFO Received complete push request method=POST path=/47412026/11/11 23:06:22 INFO Vacuumed table table=pending_closures47422026/11/11 23:06:22 INFO Completed push id=19 objects=14 duration=479.917µs47432026/11/11 23:06:22 INFO Aborted multipart uploads count=0 kept=047442026/11/11 23:06:22 WARN Force mode enabled - objects will be deleted immediately without grace period47452026/11/11 23:06:22 INFO Vacuumed table table=pending_objects47462026/11/11 23:06:22 INFO Vacuumed table table=multipart_uploads47472026/11/11 23:06:22 INFO Vacuumed table table=closures47482026/11/11 23:06:22 INFO Vacuumed table table=objects47492026/11/11 23:06:22 INFO Aborted multipart uploads count=0 kept=047502026/11/11 23:06:22 INFO Received complete upload request method=POST path=/47512026/11/11 23:06:22 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=047522026/11/11 23:06:22 INFO Received complete upload request method=POST path=/47532026/11/11 23:06:22 INFO Completed upload id=30 objects=5 duration=289.417µs47542026/11/11 23:06:22 INFO Vacuumed table table=pending_closures47552026/11/11 23:06:22 INFO Completed upload id=30 objects=6 duration=6.811959ms47562026/11/11 23:06:22 INFO Received complete push request method=POST path=/47572026/11/11 23:06:22 INFO Vacuumed table table=pending_objects47582026/11/11 23:06:22 INFO Vacuumed table table=multipart_uploads47592026/11/11 23:06:22 INFO Vacuumed table table=closures47602026/11/11 23:06:22 INFO Completed push id=28 objects=26 duration=6.453875ms47612026/11/11 23:06:22 INFO Vacuumed table table=objects47622026/11/11 23:06:22 INFO Received complete upload request method=POST path=/47632026/11/11 23:06:22 INFO Completed upload id=31 objects=5 duration=209.125µs47642026/11/11 23:06:22 INFO Received push request method=POST path=/47652026/11/11 23:06:22 INFO Received complete push request method=POST path=/47662026/11/11 23:06:22 INFO Completed push id=30 objects=3 duration=340.417µs47672026/11/11 23:06:22 INFO Received complete upload request method=POST path=/47682026/11/11 23:06:22 INFO Completed upload id=34 objects=3 duration=125.917µs47692026/11/11 23:06:22 INFO Received complete push request method=POST path=/47702026/11/11 23:06:22 INFO Received complete push request method=POST path=/47712026/11/11 23:06:22 INFO Completed push id=32 objects=19 duration=223.417µs47722026/11/11 23:06:22 INFO Completed push id=8 objects=6 duration=5.940458ms47732026/11/11 23:06:22 INFO Aborted multipart uploads count=0 kept=047742026/11/11 23:06:22 WARN Force mode enabled - objects will be deleted immediately without grace period47752026/11/11 23:06:22 INFO Aborted multipart uploads count=0 kept=047762026/11/11 23:06:22 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=047772026/11/11 23:06:22 WARN Force mode enabled - objects will be deleted immediately without grace period47782026/11/11 23:06:22 INFO Received push request method=POST path=/47792026/11/11 23:06:22 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=047802026/11/11 23:06:22 INFO Received complete push request method=POST path=/47812026/11/11 23:06:22 INFO Vacuumed table table=pending_closures47822026/11/11 23:06:22 INFO Vacuumed table table=pending_closures47832026/11/11 23:06:22 INFO Completed push id=31 objects=3 duration=320.042µs47842026/11/11 23:06:22 INFO Vacuumed table table=pending_objects47852026/11/11 23:06:22 INFO Vacuumed table table=multipart_uploads47862026/11/11 23:06:22 INFO Vacuumed table table=pending_objects47872026/11/11 23:06:22 INFO Vacuumed table table=closures47882026/11/11 23:06:22 INFO Vacuumed table table=multipart_uploads47892026/11/11 23:06:22 INFO Vacuumed table table=objects47902026/11/11 23:06:22 INFO Vacuumed table table=closures47912026/11/11 23:06:22 INFO Vacuumed table table=objects47922026/11/11 23:06:22 INFO Received complete push request method=POST path=/47932026/11/11 23:06:22 INFO Completed push id=32 objects=6 duration=507.959µs47942026/11/11 23:06:22 INFO Received complete upload request method=POST path=/47952026/11/11 23:06:22 INFO Completed upload id=33 objects=7 duration=333.417µs47962026/11/11 23:06:22 INFO Received complete upload request method=POST path=/47972026/11/11 23:06:22 INFO Completed upload id=34 objects=3 duration=225.459µs47982026/11/11 23:06:22 INFO Received complete push request method=POST path=/47992026/11/11 23:06:22 INFO Completed push id=35 objects=11 duration=278.167µs48002026/11/11 23:06:22 INFO Aborted multipart uploads count=0 kept=048012026/11/11 23:06:22 INFO Garbage collection completed failed-uploads-deleted=3 old-closures-deleted=1 objects-marked-for-deletion=3 objects-deleted-after-grace-period=3 objects-failed-to-delete=048022026/11/11 23:06:22 WARN Force mode enabled - objects will be deleted immediately without grace period48032026/11/11 23:06:22 INFO Vacuumed table table=pending_closures48042026/11/11 23:06:22 INFO Garbage collection completed failed-uploads-deleted=6 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=048052026/11/11 23:06:22 INFO Vacuumed table table=pending_objects48062026/11/11 23:06:22 INFO Vacuumed table table=multipart_uploads48072026/11/11 23:06:22 INFO Vacuumed table table=closures48082026/11/11 23:06:22 INFO Vacuumed table table=pending_closures48092026/11/11 23:06:22 INFO Vacuumed table table=objects48102026/11/11 23:06:22 INFO Vacuumed table table=pending_objects48112026/11/11 23:06:22 INFO Vacuumed table table=multipart_uploads48122026/11/11 23:06:22 INFO Vacuumed table table=closures48132026/11/11 23:06:22 INFO Vacuumed table table=objects48142026/11/11 23:06:22 INFO Received push request method=POST path=/48152026/11/11 23:06:22 INFO Received uploads request method=POST path=/48162026/11/11 23:06:22 INFO Aborted multipart uploads count=0 kept=048172026/11/11 23:06:22 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=048182026/11/11 23:06:22 INFO Vacuumed table table=pending_closures48192026/11/11 23:06:22 INFO Vacuumed table table=pending_objects48202026/11/11 23:06:22 INFO Vacuumed table table=multipart_uploads48212026/11/11 23:06:22 INFO Vacuumed table table=closures48222026/11/11 23:06:22 INFO Vacuumed table table=objects48232026/11/11 23:06:23 INFO Received complete push request method=POST path=/48242026/11/11 23:06:23 INFO Completed push id=9 objects=24 duration=471.334µs48252026/11/11 23:06:23 INFO Received uploads request method=POST path=/48262026/11/11 23:06:23 INFO Received uploads request method=POST path=/48272026/11/11 23:06:23 INFO Received complete upload request method=POST path=/48282026/11/11 23:06:23 INFO Completed upload id=10 objects=10 duration=399.833µs48292026/11/11 23:06:23 INFO Received uploads request method=POST path=/48302026/11/11 23:06:23 INFO Received push request method=POST path=/48312026/11/11 23:06:23 INFO Received push request method=POST path=/48322026/11/11 23:06:23 INFO Received uploads request method=POST path=/48332026/11/11 23:06:23 INFO Received complete push request method=POST path=/48342026/11/11 23:06:23 INFO Completed push id=14 objects=3 duration=249.375µs48352026/11/11 23:06:23 INFO Received push request method=POST path=/48362026/11/11 23:06:23 INFO Received push request method=POST path=/48372026/11/11 23:06:23 INFO Aborted multipart uploads count=0 kept=048382026/11/11 23:06:23 WARN Force mode enabled - objects will be deleted immediately without grace period48392026/11/11 23:06:23 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=048402026/11/11 23:06:23 INFO Vacuumed table table=pending_closures48412026/11/11 23:06:23 INFO Vacuumed table table=pending_objects48422026/11/11 23:06:23 INFO Vacuumed table table=multipart_uploads48432026/11/11 23:06:23 INFO Vacuumed table table=closures48442026/11/11 23:06:23 INFO Vacuumed table table=objects48452026/11/11 23:06:23 INFO Received push request method=POST path=/48462026/11/11 23:06:23 INFO Received uploads request method=POST path=/48472026/11/11 23:06:23 INFO Received uploads request method=POST path=/48482026/11/11 23:06:23 INFO Aborted multipart uploads count=0 kept=048492026/11/11 23:06:23 WARN Force mode enabled - objects will be deleted immediately without grace period48502026/11/11 23:06:23 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=048512026/11/11 23:06:23 INFO Vacuumed table table=pending_closures48522026/11/11 23:06:23 INFO Vacuumed table table=pending_objects48532026/11/11 23:06:23 INFO Vacuumed table table=multipart_uploads48542026/11/11 23:06:23 INFO Vacuumed table table=closures48552026/11/11 23:06:23 INFO Vacuumed table table=objects48562026/11/11 23:06:23 INFO Received uploads request method=POST path=/48572026/11/11 23:06:23 INFO Received uploads request method=POST path=/48582026/11/11 23:06:23 INFO Received complete push request method=POST path=/48592026/11/11 23:06:23 INFO Completed push id=13 objects=15 duration=400.083µs48602026/11/11 23:06:23 INFO Received uploads request method=POST path=/48612026/11/11 23:06:23 INFO Aborted multipart uploads count=0 kept=048622026/11/11 23:06:23 ERROR failed to remove object object=realisations/sha256:ffffffff!out.doi error="Access Denied."48632026/11/11 23:06:23 INFO Received uploads request method=POST path=/48642026/11/11 23:06:23 INFO Received complete push request method=POST path=/48652026/11/11 23:06:23 INFO Completed push id=18 objects=6 duration=695.625µs48662026/11/11 23:06:23 INFO Received complete upload request method=POST path=/48672026/11/11 23:06:23 INFO Completed upload id=23 objects=9 duration=181.042µs48682026/11/11 23:06:23 INFO Received push request method=POST path=/48692026/11/11 23:06:23 INFO Received uploads request method=POST path=/48702026/11/11 23:06:23 INFO Received push request method=POST path=/48712026/11/11 23:06:23 INFO Received complete push request method=POST path=/48722026/11/11 23:06:23 INFO Completed push id=16 objects=26 duration=266.208µs48732026/11/11 23:06:23 INFO Aborted multipart uploads count=0 kept=048742026/11/11 23:06:23 WARN Force mode enabled - objects will be deleted immediately without grace period48752026/11/11 23:06:23 INFO Garbage collection completed failed-uploads-deleted=4 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=048762026/11/11 23:06:23 INFO Vacuumed table table=pending_closures48772026/11/11 23:06:23 INFO Vacuumed table table=pending_objects48782026/11/11 23:06:23 INFO Vacuumed table table=multipart_uploads48792026/11/11 23:06:23 INFO Vacuumed table table=closures48802026/11/11 23:06:23 INFO Vacuumed table table=objects48812026/11/11 23:06:23 INFO Received complete push request method=POST path=/48822026/11/11 23:06:23 INFO Received complete upload request method=POST path=/48832026/11/11 23:06:23 INFO Completed push id=27 objects=6 duration=699.5µs48842026/11/11 23:06:23 INFO Received complete push request method=POST path=/48852026/11/11 23:06:23 INFO Completed push id=20 objects=3 duration=337.792µs48862026/11/11 23:06:23 INFO Completed upload id=13 objects=14 duration=937.75µs48872026/11/11 23:06:23 INFO Aborted multipart uploads count=0 kept=048882026/11/11 23:06:23 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=048892026/11/11 23:06:23 INFO Vacuumed table table=pending_closures48902026/11/11 23:06:23 INFO Vacuumed table table=pending_objects48912026/11/11 23:06:23 INFO Vacuumed table table=multipart_uploads48922026/11/11 23:06:23 INFO Vacuumed table table=closures48932026/11/11 23:06:23 INFO Vacuumed table table=objects48942026/11/11 23:06:23 INFO Received complete upload request method=POST path=/48952026/11/11 23:06:23 INFO Completed upload id=15 objects=2 duration=228.75µs48962026/11/11 23:06:23 INFO Received push request method=POST path=/48972026/11/11 23:06:23 INFO Received push request method=POST path=/48982026/11/11 23:06:23 INFO Received push request method=POST path=/48992026/11/11 23:06:23 INFO Received push request method=POST path=/49002026/11/11 23:06:23 INFO Received complete push request method=POST path=/49012026/11/11 23:06:23 INFO Received complete upload request method=POST path=/49022026/11/11 23:06:23 INFO Completed upload id=22 objects=6 duration=545.416µs49032026/11/11 23:06:23 INFO Received uploads request method=POST path=/49042026/11/11 23:06:23 INFO Completed push id=31 objects=6 duration=1.242125ms49052026/11/11 23:06:23 INFO Received uploads request method=POST path=/49062026/11/11 23:06:23 INFO Received uploads request method=POST path=/49072026/11/11 23:06:23 INFO Received uploads request method=POST path=/49082026/11/11 23:06:23 INFO Received complete upload request method=POST path=/49092026/11/11 23:06:23 INFO Completed upload id=26 objects=8 duration=210.166µs49102026/11/11 23:06:23 INFO Received uploads request method=POST path=/49112026/11/11 23:06:23 INFO Received complete push request method=POST path=/49122026/11/11 23:06:23 INFO Completed push id=28 objects=14 duration=215.167µs49132026/11/11 23:06:23 INFO Received push request method=POST path=/49142026/11/11 23:06:23 INFO Received push request method=POST path=/49152026/11/11 23:06:23 INFO Received push request method=POST path=/49162026/11/11 23:06:23 INFO Received uploads request method=POST path=/49172026/11/11 23:06:23 INFO Received uploads request method=POST path=/49182026/11/11 23:06:23 INFO Received uploads request method=POST path=/49192026/11/11 23:06:23 INFO Aborted multipart uploads count=0 kept=049202026/11/11 23:06:23 WARN Force mode enabled - objects will be deleted immediately without grace period49212026/11/11 23:06:23 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=049222026/11/11 23:06:23 INFO Vacuumed table table=pending_closures49232026/11/11 23:06:23 INFO Vacuumed table table=pending_objects49242026/11/11 23:06:23 INFO Received uploads request method=POST path=/49252026/11/11 23:06:23 INFO Vacuumed table table=multipart_uploads49262026/11/11 23:06:23 INFO Vacuumed table table=closures49272026/11/11 23:06:23 INFO Vacuumed table table=objects49282026/11/11 23:06:23 INFO Received uploads request method=POST path=/49292026/11/11 23:06:23 INFO Received uploads request method=POST path=/49302026/11/11 23:06:23 INFO Received uploads request method=POST path=/49312026/11/11 23:06:23 INFO Received complete upload request method=POST path=/49322026/11/11 23:06:23 INFO Received push request method=POST path=/49332026/11/11 23:06:23 INFO Completed upload id=21 objects=9 duration=478.375µs49342026/11/11 23:06:23 INFO Received complete push request method=POST path=/49352026/11/11 23:06:23 INFO Completed push id=25 objects=10 duration=400.375µs49362026/11/11 23:06:23 INFO Received complete upload request method=POST path=/49372026/11/11 23:06:23 INFO Completed upload id=29 objects=5 duration=250µs49382026/11/11 23:06:23 INFO Received complete upload request method=POST path=/49392026/11/11 23:06:23 INFO Completed upload id=30 objects=2 duration=401µs49402026/11/11 23:06:23 INFO Received complete push request method=POST path=/49412026/11/11 23:06:23 INFO Completed push id=31 objects=20 duration=219.875µs49422026/11/11 23:06:23 INFO Received complete upload request method=POST path=/49432026/11/11 23:06:23 INFO Completed upload id=32 objects=5 duration=134.75µs49442026/11/11 23:06:23 INFO Received complete upload request method=POST path=/49452026/11/11 23:06:23 INFO Completed upload id=33 objects=3 duration=130.583µs49462026/11/11 23:06:23 INFO Aborted multipart uploads count=0 kept=049472026/11/11 23:06:23 WARN Force mode enabled - objects will be deleted immediately without grace period49482026/11/11 23:06:23 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=049492026/11/11 23:06:23 INFO Vacuumed table table=pending_closures49502026/11/11 23:06:23 INFO Vacuumed table table=pending_objects49512026/11/11 23:06:23 INFO Vacuumed table table=multipart_uploads49522026/11/11 23:06:23 INFO Vacuumed table table=closures49532026/11/11 23:06:23 INFO Vacuumed table table=objects49542026/11/11 23:06:23 INFO Received complete push request method=POST path=/49552026/11/11 23:06:23 INFO Completed push id=1 objects=9 duration=378.25µs49562026/11/11 23:06:23 INFO Received complete push request method=POST path=/49572026/11/11 23:06:23 INFO Completed push id=16 objects=7 duration=614.167µs49582026/11/11 23:06:23 INFO Received complete push request method=POST path=/49592026/11/11 23:06:23 INFO Completed push id=23 objects=6 duration=1.101458ms49602026/11/11 23:06:23 INFO Received complete push request method=POST path=/49612026/11/11 23:06:23 INFO Completed push id=24 objects=6 duration=374.833µs49622026/11/11 23:06:23 INFO Received complete push request method=POST path=/49632026/11/11 23:06:23 INFO Completed push id=25 objects=7 duration=1.088792ms49642026/11/11 23:06:23 INFO Received complete upload request method=POST path=/49652026/11/11 23:06:23 INFO Completed upload id=2 objects=7 duration=736.5µs49662026/11/11 23:06:24 INFO Received complete upload request method=POST path=/49672026/11/11 23:06:24 INFO Completed upload id=26 objects=24 duration=1.269208ms49682026/11/11 23:06:24 INFO Received complete upload request method=POST path=/49692026/11/11 23:06:24 INFO Completed upload id=8 objects=6 duration=1.046125ms49702026/11/11 23:06:24 INFO Received complete upload request method=POST path=/49712026/11/11 23:06:24 INFO Completed upload id=27 objects=26 duration=1.152208ms49722026/11/11 23:06:24 INFO Received complete push request method=POST path=/49732026/11/11 23:06:24 INFO Completed push id=28 objects=6 duration=730.125µs49742026/11/11 23:06:24 INFO Received complete push request method=POST path=/49752026/11/11 23:06:24 INFO Completed push id=29 objects=6 duration=566.209µs49762026/11/11 23:06:24 INFO Received complete upload request method=POST path=/49772026/11/11 23:06:24 INFO Completed upload id=12 objects=9 duration=1.003833ms49782026/11/11 23:06:24 INFO Received complete upload request method=POST path=/49792026/11/11 23:06:24 INFO Completed upload id=30 objects=8 duration=848.458µs49802026/11/11 23:06:24 INFO Received complete upload request method=POST path=/49812026/11/11 23:06:24 INFO Completed upload id=31 objects=6 duration=954.042µs49822026/11/11 23:06:24 INFO Received complete upload request method=POST path=/49832026/11/11 23:06:24 INFO Completed upload id=32 objects=4 duration=347.666µs49842026/11/11 23:06:24 INFO Received complete upload request method=POST path=/49852026/11/11 23:06:24 INFO Completed upload id=33 objects=10 duration=401.333µs49862026/11/11 23:06:24 INFO Received complete upload request method=POST path=/49872026/11/11 23:06:24 INFO Completed upload id=34 objects=23 duration=951.791µs49882026/11/11 23:06:24 INFO Received complete push request method=POST path=/49892026/11/11 23:06:24 INFO Completed push id=35 objects=6 duration=849.917µs49902026/11/11 23:06:24 INFO Aborted multipart uploads count=0 kept=049912026/11/11 23:06:24 WARN Force mode enabled - objects will be deleted immediately without grace period49922026/11/11 23:06:24 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=049932026/11/11 23:06:24 INFO Vacuumed table table=pending_closures49942026/11/11 23:06:24 INFO Vacuumed table table=pending_objects49952026/11/11 23:06:24 INFO Vacuumed table table=multipart_uploads49962026/11/11 23:06:24 INFO Vacuumed table table=closures49972026/11/11 23:06:24 INFO Vacuumed table table=objects49982026/11/11 23:06:24 INFO Received complete upload request method=POST path=/49992026/11/11 23:06:24 INFO Completed upload id=18 objects=22 duration=1.008833ms50002026/11/11 23:06:24 INFO Received complete upload request method=POST path=/50012026/11/11 23:06:24 INFO Completed upload id=21 objects=8 duration=417.083µs50022026/11/11 23:06:24 INFO Received complete upload request method=POST path=/50032026/11/11 23:06:24 INFO Completed upload id=22 objects=7 duration=328.791µs50042026/11/11 23:06:24 INFO Received complete push request method=POST path=/50052026/11/11 23:06:24 INFO Completed push id=24 objects=5 duration=342.667µs50062026/11/11 23:06:24 INFO Received complete upload request method=POST path=/50072026/11/11 23:06:24 INFO Completed upload id=25 objects=8 duration=205.5µs50082026/11/11 23:06:24 INFO Received complete push request method=POST path=/50092026/11/11 23:06:24 INFO Completed push id=26 objects=4 duration=263.291µs50102026/11/11 23:06:24 INFO Received complete push request method=POST path=/50112026/11/11 23:06:24 INFO Completed push id=30 objects=2 duration=216.041µs50122026/11/11 23:06:24 INFO Received complete push request method=POST path=/50132026/11/11 23:06:24 INFO Completed push id=32 objects=7 duration=281.834µs50142026/11/11 23:06:24 INFO Received complete upload request method=POST path=/50152026/11/11 23:06:24 INFO Completed upload id=33 objects=6 duration=201.25µs50162026/11/11 23:06:24 INFO Received complete upload request method=POST path=/50172026/11/11 23:06:24 INFO Completed upload id=34 objects=3 duration=159.041µs50182026/11/11 23:06:24 INFO Aborted multipart uploads count=0 kept=050192026/11/11 23:06:24 WARN Force mode enabled - objects will be deleted immediately without grace period50202026/11/11 23:06:24 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=050212026/11/11 23:06:24 INFO Vacuumed table table=pending_closures50222026/11/11 23:06:24 INFO Vacuumed table table=pending_objects50232026/11/11 23:06:24 INFO Vacuumed table table=multipart_uploads50242026/11/11 23:06:24 INFO Vacuumed table table=closures50252026/11/11 23:06:24 INFO Vacuumed table table=objects5026--- PASS: FuzzPushGC (0.01s)5027 --- PASS: FuzzPushGC/seed#14 (7.22s)5028 --- PASS: FuzzPushGC/seed#15 (8.88s)5029 --- PASS: FuzzPushGC/seed#2 (9.94s)5030 --- PASS: FuzzPushGC/seed#11 (10.23s)5031 --- PASS: FuzzPushGC/seed#0 (11.68s)5032 --- PASS: FuzzPushGC/seed#5 (11.89s)5033 --- PASS: FuzzPushGC/seed#4 (12.67s)5034 --- PASS: FuzzPushGC/seed#3 (12.69s)5035 --- PASS: FuzzPushGC/seed#9 (12.90s)5036 --- PASS: FuzzPushGC/seed#1 (14.14s)5037 --- PASS: FuzzPushGC/seed#7 (14.44s)5038 --- PASS: FuzzPushGC/seed#13 (14.45s)5039 --- PASS: FuzzPushGC/seed#8 (14.70s)5040 --- PASS: FuzzPushGC/seed#6 (15.31s)5041 --- PASS: FuzzPushGC/seed#12 (16.33s)5042 --- PASS: FuzzPushGC/seed#10 (16.53s)5043PASS5044{"timestamp":"2026-11-11T23:06:24.780937Z","level":"ERROR","message":"HTTP transport failed","event":"http_transport_failed","component":"server","subsystem":"transport","peer_addr":"127.0.0.1:56784","error_kind":"io_error","error":"Cancelled","result":"transport_error","target":"rustfs::server::http","filename":"rustfs/src/server/http.rs","line_number":2561,"threadName":"rustfs-worker","threadId":"ThreadId(9)"}5045{"timestamp":"2026-11-11T23:06:24.781536Z","level":"ERROR","message":"HTTP transport failed","event":"http_transport_failed","component":"server","subsystem":"transport","peer_addr":"127.0.0.1:56636","error_kind":"io_error","error":"Cancelled","result":"transport_error","target":"rustfs::server::http","filename":"rustfs/src/server/http.rs","line_number":2561,"threadName":"rustfs-worker","threadId":"ThreadId(10)"}50462026-11-11 23:06:24.926 UTC [72184] LOG: received smart shutdown request50472026-11-11 23:06:24.927 UTC [72184] LOG: background worker "logical replication launcher" (PID 72194) exited with exit code 150482026-11-11 23:06:25.853 UTC [72189] LOG: checkpoint complete: wrote 3386 buffers (20.7%), wrote 5 SLRU buffers; 0 WAL file(s) added, 0 removed, 33 recycled; write=28.036 s, sync=0.818 s, total=29.030 s; sync files=42366, longest=0.001 s, average=0.001 s; distance=532976 kB, estimate=532976 kB; lsn=0/27998950, redo lsn=0/220090A050492026-11-11 23:06:25.856 UTC [72189] LOG: shutting down50502026-11-11 23:06:25.856 UTC [72189] LOG: checkpoint starting: shutdown immediate50512026-11-11 23:06:26.345 UTC [72189] LOG: checkpoint complete: wrote 8818 buffers (53.8%), wrote 2 SLRU buffers; 0 WAL file(s) added, 0 removed, 5 recycled; write=0.438 s, sync=0.049 s, total=0.490 s; sync files=2978, longest=0.001 s, average=0.001 s; distance=91710 kB, estimate=488849 kB; lsn=0/279989C8, redo lsn=0/279989C850522026-11-11 23:06:26.352 UTC [72184] LOG: database system is shut down5053Running OIDC tests...5054=== RUN TestAudienceForIssuer5055=== PAUSE TestAudienceForIssuer5056=== RUN TestGlobMatch5057=== PAUSE TestGlobMatch5058=== RUN TestValidateToken_ValidToken5059=== PAUSE TestValidateToken_ValidToken5060=== RUN TestValidateToken_WrongAudience5061=== PAUSE TestValidateToken_WrongAudience5062=== RUN TestValidateToken_Expired5063=== PAUSE TestValidateToken_Expired5064=== RUN TestValidateToken_BoundClaimsMismatch5065=== PAUSE TestValidateToken_BoundClaimsMismatch5066=== RUN TestValidateToken_BoundSubjectMismatch5067=== PAUSE TestValidateToken_BoundSubjectMismatch5068=== RUN TestValidateToken_MultipleProviders5069=== PAUSE TestValidateToken_MultipleProviders5070=== RUN TestValidateToken_NoMatchingProvider5071=== PAUSE TestValidateToken_NoMatchingProvider5072=== RUN TestValidateToken_KubernetesServiceAccount5073=== PAUSE TestValidateToken_KubernetesServiceAccount5074=== RUN TestNewValidator_KubernetesRequiresCA5075=== PAUSE TestNewValidator_KubernetesRequiresCA5076=== RUN TestValidateToken_KubernetesIssuerFromOwnToken5077=== PAUSE TestValidateToken_KubernetesIssuerFromOwnToken5078=== RUN TestPins_ReservedForMatchingRule5079=== PAUSE TestPins_ReservedForMatchingRule5080=== RUN TestPins_TopLevelShorthand5081=== PAUSE TestPins_TopLevelShorthand5082=== RUN TestPins_ConfigValidation5083=== PAUSE TestPins_ConfigValidation5084=== RUN TestScopes_LegacyProviderDefaultsToWrite5085=== PAUSE TestScopes_LegacyProviderDefaultsToWrite5086=== RUN TestScopes_Rules5087=== PAUSE TestScopes_Rules5088=== RUN TestScopes_ConfigValidation5089=== PAUSE TestScopes_ConfigValidation5090=== CONT TestAudienceForIssuer5091--- PASS: TestAudienceForIssuer (0.00s)5092=== CONT TestValidateToken_ValidToken5093=== CONT TestGlobMatch5094=== CONT TestValidateToken_WrongAudience5095=== CONT TestValidateToken_KubernetesServiceAccount5096=== RUN TestGlobMatch/foo_foo5097=== PAUSE TestGlobMatch/foo_foo5098=== RUN TestGlobMatch/foo_bar5099=== PAUSE TestGlobMatch/foo_bar5100=== RUN TestGlobMatch/*_5101=== PAUSE TestGlobMatch/*_5102=== RUN TestGlobMatch/*_anything5103=== PAUSE TestGlobMatch/*_anything5104=== CONT TestValidateToken_NoMatchingProvider5105=== CONT TestValidateToken_MultipleProviders5106=== CONT TestValidateToken_BoundSubjectMismatch5107=== CONT TestPins_ConfigValidation5108=== CONT TestScopes_ConfigValidation5109--- PASS: TestScopes_ConfigValidation (0.00s)5110=== CONT TestScopes_Rules5111--- PASS: TestPins_ConfigValidation (0.00s)5112=== CONT TestScopes_LegacyProviderDefaultsToWrite5113=== CONT TestPins_TopLevelShorthand5114=== CONT TestPins_ReservedForMatchingRule5115=== CONT TestValidateToken_KubernetesIssuerFromOwnToken5116=== CONT TestNewValidator_KubernetesRequiresCA5117=== CONT TestValidateToken_Expired5118=== CONT TestValidateToken_BoundClaimsMismatch5119=== RUN TestGlobMatch/foo*_foo5120=== PAUSE TestGlobMatch/foo*_foo5121=== RUN TestGlobMatch/foo*_foobar5122=== PAUSE TestGlobMatch/foo*_foobar5123=== RUN TestGlobMatch/foo*_bar5124=== PAUSE TestGlobMatch/foo*_bar5125=== RUN TestGlobMatch/*bar_bar5126=== PAUSE TestGlobMatch/*bar_bar5127=== RUN TestGlobMatch/*bar_foobar5128=== PAUSE TestGlobMatch/*bar_foobar5129=== RUN TestGlobMatch/*bar_foo5130=== PAUSE TestGlobMatch/*bar_foo5131=== RUN TestGlobMatch/foo*bar_foobar5132=== PAUSE TestGlobMatch/foo*bar_foobar5133=== RUN TestGlobMatch/foo*bar_foo123bar5134=== PAUSE TestGlobMatch/foo*bar_foo123bar5135=== RUN TestGlobMatch/foo*bar_foobarbaz5136=== PAUSE TestGlobMatch/foo*bar_foobarbaz5137=== RUN TestGlobMatch/*/*_foo/bar5138=== PAUSE TestGlobMatch/*/*_foo/bar5139=== RUN TestGlobMatch/*/*_foo5140=== PAUSE TestGlobMatch/*/*_foo5141=== RUN TestGlobMatch/refs/heads/*_refs/heads/main5142=== PAUSE TestGlobMatch/refs/heads/*_refs/heads/main5143=== RUN TestGlobMatch/refs/heads/*_refs/tags/v1.05144=== PAUSE TestGlobMatch/refs/heads/*_refs/tags/v1.05145=== RUN TestGlobMatch/refs/*/main_refs/heads/main5146=== PAUSE TestGlobMatch/refs/*/main_refs/heads/main5147=== RUN TestGlobMatch/fo?_foo5148=== PAUSE TestGlobMatch/fo?_foo5149=== RUN TestGlobMatch/fo?_fo5150=== PAUSE TestGlobMatch/fo?_fo5151=== RUN TestGlobMatch/fo?_fooo5152=== PAUSE TestGlobMatch/fo?_fooo5153=== RUN TestGlobMatch/?oo_foo5154=== PAUSE TestGlobMatch/?oo_foo5155=== RUN TestGlobMatch/?oo_boo5156=== PAUSE TestGlobMatch/?oo_boo5157=== RUN TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main5158=== PAUSE TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main5159=== RUN TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main5160=== PAUSE TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main5161=== CONT TestGlobMatch/foo_foo5162=== CONT TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main5163=== CONT TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main5164=== CONT TestGlobMatch/?oo_boo5165=== CONT TestGlobMatch/?oo_foo5166=== CONT TestGlobMatch/fo?_fooo5167=== CONT TestGlobMatch/fo?_fo5168=== CONT TestGlobMatch/fo?_foo5169=== CONT TestGlobMatch/refs/*/main_refs/heads/main5170=== CONT TestGlobMatch/refs/heads/*_refs/tags/v1.05171=== CONT TestGlobMatch/refs/heads/*_refs/heads/main5172=== CONT TestGlobMatch/*/*_foo5173=== CONT TestGlobMatch/*/*_foo/bar5174=== CONT TestGlobMatch/foo*bar_foobarbaz5175=== CONT TestGlobMatch/foo*bar_foo123bar5176=== CONT TestGlobMatch/foo*bar_foobar5177=== CONT TestGlobMatch/*bar_foo5178=== CONT TestGlobMatch/*bar_foobar5179=== CONT TestGlobMatch/*bar_bar5180=== CONT TestGlobMatch/foo*_bar5181=== CONT TestGlobMatch/foo*_foobar5182=== CONT TestGlobMatch/foo*_foo5183=== CONT TestGlobMatch/*_anything5184=== CONT TestGlobMatch/*_5185=== CONT TestGlobMatch/foo_bar5186--- PASS: TestGlobMatch (0.02s)5187 --- PASS: TestGlobMatch/foo_foo (0.00s)5188 --- PASS: TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main (0.00s)5189 --- PASS: TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main (0.00s)5190 --- PASS: TestGlobMatch/?oo_boo (0.00s)5191 --- PASS: TestGlobMatch/?oo_foo (0.00s)5192 --- PASS: TestGlobMatch/fo?_fooo (0.00s)5193 --- PASS: TestGlobMatch/fo?_fo (0.00s)5194 --- PASS: TestGlobMatch/fo?_foo (0.00s)5195 --- PASS: TestGlobMatch/refs/*/main_refs/heads/main (0.00s)5196 --- PASS: TestGlobMatch/refs/heads/*_refs/tags/v1.0 (0.00s)5197 --- PASS: TestGlobMatch/refs/heads/*_refs/heads/main (0.00s)5198 --- PASS: TestGlobMatch/*/*_foo (0.00s)5199 --- PASS: TestGlobMatch/*/*_foo/bar (0.00s)5200 --- PASS: TestGlobMatch/foo*bar_foobarbaz (0.00s)5201 --- PASS: TestGlobMatch/foo*bar_foo123bar (0.00s)5202 --- PASS: TestGlobMatch/foo*bar_foobar (0.00s)5203 --- PASS: TestGlobMatch/*bar_foo (0.00s)5204 --- PASS: TestGlobMatch/*bar_foobar (0.00s)5205 --- PASS: TestGlobMatch/*bar_bar (0.00s)5206 --- PASS: TestGlobMatch/foo*_bar (0.00s)5207 --- PASS: TestGlobMatch/foo*_foobar (0.00s)5208 --- PASS: TestGlobMatch/foo*_foo (0.00s)5209 --- PASS: TestGlobMatch/*_anything (0.00s)5210 --- PASS: TestGlobMatch/*_ (0.00s)5211 --- PASS: TestGlobMatch/foo_bar (0.00s)52122026/11/11 23:06:28 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:57325/oidc52132026/11/11 23:06:28 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:57323/oidc5214--- PASS: TestScopes_LegacyProviderDefaultsToWrite (0.05s)5215--- PASS: TestPins_ReservedForMatchingRule (0.05s)52162026/11/11 23:06:28 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:57330/oidc52172026/11/11 23:06:28 INFO OIDC provider initialized name=kubernetes issuer=https://oidc.eks.invalid/id/ABC12352182026/11/11 23:06:28 INFO OIDC provider initialized name=kubernetes issuer=https://127.0.0.1:573285219--- PASS: TestValidateToken_KubernetesIssuerFromOwnToken (0.08s)5220--- PASS: TestScopes_Rules (0.08s)5221--- PASS: TestValidateToken_KubernetesServiceAccount (0.09s)52222026/11/11 23:06:28 http: TLS handshake error from 127.0.0.1:57332: remote error: tls: bad certificate5223--- PASS: TestNewValidator_KubernetesRequiresCA (0.08s)52242026/11/11 23:06:28 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:57336/oidc5225--- PASS: TestValidateToken_WrongAudience (0.09s)52262026/11/11 23:06:28 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:57338/oidc52272026/11/11 23:06:28 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:57340/oidc52282026/11/11 23:06:28 INFO OIDC provider initialized name=provider1 issuer=http://127.0.0.1:57327/oidc52292026/11/11 23:06:28 INFO OIDC provider initialized name=provider2 issuer=http://127.0.0.1:57342/oidc5230--- PASS: TestValidateToken_BoundClaimsMismatch (0.08s)5231--- PASS: TestValidateToken_Expired (0.08s)5232--- PASS: TestValidateToken_MultipleProviders (0.10s)52332026/11/11 23:06:28 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:57345/oidc5234--- PASS: TestValidateToken_ValidToken (0.11s)52352026/11/11 23:06:28 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:57347/oidc5236--- PASS: TestPins_TopLevelShorthand (0.13s)52372026/11/11 23:06:28 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:57349/oidc5238--- PASS: TestValidateToken_BoundSubjectMismatch (0.14s)52392026/11/11 23:06:28 INFO OIDC provider initialized name=provider1 issuer=http://127.0.0.1:57351/oidc5240--- PASS: TestValidateToken_NoMatchingProvider (0.19s)5241PASS5242Running hook tests...5243=== RUN TestSendPathsEmpty5244=== PAUSE TestSendPathsEmpty5245=== RUN TestQueueEnqueueAndFetch5246=== PAUSE TestQueueEnqueueAndFetch5247=== RUN TestQueueDeduplication5248=== PAUSE TestQueueDeduplication5249=== RUN TestQueueRemove5250=== PAUSE TestQueueRemove5251=== RUN TestQueueFetchBatchLimit5252=== PAUSE TestQueueFetchBatchLimit5253=== RUN TestQueueRetryMovesToBack5254=== PAUSE TestQueueRetryMovesToBack5255=== RUN TestQueueFetchRemoveLifecycle5256=== PAUSE TestQueueFetchRemoveLifecycle5257=== RUN TestQueueConcurrentWriters5258=== PAUSE TestQueueConcurrentWriters5259=== RUN TestQueueRemoveLargeClosure5260=== PAUSE TestQueueRemoveLargeClosure5261=== RUN TestServerClientIntegration5262--- PASS: TestServerClientIntegration (0.00s)5263=== RUN TestServerQueueError52642026/11/11 23:06:28 ERROR Failed to queue paths error="permission denied" count=15265--- PASS: TestServerQueueError (0.00s)5266=== RUN TestGetListenerSocketActivation5267 server_test.go:145: systemd socket activation does not exist on darwin5268--- SKIP: TestGetListenerSocketActivation (0.00s)5269=== RUN TestServerStalledClientDoesNotBlockShutdown5270=== PAUSE TestServerStalledClientDoesNotBlockShutdown5271=== RUN TestServerBacksOffOnAcceptErrors5272=== PAUSE TestServerBacksOffOnAcceptErrors5273=== RUN TestDrainIsolatesPoisonPath5274=== PAUSE TestDrainIsolatesPoisonPath5275=== RUN TestRunNotBlockedByPoisonHead5276=== PAUSE TestRunNotBlockedByPoisonHead5277=== RUN TestDrainGivesUpWhenServerDown5278=== PAUSE TestDrainGivesUpWhenServerDown5279=== RUN TestFailedPathPrunedByLaterClosure5280=== PAUSE TestFailedPathPrunedByLaterClosure5281=== RUN TestWorkerUploadsAndRemoves5282=== PAUSE TestWorkerUploadsAndRemoves5283=== RUN TestWorkerSkipsGCdPaths5284=== PAUSE TestWorkerSkipsGCdPaths5285=== RUN TestWorkerPrunesClosureDeps5286=== PAUSE TestWorkerPrunesClosureDeps5287=== RUN TestDrainTimeout5288=== PAUSE TestDrainTimeout5289=== RUN TestWorkerRemoveFailureIsNotProgress5290=== PAUSE TestWorkerRemoveFailureIsNotProgress5291=== RUN TestWorkerKeepsPathItCannotStat5292=== PAUSE TestWorkerKeepsPathItCannotStat5293=== CONT TestSendPathsEmpty5294=== CONT TestFailedPathPrunedByLaterClosure5295--- PASS: TestSendPathsEmpty (0.00s)5296=== CONT TestWorkerKeepsPathItCannotStat5297=== CONT TestWorkerRemoveFailureIsNotProgress5298=== CONT TestDrainTimeout5299=== CONT TestWorkerPrunesClosureDeps5300=== CONT TestWorkerSkipsGCdPaths5301=== CONT TestWorkerUploadsAndRemoves5302=== CONT TestDrainIsolatesPoisonPath5303=== CONT TestServerBacksOffOnAcceptErrors5304=== CONT TestServerStalledClientDoesNotBlockShutdown5305=== CONT TestQueueRemoveLargeClosure53062026/11/11 23:06:28 ERROR Accept failed error="too many open files"5307=== CONT TestDrainGivesUpWhenServerDown5308=== CONT TestQueueConcurrentWriters5309=== CONT TestQueueRemove5310=== CONT TestQueueFetchBatchLimit5311=== CONT TestQueueDeduplication5312=== CONT TestQueueFetchRemoveLifecycle5313=== CONT TestQueueEnqueueAndFetch5314=== CONT TestQueueRetryMovesToBack5315=== CONT TestRunNotBlockedByPoisonHead53162026/11/11 23:06:28 ERROR Accept failed error="too many open files"53172026/11/11 23:06:28 INFO Upload queue status pending=253182026/11/11 23:06:28 WARN Store path no longer exists (garbage collected?), removing from queue path=/private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestWorkerSkipsGCdPaths3327386891/002/nonexistent53192026/11/11 23:06:28 INFO Uploading batch count=153202026/11/11 23:06:28 INFO Upload queue status pending=35321--- PASS: TestQueueRemove (0.01s)53222026/11/11 23:06:28 INFO Upload queue status pending=253232026/11/11 23:06:28 INFO Uploading batch count=253242026/11/11 23:06:28 INFO Upload queue status pending=253252026/11/11 23:06:28 WARN Cannot stat store path, will retry later path=/private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestWorkerKeepsPathItCannotStat3042460823/002/locked/aaa error="stat /private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestWorkerKeepsPathItCannotStat3042460823/002/locked/aaa: permission denied"5326--- PASS: TestQueueEnqueueAndFetch (0.01s)53272026/11/11 23:06:28 INFO Uploading batch count=153282026/11/11 23:06:28 INFO Uploading batch count=253292026/11/11 23:06:28 INFO Uploading batch count=153302026/11/11 23:06:28 ERROR Upload failed error="upload failed" count=15331--- PASS: TestQueueFetchRemoveLifecycle (0.01s)5332--- PASS: TestQueueDeduplication (0.01s)53332026/11/11 23:06:28 INFO Uploading batch count=153342026/11/11 23:06:28 ERROR Upload failed error="upload failed" count=153352026/11/11 23:06:28 INFO Uploading batch count=253362026/11/11 23:06:28 ERROR Upload failed error="upload failed" count=253372026/11/11 23:06:28 INFO Uploading batch count=453382026/11/11 23:06:28 ERROR Upload failed error="upload failed" count=453392026/11/11 23:06:28 ERROR Upload failed, will retry later error="upload failed" path=/private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestDrainGivesUpWhenServerDown616741970/002/a53402026/11/11 23:06:28 INFO Uploading batch count=153412026/11/11 23:06:28 ERROR Upload failed, will retry later error="upload failed" path=/private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestDrainIsolatesPoisonPath783785049/002/bbb53422026/11/11 23:06:28 WARN Cannot stat store path, will retry later path=/private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestWorkerKeepsPathItCannotStat3042460823/002/locked/aaa error="stat /private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestWorkerKeepsPathItCannotStat3042460823/002/locked/aaa: permission denied"53432026/11/11 23:06:28 ERROR Upload failed, will retry later error="upload failed" path=/private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestDrainGivesUpWhenServerDown616741970/002/b53442026/11/11 23:06:28 INFO Uploading batch count=153452026/11/11 23:06:28 WARN Cannot stat store path, will retry later path=/private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestWorkerKeepsPathItCannotStat3042460823/002/locked/aaa error="stat /private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestWorkerKeepsPathItCannotStat3042460823/002/locked/aaa: permission denied"53462026/11/11 23:06:28 INFO Uploading batch count=253472026/11/11 23:06:28 ERROR Upload failed error="upload failed" count=253482026/11/11 23:06:28 ERROR Upload failed, will retry later error="upload failed" path=/private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestDrainGivesUpWhenServerDown616741970/002/c53492026/11/11 23:06:28 ERROR Upload failed, will retry later error="upload failed" path=/private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestDrainGivesUpWhenServerDown616741970/002/d5350--- PASS: TestQueueRetryMovesToBack (0.01s)53512026/11/11 23:06:28 ERROR Drain finished with paths left in queue remaining=15352--- PASS: TestQueueFetchBatchLimit (0.01s)53532026/11/11 23:06:28 ERROR Accept failed error="too many open files"53542026/11/11 23:06:28 INFO Uploading batch count=253552026/11/11 23:06:28 ERROR Upload failed error="upload failed" count=253562026/11/11 23:06:28 ERROR Upload failed, will retry later error="upload failed" path=/private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestDrainGivesUpWhenServerDown616741970/002/e53572026/11/11 23:06:28 INFO Uploading batch count=153582026/11/11 23:06:28 ERROR Upload failed error="upload failed" count=153592026/11/11 23:06:28 ERROR Upload failed, will retry later error="upload failed" path=/private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestDrainGivesUpWhenServerDown616741970/002/f53602026/11/11 23:06:28 WARN Store path no longer exists (garbage collected?), removing from queue path=/private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestWorkerRemoveFailureIsNotProgress2171517787/002/nonexistent53612026/11/11 23:06:28 ERROR Drain finished with paths left in queue remaining=1053622026/11/11 23:06:28 ERROR Failed to remove paths from queue error="deleting paths: attempt to write a readonly database (8)" count=153632026/11/11 23:06:28 INFO Uploading batch count=153642026/11/11 23:06:28 WARN Store path no longer exists (garbage collected?), removing from queue path=/private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestWorkerRemoveFailureIsNotProgress2171517787/002/nonexistent53652026/11/11 23:06:28 ERROR Failed to remove paths from queue error="deleting paths: attempt to write a readonly database (8)" count=153662026/11/11 23:06:28 WARN Store path no longer exists (garbage collected?), removing from queue path=/private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestWorkerRemoveFailureIsNotProgress2171517787/002/nonexistent53672026/11/11 23:06:28 ERROR Upload failed error="upload failed" count=153682026/11/11 23:06:28 ERROR Failed to remove paths from queue error="deleting paths: attempt to write a readonly database (8)" count=153692026/11/11 23:06:28 ERROR Drain finished with paths left in queue remaining=15370--- PASS: TestWorkerKeepsPathItCannotStat (0.02s)53712026/11/11 23:06:28 INFO Uploading batch count=153722026/11/11 23:06:28 ERROR Upload failed error="upload failed" count=153732026/11/11 23:06:28 ERROR Drain finished with paths left in queue remaining=15374--- PASS: TestFailedPathPrunedByLaterClosure (0.02s)5375--- PASS: TestWorkerRemoveFailureIsNotProgress (0.02s)5376--- PASS: TestDrainGivesUpWhenServerDown (0.02s)5377--- PASS: TestDrainIsolatesPoisonPath (0.02s)5378--- PASS: TestWorkerSkipsGCdPaths (0.03s)5379--- PASS: TestWorkerUploadsAndRemoves (0.03s)5380--- PASS: TestWorkerPrunesClosureDeps (0.03s)53812026/11/11 23:06:28 ERROR Accept failed error="too many open files"5382--- PASS: TestQueueRemoveLargeClosure (0.05s)5383--- PASS: TestQueueConcurrentWriters (0.06s)53842026/11/11 23:06:28 ERROR Accept failed error="too many open files"53852026/11/11 23:06:28 ERROR Accept failed error="too many open files"53862026/11/11 23:06:29 ERROR Failed to decode request error="read unix /private/var/tb/8/scratch/9bf71896e68fdfe3/build/hook3427966023/test.sock->: i/o timeout"53872026/11/11 23:06:29 ERROR Failed to write response error="write unix /private/var/tb/8/scratch/9bf71896e68fdfe3/build/hook3427966023/test.sock->: i/o timeout"5388--- PASS: TestServerStalledClientDoesNotBlockShutdown (0.20s)53892026/11/11 23:06:29 ERROR Upload failed error="context deadline exceeded" count=253902026/11/11 23:06:29 ERROR Drain finished with paths left in queue remaining=45391--- PASS: TestDrainTimeout (0.22s)53922026/11/11 23:06:29 ERROR Accept failed error="too many open files"53932026/11/11 23:06:29 ERROR Accept failed error="too many open files"5394--- PASS: TestServerBacksOffOnAcceptErrors (0.64s)53952026/11/11 23:06:29 INFO Uploading batch count=153962026/11/11 23:06:29 INFO Uploading batch count=153972026/11/11 23:06:29 INFO Uploading batch count=153982026/11/11 23:06:29 ERROR Upload failed error="upload failed" count=153992026/11/11 23:06:29 INFO Uploading batch count=154002026/11/11 23:06:29 ERROR Upload failed error="upload failed" count=154012026/11/11 23:06:29 INFO Uploading batch count=154022026/11/11 23:06:29 ERROR Upload failed error="upload failed" count=154032026/11/11 23:06:29 INFO Uploading batch count=154042026/11/11 23:06:29 ERROR Upload failed error="upload failed" count=154052026/11/11 23:06:29 ERROR Drain finished with paths left in queue remaining=15406--- PASS: TestRunNotBlockedByPoisonHead (1.04s)5407PASS5408Running signing tests...5409=== RUN TestExternalSigner5410=== PAUSE TestExternalSigner5411=== RUN TestExternalSignerWrongPublicKey5412=== PAUSE TestExternalSignerWrongPublicKey5413=== RUN TestExternalSignerErrors5414=== PAUSE TestExternalSignerErrors5415=== RUN TestExternalSignerRestartsAfterCrash5416=== PAUSE TestExternalSignerRestartsAfterCrash5417=== RUN TestExternalSignerProgramErrorKeepsProcess5418=== PAUSE TestExternalSignerProgramErrorKeepsProcess5419=== RUN TestExternalSignerClose5420=== PAUSE TestExternalSignerClose5421=== RUN TestExternalSignerRejectsInvalidPublicKey5422=== PAUSE TestExternalSignerRejectsInvalidPublicKey5423=== RUN TestExternalSignerCancellation5424=== PAUSE TestExternalSignerCancellation5425=== RUN TestGenerateFingerprint5426=== PAUSE TestGenerateFingerprint5427=== RUN TestParseSigningKey5428=== PAUSE TestParseSigningKey5429=== RUN TestSign5430=== PAUSE TestSign5431=== RUN TestSignBatch5432=== PAUSE TestSignBatch5433=== RUN TestNilKeyPublicKey5434=== PAUSE TestNilKeyPublicKey5435=== RUN TestSignErrors5436=== PAUSE TestSignErrors5437=== CONT TestExternalSigner5438=== CONT TestExternalSignerProgramErrorKeepsProcess5439=== CONT TestExternalSignerRejectsInvalidPublicKey5440=== RUN TestExternalSignerRejectsInvalidPublicKey/#005441=== CONT TestExternalSignerCancellation5442=== CONT TestSignErrors5443=== CONT TestNilKeyPublicKey5444--- PASS: TestNilKeyPublicKey (0.00s)5445=== CONT TestSignBatch5446=== CONT TestSign5447=== CONT TestParseSigningKey5448=== RUN TestParseSigningKey/valid_32-byte_key5449=== PAUSE TestParseSigningKey/valid_32-byte_key5450=== RUN TestParseSigningKey/valid_32-byte_key_with_different_name5451=== PAUSE TestParseSigningKey/valid_32-byte_key_with_different_name5452=== RUN TestParseSigningKey/no_colon5453=== PAUSE TestParseSigningKey/no_colon5454=== RUN TestParseSigningKey/empty_name5455=== PAUSE TestParseSigningKey/empty_name5456=== RUN TestParseSigningKey/invalid_base645457=== PAUSE TestParseSigningKey/invalid_base645458=== RUN TestParseSigningKey/wrong_length5459=== PAUSE TestParseSigningKey/wrong_length5460=== CONT TestParseSigningKey/valid_32-byte_key5461=== CONT TestGenerateFingerprint5462=== RUN TestGenerateFingerprint/basic_with_references5463=== PAUSE TestGenerateFingerprint/basic_with_references5464=== RUN TestGenerateFingerprint/no_references5465=== PAUSE TestGenerateFingerprint/no_references5466=== RUN TestGenerateFingerprint/unsorted_references_get_sorted5467=== PAUSE TestGenerateFingerprint/unsorted_references_get_sorted5468=== RUN TestGenerateFingerprint/invalid_nar_hash_prefix5469=== PAUSE TestGenerateFingerprint/invalid_nar_hash_prefix5470=== RUN TestGenerateFingerprint/invalid_nar_hash_length5471=== PAUSE TestGenerateFingerprint/invalid_nar_hash_length5472=== RUN TestGenerateFingerprint/invalid_store_path_prefix5473=== CONT TestParseSigningKey/empty_name5474=== CONT TestExternalSignerErrors5475=== RUN TestExternalSignerErrors/exit_at_startup5476=== CONT TestExternalSignerRestartsAfterCrash5477=== CONT TestExternalSignerWrongPublicKey5478=== PAUSE TestExternalSignerRejectsInvalidPublicKey/#005479=== RUN TestExternalSignerRejectsInvalidPublicKey/no-colon5480=== PAUSE TestExternalSignerRejectsInvalidPublicKey/no-colon5481=== RUN TestExternalSignerRejectsInvalidPublicKey/:AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA=5482=== PAUSE TestExternalSignerRejectsInvalidPublicKey/:AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA=5483=== RUN TestExternalSignerRejectsInvalidPublicKey/test-key:invalid!5484=== PAUSE TestExternalSignerRejectsInvalidPublicKey/test-key:invalid!5485=== CONT TestParseSigningKey/wrong_length5486=== RUN TestExternalSignerRejectsInvalidPublicKey/test-key:YQ==5487=== PAUSE TestExternalSignerRejectsInvalidPublicKey/test-key:YQ==5488=== CONT TestParseSigningKey/invalid_base645489=== CONT TestParseSigningKey/valid_32-byte_key_with_different_name5490=== CONT TestParseSigningKey/no_colon5491=== CONT TestExternalSignerClose5492=== PAUSE TestGenerateFingerprint/invalid_store_path_prefix5493=== PAUSE TestExternalSignerErrors/exit_at_startup5494=== RUN TestExternalSignerErrors/null5495=== PAUSE TestExternalSignerErrors/null5496=== RUN TestExternalSignerErrors/missing_signatures5497=== PAUSE TestExternalSignerErrors/missing_signatures5498=== RUN TestExternalSignerErrors/null_signatures5499=== PAUSE TestExternalSignerErrors/null_signatures5500=== RUN TestExternalSignerErrors/invalid_signature_base645501=== PAUSE TestExternalSignerErrors/invalid_signature_base645502=== RUN TestExternalSignerErrors/program_error5503=== PAUSE TestExternalSignerErrors/program_error5504=== RUN TestExternalSignerErrors/invalid_JSON5505=== PAUSE TestExternalSignerErrors/invalid_JSON5506=== RUN TestExternalSignerErrors/wrong_signatures_shape5507=== PAUSE TestExternalSignerErrors/wrong_signatures_shape5508=== RUN TestExternalSignerErrors/wrong_signature_name5509=== PAUSE TestExternalSignerErrors/wrong_signature_name5510=== CONT TestExternalSignerRejectsInvalidPublicKey/#005511=== RUN TestExternalSignerErrors/wrong_signature_length5512=== CONT TestExternalSignerRejectsInvalidPublicKey/test-key:YQ==5513=== RUN TestGenerateFingerprint/invalid_reference_prefix5514=== CONT TestExternalSignerRejectsInvalidPublicKey/test-key:invalid!5515=== PAUSE TestExternalSignerErrors/wrong_signature_length5516=== PAUSE TestGenerateFingerprint/invalid_reference_prefix5517=== CONT TestGenerateFingerprint/basic_with_references5518=== RUN TestExternalSignerErrors/wrong_shape5519=== CONT TestGenerateFingerprint/invalid_store_path_prefix5520=== PAUSE TestExternalSignerErrors/wrong_shape5521=== RUN TestExternalSignerErrors/unrequested_key5522=== CONT TestGenerateFingerprint/invalid_nar_hash_prefix5523=== CONT TestExternalSignerRejectsInvalidPublicKey/no-colon5524=== CONT TestExternalSignerRejectsInvalidPublicKey/:AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA=5525--- PASS: TestExternalSignerRejectsInvalidPublicKey (0.00s)5526 --- PASS: TestExternalSignerRejectsInvalidPublicKey/#00 (0.00s)5527 --- PASS: TestExternalSignerRejectsInvalidPublicKey/test-key:YQ== (0.00s)5528 --- PASS: TestExternalSignerRejectsInvalidPublicKey/test-key:invalid! (0.00s)5529 --- PASS: TestExternalSignerRejectsInvalidPublicKey/no-colon (0.00s)5530 --- PASS: TestExternalSignerRejectsInvalidPublicKey/:AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA= (0.00s)5531=== PAUSE TestExternalSignerErrors/unrequested_key5532=== RUN TestExternalSignerErrors/missing_signature_name5533=== PAUSE TestExternalSignerErrors/missing_signature_name5534=== RUN TestExternalSignerErrors/exit_on_request5535=== CONT TestGenerateFingerprint/invalid_reference_prefix5536=== CONT TestGenerateFingerprint/invalid_nar_hash_length5537=== CONT TestGenerateFingerprint/unsorted_references_get_sorted5538=== CONT TestGenerateFingerprint/no_references5539--- PASS: TestGenerateFingerprint (0.00s)5540 --- PASS: TestGenerateFingerprint/basic_with_references (0.00s)5541 --- PASS: TestGenerateFingerprint/invalid_store_path_prefix (0.00s)5542 --- PASS: TestGenerateFingerprint/invalid_nar_hash_prefix (0.00s)5543 --- PASS: TestGenerateFingerprint/invalid_reference_prefix (0.00s)5544 --- PASS: TestGenerateFingerprint/invalid_nar_hash_length (0.00s)5545 --- PASS: TestGenerateFingerprint/unsorted_references_get_sorted (0.00s)5546 --- PASS: TestGenerateFingerprint/no_references (0.00s)5547=== PAUSE TestExternalSignerErrors/exit_on_request5548=== RUN TestExternalSignerErrors/wrong_id5549=== PAUSE TestExternalSignerErrors/wrong_id5550=== RUN TestExternalSignerErrors/too_few_signatures5551=== PAUSE TestExternalSignerErrors/too_few_signatures5552=== CONT TestExternalSignerErrors/too_few_signatures5553=== CONT TestExternalSignerErrors/invalid_JSON5554=== RUN TestSignErrors/nil_key5555=== PAUSE TestSignErrors/nil_key5556=== RUN TestSignErrors/nil_narinfo5557=== CONT TestExternalSignerErrors/wrong_signatures_shape5558=== CONT TestExternalSignerErrors/wrong_shape5559=== CONT TestExternalSignerErrors/program_error5560=== CONT TestExternalSignerErrors/exit_at_startup5561=== CONT TestExternalSignerErrors/missing_signature_name5562=== PAUSE TestSignErrors/nil_narinfo5563=== RUN TestSignErrors/invalid_narinfo5564=== CONT TestExternalSignerErrors/exit_on_request5565=== CONT TestExternalSignerErrors/wrong_signature_length5566=== PAUSE TestSignErrors/invalid_narinfo5567=== RUN TestSignErrors/canceled5568=== PAUSE TestSignErrors/canceled5569=== CONT TestExternalSignerErrors/wrong_id5570=== CONT TestExternalSignerErrors/missing_signatures5571=== CONT TestExternalSignerErrors/null_signatures5572=== CONT TestExternalSignerErrors/unrequested_key5573--- PASS: TestSignBatch (0.00s)5574--- PASS: TestParseSigningKey (0.00s)5575 --- PASS: TestParseSigningKey/empty_name (0.00s)5576 --- PASS: TestParseSigningKey/wrong_length (0.00s)5577 --- PASS: TestParseSigningKey/invalid_base64 (0.00s)5578 --- PASS: TestParseSigningKey/no_colon (0.00s)5579 --- PASS: TestParseSigningKey/valid_32-byte_key (0.00s)5580 --- PASS: TestParseSigningKey/valid_32-byte_key_with_different_name (0.00s)5581=== CONT TestExternalSignerErrors/null5582--- PASS: TestSign (0.00s)5583=== CONT TestSignErrors/canceled5584=== CONT TestSignErrors/invalid_narinfo5585=== CONT TestSignErrors/nil_narinfo5586=== CONT TestSignErrors/nil_key5587--- PASS: TestSignErrors (0.00s)5588 --- PASS: TestSignErrors/canceled (0.00s)5589 --- PASS: TestSignErrors/invalid_narinfo (0.00s)5590 --- PASS: TestSignErrors/nil_narinfo (0.00s)5591 --- PASS: TestSignErrors/nil_key (0.00s)5592=== CONT TestExternalSignerErrors/invalid_signature_base645593=== CONT TestExternalSignerErrors/wrong_signature_name5594--- PASS: TestExternalSignerCancellation (0.23s)5595--- PASS: TestExternalSignerWrongPublicKey (0.40s)5596--- PASS: TestExternalSignerProgramErrorKeepsProcess (0.59s)5597--- PASS: TestExternalSignerRestartsAfterCrash (0.80s)5598/private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestExternalSignerRestartsAfterCrash2240744207/001/sign program: line 7: /private/var/tb/8/scratch/9bf71896e68fdfe3/build/TestExternalSignerRestartsAfterCrash2240744207/001/sign program.starts: No such file or directory5599--- PASS: TestExternalSignerClose (2.48s)5600--- PASS: TestExternalSigner (2.68s)5601--- PASS: TestExternalSignerErrors (0.00s)5602 --- PASS: TestExternalSignerErrors/missing_signature_name (0.97s)5603 --- PASS: TestExternalSignerErrors/wrong_shape (1.15s)5604 --- PASS: TestExternalSignerErrors/null (1.33s)5605 --- PASS: TestExternalSignerErrors/wrong_signatures_shape (1.52s)5606 --- PASS: TestExternalSignerErrors/null_signatures (1.71s)5607 --- PASS: TestExternalSignerErrors/too_few_signatures (1.91s)5608 --- PASS: TestExternalSignerErrors/program_error (2.10s)5609 --- PASS: TestExternalSignerErrors/wrong_signature_name (2.28s)5610 --- PASS: TestExternalSignerErrors/invalid_JSON (2.85s)5611 --- PASS: TestExternalSignerErrors/exit_at_startup (3.05s)5612 --- PASS: TestExternalSignerErrors/exit_on_request (3.24s)5613 --- PASS: TestExternalSignerErrors/missing_signatures (3.42s)5614 --- PASS: TestExternalSignerErrors/unrequested_key (3.61s)5615 --- PASS: TestExternalSignerErrors/wrong_signature_length (3.80s)5616 --- PASS: TestExternalSignerErrors/wrong_id (3.98s)5617 --- PASS: TestExternalSignerErrors/invalid_signature_base64 (4.17s)5618PASS5619Running OpenBao signer tests...5620=== RUN TestSign5621=== PAUSE TestSign5622=== RUN TestSignErrors5623=== PAUSE TestSignErrors5624=== RUN TestServe5625=== PAUSE TestServe5626=== RUN TestServeRejectsGarbage5627=== PAUSE TestServeRejectsGarbage5628=== CONT TestSign5629=== CONT TestServe5630=== CONT TestServeRejectsGarbage5631=== CONT TestSignErrors5632=== RUN TestSignErrors/http_error5633--- PASS: TestServeRejectsGarbage (0.00s)5634=== PAUSE TestSignErrors/http_error5635=== RUN TestSignErrors/invalid_json5636=== PAUSE TestSignErrors/invalid_json5637=== RUN TestSignErrors/no_prefix5638=== PAUSE TestSignErrors/no_prefix5639=== RUN TestSignErrors/invalid_base645640=== PAUSE TestSignErrors/invalid_base645641=== CONT TestSignErrors/http_error5642=== CONT TestSignErrors/no_prefix5643=== CONT TestSignErrors/invalid_base645644=== CONT TestSignErrors/invalid_json5645--- PASS: TestServe (0.00s)5646--- PASS: TestSign (0.00s)5647--- PASS: TestSignErrors (0.00s)5648 --- PASS: TestSignErrors/invalid_base64 (0.00s)5649 --- PASS: TestSignErrors/no_prefix (0.00s)5650 --- PASS: TestSignErrors/invalid_json (0.00s)5651 --- PASS: TestSignErrors/http_error (0.00s)5652PASS