niks3-go-unit-tests
checks.aarch64-linux.go-unit-tests
· build #132
· raw
1tribuchet: building on eliza2Running client tests...3=== RUN TestDoServerRequestAttachesToken4=== PAUSE TestDoServerRequestAttachesToken5=== RUN TestCaseHackSuffix6=== PAUSE TestCaseHackSuffix7=== RUN TestFilterOversizedClosures8=== PAUSE TestFilterOversizedClosures9=== RUN TestPartSizeForNAR10=== PAUSE TestPartSizeForNAR11=== RUN TestUploadMultipart_SupersededByPeer12=== PAUSE TestUploadMultipart_SupersededByPeer13=== RUN TestDumpPathMatchesNix14=== PAUSE TestDumpPathMatchesNix15=== RUN TestDumpPathSingleFile16=== PAUSE TestDumpPathSingleFile17=== RUN TestDumpPathWriterError18=== PAUSE TestDumpPathWriterError19=== RUN TestEncodeNixBase3220=== PAUSE TestEncodeNixBase3221=== RUN TestEncodeNixBase32WithRealHash22=== PAUSE TestEncodeNixBase32WithRealHash23=== RUN TestConvertHashToNix3224=== PAUSE TestConvertHashToNix3225=== RUN TestGetStorePathHash26=== PAUSE TestGetStorePathHash27=== RUN TestPathInfoHashCompatibility28=== PAUSE TestPathInfoHashCompatibility29=== RUN TestParsePathInfoJSON30=== PAUSE TestParsePathInfoJSON31=== RUN TestParsePathInfoJSONMultiplePaths32=== PAUSE TestParsePathInfoJSONMultiplePaths33=== RUN TestPathInfoCACompatibility34=== PAUSE TestPathInfoCACompatibility35=== RUN TestRateLimiterFeedback36=== PAUSE TestRateLimiterFeedback37=== RUN TestRateLimiterFeedback_400DoesNotCountAsSuccess38=== PAUSE TestRateLimiterFeedback_400DoesNotCountAsSuccess39=== RUN TestResolveStorePath40=== PAUSE TestResolveStorePath41=== RUN TestDoWithRetry_BodyReplayedViaGetBody42=== PAUSE TestDoWithRetry_BodyReplayedViaGetBody43=== RUN TestShellSplit44=== PAUSE TestShellSplit45=== RUN TestShellSplitErrors46=== PAUSE TestShellSplitErrors47=== RUN TestSetClientTLS48=== PAUSE TestSetClientTLS49=== RUN TestSetClientTLSDoesNotMutateDefaultTransport50=== PAUSE TestSetClientTLSDoesNotMutateDefaultTransport51=== RUN TestSetClientTLSErrors52=== PAUSE TestSetClientTLSErrors53=== RUN TestStaticToken54=== PAUSE TestStaticToken55=== RUN TestFileTokenReadsAndCaches56=== PAUSE TestFileTokenReadsAndCaches57=== RUN TestFileTokenMissing58=== PAUSE TestFileTokenMissing59=== RUN TestFileTokenEmpty60=== PAUSE TestFileTokenEmpty61=== RUN TestScriptTokenNoExpiryRerunsEveryCall62=== PAUSE TestScriptTokenNoExpiryRerunsEveryCall63=== RUN TestScriptTokenCachesUntilRefresh64=== PAUSE TestScriptTokenCachesUntilRefresh65=== RUN TestScriptTokenEmptyToken66=== PAUSE TestScriptTokenEmptyToken67=== RUN TestScriptTokenBadJSON68=== PAUSE TestScriptTokenBadJSON69=== RUN TestScriptTokenScriptFails70=== PAUSE TestScriptTokenScriptFails71=== RUN TestScriptTokenEmptyCommand72=== PAUSE TestScriptTokenEmptyCommand73=== CONT TestDoServerRequestAttachesToken74=== CONT TestFileTokenMissing75=== CONT TestResolveStorePath76=== CONT TestEncodeNixBase32WithRealHash77--- PASS: TestEncodeNixBase32WithRealHash (0.00s)78=== CONT TestParsePathInfoJSON79=== RUN TestParsePathInfoJSON/Nix_format80=== CONT TestParsePathInfoJSONMultiplePaths81=== CONT TestRateLimiterFeedback_400DoesNotCountAsSuccess82=== CONT TestStaticToken83=== RUN TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths84--- PASS: TestStaticToken (0.00s)85=== CONT TestFileTokenReadsAndCaches86=== PAUSE TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths87=== RUN TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths88=== PAUSE TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths89=== CONT TestSetClientTLSDoesNotMutateDefaultTransport90--- PASS: TestFileTokenMissing (0.00s)91=== CONT TestDumpPathMatchesNix922026/08/20 17:24:08 WARN Rate limiter enabled after throttle name=server-test rate=593--- PASS: TestFileTokenReadsAndCaches (0.00s)94=== CONT TestScriptTokenNoExpiryRerunsEveryCall95--- PASS: TestResolveStorePath (0.00s)96=== CONT TestScriptTokenCachesUntilRefresh97=== CONT TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths98=== CONT TestPathInfoHashCompatibility99=== RUN TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)100=== CONT TestGetStorePathHash101=== PAUSE TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)102=== RUN TestPathInfoHashCompatibility/old_string_format_with_colon103=== PAUSE TestPathInfoHashCompatibility/old_string_format_with_colon104=== CONT TestScriptTokenEmptyToken105=== CONT TestScriptTokenEmptyCommand106=== CONT TestScriptTokenScriptFails107=== CONT TestScriptTokenBadJSON108=== CONT TestRateLimiterFeedback109=== CONT TestPathInfoCACompatibility110=== PAUSE TestParsePathInfoJSON/Nix_format111=== CONT TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths112=== CONT TestShellSplitErrors113=== CONT TestSetClientTLS114=== CONT TestUploadMultipart_SupersededByPeer115=== CONT TestEncodeNixBase32116=== CONT TestDumpPathWriterError117=== CONT TestDumpPathSingleFile118=== RUN TestGetStorePathHash/valid_store_path119=== RUN TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI120=== CONT TestFilterOversizedClosures121=== RUN TestEncodeNixBase32/test_string_hash122=== PAUSE TestEncodeNixBase32/test_string_hash123=== RUN TestEncodeNixBase32/empty_input124=== PAUSE TestEncodeNixBase32/empty_input125=== RUN TestRateLimiterFeedback/429_enables_limiter126=== PAUSE TestRateLimiterFeedback/429_enables_limiter127=== CONT TestConvertHashToNix32128=== PAUSE TestGetStorePathHash/valid_store_path129=== RUN TestGetStorePathHash/basename_without_hyphen_should_error130=== RUN TestFilterOversizedClosures/no_limit_keeps_everything131=== PAUSE TestFilterOversizedClosures/no_limit_keeps_everything132=== PAUSE TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI133=== RUN TestPathInfoHashCompatibility/new_structured_format_with_sha512134=== PAUSE TestGetStorePathHash/basename_without_hyphen_should_error135=== CONT TestSetClientTLSErrors136=== RUN TestParsePathInfoJSON/Lix_format137=== CONT TestFileTokenEmpty138=== RUN TestRateLimiterFeedback/503_enables_limiter139=== PAUSE TestRateLimiterFeedback/503_enables_limiter140=== CONT TestCaseHackSuffix141=== CONT TestPartSizeForNAR142=== RUN TestPathInfoCACompatibility/null_ca_field143=== RUN TestUploadMultipart_SupersededByPeer/exists144=== RUN TestConvertHashToNix32/SRI_format_to_Nix32145=== CONT TestShellSplit146=== RUN TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped147--- PASS: TestScriptTokenEmptyCommand (0.00s)148=== PAUSE TestPathInfoHashCompatibility/new_structured_format_with_sha512149=== RUN TestGetStorePathHash/hash_with_invalid_characters_should_error150=== PAUSE TestParsePathInfoJSON/Lix_format151=== CONT TestDoWithRetry_BodyReplayedViaGetBody152=== RUN TestParsePathInfoJSON/empty_input153=== RUN TestRateLimiterFeedback/200_does_not_enable_limiter154=== PAUSE TestPathInfoCACompatibility/null_ca_field155=== RUN TestPartSizeForNAR/zero_stays_at_minimum156=== PAUSE TestUploadMultipart_SupersededByPeer/exists157--- PASS: TestShellSplitErrors (0.00s)158--- PASS: TestScriptTokenScriptFails (0.00s)159--- PASS: TestScriptTokenEmptyToken (0.00s)160--- PASS: TestFileTokenEmpty (0.00s)161--- PASS: TestDoServerRequestAttachesToken (0.01s)162=== CONT TestEncodeNixBase32/empty_input163=== PAUSE TestConvertHashToNix32/SRI_format_to_Nix32164=== RUN TestSetClientTLSErrors/missing_cert_file165=== CONT TestPathInfoHashCompatibility/new_structured_format_with_sha512166--- PASS: TestShellSplit (0.00s)167--- PASS: TestParsePathInfoJSONMultiplePaths (0.00s)168 --- PASS: TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths (0.00s)169 --- PASS: TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths (0.00s)170=== PAUSE TestRateLimiterFeedback/200_does_not_enable_limiter171=== PAUSE TestGetStorePathHash/hash_with_invalid_characters_should_error172=== PAUSE TestPartSizeForNAR/zero_stays_at_minimum173=== RUN TestUploadMultipart_SupersededByPeer/missing174=== CONT TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)175=== RUN TestConvertHashToNix32/already_Nix32_format176=== PAUSE TestSetClientTLSErrors/missing_cert_file177=== CONT TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI178=== CONT TestEncodeNixBase32/test_string_hash179=== RUN TestPathInfoCACompatibility/old_string_format_-_text180=== RUN TestGetStorePathHash/hash_with_wrong_length_should_error181=== PAUSE TestParsePathInfoJSON/empty_input182=== CONT TestPathInfoHashCompatibility/old_string_format_with_colon183=== RUN TestPartSizeForNAR/small_stays_at_minimum184=== PAUSE TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped1852026/08/20 17:24:08 WARN Rate limiter enabled after throttle name=server-test rate=5186=== RUN TestRateLimiterFeedback/400_does_not_enable_limiter1872026/08/20 17:24:08 WARN Request returned retryable status, retrying attempt=1 max_attempts=6 backoff=0s status=503 url=http://127.0.0.1:41765188=== PAUSE TestGetStorePathHash/hash_with_wrong_length_should_error189=== PAUSE TestUploadMultipart_SupersededByPeer/missing190=== RUN TestParsePathInfoJSON/whitespace_only191--- PASS: TestScriptTokenBadJSON (0.01s)192=== PAUSE TestConvertHashToNix32/already_Nix32_format193=== RUN TestFilterOversizedClosures/all_closures_skipped194=== RUN TestSetClientTLSErrors/missing_key_file195=== PAUSE TestSetClientTLSErrors/missing_key_file196=== RUN TestSetClientTLSErrors/missing_ca_file197=== PAUSE TestRateLimiterFeedback/400_does_not_enable_limiter198=== PAUSE TestPartSizeForNAR/small_stays_at_minimum199=== PAUSE TestPathInfoCACompatibility/old_string_format_-_text200=== CONT TestGetStorePathHash/valid_store_path201=== CONT TestRateLimiterFeedback/400_does_not_enable_limiter202=== CONT TestGetStorePathHash/hash_with_wrong_length_should_error203=== CONT TestUploadMultipart_SupersededByPeer/missing204--- PASS: TestEncodeNixBase32 (0.00s)205 --- PASS: TestEncodeNixBase32/empty_input (0.00s)206 --- PASS: TestEncodeNixBase32/test_string_hash (0.00s)207--- PASS: TestSetClientTLSDoesNotMutateDefaultTransport (0.02s)208=== RUN TestConvertHashToNix32/invalid_format209--- PASS: TestPathInfoHashCompatibility (0.01s)210 --- PASS: TestPathInfoHashCompatibility/new_structured_format_with_sha512 (0.00s)211 --- PASS: TestPathInfoHashCompatibility/old_string_format_with_colon (0.00s)212 --- PASS: TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI) (0.00s)213 --- PASS: TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI (0.00s)214=== PAUSE TestConvertHashToNix32/invalid_format215=== CONT TestConvertHashToNix32/SRI_format_to_Nix32216=== PAUSE TestSetClientTLSErrors/missing_ca_file217=== CONT TestRateLimiterFeedback/429_enables_limiter218=== RUN TestSetClientTLSErrors/invalid_ca_file219=== RUN TestSetClientTLS/rejects_connection_without_client_cert220=== PAUSE TestSetClientTLS/rejects_connection_without_client_cert221=== RUN TestSetClientTLS/succeeds_with_client_cert_and_CA222=== PAUSE TestSetClientTLS/succeeds_with_client_cert_and_CA223=== RUN TestSetClientTLS/preserves_debug_logging_transport224=== PAUSE TestSetClientTLSErrors/invalid_ca_file225=== CONT TestSetClientTLSErrors/missing_cert_file2262026/08/20 17:24:08 WARN Rate limiter backed off name=server-test rate=5227=== RUN TestPartSizeForNAR/80_GiB_fits_at_minimum2282026/08/20 17:24:08 WARN Request returned retryable status, retrying attempt=2 max_attempts=6 backoff=0s status=503 url=http://127.0.0.1:41765229=== PAUSE TestPartSizeForNAR/80_GiB_fits_at_minimum230=== RUN TestPathInfoCACompatibility/old_string_format_-_fixed_recursive231=== PAUSE TestFilterOversizedClosures/all_closures_skipped232=== CONT TestGetStorePathHash/basename_without_hyphen_should_error233--- PASS: TestScriptTokenCachesUntilRefresh (0.02s)234=== CONT TestSetClientTLSErrors/missing_key_file235=== CONT TestGetStorePathHash/hash_with_invalid_characters_should_error236=== RUN TestPartSizeForNAR/115_GiB_needs_larger_parts237=== CONT TestFilterOversizedClosures/all_closures_skipped238=== CONT TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped239--- PASS: TestGetStorePathHash (0.01s)240 --- PASS: TestGetStorePathHash/valid_store_path (0.00s)241 --- PASS: TestGetStorePathHash/hash_with_wrong_length_should_error (0.00s)242 --- PASS: TestGetStorePathHash/basename_without_hyphen_should_error (0.00s)243 --- PASS: TestGetStorePathHash/hash_with_invalid_characters_should_error (0.00s)244=== CONT TestSetClientTLSErrors/missing_ca_file2452026/08/20 17:24:08 WARN Skipping closure: path exceeds server max NAR size top_level_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper oversized_path=/nix/store/bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb-vm-image nar_size=5000 max_nar_size=20002462026/08/20 17:24:08 WARN Skipping closure: path exceeds server max NAR size top_level_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper oversized_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper nar_size=100 max_nar_size=50247=== CONT TestFilterOversizedClosures/no_limit_keeps_everything248=== CONT TestConvertHashToNix32/invalid_format249=== CONT TestUploadMultipart_SupersededByPeer/exists250=== CONT TestConvertHashToNix32/already_Nix32_format251=== PAUSE TestParsePathInfoJSON/whitespace_only252=== CONT TestRateLimiterFeedback/503_enables_limiter253=== PAUSE TestSetClientTLS/preserves_debug_logging_transport254=== CONT TestRateLimiterFeedback/200_does_not_enable_limiter255=== CONT TestSetClientTLSErrors/invalid_ca_file256=== PAUSE TestPathInfoCACompatibility/old_string_format_-_fixed_recursive257=== PAUSE TestPartSizeForNAR/115_GiB_needs_larger_parts258=== RUN TestPathInfoCACompatibility/new_structured_format_-_text259=== RUN TestPartSizeForNAR/1_TiB2602026/08/20 17:24:08 WARN Rate limiter enabled after throttle name=server-test rate=52612026/08/20 17:24:08 WARN Request returned retryable status, retrying attempt=1 max_attempts=2 backoff=0s status=429 url=http://127.0.0.1:43365262--- PASS: TestFilterOversizedClosures (0.02s)263 --- PASS: TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped (0.00s)264 --- PASS: TestFilterOversizedClosures/all_closures_skipped (0.00s)265 --- PASS: TestFilterOversizedClosures/no_limit_keeps_everything (0.00s)266--- PASS: TestDoWithRetry_BodyReplayedViaGetBody (0.02s)2672026/08/20 17:24:08 WARN Rate limiter backed off name=server-test rate=5268=== RUN TestParsePathInfoJSON/invalid_JSON269=== CONT TestSetClientTLS/rejects_connection_without_client_cert270=== CONT TestSetClientTLS/preserves_debug_logging_transport271=== PAUSE TestPathInfoCACompatibility/new_structured_format_-_text272=== RUN TestPathInfoCACompatibility/new_structured_format_-_nar_method273=== PAUSE TestPathInfoCACompatibility/new_structured_format_-_nar_method2742026/08/20 17:24:08 WARN Rate limiter enabled after throttle name=server-test rate=5275=== PAUSE TestParsePathInfoJSON/invalid_JSON2762026/08/20 17:24:08 WARN Request returned retryable status, retrying attempt=1 max_attempts=2 backoff=0s status=503 url=http://127.0.0.1:39901277=== CONT TestPathInfoCACompatibility/old_string_format_-_text278=== CONT TestSetClientTLS/succeeds_with_client_cert_and_CA2792026/08/20 17:24:08 WARN Rate limiter backed off name=server-test rate=5280=== CONT TestParsePathInfoJSON/Nix_format281--- PASS: TestConvertHashToNix32 (0.01s)282 --- PASS: TestConvertHashToNix32/SRI_format_to_Nix32 (0.00s)283 --- PASS: TestConvertHashToNix32/invalid_format (0.00s)284 --- PASS: TestConvertHashToNix32/already_Nix32_format (0.00s)285=== PAUSE TestPartSizeForNAR/1_TiB286=== RUN TestPartSizeForNAR/5_TiB_S3_max_object287=== CONT TestPathInfoCACompatibility/new_structured_format_-_text288=== CONT TestPathInfoCACompatibility/new_structured_format_-_nar_method289=== CONT TestPathInfoCACompatibility/null_ca_field290=== CONT TestPathInfoCACompatibility/old_string_format_-_fixed_recursive291=== CONT TestParsePathInfoJSON/invalid_JSON292=== CONT TestParsePathInfoJSON/Lix_format293=== CONT TestParsePathInfoJSON/whitespace_only294=== CONT TestParsePathInfoJSON/empty_input295--- PASS: TestScriptTokenNoExpiryRerunsEveryCall (0.02s)296=== PAUSE TestPartSizeForNAR/5_TiB_S3_max_object297--- PASS: TestRateLimiterFeedback (0.01s)298 --- PASS: TestRateLimiterFeedback/400_does_not_enable_limiter (0.01s)299 --- PASS: TestRateLimiterFeedback/429_enables_limiter (0.01s)300 --- PASS: TestRateLimiterFeedback/503_enables_limiter (0.00s)301 --- PASS: TestRateLimiterFeedback/200_does_not_enable_limiter (0.00s)302=== RUN TestPartSizeForNAR/capped_at_5_GiB303=== PAUSE TestPartSizeForNAR/capped_at_5_GiB304=== CONT TestPartSizeForNAR/zero_stays_at_minimum305--- PASS: TestPathInfoCACompatibility (0.02s)306 --- PASS: TestPathInfoCACompatibility/old_string_format_-_text (0.00s)307 --- PASS: TestPathInfoCACompatibility/new_structured_format_-_text (0.00s)308 --- PASS: TestPathInfoCACompatibility/new_structured_format_-_nar_method (0.00s)309 --- PASS: TestPathInfoCACompatibility/null_ca_field (0.00s)310 --- PASS: TestPathInfoCACompatibility/old_string_format_-_fixed_recursive (0.00s)311=== CONT TestPartSizeForNAR/capped_at_5_GiB312=== CONT TestPartSizeForNAR/115_GiB_needs_larger_parts313=== CONT TestPartSizeForNAR/5_TiB_S3_max_object314=== CONT TestPartSizeForNAR/80_GiB_fits_at_minimum315=== CONT TestPartSizeForNAR/small_stays_at_minimum316=== CONT TestPartSizeForNAR/1_TiB317--- PASS: TestUploadMultipart_SupersededByPeer (0.01s)318 --- PASS: TestUploadMultipart_SupersededByPeer/missing (0.01s)319 --- PASS: TestUploadMultipart_SupersededByPeer/exists (0.00s)320--- PASS: TestParsePathInfoJSON (0.03s)321 --- PASS: TestParsePathInfoJSON/Nix_format (0.00s)322 --- PASS: TestParsePathInfoJSON/invalid_JSON (0.00s)323 --- PASS: TestParsePathInfoJSON/Lix_format (0.00s)324 --- PASS: TestParsePathInfoJSON/whitespace_only (0.00s)325 --- PASS: TestParsePathInfoJSON/empty_input (0.00s)326--- PASS: TestPartSizeForNAR (0.02s)327 --- PASS: TestPartSizeForNAR/zero_stays_at_minimum (0.00s)328 --- PASS: TestPartSizeForNAR/capped_at_5_GiB (0.00s)329 --- PASS: TestPartSizeForNAR/115_GiB_needs_larger_parts (0.00s)330 --- PASS: TestPartSizeForNAR/5_TiB_S3_max_object (0.00s)331 --- PASS: TestPartSizeForNAR/80_GiB_fits_at_minimum (0.00s)332 --- PASS: TestPartSizeForNAR/small_stays_at_minimum (0.00s)333 --- PASS: TestPartSizeForNAR/1_TiB (0.00s)334--- PASS: TestSetClientTLSErrors (0.01s)335 --- PASS: TestSetClientTLSErrors/missing_cert_file (0.00s)336 --- PASS: TestSetClientTLSErrors/missing_key_file (0.00s)337 --- PASS: TestSetClientTLSErrors/missing_ca_file (0.01s)338 --- PASS: TestSetClientTLSErrors/invalid_ca_file (0.00s)3392026/08/20 17:24:08 http: TLS handshake error from 127.0.0.1:58464: remote error: tls: bad certificate340--- PASS: TestSetClientTLS (0.02s)341 --- PASS: TestSetClientTLS/succeeds_with_client_cert_and_CA (0.00s)342 --- PASS: TestSetClientTLS/preserves_debug_logging_transport (0.00s)343 --- PASS: TestSetClientTLS/rejects_connection_without_client_cert (0.01s)344--- PASS: TestDumpPathWriterError (0.05s)345--- PASS: TestDumpPathSingleFile (0.10s)346--- PASS: TestCaseHackSuffix (0.09s)347--- PASS: TestDumpPathMatchesNix (0.11s)348--- PASS: TestRateLimiterFeedback_400DoesNotCountAsSuccess (1.00s)349PASS350Running server tests...351The files belonging to this database system will be owned by user "nixbld".352This user must also own the server process.353354The database cluster will be initialized with locale "C".355The default database encoding has accordingly been set to "SQL_ASCII".356The default text search configuration will be set to "english".357358Data page checksums are enabled.359360creating directory /build/postgres716756029/data ... ok361creating subdirectories ... ok362selecting dynamic shared memory implementation ... posix363selecting default "max_connections" ... 100364selecting default "shared_buffers" ... 128MB365selecting default time zone ... UTC366creating configuration files ... ok367running bootstrap script ... ok368performing post-bootstrap initialization ... ok369syncing data to disk ... ok370371initdb: warning: enabling "trust" authentication for local connections372initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.373374Success. You can now start the database server using:375376 pg_ctl -D /build/postgres716756029/data -l logfile start377378/build/postgres716756029:5432 - no response3792026-08-20 17:24:09.989 UTC [111] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit3802026-08-20 17:24:09.989 UTC [111] LOG: listening on Unix socket "/build/postgres716756029/.s.PGSQL.5432"3812026-08-20 17:24:09.993 UTC [118] LOG: database system was shut down at 2026-08-20 17:24:09 UTC3822026-08-20 17:24:09.997 UTC [111] LOG: database system is ready to accept connections383/build/postgres716756029:5432 - accepting connections384=== RUN TestService_AuthMiddleware385=== PAUSE TestService_AuthMiddleware386=== RUN TestService_AuthMiddleware_MTLSProxyHeader387=== PAUSE TestService_AuthMiddleware_MTLSProxyHeader388=== RUN TestService_AuthMiddleware_MTLSBoundSubjects389=== PAUSE TestService_AuthMiddleware_MTLSBoundSubjects390=== RUN TestService_ReadAuthMiddleware391=== PAUSE TestService_ReadAuthMiddleware392=== RUN TestService_AuthMiddleware_OIDC393=== PAUSE TestService_AuthMiddleware_OIDC394=== RUN TestCacheConfigHandler395=== PAUSE TestCacheConfigHandler396=== RUN TestCacheStatsHandler397=== PAUSE TestCacheStatsHandler398=== RUN TestClientCADerivations399=== PAUSE TestClientCADerivations400=== RUN TestClientErrorHandling401=== PAUSE TestClientErrorHandling402=== RUN TestClientIntegration403=== PAUSE TestClientIntegration404=== RUN TestClientMultipleUploads405=== PAUSE TestClientMultipleUploads406=== RUN TestClientWithDependencies407=== PAUSE TestClientWithDependencies408=== RUN TestPinProtectsFromGC409=== PAUSE TestPinProtectsFromGC410=== RUN TestGCAdvisoryLockBlocksConcurrentRun4112026-08-20 17:24:13.112 UTC [518] ERROR: relation "goose_db_version" does not exist at character 364122026-08-20 17:24:13.112 UTC [518] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4132026/08/20 17:24:13 OK 20241026095416_initial_model.sql (11.63ms)4142026/08/20 17:24:13 OK 20251210153512_drop_unused_gin_index.sql (1.52ms)4152026/08/20 17:24:13 OK 20251218171726_add_pins.sql (2.8ms)4162026/08/20 17:24:13 OK 20260628120000_add_object_size_and_stats.sql (2.77ms)4172026/08/20 17:24:13 goose: successfully migrated database to version: 202606281200004182026/08/20 17:24:13 OK 1_commit_pending_closure.sql (2.07ms)4192026/08/20 17:24:13 OK 2_object_stats_trigger.sql (862.55µs)4202026/08/20 17:24:13 goose: up to current file version: 2421--- PASS: TestGCAdvisoryLockBlocksConcurrentRun (0.28s)422=== RUN TestGCBugBareHashReferences423=== PAUSE TestGCBugBareHashReferences424=== RUN TestGCMetrics425=== PAUSE TestGCMetrics426=== RUN TestGCTaskStore_StartNew427=== PAUSE TestGCTaskStore_StartNew428=== RUN TestGCTaskStore_DeduplicateSameParams429=== PAUSE TestGCTaskStore_DeduplicateSameParams430=== RUN TestGCTaskStore_ConflictDifferentParams431=== PAUSE TestGCTaskStore_ConflictDifferentParams432=== RUN TestGCTaskStore_GetEmpty433=== PAUSE TestGCTaskStore_GetEmpty434=== RUN TestGCTaskStore_GetReturnsLatest435=== PAUSE TestGCTaskStore_GetReturnsLatest436=== RUN TestGCTaskStore_CompletedAllowsNewTask437=== PAUSE TestGCTaskStore_CompletedAllowsNewTask438=== RUN TestGCTaskStore_PhaseUpdates439=== PAUSE TestGCTaskStore_PhaseUpdates440=== RUN TestGCTaskStore_Fail441=== PAUSE TestGCTaskStore_Fail442=== RUN TestGracefulShutdownDrainsInflight443=== PAUSE TestGracefulShutdownDrainsInflight444=== RUN TestService_healthCheckHandler445=== PAUSE TestService_healthCheckHandler446=== RUN TestGenerateLandingPage447=== PAUSE TestGenerateLandingPage448=== RUN TestCacheConfigHandlerMaxNarSize449=== PAUSE TestCacheConfigHandlerMaxNarSize450=== RUN TestCreatePendingClosureRejectsOversizedNAR451=== PAUSE TestCreatePendingClosureRejectsOversizedNAR452=== RUN TestNARDeduplicationMetadataUploadBug453=== PAUSE TestNARDeduplicationMetadataUploadBug454=== RUN TestMetricsInventory455=== PAUSE TestMetricsInventory456=== RUN TestService_NativeMTLS457=== PAUSE TestService_NativeMTLS458=== RUN TestServerTLSConfig459=== PAUSE TestServerTLSConfig460=== RUN TestMultipartCleanup461=== PAUSE TestMultipartCleanup462=== RUN TestObjectStatsTrigger463=== PAUSE TestObjectStatsTrigger464=== RUN TestOrphanedObjectsGC465=== PAUSE TestOrphanedObjectsGC466=== RUN TestOrphanedObjectsGCStressTest467=== PAUSE TestOrphanedObjectsGCStressTest468=== RUN TestResurrectedObjectNotDeleted469=== PAUSE TestResurrectedObjectNotDeleted470=== RUN TestParseSingleRange471=== PAUSE TestParseSingleRange472=== RUN TestIsValidCachePath473=== PAUSE TestIsValidCachePath474=== RUN TestReadProxyNarinfo475=== PAUSE TestReadProxyNarinfo476=== RUN TestReadProxyNarinfoAlreadyDecompressed477=== PAUSE TestReadProxyNarinfoAlreadyDecompressed478=== RUN TestReadProxyNarStreaming479=== PAUSE TestReadProxyNarStreaming480=== RUN TestReadProxy404481=== PAUSE TestReadProxy404482=== RUN TestReadProxyInvalidPath483=== PAUSE TestReadProxyInvalidPath484=== RUN TestReadProxyHead485=== PAUSE TestReadProxyHead486=== RUN TestReadProxyConditionalGet487=== PAUSE TestReadProxyConditionalGet488=== RUN TestReadProxyRootRedirectsToIndexHTML489=== PAUSE TestReadProxyRootRedirectsToIndexHTML490=== RUN TestReadProxyDisabled491=== PAUSE TestReadProxyDisabled492=== RUN TestReadProxyRangeRequest493=== PAUSE TestReadProxyRangeRequest494=== RUN TestRedundantMultipartUpload495=== PAUSE TestRedundantMultipartUpload496=== RUN TestCompleteMultipartUpload_ErrorButObjectExists497=== PAUSE TestCompleteMultipartUpload_ErrorButObjectExists498=== RUN TestCompletedNarNotReofferedAcrossClosures499=== PAUSE TestCompletedNarNotReofferedAcrossClosures500=== RUN TestPresignedUploadRegisteredBeforeCommit501=== PAUSE TestPresignedUploadRegisteredBeforeCommit502=== RUN TestService_Rustfstest503=== PAUSE TestService_Rustfstest504=== RUN TestParseSize505=== PAUSE TestParseSize506=== RUN TestSkippedUploadsHandler507=== PAUSE TestSkippedUploadsHandler508=== RUN TestSystemdListenerNotActivated509--- PASS: TestSystemdListenerNotActivated (0.00s)510=== RUN TestWatchdogBeatsWhenHealthy511--- PASS: TestWatchdogBeatsWhenHealthy (0.02s)512=== RUN TestWatchdogSkipsWhenUnhealthy5132026/08/20 17:24:13 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"5142026/08/20 17:24:13 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"5152026/08/20 17:24:13 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"5162026/08/20 17:24:13 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"5172026/08/20 17:24:13 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"5182026/08/20 17:24:13 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"5192026/08/20 17:24:13 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"5202026/08/20 17:24:13 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"5212026/08/20 17:24:13 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"5222026/08/20 17:24:13 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"523--- PASS: TestWatchdogSkipsWhenUnhealthy (0.20s)524=== RUN TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle525=== PAUSE TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle526=== RUN TestProxyWriteTimeout527=== PAUSE TestProxyWriteTimeout528=== RUN TestIsValidUploadKey529=== PAUSE TestIsValidUploadKey530=== RUN TestUploadHandlersRejectInvalidKeys531=== PAUSE TestUploadHandlersRejectInvalidKeys532=== RUN TestUploadHandlersRejectOversizedBody533=== PAUSE TestUploadHandlersRejectOversizedBody534=== RUN TestService_cleanupPendingClosuresHandler535=== PAUSE TestService_cleanupPendingClosuresHandler536=== RUN TestService_createPendingClosureHandler537=== PAUSE TestService_createPendingClosureHandler538=== RUN TestService_verifyS3Integrity539=== PAUSE TestService_verifyS3Integrity540=== RUN TestCompleteMultipartUnregistered541=== PAUSE TestCompleteMultipartUnregistered542=== RUN TestCreatePendingClosure_SmallNARUsesSimplePUT543=== PAUSE TestCreatePendingClosure_SmallNARUsesSimplePUT544=== CONT TestCreatePendingClosure_SmallNARUsesSimplePUT545=== CONT TestUploadHandlersRejectOversizedBody546=== CONT TestOrphanedObjectsGC547=== CONT TestMetricsInventory548=== CONT TestService_AuthMiddleware549=== CONT TestCompleteMultipartUnregistered550=== CONT TestObjectStatsTrigger551=== CONT TestService_verifyS3Integrity552=== CONT TestMultipartCleanup553=== CONT TestService_createPendingClosureHandler554=== CONT TestServerTLSConfig555=== RUN TestServerTLSConfig/no_client_CA556=== CONT TestService_cleanupPendingClosuresHandler557=== PAUSE TestServerTLSConfig/no_client_CA558=== RUN TestServerTLSConfig/missing_CA_file559=== CONT TestService_NativeMTLS560=== CONT TestNARDeduplicationMetadataUploadBug561=== PAUSE TestServerTLSConfig/missing_CA_file562=== CONT TestCreatePendingClosureRejectsOversizedNAR563=== RUN TestServerTLSConfig/not_a_PEM_file564=== PAUSE TestServerTLSConfig/not_a_PEM_file565=== CONT TestGenerateLandingPage566=== CONT TestGCBugBareHashReferences567=== CONT TestPinProtectsFromGC568=== CONT TestClientWithDependencies569=== CONT TestClientMultipleUploads570=== CONT TestClientIntegration571=== CONT TestClientErrorHandling572=== CONT TestGCMetrics573=== CONT TestCacheConfigHandlerMaxNarSize574=== CONT TestClientCADerivations5752026/08/20 17:24:13 INFO Received uploads request method=POST path=/api/pending_closures576--- PASS: TestCreatePendingClosureRejectsOversizedNAR (0.00s)577=== CONT TestCacheStatsHandler578--- PASS: TestGenerateLandingPage (0.00s)579=== RUN TestClientErrorHandling/InvalidStorePath580=== PAUSE TestClientErrorHandling/InvalidStorePath581=== RUN TestClientErrorHandling/InvalidAuthToken582=== PAUSE TestClientErrorHandling/InvalidAuthToken583=== RUN TestClientErrorHandling/ServerNotAvailable584=== PAUSE TestClientErrorHandling/ServerNotAvailable585=== CONT TestCacheConfigHandler586=== RUN TestCacheConfigHandler/full_config,_no_issuer587=== PAUSE TestCacheConfigHandler/full_config,_no_issuer588=== RUN TestCacheConfigHandler/no_cache_url_configured589=== PAUSE TestCacheConfigHandler/no_cache_url_configured590=== CONT TestGracefulShutdownDrainsInflight591=== RUN TestCacheConfigHandler/no_signing_keys592=== PAUSE TestCacheConfigHandler/no_signing_keys593=== RUN TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator594=== PAUSE TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator595=== CONT TestService_AuthMiddleware_OIDC596=== CONT TestService_healthCheckHandler5972026/08/20 17:24:13 INFO Starting HTTP server address=127.0.0.1:34515598--- PASS: TestCacheConfigHandlerMaxNarSize (0.00s)5992026/08/20 17:24:13 INFO Shutdown signal received, draining in-flight requests timeout=10s6002026/08/20 17:24:13 INFO OIDC provider initialized name=test6012026-08-20 17:24:13.616 UTC [579] ERROR: relation "goose_db_version" does not exist at character 366022026-08-20 17:24:13.616 UTC [579] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC6032026/08/20 17:24:13 OK 20241026095416_initial_model.sql (21.3ms)604=== RUN TestUploadHandlersRejectOversizedBody/create_pending_closure605=== PAUSE TestUploadHandlersRejectOversizedBody/create_pending_closure606=== RUN TestUploadHandlersRejectOversizedBody/complete_multipart607=== PAUSE TestUploadHandlersRejectOversizedBody/complete_multipart608=== RUN TestUploadHandlersRejectOversizedBody/request_more_parts609=== PAUSE TestUploadHandlersRejectOversizedBody/request_more_parts610=== CONT TestGCTaskStore_Fail611--- PASS: TestGCTaskStore_Fail (0.00s)612=== CONT TestService_ReadAuthMiddleware6132026-08-20 17:24:13.686 UTC [591] ERROR: relation "goose_db_version" does not exist at character 366142026-08-20 17:24:13.686 UTC [591] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC6152026-08-20 17:24:13.686 UTC [594] ERROR: relation "goose_db_version" does not exist at character 366162026-08-20 17:24:13.686 UTC [594] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC6172026-08-20 17:24:13.686 UTC [592] ERROR: relation "goose_db_version" does not exist at character 366182026-08-20 17:24:13.686 UTC [592] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC6192026-08-20 17:24:13.686 UTC [593] ERROR: relation "goose_db_version" does not exist at character 366202026-08-20 17:24:13.686 UTC [593] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC6212026-08-20 17:24:13.694 UTC [597] ERROR: relation "goose_db_version" does not exist at character 366222026-08-20 17:24:13.694 UTC [597] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC6232026/08/20 17:24:13 OK 20251210153512_drop_unused_gin_index.sql (17.34ms)6242026/08/20 17:24:13 OK 20251218171726_add_pins.sql (16.49ms)6252026/08/20 17:24:13 OK 20260628120000_add_object_size_and_stats.sql (19.77ms)6262026/08/20 17:24:13 goose: successfully migrated database to version: 202606281200006272026/08/20 17:24:13 OK 1_commit_pending_closure.sql (4.43ms)6282026/08/20 17:24:13 OK 2_object_stats_trigger.sql (4.28ms)6292026/08/20 17:24:13 goose: up to current file version: 2630--- PASS: TestGracefulShutdownDrainsInflight (0.15s)631=== CONT TestGCTaskStore_PhaseUpdates632--- PASS: TestGCTaskStore_PhaseUpdates (0.00s)633=== CONT TestService_AuthMiddleware_MTLSBoundSubjects6342026/08/20 17:24:13 OK 20241026095416_initial_model.sql (33.34ms)6352026-08-20 17:24:13.752 UTC [599] ERROR: relation "goose_db_version" does not exist at character 366362026-08-20 17:24:13.752 UTC [599] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC6372026/08/20 17:24:13 OK 20241026095416_initial_model.sql (38.64ms)6382026-08-20 17:24:13.757 UTC [600] ERROR: relation "goose_db_version" does not exist at character 366392026-08-20 17:24:13.757 UTC [600] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC6402026-08-20 17:24:13.759 UTC [603] ERROR: relation "goose_db_version" does not exist at character 366412026-08-20 17:24:13.759 UTC [603] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC6422026-08-20 17:24:13.759 UTC [602] ERROR: relation "goose_db_version" does not exist at character 366432026-08-20 17:24:13.759 UTC [602] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC6442026/08/20 17:24:13 OK 20251210153512_drop_unused_gin_index.sql (5.25ms)6452026/08/20 17:24:13 OK 20241026095416_initial_model.sql (40.13ms)6462026/08/20 17:24:13 OK 20251210153512_drop_unused_gin_index.sql (5.76ms)6472026/08/20 17:24:13 OK 20241026095416_initial_model.sql (41.48ms)6482026/08/20 17:24:13 OK 20241026095416_initial_model.sql (40.76ms)6492026/08/20 17:24:13 OK 20251210153512_drop_unused_gin_index.sql (6.53ms)6502026/08/20 17:24:13 OK 20251210153512_drop_unused_gin_index.sql (5.31ms)6512026/08/20 17:24:13 OK 20251210153512_drop_unused_gin_index.sql (5.37ms)6522026/08/20 17:24:13 OK 20251218171726_add_pins.sql (10.51ms)6532026/08/20 17:24:13 OK 20251218171726_add_pins.sql (11.16ms)6542026-08-20 17:24:13.775 UTC [605] ERROR: relation "goose_db_version" does not exist at character 366552026-08-20 17:24:13.775 UTC [605] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC6562026-08-20 17:24:13.776 UTC [607] ERROR: relation "goose_db_version" does not exist at character 366572026-08-20 17:24:13.776 UTC [607] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC6582026-08-20 17:24:13.776 UTC [606] ERROR: relation "goose_db_version" does not exist at character 366592026-08-20 17:24:13.776 UTC [606] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC6602026/08/20 17:24:13 OK 20251218171726_add_pins.sql (13.26ms)6612026/08/20 17:24:13 OK 20251218171726_add_pins.sql (19.09ms)6622026/08/20 17:24:13 OK 20251218171726_add_pins.sql (19.39ms)6632026/08/20 17:24:13 OK 20260628120000_add_object_size_and_stats.sql (19.76ms)6642026/08/20 17:24:13 goose: successfully migrated database to version: 202606281200006652026/08/20 17:24:13 OK 20241026095416_initial_model.sql (30.26ms)6662026/08/20 17:24:13 OK 20260628120000_add_object_size_and_stats.sql (22.66ms)6672026/08/20 17:24:13 goose: successfully migrated database to version: 202606281200006682026/08/20 17:24:13 OK 20241026095416_initial_model.sql (27.28ms)6692026/08/20 17:24:13 OK 20260628120000_add_object_size_and_stats.sql (15.4ms)6702026/08/20 17:24:13 goose: successfully migrated database to version: 202606281200006712026/08/20 17:24:13 OK 1_commit_pending_closure.sql (6.76ms)6722026/08/20 17:24:13 OK 20241026095416_initial_model.sql (27.97ms)6732026/08/20 17:24:13 OK 20260628120000_add_object_size_and_stats.sql (9.97ms)6742026/08/20 17:24:13 goose: successfully migrated database to version: 202606281200006752026/08/20 17:24:13 OK 20260628120000_add_object_size_and_stats.sql (9.95ms)6762026/08/20 17:24:13 goose: successfully migrated database to version: 202606281200006772026/08/20 17:24:13 OK 20241026095416_initial_model.sql (28.65ms)6782026/08/20 17:24:13 OK 20251210153512_drop_unused_gin_index.sql (3.5ms)6792026/08/20 17:24:13 OK 20251210153512_drop_unused_gin_index.sql (4.15ms)6802026/08/20 17:24:13 OK 1_commit_pending_closure.sql (6.23ms)6812026/08/20 17:24:13 OK 20251210153512_drop_unused_gin_index.sql (5.01ms)6822026/08/20 17:24:13 OK 20251210153512_drop_unused_gin_index.sql (5.36ms)6832026/08/20 17:24:13 OK 2_object_stats_trigger.sql (7.85ms)6842026/08/20 17:24:13 goose: up to current file version: 26852026/08/20 17:24:13 OK 1_commit_pending_closure.sql (8.16ms)6862026/08/20 17:24:13 OK 1_commit_pending_closure.sql (7.96ms)6872026/08/20 17:24:13 OK 20251218171726_add_pins.sql (7.7ms)6882026/08/20 17:24:13 OK 1_commit_pending_closure.sql (7.44ms)6892026/08/20 17:24:13 OK 2_object_stats_trigger.sql (5.08ms)6902026/08/20 17:24:13 goose: up to current file version: 26912026/08/20 17:24:13 OK 20251218171726_add_pins.sql (7.14ms)6922026/08/20 17:24:13 OK 20251218171726_add_pins.sql (7.04ms)6932026/08/20 17:24:13 OK 2_object_stats_trigger.sql (4.02ms)6942026/08/20 17:24:13 goose: up to current file version: 26952026/08/20 17:24:13 OK 2_object_stats_trigger.sql (4.21ms)6962026/08/20 17:24:13 goose: up to current file version: 26972026/08/20 17:24:13 OK 20251218171726_add_pins.sql (9.35ms)6982026/08/20 17:24:13 OK 2_object_stats_trigger.sql (6.12ms)6992026/08/20 17:24:13 goose: up to current file version: 27002026/08/20 17:24:13 OK 20260628120000_add_object_size_and_stats.sql (9.5ms)7012026/08/20 17:24:13 goose: successfully migrated database to version: 202606281200007022026/08/20 17:24:13 OK 20241026095416_initial_model.sql (19.21ms)7032026/08/20 17:24:13 OK 20260628120000_add_object_size_and_stats.sql (10.1ms)7042026/08/20 17:24:13 goose: successfully migrated database to version: 202606281200007052026/08/20 17:24:13 OK 20241026095416_initial_model.sql (21.03ms)7062026/08/20 17:24:13 OK 20241026095416_initial_model.sql (21.06ms)7072026/08/20 17:24:13 OK 20260628120000_add_object_size_and_stats.sql (16.98ms)7082026/08/20 17:24:13 goose: successfully migrated database to version: 202606281200007092026/08/20 17:24:13 OK 20260628120000_add_object_size_and_stats.sql (14.5ms)7102026/08/20 17:24:13 goose: successfully migrated database to version: 202606281200007112026/08/20 17:24:13 OK 20251210153512_drop_unused_gin_index.sql (11.3ms)7122026/08/20 17:24:13 OK 1_commit_pending_closure.sql (11.25ms)7132026/08/20 17:24:13 OK 1_commit_pending_closure.sql (13.51ms)7142026/08/20 17:24:13 OK 20251210153512_drop_unused_gin_index.sql (11.57ms)7152026/08/20 17:24:13 OK 20251210153512_drop_unused_gin_index.sql (11.62ms)7162026-08-20 17:24:13.829 UTC [609] ERROR: relation "goose_db_version" does not exist at character 367172026-08-20 17:24:13.829 UTC [609] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7182026-08-20 17:24:13.830 UTC [608] ERROR: relation "goose_db_version" does not exist at character 367192026-08-20 17:24:13.830 UTC [608] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7202026/08/20 17:24:13 OK 1_commit_pending_closure.sql (5.02ms)7212026/08/20 17:24:13 OK 2_object_stats_trigger.sql (5.4ms)7222026/08/20 17:24:13 goose: up to current file version: 27232026/08/20 17:24:13 OK 2_object_stats_trigger.sql (5.2ms)7242026/08/20 17:24:13 goose: up to current file version: 27252026/08/20 17:24:13 OK 1_commit_pending_closure.sql (7.6ms)7262026/08/20 17:24:13 OK 20251218171726_add_pins.sql (7.8ms)7272026/08/20 17:24:13 OK 20251218171726_add_pins.sql (6.87ms)7282026/08/20 17:24:13 OK 2_object_stats_trigger.sql (4.62ms)7292026/08/20 17:24:13 goose: up to current file version: 27302026/08/20 17:24:13 OK 20251218171726_add_pins.sql (8.66ms)731{"timestamp":"2026-08-20T17:24:13.838575829Z","level":"ERROR","duration":"603.385µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(355)"}732{"timestamp":"2026-08-20T17:24:13.839472956Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"7640cf7d-9503-45df-9ce1-31ac1dcbbb64","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket10/","status_code":503,"duration_ms":1,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(355)"}7332026/08/20 17:24:13 OK 20260628120000_add_object_size_and_stats.sql (7.62ms)7342026/08/20 17:24:13 goose: successfully migrated database to version: 202606281200007352026/08/20 17:24:13 OK 2_object_stats_trigger.sql (7.39ms)7362026/08/20 17:24:13 goose: up to current file version: 27372026-08-20 17:24:13.843 UTC [610] ERROR: relation "goose_db_version" does not exist at character 367382026-08-20 17:24:13.843 UTC [610] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7392026/08/20 17:24:13 OK 20260628120000_add_object_size_and_stats.sql (7.57ms)7402026/08/20 17:24:13 goose: successfully migrated database to version: 202606281200007412026-08-20 17:24:13.844 UTC [613] ERROR: relation "goose_db_version" does not exist at character 367422026-08-20 17:24:13.844 UTC [613] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC743{"timestamp":"2026-08-20T17:24:13.845100086Z","level":"ERROR","duration":"563.645µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(303)"}744{"timestamp":"2026-08-20T17:24:13.845172306Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"f812f508-5074-4e7b-9a18-4ead2792a4b5","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket11/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(303)"}7452026-08-20 17:24:13.845 UTC [614] ERROR: relation "goose_db_version" does not exist at character 367462026-08-20 17:24:13.845 UTC [614] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7472026-08-20 17:24:13.845 UTC [611] ERROR: relation "goose_db_version" does not exist at character 367482026-08-20 17:24:13.845 UTC [611] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7492026-08-20 17:24:13.846 UTC [616] ERROR: relation "goose_db_version" does not exist at character 367502026-08-20 17:24:13.846 UTC [616] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7512026-08-20 17:24:13.846 UTC [612] ERROR: relation "goose_db_version" does not exist at character 367522026-08-20 17:24:13.846 UTC [612] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7532026-08-20 17:24:13.846 UTC [615] ERROR: relation "goose_db_version" does not exist at character 367542026-08-20 17:24:13.846 UTC [615] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7552026/08/20 17:24:13 OK 1_commit_pending_closure.sql (6.53ms)7562026-08-20 17:24:13.850 UTC [617] ERROR: relation "goose_db_version" does not exist at character 367572026-08-20 17:24:13.850 UTC [617] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7582026/08/20 17:24:13 OK 1_commit_pending_closure.sql (8.44ms)7592026/08/20 17:24:13 OK 20260628120000_add_object_size_and_stats.sql (13.9ms)7602026/08/20 17:24:13 goose: successfully migrated database to version: 202606281200007612026/08/20 17:24:13 OK 2_object_stats_trigger.sql (5.8ms)7622026/08/20 17:24:13 goose: up to current file version: 27632026/08/20 17:24:13 OK 20241026095416_initial_model.sql (14.23ms)7642026/08/20 17:24:13 OK 2_object_stats_trigger.sql (4.35ms)7652026/08/20 17:24:13 goose: up to current file version: 2766{"timestamp":"2026-08-20T17:24:13.857755996Z","level":"ERROR","duration":"636.225µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(304)"}767{"timestamp":"2026-08-20T17:24:13.857837677Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"dee46eec-39b9-40ce-bbc7-5f732b059771","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket12/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(304)"}7682026/08/20 17:24:13 OK 1_commit_pending_closure.sql (5.01ms)7692026/08/20 17:24:13 OK 20241026095416_initial_model.sql (15.41ms)770{"timestamp":"2026-08-20T17:24:13.858971587Z","level":"ERROR","duration":"450.904µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(303)"}771{"timestamp":"2026-08-20T17:24:13.859026267Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"32485ee8-0cbf-46f7-9596-4fa68c982504","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket13/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(303)"}7722026/08/20 17:24:13 OK 20251210153512_drop_unused_gin_index.sql (3.9ms)7732026/08/20 17:24:13 OK 2_object_stats_trigger.sql (2.83ms)7742026/08/20 17:24:13 goose: up to current file version: 2775{"timestamp":"2026-08-20T17:24:13.863459826Z","level":"ERROR","duration":"492.484µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(304)"}776{"timestamp":"2026-08-20T17:24:13.863543867Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"89010736-8013-4403-964a-309f753b3d89","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket14/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(304)"}7772026/08/20 17:24:13 OK 20251210153512_drop_unused_gin_index.sql (4.75ms)7782026/08/20 17:24:13 OK 20251218171726_add_pins.sql (6.39ms)7792026/08/20 17:24:13 OK 20241026095416_initial_model.sql (12.19ms)7802026-08-20 17:24:13.869 UTC [618] ERROR: relation "goose_db_version" does not exist at character 367812026-08-20 17:24:13.869 UTC [618] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7822026/08/20 17:24:13 OK 20241026095416_initial_model.sql (13.22ms)7832026/08/20 17:24:13 OK 20241026095416_initial_model.sql (14.16ms)7842026/08/20 17:24:13 OK 20251218171726_add_pins.sql (6.12ms)7852026/08/20 17:24:13 OK 20241026095416_initial_model.sql (12.65ms)7862026/08/20 17:24:13 OK 20241026095416_initial_model.sql (13.89ms)7872026/08/20 17:24:13 OK 20241026095416_initial_model.sql (14.64ms)7882026/08/20 17:24:13 OK 20251210153512_drop_unused_gin_index.sql (3.36ms)7892026/08/20 17:24:13 OK 20260628120000_add_object_size_and_stats.sql (6.53ms)7902026/08/20 17:24:13 goose: successfully migrated database to version: 202606281200007912026/08/20 17:24:13 OK 20241026095416_initial_model.sql (13.62ms)7922026/08/20 17:24:13 OK 20241026095416_initial_model.sql (14.57ms)7932026/08/20 17:24:13 OK 20251210153512_drop_unused_gin_index.sql (2.81ms)7942026/08/20 17:24:13 OK 20251210153512_drop_unused_gin_index.sql (3.08ms)7952026/08/20 17:24:13 OK 20251210153512_drop_unused_gin_index.sql (2.56ms)7962026/08/20 17:24:13 OK 20251210153512_drop_unused_gin_index.sql (4.09ms)7972026/08/20 17:24:13 OK 20260628120000_add_object_size_and_stats.sql (4.86ms)7982026/08/20 17:24:13 goose: successfully migrated database to version: 202606281200007992026/08/20 17:24:13 OK 20251210153512_drop_unused_gin_index.sql (2.31ms)8002026/08/20 17:24:13 OK 20251210153512_drop_unused_gin_index.sql (3.81ms)8012026/08/20 17:24:13 OK 1_commit_pending_closure.sql (2.99ms)8022026/08/20 17:24:13 OK 20251210153512_drop_unused_gin_index.sql (3.11ms)8032026/08/20 17:24:13 OK 20251218171726_add_pins.sql (4.5ms)8042026/08/20 17:24:13 OK 20251218171726_add_pins.sql (5.91ms)8052026/08/20 17:24:13 OK 2_object_stats_trigger.sql (2.45ms)8062026/08/20 17:24:13 goose: up to current file version: 28072026/08/20 17:24:13 OK 20251218171726_add_pins.sql (4.33ms)8082026/08/20 17:24:13 OK 1_commit_pending_closure.sql (3.26ms)8092026/08/20 17:24:13 OK 20251218171726_add_pins.sql (5.31ms)8102026/08/20 17:24:13 OK 20251218171726_add_pins.sql (4.41ms)811{"timestamp":"2026-08-20T17:24:13.880076212Z","level":"ERROR","duration":"386.884µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(355)"}8122026/08/20 17:24:13 OK 20251218171726_add_pins.sql (5.64ms)813{"timestamp":"2026-08-20T17:24:13.880134112Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"db24bdb4-3af9-49cd-be00-b079bf28affc","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket15/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(355)"}8142026/08/20 17:24:13 OK 20251218171726_add_pins.sql (5.72ms)8152026/08/20 17:24:13 OK 20251218171726_add_pins.sql (5.03ms)8162026/08/20 17:24:13 OK 2_object_stats_trigger.sql (4.23ms)8172026/08/20 17:24:13 goose: up to current file version: 28182026/08/20 17:24:13 OK 20260628120000_add_object_size_and_stats.sql (5.58ms)8192026/08/20 17:24:13 goose: successfully migrated database to version: 202606281200008202026/08/20 17:24:13 OK 20260628120000_add_object_size_and_stats.sql (5.4ms)8212026/08/20 17:24:13 goose: successfully migrated database to version: 202606281200008222026/08/20 17:24:13 OK 20260628120000_add_object_size_and_stats.sql (5.2ms)8232026/08/20 17:24:13 goose: successfully migrated database to version: 202606281200008242026/08/20 17:24:13 OK 20260628120000_add_object_size_and_stats.sql (6.28ms)8252026/08/20 17:24:13 goose: successfully migrated database to version: 202606281200008262026/08/20 17:24:13 OK 20260628120000_add_object_size_and_stats.sql (5.36ms)8272026/08/20 17:24:13 goose: successfully migrated database to version: 202606281200008282026/08/20 17:24:13 OK 20260628120000_add_object_size_and_stats.sql (5.24ms)8292026/08/20 17:24:13 goose: successfully migrated database to version: 202606281200008302026/08/20 17:24:13 OK 1_commit_pending_closure.sql (2.15ms)8312026/08/20 17:24:13 OK 20260628120000_add_object_size_and_stats.sql (4.37ms)8322026/08/20 17:24:13 goose: successfully migrated database to version: 202606281200008332026/08/20 17:24:13 OK 20260628120000_add_object_size_and_stats.sql (4.47ms)8342026/08/20 17:24:13 goose: successfully migrated database to version: 202606281200008352026/08/20 17:24:13 OK 20241026095416_initial_model.sql (9.06ms)8362026/08/20 17:24:13 OK 1_commit_pending_closure.sql (2.24ms)8372026/08/20 17:24:13 OK 1_commit_pending_closure.sql (2.39ms)8382026/08/20 17:24:13 OK 2_object_stats_trigger.sql (1.24ms)8392026/08/20 17:24:13 goose: up to current file version: 28402026/08/20 17:24:13 OK 1_commit_pending_closure.sql (1.9ms)8412026/08/20 17:24:13 OK 1_commit_pending_closure.sql (3.08ms)8422026/08/20 17:24:13 OK 2_object_stats_trigger.sql (1.13ms)8432026/08/20 17:24:13 goose: up to current file version: 28442026/08/20 17:24:13 OK 1_commit_pending_closure.sql (2.15ms)8452026/08/20 17:24:13 OK 2_object_stats_trigger.sql (1.33ms)8462026/08/20 17:24:13 goose: up to current file version: 28472026/08/20 17:24:13 OK 20251210153512_drop_unused_gin_index.sql (2.03ms)8482026/08/20 17:24:13 OK 1_commit_pending_closure.sql (2.34ms)8492026/08/20 17:24:13 OK 1_commit_pending_closure.sql (2.48ms)850{"timestamp":"2026-08-20T17:24:13.888811328Z","level":"ERROR","duration":"534.045µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(303)"}851{"timestamp":"2026-08-20T17:24:13.888892929Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"cbb8eb72-a1d9-43ad-b466-9ed476e1552d","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket17/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(303)"}8522026/08/20 17:24:13 OK 2_object_stats_trigger.sql (1.27ms)8532026/08/20 17:24:13 goose: up to current file version: 28542026/08/20 17:24:13 OK 2_object_stats_trigger.sql (1.82ms)8552026/08/20 17:24:13 goose: up to current file version: 28562026/08/20 17:24:13 OK 2_object_stats_trigger.sql (1.31ms)8572026/08/20 17:24:13 goose: up to current file version: 2858{"timestamp":"2026-08-20T17:24:13.889559515Z","level":"ERROR","duration":"558.444µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(264)"}859{"timestamp":"2026-08-20T17:24:13.889642835Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"0bbbf0f5-6923-4430-b70b-a320c86d1c9f","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket19/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(264)"}8602026/08/20 17:24:13 OK 2_object_stats_trigger.sql (1.1ms)8612026/08/20 17:24:13 goose: up to current file version: 2862{"timestamp":"2026-08-20T17:24:13.889776836Z","level":"ERROR","duration":"498.904µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(302)"}863{"timestamp":"2026-08-20T17:24:13.889849477Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"ddbf30da-e1eb-4658-a47b-cf667cc96edc","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket18/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(302)"}8642026/08/20 17:24:13 OK 2_object_stats_trigger.sql (1.57ms)8652026/08/20 17:24:13 goose: up to current file version: 2866{"timestamp":"2026-08-20T17:24:13.890423242Z","level":"ERROR","duration":"343.203µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(355)"}867{"timestamp":"2026-08-20T17:24:13.890469642Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"2ff9e6cd-8fb9-43ec-824b-1d2e9522fda6","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket20/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(355)"}868{"timestamp":"2026-08-20T17:24:13.890731185Z","level":"ERROR","duration":"287.283µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(295)"}869{"timestamp":"2026-08-20T17:24:13.890770825Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"731de673-e414-49da-ac1e-e5ca83490424","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket22/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(295)"}870{"timestamp":"2026-08-20T17:24:13.890827526Z","level":"ERROR","duration":"448.964µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(264)"}871{"timestamp":"2026-08-20T17:24:13.890893306Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"8163d349-039f-42d2-9ce4-39c736603d77","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket21/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(264)"}872{"timestamp":"2026-08-20T17:24:13.891098908Z","level":"ERROR","duration":"419.704µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(381)"}873{"timestamp":"2026-08-20T17:24:13.891141328Z","level":"ERROR","duration":"252.922µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(355)"}874{"timestamp":"2026-08-20T17:24:13.891175629Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"0fe078c5-d20b-4f3f-8c6e-26659d4fb8c5","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket24/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(355)"}875{"timestamp":"2026-08-20T17:24:13.891170729Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"4ae67482-73a1-48ac-9dc3-39c80dd4add4","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket23/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(381)"}8762026/08/20 17:24:13 OK 20251218171726_add_pins.sql (3.76ms)8772026/08/20 17:24:13 OK 20260628120000_add_object_size_and_stats.sql (3.5ms)8782026/08/20 17:24:13 goose: successfully migrated database to version: 202606281200008792026/08/20 17:24:13 WARN mTLS auth: subject not in bound subjects subject="CN=writer"880--- PASS: TestService_ReadAuthMiddleware (0.21s)881=== CONT TestGCTaskStore_CompletedAllowsNewTask882--- PASS: TestGCTaskStore_CompletedAllowsNewTask (0.00s)883=== CONT TestService_AuthMiddleware_MTLSProxyHeader8842026/08/20 17:24:13 OK 1_commit_pending_closure.sql (1.72ms)8852026/08/20 17:24:13 OK 2_object_stats_trigger.sql (1.07ms)8862026/08/20 17:24:13 goose: up to current file version: 2887{"timestamp":"2026-08-20T17:24:13.900197868Z","level":"ERROR","duration":"560.725µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(303)"}888{"timestamp":"2026-08-20T17:24:13.900287768Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"602567ba-1f03-4757-a3bd-d430a6ec7e92","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket25/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(303)"}889{"timestamp":"2026-08-20T17:24:13.904581146Z","level":"ERROR","duration":"128.261µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(355)"}890{"timestamp":"2026-08-20T17:24:13.904622866Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"f499148e-9dcb-4203-a909-30c244a242b6","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket18/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(355)"}891{"timestamp":"2026-08-20T17:24:13.906519683Z","level":"ERROR","duration":"421.984µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(355)"}892{"timestamp":"2026-08-20T17:24:13.906543183Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"1e2c8e97-f3ce-4486-8e43-adb28323f422","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket20/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(355)"}893{"timestamp":"2026-08-20T17:24:13.932240668Z","level":"ERROR","duration":"187.922µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(295)"}894{"timestamp":"2026-08-20T17:24:13.932292688Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"7724f930-4af5-4081-aa68-5a5c0e84da38","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket22/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(295)"}895{"timestamp":"2026-08-20T17:24:13.934434867Z","level":"ERROR","duration":"569.325µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(303)"}896{"timestamp":"2026-08-20T17:24:13.934517468Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"8c84c2ad-7ab8-4a27-b51a-1a591cd848a8","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket23/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(303)"}897{"timestamp":"2026-08-20T17:24:13.937203791Z","level":"ERROR","duration":"140.841µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(303)"}898{"timestamp":"2026-08-20T17:24:13.937254572Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"ba8779dd-376b-4cf0-916a-5c48d3cdf2c2","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket11/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(303)"}899{"timestamp":"2026-08-20T17:24:13.940226418Z","level":"ERROR","duration":"231.962µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(304)"}900{"timestamp":"2026-08-20T17:24:13.940300939Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"ae14831c-fc6f-49d7-90e3-18182a0e90ca","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket12/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(304)"}9012026/08/20 17:24:13 WARN Authentication failed token_preview=wrongtoken token_length=10 reason="static API token mismatch"902--- PASS: TestService_AuthMiddleware (0.41s)903=== CONT TestGCTaskStore_GetReturnsLatest904--- PASS: TestGCTaskStore_GetReturnsLatest (0.00s)905=== CONT TestGCTaskStore_GetEmpty906--- PASS: TestGCTaskStore_GetEmpty (0.00s)907=== CONT TestGCTaskStore_ConflictDifferentParams908--- PASS: TestGCTaskStore_ConflictDifferentParams (0.00s)909=== CONT TestParseSize910--- PASS: TestParseSize (0.00s)911=== CONT TestGCTaskStore_DeduplicateSameParams912--- PASS: TestGCTaskStore_DeduplicateSameParams (0.00s)913=== CONT TestUploadHandlersRejectInvalidKeys914=== RUN TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info915=== PAUSE TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info916=== RUN TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal917=== PAUSE TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal918=== RUN TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key919=== PAUSE TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key920=== RUN TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key921=== PAUSE TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key922=== CONT TestGCTaskStore_StartNew923--- PASS: TestGCTaskStore_StartNew (0.00s)924=== CONT TestIsValidUploadKey925=== RUN TestIsValidUploadKey/narinfo926=== PAUSE TestIsValidUploadKey/narinfo927=== RUN TestIsValidUploadKey/nar_zst928=== PAUSE TestIsValidUploadKey/nar_zst929=== RUN TestIsValidUploadKey/nar_xz930=== PAUSE TestIsValidUploadKey/nar_xz931=== RUN TestIsValidUploadKey/nar_plain932=== PAUSE TestIsValidUploadKey/nar_plain933=== RUN TestIsValidUploadKey/listing934=== PAUSE TestIsValidUploadKey/listing935=== RUN TestIsValidUploadKey/build_log936=== PAUSE TestIsValidUploadKey/build_log937=== RUN TestIsValidUploadKey/build_log_home-manager_file938=== PAUSE TestIsValidUploadKey/build_log_home-manager_file939=== RUN TestIsValidUploadKey/build_log_plus_in_name940=== PAUSE TestIsValidUploadKey/build_log_plus_in_name941=== RUN TestIsValidUploadKey/build_log_question_mark942=== PAUSE TestIsValidUploadKey/build_log_question_mark943=== RUN TestIsValidUploadKey/build_log_equals944=== PAUSE TestIsValidUploadKey/build_log_equals945=== RUN TestIsValidUploadKey/realisation946=== PAUSE TestIsValidUploadKey/realisation947=== RUN TestIsValidUploadKey/realisation_plus_in_output948=== PAUSE TestIsValidUploadKey/realisation_plus_in_output949=== RUN TestIsValidUploadKey/nix-cache-info950=== PAUSE TestIsValidUploadKey/nix-cache-info951=== RUN TestIsValidUploadKey/index.html952=== PAUSE TestIsValidUploadKey/index.html953=== RUN TestIsValidUploadKey/narinfo_key,_nar_type954=== PAUSE TestIsValidUploadKey/narinfo_key,_nar_type955=== RUN TestIsValidUploadKey/nar_key,_narinfo_type956=== PAUSE TestIsValidUploadKey/nar_key,_narinfo_type957=== RUN TestIsValidUploadKey/listing_key,_narinfo_type958=== PAUSE TestIsValidUploadKey/listing_key,_narinfo_type959=== RUN TestIsValidUploadKey/traversal960=== PAUSE TestIsValidUploadKey/traversal961=== RUN TestIsValidUploadKey/traversal_nar962=== PAUSE TestIsValidUploadKey/traversal_nar963=== RUN TestIsValidUploadKey/absolute964=== PAUSE TestIsValidUploadKey/absolute965=== RUN TestIsValidUploadKey/empty_key966=== PAUSE TestIsValidUploadKey/empty_key967=== RUN TestIsValidUploadKey/unknown_type968=== PAUSE TestIsValidUploadKey/unknown_type969=== CONT TestProxyWriteTimeout970=== RUN TestProxyWriteTimeout/narinfo971=== PAUSE TestProxyWriteTimeout/narinfo972=== RUN TestProxyWriteTimeout/1_GiB_nar973=== PAUSE TestProxyWriteTimeout/1_GiB_nar974=== RUN TestProxyWriteTimeout/10_GiB_nar975=== PAUSE TestProxyWriteTimeout/10_GiB_nar976=== RUN TestProxyWriteTimeout/unknown_size977=== PAUSE TestProxyWriteTimeout/unknown_size978=== CONT TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle979--- PASS: TestMetricsInventory (0.42s)980=== CONT TestReadProxyDisabled9812026-08-20 17:24:13.969 UTC [625] ERROR: relation "goose_db_version" does not exist at character 369822026-08-20 17:24:13.969 UTC [625] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC9832026/08/20 17:24:13 OK 20241026095416_initial_model.sql (13.99ms)9842026/08/20 17:24:13 OK 20251210153512_drop_unused_gin_index.sql (3.68ms)9852026/08/20 17:24:14 OK 20251218171726_add_pins.sql (11.72ms)9862026/08/20 17:24:14 OK 20260628120000_add_object_size_and_stats.sql (6.45ms)9872026/08/20 17:24:14 goose: successfully migrated database to version: 202606281200009882026/08/20 17:24:14 OK 1_commit_pending_closure.sql (2.24ms)9892026/08/20 17:24:14 OK 2_object_stats_trigger.sql (976.23µs)9902026/08/20 17:24:14 goose: up to current file version: 29912026-08-20 17:24:14.029 UTC [626] ERROR: relation "goose_db_version" does not exist at character 369922026-08-20 17:24:14.029 UTC [626] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC9932026-08-20 17:24:14.029 UTC [627] ERROR: relation "goose_db_version" does not exist at character 369942026-08-20 17:24:14.029 UTC [627] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC9952026/08/20 17:24:14 OK 20241026095416_initial_model.sql (9.86ms)9962026/08/20 17:24:14 OK 20241026095416_initial_model.sql (10.03ms)9972026/08/20 17:24:14 OK 20251210153512_drop_unused_gin_index.sql (1.2ms)9982026/08/20 17:24:14 OK 20251210153512_drop_unused_gin_index.sql (1.41ms)9992026/08/20 17:24:14 OK 20251218171726_add_pins.sql (3.43ms)10002026/08/20 17:24:14 OK 20251218171726_add_pins.sql (3.22ms)10012026/08/20 17:24:14 OK 20260628120000_add_object_size_and_stats.sql (3.31ms)10022026/08/20 17:24:14 goose: successfully migrated database to version: 2026062812000010032026/08/20 17:24:14 OK 20260628120000_add_object_size_and_stats.sql (3.39ms)10042026/08/20 17:24:14 goose: successfully migrated database to version: 2026062812000010052026/08/20 17:24:14 OK 1_commit_pending_closure.sql (1.8ms)10062026/08/20 17:24:14 OK 1_commit_pending_closure.sql (2.05ms)10072026/08/20 17:24:14 OK 2_object_stats_trigger.sql (927.43µs)10082026/08/20 17:24:14 goose: up to current file version: 210092026/08/20 17:24:14 OK 2_object_stats_trigger.sql (900.35µs)10102026/08/20 17:24:14 goose: up to current file version: 21011{"timestamp":"2026-08-20T17:24:14.302289024Z","level":"ERROR","duration":"215.482µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(355)"}1012{"timestamp":"2026-08-20T17:24:14.302366045Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"c544cfef-1323-4b34-a234-1fbe96232f34","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket12/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(355)"}1013{"timestamp":"2026-08-20T17:24:14.302632967Z","level":"ERROR","duration":"730.486µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(304)"}1014{"timestamp":"2026-08-20T17:24:14.302658268Z","level":"ERROR","duration":"608.226µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(381)"}1015{"timestamp":"2026-08-20T17:24:14.302704068Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"982d8beb-1331-49a6-9eda-1a0941e3ff89","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket20/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(304)"}1016{"timestamp":"2026-08-20T17:24:14.302712748Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"4ed7aa25-8b87-4272-98a9-2d9df6002597","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket21/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(381)"}1017{"timestamp":"2026-08-20T17:24:14.302705108Z","level":"ERROR","duration":"609.585µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(264)"}1018{"timestamp":"2026-08-20T17:24:14.302768109Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"91a8a36a-6f64-4e2b-a993-2261d0ff5161","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket17/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(264)"}1019{"timestamp":"2026-08-20T17:24:14.463333773Z","level":"ERROR","duration":"259.682µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(374)"}1020{"timestamp":"2026-08-20T17:24:14.463392254Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"3e5ce4af-effa-44ff-b4a1-34884c9bb571","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket10/","status_code":503,"duration_ms":5,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(374)"}1021{"timestamp":"2026-08-20T17:24:14.483434829Z","level":"ERROR","duration":"2.563523ms","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(356)"}1022{"timestamp":"2026-08-20T17:24:14.483488889Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"ac122e17-e1f9-4d69-948a-a2b1454824ac","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket15/","status_code":503,"duration_ms":2,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(356)"}10232026/08/20 17:24:14 WARN mTLS auth: subject not in bound subjects subject="CN=untrusted,O=Other"10242026/08/20 17:24:14 WARN mTLS auth: bound subjects configured but subject DN unavailable10252026/08/20 17:24:14 WARN mTLS auth: subject not in bound subjects subject="CN=untrusted"1026--- PASS: TestService_AuthMiddleware_MTLSBoundSubjects (0.73s)1027=== CONT TestSkippedUploadsHandler10282026/08/20 17:24:14 INFO Client skipped oversized paths paths=3 nar_bytes=50000000001029--- PASS: TestSkippedUploadsHandler (0.01s)1030=== CONT TestCompleteMultipartUpload_ErrorButObjectExists1031{"timestamp":"2026-08-20T17:24:14.519906268Z","level":"ERROR","duration":"217.723265ms","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(387)"}1032{"timestamp":"2026-08-20T17:24:14.519968429Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"026653ea-b8d4-4b91-824c-63c2d3235f8a","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket22/","status_code":503,"duration_ms":218,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(387)"}1033{"timestamp":"2026-08-20T17:24:14.533392746Z","level":"ERROR","duration":"14.392686ms","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(356)"}1034{"timestamp":"2026-08-20T17:24:14.533452246Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"a74e783d-24ee-4af3-90b5-757409e2c3fd","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket27/","status_code":503,"duration_ms":14,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(356)"}1035{"timestamp":"2026-08-20T17:24:14.533684248Z","level":"ERROR","duration":"14.680388ms","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(374)"}1036{"timestamp":"2026-08-20T17:24:14.533742549Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"e7d8eb3a-1119-4afa-a61c-902813594412","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket26/","status_code":503,"duration_ms":14,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(374)"}1037{"timestamp":"2026-08-20T17:24:14.542844149Z","level":"ERROR","duration":"325.663µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(295)"}1038{"timestamp":"2026-08-20T17:24:14.542885269Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"745674c3-4b15-44a9-9a1f-8008be885c95","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket17/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(295)"}1039{"timestamp":"2026-08-20T17:24:14.54299373Z","level":"ERROR","duration":"264.122µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(214)"}1040{"timestamp":"2026-08-20T17:24:14.54303529Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"110b3e09-67d9-447a-a1be-ccab6363b131","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket18/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(214)"}10412026-08-20 17:24:14.569 UTC [631] ERROR: relation "goose_db_version" does not exist at character 3610422026-08-20 17:24:14.569 UTC [631] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC1043{"timestamp":"2026-08-20T17:24:14.569946225Z","level":"ERROR","duration":"159.981µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(295)"}1044{"timestamp":"2026-08-20T17:24:14.570002766Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"2551dfde-e54b-4c16-b69f-1975c71b556a","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket27/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(295)"}10452026/08/20 17:24:14 OK 20241026095416_initial_model.sql (10.58ms)10462026/08/20 17:24:14 OK 20251210153512_drop_unused_gin_index.sql (2.29ms)1047{"timestamp":"2026-08-20T17:24:14.589600137Z","level":"ERROR","duration":"148.101µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(295)"}1048{"timestamp":"2026-08-20T17:24:14.589644678Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"07ded1c0-53a7-4b3a-af8c-92e13b120da2","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket26/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(295)"}10492026/08/20 17:24:14 OK 20251218171726_add_pins.sql (3.62ms)10502026/08/20 17:24:14 OK 20260628120000_add_object_size_and_stats.sql (2.99ms)10512026/08/20 17:24:14 goose: successfully migrated database to version: 2026062812000010522026/08/20 17:24:14 OK 1_commit_pending_closure.sql (1.85ms)10532026/08/20 17:24:14 OK 2_object_stats_trigger.sql (850.99µs)10542026/08/20 17:24:14 goose: up to current file version: 21055{"timestamp":"2026-08-20T17:24:14.600653034Z","level":"ERROR","duration":"446.704µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(295)"}1056{"timestamp":"2026-08-20T17:24:14.600712275Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"b3cde81a-f286-4455-b438-2b406659d914","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket29/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(295)"}1057{"timestamp":"2026-08-20T17:24:14.613759889Z","level":"ERROR","duration":"83.022946ms","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(354)"}1058{"timestamp":"2026-08-20T17:24:14.61381395Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"1c4f4b0d-ddb3-4508-840a-af5add465839","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket15/","status_code":503,"duration_ms":93,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(354)"}10592026/08/20 17:24:14 INFO Received uploads request method=POST path=/api/pending_closures1060--- PASS: TestCreatePendingClosure_SmallNARUsesSimplePUT (1.12s)1061=== CONT TestRedundantMultipartUpload1062=== NAME TestOrphanedObjectsGC1063 orphaned_objects_gc_test.go:290: GC Test Summary:1064 orphaned_objects_gc_test.go:291: - Kept: 2 objects from closure A1065 orphaned_objects_gc_test.go:292: - Deleted: 2 objects from closure B1066 orphaned_objects_gc_test.go:293: - Deleted: 6 orphaned chain objects (X1->X2->X3)1067 orphaned_objects_gc_test.go:294: - Deleted: 2 orphaned single objects (Y)1068 orphaned_objects_gc_test.go:295: - Total deleted: 10 objects1069--- PASS: TestOrphanedObjectsGC (1.19s)1070=== CONT TestReadProxyRangeRequest10712026-08-20 17:24:14.721 UTC [652] ERROR: relation "goose_db_version" does not exist at character 3610722026-08-20 17:24:14.721 UTC [652] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC1073{"timestamp":"2026-08-20T17:24:14.730354229Z","level":"ERROR","duration":"4.043135ms","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(312)"}1074{"timestamp":"2026-08-20T17:24:14.730429209Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"ceb67692-e4bd-46d6-a206-287cb65c3a74","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket23/","status_code":503,"duration_ms":197,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(312)"}10752026/08/20 17:24:14 OK 20241026095416_initial_model.sql (10.65ms)10762026/08/20 17:24:14 OK 20251210153512_drop_unused_gin_index.sql (2.7ms)10772026/08/20 17:24:14 OK 20251218171726_add_pins.sql (4.61ms)1078{"timestamp":"2026-08-20T17:24:14.750882628Z","level":"ERROR","duration":"1.690755ms","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(312)"}1079{"timestamp":"2026-08-20T17:24:14.750942709Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"5ae09685-0e35-4ebc-815e-f3edc25c50d4","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket22/","status_code":503,"duration_ms":1,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(312)"}10802026/08/20 17:24:14 OK 20260628120000_add_object_size_and_stats.sql (5.35ms)10812026/08/20 17:24:14 goose: successfully migrated database to version: 202606281200001082{"timestamp":"2026-08-20T17:24:14.753174428Z","level":"ERROR","duration":"107.721µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(312)"}1083{"timestamp":"2026-08-20T17:24:14.753202089Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"d68e7bf0-f5ae-48f7-83f2-03b3b074fb9c","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket26/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(312)"}10842026/08/20 17:24:14 OK 1_commit_pending_closure.sql (3.31ms)10852026/08/20 17:24:14 OK 2_object_stats_trigger.sql (2.04ms)10862026/08/20 17:24:14 goose: up to current file version: 21087{"timestamp":"2026-08-20T17:24:14.758799697Z","level":"ERROR","duration":"621.885µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(214)"}1088{"timestamp":"2026-08-20T17:24:14.758883918Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"3e0799d7-9883-488d-9a50-d1c7098b97ad","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket30/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(214)"}1089{"timestamp":"2026-08-20T17:24:14.772122654Z","level":"ERROR","duration":"548.025µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(354)"}1090{"timestamp":"2026-08-20T17:24:14.772195815Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"9b41b880-e811-42d5-a851-1ee1fc691c1d","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket29/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(354)"}1091{"timestamp":"2026-08-20T17:24:14.783267131Z","level":"ERROR","duration":"316.662µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(295)"}1092{"timestamp":"2026-08-20T17:24:14.783348852Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"5c29463f-175f-4333-862b-7ae3aa420b97","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket30/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(295)"}10932026-08-20 17:24:14.797 UTC [655] ERROR: relation "goose_db_version" does not exist at character 3610942026-08-20 17:24:14.797 UTC [655] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC10952026/08/20 17:24:14 OK 20241026095416_initial_model.sql (9.99ms)10962026/08/20 17:24:14 OK 20251210153512_drop_unused_gin_index.sql (1.28ms)10972026/08/20 17:24:14 OK 20251218171726_add_pins.sql (3.6ms)10982026/08/20 17:24:14 OK 20260628120000_add_object_size_and_stats.sql (3.8ms)10992026/08/20 17:24:14 goose: successfully migrated database to version: 2026062812000011002026/08/20 17:24:14 OK 1_commit_pending_closure.sql (1.81ms)11012026/08/20 17:24:14 OK 2_object_stats_trigger.sql (826.45µs)11022026/08/20 17:24:14 goose: up to current file version: 21103{"timestamp":"2026-08-20T17:24:14.82765696Z","level":"ERROR","duration":"498.205µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(214)"}1104{"timestamp":"2026-08-20T17:24:14.82774524Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"7ba71cc9-612e-4c32-be64-5292c395a3a8","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket31/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(214)"}1105{"timestamp":"2026-08-20T17:24:14.833703353Z","level":"ERROR","duration":"205.522µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(295)"}1106{"timestamp":"2026-08-20T17:24:14.833785793Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"dea98965-1564-4d7e-bc4f-2083b151d64e","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket12/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(295)"}1107{"timestamp":"2026-08-20T17:24:14.862972129Z","level":"ERROR","duration":"3.33773ms","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1108{"timestamp":"2026-08-20T17:24:14.863027789Z","level":"ERROR","duration":"3.547591ms","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(353)"}1109{"timestamp":"2026-08-20T17:24:14.86306411Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"4fe987b8-e83e-48cd-ba54-06e6eabed7b0","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket28/","status_code":503,"duration_ms":3,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(353)"}1110{"timestamp":"2026-08-20T17:24:14.866106136Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"5b5a1944-d980-4b2d-b54d-07b359c50c98","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket13/","status_code":503,"duration_ms":563,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1111{"timestamp":"2026-08-20T17:24:14.866201157Z","level":"ERROR","duration":"6.355096ms","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}1112{"timestamp":"2026-08-20T17:24:14.866249797Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"c67adb81-4eb7-4b6a-a5f6-61a23e272e0f","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket24/","status_code":503,"duration_ms":11,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}1113{"timestamp":"2026-08-20T17:24:14.86653986Z","level":"ERROR","duration":"7.92753ms","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1114{"timestamp":"2026-08-20T17:24:14.86658976Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"cc8dcf58-f288-49ab-a3cd-fe06fb3f38d9","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket19/","status_code":503,"duration_ms":12,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1115{"timestamp":"2026-08-20T17:24:14.894498685Z","level":"ERROR","duration":"201.502µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1116{"timestamp":"2026-08-20T17:24:14.894543305Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"aa7e262d-d7b0-4bfc-b019-993d8563bcde","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket30/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1117{"timestamp":"2026-08-20T17:24:14.918456014Z","level":"ERROR","duration":"213.322µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1118{"timestamp":"2026-08-20T17:24:14.918551575Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"e36644e4-6801-4f08-855e-27a999afa0ac","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket27/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1119{"timestamp":"2026-08-20T17:24:14.930218277Z","level":"ERROR","duration":"91.241µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1120{"timestamp":"2026-08-20T17:24:14.930246617Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"3bc7412a-8a26-4677-a8a7-5d3e70ca2acd","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket30/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1121{"timestamp":"2026-08-20T17:24:14.985375219Z","level":"ERROR","duration":"138.601µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1122{"timestamp":"2026-08-20T17:24:14.9854286Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"98fa6c0c-8db7-4ba8-96f4-f3cef7bfd7e1","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket17/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1123{"timestamp":"2026-08-20T17:24:14.995346786Z","level":"ERROR","duration":"206.121µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1124{"timestamp":"2026-08-20T17:24:14.995428067Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"62412df7-975f-45bd-80a2-cffd5ed92f57","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket20/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1125{"timestamp":"2026-08-20T17:24:15.020204904Z","level":"ERROR","duration":"117.441µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1126{"timestamp":"2026-08-20T17:24:15.020252084Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"d91080ac-9fd6-40ac-b4ad-47e2a415e82e","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket31/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1127{"timestamp":"2026-08-20T17:24:15.022851047Z","level":"ERROR","duration":"130.161µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1128{"timestamp":"2026-08-20T17:24:15.022902408Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"a1c77c8f-89ef-4eb2-a1cd-09be5f5a1c56","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket28/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1129{"timestamp":"2026-08-20T17:24:15.027448827Z","level":"ERROR","duration":"95.721µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1130{"timestamp":"2026-08-20T17:24:15.027490028Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"55b08210-864f-400b-a171-8b499056275b","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket12/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1131{"timestamp":"2026-08-20T17:24:15.042269157Z","level":"ERROR","duration":"141.041µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}1132{"timestamp":"2026-08-20T17:24:15.042318918Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"09a613aa-d74a-49cc-a1bd-7c84bd3f3772","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket18/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}1133{"timestamp":"2026-08-20T17:24:15.047633864Z","level":"ERROR","duration":"248.742µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1134{"timestamp":"2026-08-20T17:24:15.047681804Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"93929fab-4e62-4dc2-8c7e-c9b670338d56","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket31/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1135{"timestamp":"2026-08-20T17:24:15.06661017Z","level":"ERROR","duration":"6.012053ms","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1136{"timestamp":"2026-08-20T17:24:15.066709911Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"46f9b99f-f9ab-4c3d-aab5-e204780fb4d6","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket31/","status_code":503,"duration_ms":6,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1137{"timestamp":"2026-08-20T17:24:15.068502606Z","level":"ERROR","duration":"172.961µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1138{"timestamp":"2026-08-20T17:24:15.068556447Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"a21e12e7-d1d0-4222-b8b7-8158ade718f9","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket19/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1139{"timestamp":"2026-08-20T17:24:15.068975411Z","level":"ERROR","duration":"138.402µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1140{"timestamp":"2026-08-20T17:24:15.069010671Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"1ddf3f36-5ecf-4714-898e-e398d609e093","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket13/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1141{"timestamp":"2026-08-20T17:24:15.084537327Z","level":"ERROR","duration":"64.181µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1142{"timestamp":"2026-08-20T17:24:15.084560247Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"2b821e0e-ff11-4e67-b278-f22593612105","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket24/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1143{"timestamp":"2026-08-20T17:24:15.12614601Z","level":"ERROR","duration":"60.28µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1144{"timestamp":"2026-08-20T17:24:15.126170931Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"babc2524-0342-41a1-9a8f-4ca718c862a8","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket19/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1145{"timestamp":"2026-08-20T17:24:15.150938488Z","level":"ERROR","duration":"164.822µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1146{"timestamp":"2026-08-20T17:24:15.151002208Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"68a0121e-ddce-4661-83ef-56f8f8fc9a72","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket24/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1147{"timestamp":"2026-08-20T17:24:15.159964066Z","level":"ERROR","duration":"232.842µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1148{"timestamp":"2026-08-20T17:24:15.160052287Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"820768fb-cb91-4d9e-a0ca-f19c0b2c8a22","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket29/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1149{"timestamp":"2026-08-20T17:24:15.161639621Z","level":"ERROR","duration":"119.941µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1150{"timestamp":"2026-08-20T17:24:15.161686542Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"97c944af-1e30-4668-b06e-f5ba801740d2","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket28/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1151{"timestamp":"2026-08-20T17:24:15.168251979Z","level":"ERROR","duration":"97.301µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1152{"timestamp":"2026-08-20T17:24:15.168296239Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"ab938d80-ce0c-4a47-9953-b4ff842f5645","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket24/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1153{"timestamp":"2026-08-20T17:24:15.208991895Z","level":"ERROR","duration":"133.381µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1154{"timestamp":"2026-08-20T17:24:15.209045996Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"b9ac5dcd-3698-45aa-8e4a-2840dd6cbc68","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket18/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1155{"timestamp":"2026-08-20T17:24:15.213707777Z","level":"ERROR","duration":"117.141µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1156{"timestamp":"2026-08-20T17:24:15.213755997Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"fb357d1f-1a57-43ef-a624-97d732c0d204","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket13/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1157{"timestamp":"2026-08-20T17:24:15.255455702Z","level":"ERROR","duration":"226.562µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1158{"timestamp":"2026-08-20T17:24:15.255505442Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"c5ae862b-463c-4f5d-9ec1-2310e354c83f","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket17/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1159{"timestamp":"2026-08-20T17:24:15.321276617Z","level":"ERROR","duration":"161.121µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1160{"timestamp":"2026-08-20T17:24:15.321340978Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"7b7656c0-2fa2-4591-9179-1719c74b252e","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket26/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1161{"timestamp":"2026-08-20T17:24:15.321352258Z","level":"ERROR","duration":"209.002µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1162{"timestamp":"2026-08-20T17:24:15.321429379Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"25e85367-8501-4ec8-9b25-720083b6e623","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket24/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1163{"timestamp":"2026-08-20T17:24:15.402140825Z","level":"ERROR","duration":"170.742µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1164{"timestamp":"2026-08-20T17:24:15.402208245Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"4a540611-533a-4b51-b47d-867bc2a998e0","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket19/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1165{"timestamp":"2026-08-20T17:24:15.404870048Z","level":"ERROR","duration":"105.401µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1166{"timestamp":"2026-08-20T17:24:15.404914649Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"9a706396-26bf-4356-9836-3890da237398","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket15/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1167{"timestamp":"2026-08-20T17:24:15.461497224Z","level":"ERROR","duration":"107.261µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1168{"timestamp":"2026-08-20T17:24:15.461544004Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"885c2d5c-aff5-45a9-bc27-75484e1e12ec","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket23/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1169{"timestamp":"2026-08-20T17:24:15.47819247Z","level":"ERROR","duration":"105.921µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1170{"timestamp":"2026-08-20T17:24:15.47823711Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"926a358d-26b4-4c11-b875-0255173490b0","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket31/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1171{"timestamp":"2026-08-20T17:24:15.557873987Z","level":"ERROR","duration":"178.182µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1172{"timestamp":"2026-08-20T17:24:15.557922867Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"a800239e-34aa-46a5-b766-2d90dfff84fc","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket22/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1173{"timestamp":"2026-08-20T17:24:15.571558787Z","level":"ERROR","duration":"98.461µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1174{"timestamp":"2026-08-20T17:24:15.571600067Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"b9e43e33-3083-43d3-a9fc-05e51723d38c","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket30/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1175{"timestamp":"2026-08-20T17:24:15.622175069Z","level":"ERROR","duration":"95.101µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1176{"timestamp":"2026-08-20T17:24:15.62221759Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"5a5eca40-2029-44b3-8bdd-4770fc9c1cc1","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket20/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1177{"timestamp":"2026-08-20T17:24:15.691854599Z","level":"ERROR","duration":"97.901µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1178{"timestamp":"2026-08-20T17:24:15.691897679Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"6662c1a8-bf38-46aa-a3ad-35c23a57f3f5","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket27/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1179{"timestamp":"2026-08-20T17:24:15.701798486Z","level":"ERROR","duration":"199.182µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1180{"timestamp":"2026-08-20T17:24:15.701874206Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"7f5c9ac7-e214-477e-9353-76c374a2c130","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket19/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1181{"timestamp":"2026-08-20T17:24:15.779811828Z","level":"ERROR","duration":"223.362µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1182{"timestamp":"2026-08-20T17:24:15.779912569Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"6c4f67ba-4e78-4a2c-ba73-db4ae3ca3bf5","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket28/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1183{"timestamp":"2026-08-20T17:24:15.83601666Z","level":"ERROR","duration":"244.022µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1184{"timestamp":"2026-08-20T17:24:15.83610636Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"a1c3f77d-4e20-4c31-b9dd-fefa52150c68","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket23/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1185{"timestamp":"2026-08-20T17:24:15.842839119Z","level":"ERROR","duration":"152.021µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1186{"timestamp":"2026-08-20T17:24:15.84289522Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"70c35c62-43ad-43bd-b582-cd709d3c6c3d","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket22/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1187{"timestamp":"2026-08-20T17:24:15.884835887Z","level":"ERROR","duration":"268.003µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1188{"timestamp":"2026-08-20T17:24:15.884916807Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"dc56c7b1-c50e-4684-9759-2327e0e198eb","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket15/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1189{"timestamp":"2026-08-20T17:24:15.91383764Z","level":"ERROR","duration":"163.201µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1190{"timestamp":"2026-08-20T17:24:15.913896461Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"e80bd0d4-0f09-4321-aa4d-064107a54cce","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket29/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1191{"timestamp":"2026-08-20T17:24:15.925767985Z","level":"ERROR","duration":"137.202µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1192{"timestamp":"2026-08-20T17:24:15.925820645Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"8bedbf53-4d99-407a-a37e-b9e0c12111c1","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket12/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1193{"timestamp":"2026-08-20T17:24:15.946852069Z","level":"ERROR","duration":"208.282µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1194{"timestamp":"2026-08-20T17:24:15.94693057Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"b1603d94-9d71-4c57-80ae-a6f0d0249b65","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket13/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1195{"timestamp":"2026-08-20T17:24:15.992855911Z","level":"ERROR","duration":"169.281µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1196{"timestamp":"2026-08-20T17:24:15.992914332Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"3ea890af-d42b-4c34-a675-79b3dd08b7e1","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket23/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1197{"timestamp":"2026-08-20T17:24:16.051885408Z","level":"ERROR","duration":"163.102µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1198{"timestamp":"2026-08-20T17:24:16.051947388Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"77102fde-7f78-4e0b-8a36-bac22b256aac","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket23/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1199{"timestamp":"2026-08-20T17:24:16.061887955Z","level":"ERROR","duration":"230.922µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1200{"timestamp":"2026-08-20T17:24:16.061973096Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"2892d973-de85-4374-bd75-212ac0dc739d","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket18/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1201{"timestamp":"2026-08-20T17:24:16.097009302Z","level":"ERROR","duration":"194.841µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1202{"timestamp":"2026-08-20T17:24:16.097077903Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"b55e1dbf-4214-4a20-92e4-4fc5b4fd78ec","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket24/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1203{"timestamp":"2026-08-20T17:24:16.106742088Z","level":"ERROR","duration":"133.682µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1204{"timestamp":"2026-08-20T17:24:16.106794608Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"16b9fdd3-3207-4f88-85dc-ee36b6f1abc3","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket31/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1205{"timestamp":"2026-08-20T17:24:16.114332894Z","level":"ERROR","duration":"111.921µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1206{"timestamp":"2026-08-20T17:24:16.114382035Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"c9064201-2782-443c-b499-d2a839a10c7b","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket24/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1207{"timestamp":"2026-08-20T17:24:16.159061085Z","level":"ERROR","duration":"121.721µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1208{"timestamp":"2026-08-20T17:24:16.159110966Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"260a9cb3-5200-4f6c-b125-7aca9c74836e","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket17/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1209{"timestamp":"2026-08-20T17:24:16.16987352Z","level":"ERROR","duration":"107.541µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1210{"timestamp":"2026-08-20T17:24:16.16991998Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"6a958734-9f90-4dea-8684-b8056efa0e24","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket19/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1211{"timestamp":"2026-08-20T17:24:16.173675433Z","level":"ERROR","duration":"213.342µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1212{"timestamp":"2026-08-20T17:24:16.173757354Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"a439d6d0-97cb-42d0-9d76-326364618707","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket13/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1213{"timestamp":"2026-08-20T17:24:16.175351248Z","level":"ERROR","duration":"120.141µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1214{"timestamp":"2026-08-20T17:24:16.175402688Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"6df32b54-c5a7-4570-90ad-8434fc97ca45","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket15/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1215{"timestamp":"2026-08-20T17:24:16.197177418Z","level":"ERROR","duration":"209.721µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1216{"timestamp":"2026-08-20T17:24:16.197232859Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"2a68f5ff-b233-4c4e-aa44-7305a7abf689","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket24/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1217{"timestamp":"2026-08-20T17:24:16.228062589Z","level":"ERROR","duration":"200.602µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1218{"timestamp":"2026-08-20T17:24:16.228136809Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"c4f4708e-8e96-4b86-a925-6c5ab1b01a11","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket28/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1219{"timestamp":"2026-08-20T17:24:16.228457512Z","level":"ERROR","duration":"105.681µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1220{"timestamp":"2026-08-20T17:24:16.228500172Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"d1c9725e-99c4-48f3-bce8-4e06468649a3","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket26/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1221{"timestamp":"2026-08-20T17:24:16.251148071Z","level":"ERROR","duration":"98.261µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1222{"timestamp":"2026-08-20T17:24:16.251192031Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"04bf696b-9115-4f51-a8c3-3774176fa35c","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket15/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1223{"timestamp":"2026-08-20T17:24:16.271853352Z","level":"ERROR","duration":"112.101µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1224{"timestamp":"2026-08-20T17:24:16.271905492Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"c52f1fa7-ff53-4dd0-aa38-24a1be8a5db9","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket24/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1225{"timestamp":"2026-08-20T17:24:16.318738682Z","level":"ERROR","duration":"183.222µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1226{"timestamp":"2026-08-20T17:24:16.318810123Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"c300c108-608c-4393-8ac9-37541158de38","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket19/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1227{"timestamp":"2026-08-20T17:24:16.349607012Z","level":"ERROR","duration":"143.981µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1228{"timestamp":"2026-08-20T17:24:16.349660952Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"209496e1-ae7e-4b72-9e6d-d74fa8b9f484","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket30/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1229{"timestamp":"2026-08-20T17:24:16.393366315Z","level":"ERROR","duration":"135.942µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1230{"timestamp":"2026-08-20T17:24:16.393421815Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"c728bf29-934b-4ce6-abef-6615bb065477","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket20/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1231{"timestamp":"2026-08-20T17:24:16.437155058Z","level":"ERROR","duration":"197.202µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1232{"timestamp":"2026-08-20T17:24:16.437227598Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"2b107971-ae89-46ba-8680-3b2be9ab4de6","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket18/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1233{"timestamp":"2026-08-20T17:24:16.455912282Z","level":"ERROR","duration":"149.062µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1234{"timestamp":"2026-08-20T17:24:16.455968282Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"586b1dcd-9fbc-40f6-9c3c-38e8da0fe129","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket27/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1235{"timestamp":"2026-08-20T17:24:16.474853767Z","level":"ERROR","duration":"191.221µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1236{"timestamp":"2026-08-20T17:24:16.474924688Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"32135969-6bab-49c0-ace5-cc6a13ab8a5a","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket31/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1237{"timestamp":"2026-08-20T17:24:16.493703352Z","level":"ERROR","duration":"149.601µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1238{"timestamp":"2026-08-20T17:24:16.493760493Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"68a1ccfa-9120-4212-8999-118b406b4cf5","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket22/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1239{"timestamp":"2026-08-20T17:24:16.511626469Z","level":"ERROR","duration":"253.582µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1240{"timestamp":"2026-08-20T17:24:16.51169593Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"41f90a18-667c-41ea-8ea4-bf48b3ca6082","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket31/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1241{"timestamp":"2026-08-20T17:24:16.524521382Z","level":"ERROR","duration":"164.482µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1242{"timestamp":"2026-08-20T17:24:16.524587062Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"580954a0-921e-4068-aa42-ddc7ba89097c","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket27/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1243{"timestamp":"2026-08-20T17:24:16.564419491Z","level":"ERROR","duration":"170.562µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1244{"timestamp":"2026-08-20T17:24:16.564484511Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"6be67a04-9e40-4ad7-9bc0-b1ace94a68dc","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket12/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1245{"timestamp":"2026-08-20T17:24:16.695535378Z","level":"ERROR","duration":"221.602µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1246{"timestamp":"2026-08-20T17:24:16.695622438Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"6ec8b565-2840-4dbb-b734-b6a990e4f040","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket23/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1247{"timestamp":"2026-08-20T17:24:16.730539784Z","level":"ERROR","duration":"230.982µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1248{"timestamp":"2026-08-20T17:24:16.730608284Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"1c63e533-c8a0-4808-8e7b-ba83ca64c2f4","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket28/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1249{"timestamp":"2026-08-20T17:24:16.813643611Z","level":"ERROR","duration":"275.183µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1250{"timestamp":"2026-08-20T17:24:16.813736851Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"379421de-d11b-466f-b9f7-4451f0e05903","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket29/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1251{"timestamp":"2026-08-20T17:24:16.847604468Z","level":"ERROR","duration":"200.622µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1252{"timestamp":"2026-08-20T17:24:16.847677588Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"8403103f-9a18-4df8-b2d4-6c3272a673ee","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket26/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1253{"timestamp":"2026-08-20T17:24:16.883708763Z","level":"ERROR","duration":"219.142µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1254{"timestamp":"2026-08-20T17:24:16.883790604Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"2b51cedb-fab9-4173-a3a0-3f02e0b160f8","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket13/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1255{"timestamp":"2026-08-20T17:24:16.885514099Z","level":"ERROR","duration":"143.441µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1256{"timestamp":"2026-08-20T17:24:16.88556888Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"8aec7e7b-405d-4e81-a539-0d7e577d5491","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket27/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1257{"timestamp":"2026-08-20T17:24:16.950458627Z","level":"ERROR","duration":"166.201µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1258{"timestamp":"2026-08-20T17:24:16.950574529Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"e43d3b0c-0a87-4e5d-92b9-8d812ad50b37","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket19/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1259{"timestamp":"2026-08-20T17:24:16.98732177Z","level":"ERROR","duration":"147.022µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1260{"timestamp":"2026-08-20T17:24:16.98737887Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"87c3ecf2-d249-4a9d-ab46-74cdec32cd39","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket23/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1261{"timestamp":"2026-08-20T17:24:17.025255842Z","level":"ERROR","duration":"203.022µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1262{"timestamp":"2026-08-20T17:24:17.025328962Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"b593fe15-92e4-412c-8c45-954cfe3761cc","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket23/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1263{"timestamp":"2026-08-20T17:24:17.028083586Z","level":"ERROR","duration":"129.781µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1264{"timestamp":"2026-08-20T17:24:17.028134347Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"c6234239-3b56-41a5-b8a9-48388e37970a","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket17/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1265{"timestamp":"2026-08-20T17:24:17.095796218Z","level":"ERROR","duration":"164.881µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1266{"timestamp":"2026-08-20T17:24:17.095859959Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"f9a8ff82-1b80-4236-8eee-c072bfb139df","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket29/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1267{"timestamp":"2026-08-20T17:24:17.111542576Z","level":"ERROR","duration":"132.901µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1268{"timestamp":"2026-08-20T17:24:17.111598937Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"83443aef-8b9d-469f-936d-d529b0450c91","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket31/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1269=== NAME TestClientMultipleUploads1270 client_integration_test.go:310: unexpected error: bucket creation concurrency limit reached; retry later1271 1272--- FAIL: TestClientMultipleUploads (3.54s)1273=== CONT TestReadProxyNarStreaming1274{"timestamp":"2026-08-20T17:24:17.144565785Z","level":"ERROR","duration":"221.422µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1275{"timestamp":"2026-08-20T17:24:17.144623786Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"b6b09235-a438-4d8b-b888-c123afc6034e","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket22/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}12762026-08-20 17:24:17.190 UTC [658] ERROR: relation "goose_db_version" does not exist at character 3612772026-08-20 17:24:17.190 UTC [658] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC12782026/08/20 17:24:17 OK 20241026095416_initial_model.sql (9.25ms)12792026/08/20 17:24:17 OK 20251210153512_drop_unused_gin_index.sql (1.28ms)12802026/08/20 17:24:17 OK 20251218171726_add_pins.sql (3.32ms)12812026/08/20 17:24:17 OK 20260628120000_add_object_size_and_stats.sql (2.51ms)12822026/08/20 17:24:17 goose: successfully migrated database to version: 202606281200001283{"timestamp":"2026-08-20T17:24:17.213167345Z","level":"ERROR","duration":"235.202µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1284{"timestamp":"2026-08-20T17:24:17.213254646Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"ac8fc157-94bf-481a-9fe6-e7738505ea7c","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket15/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}12852026/08/20 17:24:17 OK 1_commit_pending_closure.sql (1.75ms)12862026/08/20 17:24:17 OK 2_object_stats_trigger.sql (773.59µs)12872026/08/20 17:24:17 goose: up to current file version: 21288{"timestamp":"2026-08-20T17:24:17.217329762Z","level":"ERROR","duration":"714.307µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1289{"timestamp":"2026-08-20T17:24:17.217412302Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"124fdfcb-56d7-4cab-bb51-b22e8cbd7503","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket32/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1290{"timestamp":"2026-08-20T17:24:17.25950941Z","level":"ERROR","duration":"225.962µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1291{"timestamp":"2026-08-20T17:24:17.259592811Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"e55b203b-9f00-45c0-baa1-c10cbf684fc4","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket28/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1292{"timestamp":"2026-08-20T17:24:17.305486093Z","level":"ERROR","duration":"210.602µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1293{"timestamp":"2026-08-20T17:24:17.305566053Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"b5ccbe05-46f2-4452-8f07-857bf975196d","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket12/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1294{"timestamp":"2026-08-20T17:24:17.312529874Z","level":"ERROR","duration":"227.802µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1295{"timestamp":"2026-08-20T17:24:17.312617315Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"9067b202-d6e0-4314-848e-27f1b8738d80","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket30/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1296{"timestamp":"2026-08-20T17:24:17.328528874Z","level":"ERROR","duration":"189.761µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1297{"timestamp":"2026-08-20T17:24:17.328594115Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"e3b268f6-9bd6-4a08-9e74-82f2afaddb27","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket32/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1298{"timestamp":"2026-08-20T17:24:17.345286321Z","level":"ERROR","duration":"145.521µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1299{"timestamp":"2026-08-20T17:24:17.345378222Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"c1636f20-aa0e-4767-b7da-854b022e980e","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket17/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1300{"timestamp":"2026-08-20T17:24:17.356047495Z","level":"ERROR","duration":"120.521µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1301{"timestamp":"2026-08-20T17:24:17.356094055Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"394f41b2-39c3-4416-b2fd-88598d38e85c","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket20/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1302{"timestamp":"2026-08-20T17:24:17.396790451Z","level":"ERROR","duration":"147.261µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1303{"timestamp":"2026-08-20T17:24:17.396842672Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"c57d0f70-9cc4-40ad-b1db-f368d075741e","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket18/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1304{"timestamp":"2026-08-20T17:24:17.420453278Z","level":"ERROR","duration":"98.461µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1305{"timestamp":"2026-08-20T17:24:17.420497659Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"0d67b069-15ae-41dd-b8a1-4868d7ea6971","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket30/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1306{"timestamp":"2026-08-20T17:24:17.462261724Z","level":"ERROR","duration":"207.722µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1307{"timestamp":"2026-08-20T17:24:17.462316904Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"e008d494-4666-45f5-b45b-7b005e0b8218","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket30/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1308{"timestamp":"2026-08-20T17:24:17.476037784Z","level":"ERROR","duration":"101.301µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1309{"timestamp":"2026-08-20T17:24:17.476085505Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"b378647d-56bb-4f09-8891-e89284f9a690","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket31/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1310{"timestamp":"2026-08-20T17:24:17.483958094Z","level":"ERROR","duration":"227.382µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1311{"timestamp":"2026-08-20T17:24:17.484044714Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"967ab24c-e625-4cea-bb6e-ed84f019cfb5","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket20/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1312{"timestamp":"2026-08-20T17:24:17.571750201Z","level":"ERROR","duration":"122.961µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1313{"timestamp":"2026-08-20T17:24:17.571797942Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"b481e1c5-f875-4c12-ab01-f2f7d1077d18","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket20/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1314{"timestamp":"2026-08-20T17:24:17.609373911Z","level":"ERROR","duration":"102.021µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1315{"timestamp":"2026-08-20T17:24:17.609417511Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"48b05ea7-6eee-4e1b-a328-7ea7ffe1c110","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket17/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1316{"timestamp":"2026-08-20T17:24:17.625957956Z","level":"ERROR","duration":"96.481µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1317{"timestamp":"2026-08-20T17:24:17.625999876Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"11ecc2ff-4259-41ba-a0b4-32b6caa6f019","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket12/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1318=== NAME TestGCBugBareHashReferences1319 gc_bug_test.go:18: unexpected error: bucket creation concurrency limit reached; retry later1320 1321--- FAIL: TestGCBugBareHashReferences (4.03s)1322=== CONT TestReadProxyRootRedirectsToIndexHTML1323{"timestamp":"2026-08-20T17:24:17.674755662Z","level":"ERROR","duration":"120.261µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1324{"timestamp":"2026-08-20T17:24:17.674803103Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"20d20de4-4228-4ea7-8f1e-cdd34325f27a","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket32/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}13252026-08-20 17:24:17.686 UTC [661] ERROR: relation "goose_db_version" does not exist at character 3613262026-08-20 17:24:17.686 UTC [661] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC13272026/08/20 17:24:17 OK 20241026095416_initial_model.sql (8.91ms)13282026/08/20 17:24:17 OK 20251210153512_drop_unused_gin_index.sql (1.25ms)13292026/08/20 17:24:17 OK 20251218171726_add_pins.sql (2.76ms)13302026/08/20 17:24:17 OK 20260628120000_add_object_size_and_stats.sql (2.88ms)13312026/08/20 17:24:17 goose: successfully migrated database to version: 2026062812000013322026/08/20 17:24:17 OK 1_commit_pending_closure.sql (1.72ms)13332026/08/20 17:24:17 OK 2_object_stats_trigger.sql (751.87µs)13342026/08/20 17:24:17 goose: up to current file version: 21335{"timestamp":"2026-08-20T17:24:17.711334782Z","level":"ERROR","duration":"588.405µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1336{"timestamp":"2026-08-20T17:24:17.711410723Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"f17365c4-1198-42e2-9363-49abf28b8dad","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket33/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1337{"timestamp":"2026-08-20T17:24:17.726414994Z","level":"ERROR","duration":"220.702µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1338{"timestamp":"2026-08-20T17:24:17.726510435Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"3861057d-bf87-4918-a108-1f255ee9a31a","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket26/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1339{"timestamp":"2026-08-20T17:24:17.767585675Z","level":"ERROR","duration":"299.063µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1340{"timestamp":"2026-08-20T17:24:17.767667375Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"47a3fb07-94ba-4e63-85a9-038770013870","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket19/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1341{"timestamp":"2026-08-20T17:24:17.76940385Z","level":"ERROR","duration":"217.722µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1342{"timestamp":"2026-08-20T17:24:17.769484611Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"024bfcee-b2db-43dc-9c49-56090f4bbb6b","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket18/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1343{"timestamp":"2026-08-20T17:24:17.80137685Z","level":"ERROR","duration":"144.621µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1344{"timestamp":"2026-08-20T17:24:17.801431311Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"c39b114d-ea51-4008-87f1-a31669fe9554","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket13/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1345{"timestamp":"2026-08-20T17:24:17.828060023Z","level":"ERROR","duration":"123.881µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1346{"timestamp":"2026-08-20T17:24:17.828106864Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"91e6ae4e-97fc-4a78-ad73-5f66546737ab","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket27/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1347{"timestamp":"2026-08-20T17:24:17.85283128Z","level":"ERROR","duration":"150.101µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1348{"timestamp":"2026-08-20T17:24:17.852885781Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"7a6382f5-47ce-4110-a074-eb23155f00ec","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket22/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1349{"timestamp":"2026-08-20T17:24:17.908523887Z","level":"ERROR","duration":"104.541µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1350{"timestamp":"2026-08-20T17:24:17.908566968Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"a326ee64-3075-4450-b781-5850c9905b63","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket33/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1351{"timestamp":"2026-08-20T17:24:18.052272225Z","level":"ERROR","duration":"120.962µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1352{"timestamp":"2026-08-20T17:24:18.052320985Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"703dfa87-4855-4a76-97cc-3ac534dd1fd7","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket26/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1353{"timestamp":"2026-08-20T17:24:18.070923128Z","level":"ERROR","duration":"167.422µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1354{"timestamp":"2026-08-20T17:24:18.070969928Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"468d4d9a-63ba-410b-bf9c-9d85473b0401","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket32/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1355{"timestamp":"2026-08-20T17:24:18.078651735Z","level":"ERROR","duration":"110.241µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1356{"timestamp":"2026-08-20T17:24:18.078696076Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"2b6fec57-511e-4ec6-b76b-a2e353b9b822","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket12/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1357{"timestamp":"2026-08-20T17:24:18.091354206Z","level":"ERROR","duration":"165.681µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1358{"timestamp":"2026-08-20T17:24:18.091415327Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"c15b7d7a-2d05-4917-aaf5-17b05ef8be63","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket29/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1359=== NAME TestReadProxyRangeRequest1360 proxy_test.go:406: unexpected error: bucket creation concurrency limit reached; retry later1361 1362--- FAIL: TestReadProxyRangeRequest (3.43s)1363=== CONT TestReadProxyConditionalGet1364{"timestamp":"2026-08-20T17:24:18.156300614Z","level":"ERROR","duration":"142.121µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1365{"timestamp":"2026-08-20T17:24:18.156358995Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"98a5cbec-f38b-4129-9c00-ec05fd9b102c","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket33/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1366{"timestamp":"2026-08-20T17:24:18.164011502Z","level":"ERROR","duration":"114.461µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1367{"timestamp":"2026-08-20T17:24:18.164058862Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"4a8e7d60-07ce-4b05-9bcc-1ea546f6573a","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket30/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1368{"timestamp":"2026-08-20T17:24:18.172636897Z","level":"ERROR","duration":"135.841µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1369{"timestamp":"2026-08-20T17:24:18.172690658Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"17a7fa2a-ce42-4978-b7e4-5f55f86cb26d","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket33/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1370{"timestamp":"2026-08-20T17:24:18.176223229Z","level":"ERROR","duration":"102.161µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1371{"timestamp":"2026-08-20T17:24:18.176266889Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"16e6fc2c-d706-40b7-9257-6287efca0e3c","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket17/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1372{"timestamp":"2026-08-20T17:24:18.180745008Z","level":"ERROR","duration":"93.261µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1373{"timestamp":"2026-08-20T17:24:18.180787529Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"cda536d6-7079-482d-b320-529734dd1674","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket15/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1374{"timestamp":"2026-08-20T17:24:18.193404419Z","level":"ERROR","duration":"104.501µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1375{"timestamp":"2026-08-20T17:24:18.193451059Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"304fdf0d-d3a4-4581-ae38-76979dd3c976","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket20/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}13762026-08-20 17:24:18.216 UTC [664] ERROR: relation "goose_db_version" does not exist at character 3613772026-08-20 17:24:18.216 UTC [664] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC13782026/08/20 17:24:18 OK 20241026095416_initial_model.sql (9.31ms)1379{"timestamp":"2026-08-20T17:24:18.231419351Z","level":"ERROR","duration":"223.442µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1380{"timestamp":"2026-08-20T17:24:18.231501492Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"1576968a-60a2-40c1-9dae-ac61718b7902","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket28/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1381{"timestamp":"2026-08-20T17:24:18.231836775Z","level":"ERROR","duration":"115.181µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1382{"timestamp":"2026-08-20T17:24:18.231881295Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"a89a4f1e-84b1-4d95-b4d3-083d09f0f8dd","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket13/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}13832026/08/20 17:24:18 OK 20251210153512_drop_unused_gin_index.sql (1.26ms)13842026/08/20 17:24:18 OK 20251218171726_add_pins.sql (3.21ms)13852026/08/20 17:24:18 OK 20260628120000_add_object_size_and_stats.sql (2.67ms)13862026/08/20 17:24:18 goose: successfully migrated database to version: 2026062812000013872026/08/20 17:24:18 OK 1_commit_pending_closure.sql (1.81ms)13882026/08/20 17:24:18 OK 2_object_stats_trigger.sql (865.07µs)13892026/08/20 17:24:18 goose: up to current file version: 21390{"timestamp":"2026-08-20T17:24:18.243153814Z","level":"ERROR","duration":"573.845µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1391{"timestamp":"2026-08-20T17:24:18.243232755Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"66ebd295-f980-462d-9d8f-c6bb860f5faf","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket34/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1392{"timestamp":"2026-08-20T17:24:18.251211745Z","level":"ERROR","duration":"226.322µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1393{"timestamp":"2026-08-20T17:24:18.251291025Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"d8a0a397-c266-4cf3-ac28-638b04330f64","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket34/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1394{"timestamp":"2026-08-20T17:24:18.331153024Z","level":"ERROR","duration":"150.342µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1395{"timestamp":"2026-08-20T17:24:18.331206864Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"54dac2b0-999e-43ce-a1d9-5cf17c7d6ace","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket32/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1396{"timestamp":"2026-08-20T17:24:18.334060549Z","level":"ERROR","duration":"124.821µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1397{"timestamp":"2026-08-20T17:24:18.33411171Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"e90f489f-bbe8-4816-8304-377c2c875737","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket27/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1398=== NAME TestService_healthCheckHandler1399 health_test.go:10: unexpected error: bucket creation concurrency limit reached; retry later1400 1401--- FAIL: TestService_healthCheckHandler (4.77s)1402=== CONT TestService_Rustfstest1403{"timestamp":"2026-08-20T17:24:18.407183009Z","level":"ERROR","duration":"276.963µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1404{"timestamp":"2026-08-20T17:24:18.407249569Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"dce66147-901c-4b6a-859f-713513f74c91","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket34/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}14052026-08-20 17:24:18.439 UTC [667] ERROR: relation "goose_db_version" does not exist at character 3614062026-08-20 17:24:18.439 UTC [667] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC14072026/08/20 17:24:18 OK 20241026095416_initial_model.sql (9.35ms)14082026/08/20 17:24:18 OK 20251210153512_drop_unused_gin_index.sql (1.26ms)14092026/08/20 17:24:18 OK 20251218171726_add_pins.sql (3.22ms)14102026/08/20 17:24:18 OK 20260628120000_add_object_size_and_stats.sql (2.83ms)14112026/08/20 17:24:18 goose: successfully migrated database to version: 2026062812000014122026/08/20 17:24:18 OK 1_commit_pending_closure.sql (1.79ms)14132026/08/20 17:24:18 OK 2_object_stats_trigger.sql (785.43µs)14142026/08/20 17:24:18 goose: up to current file version: 21415{"timestamp":"2026-08-20T17:24:18.466231965Z","level":"ERROR","duration":"669.646µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1416{"timestamp":"2026-08-20T17:24:18.466317986Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"6d861fba-f98a-404d-ab49-433841395f5a","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket35/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1417{"timestamp":"2026-08-20T17:24:18.478360831Z","level":"ERROR","duration":"219.322µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1418{"timestamp":"2026-08-20T17:24:18.478433592Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"14b9a5d5-3c6f-41a4-9de5-d73f149fda09","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket32/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1419{"timestamp":"2026-08-20T17:24:18.49419261Z","level":"ERROR","duration":"123.621µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1420{"timestamp":"2026-08-20T17:24:18.49424475Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"a7665358-2615-4884-88da-0a64fac9dd07","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket18/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1421{"timestamp":"2026-08-20T17:24:18.579200474Z","level":"ERROR","duration":"217.022µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1422{"timestamp":"2026-08-20T17:24:18.579282294Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"cfd953be-0d94-413b-98be-378695d09300","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket26/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1423{"timestamp":"2026-08-20T17:24:18.589939667Z","level":"ERROR","duration":"122.201µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1424{"timestamp":"2026-08-20T17:24:18.589987808Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"2e3e5606-c547-402c-9b28-288c04b860b9","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket35/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1425{"timestamp":"2026-08-20T17:24:18.605798966Z","level":"ERROR","duration":"175.922µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1426{"timestamp":"2026-08-20T17:24:18.605861547Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"accd142d-5b3e-45a9-b9b8-cbd7e7f859ac","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket27/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1427{"timestamp":"2026-08-20T17:24:18.615615272Z","level":"ERROR","duration":"148.301µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1428{"timestamp":"2026-08-20T17:24:18.615671412Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"843b261c-3184-487b-96ea-334441386b4d","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket35/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1429{"timestamp":"2026-08-20T17:24:18.66343243Z","level":"ERROR","duration":"111.061µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1430{"timestamp":"2026-08-20T17:24:18.66347877Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"3fc44afe-c6c4-4b0f-8c69-d143dafa5af8","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket34/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1431{"timestamp":"2026-08-20T17:24:18.664911023Z","level":"ERROR","duration":"89.161µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1432{"timestamp":"2026-08-20T17:24:18.664951463Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"aa3d3604-82df-4fc6-b4f3-413e6a5e479e","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket13/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1433{"timestamp":"2026-08-20T17:24:18.677406672Z","level":"ERROR","duration":"90.36µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1434{"timestamp":"2026-08-20T17:24:18.677448813Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"7c5e9bab-de4a-4b71-801b-d0d090690b79","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket15/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1435{"timestamp":"2026-08-20T17:24:18.681214666Z","level":"ERROR","duration":"228.622µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1436{"timestamp":"2026-08-20T17:24:18.681300386Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"7304c797-8620-42f3-9ba5-ad0f380f85bb","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket35/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1437=== NAME TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle1438 throttle_test.go:112: unexpected error: bucket creation concurrency limit reached; retry later1439 1440--- FAIL: TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle (4.74s)1441=== CONT TestReadProxyHead1442=== NAME TestNARDeduplicationMetadataUploadBug1443 metadata_upload_test.go:25: unexpected error: bucket creation concurrency limit reached; retry later1444 1445--- FAIL: TestNARDeduplicationMetadataUploadBug (5.19s)1446=== CONT TestReadProxy4041447=== NAME TestClientWithDependencies1448 client_integration_test.go:577: unexpected error: bucket creation concurrency limit reached; retry later1449 1450--- FAIL: TestClientWithDependencies (5.13s)1451=== CONT TestReadProxyInvalidPath14522026-08-20 17:24:18.753 UTC [674] ERROR: relation "goose_db_version" does not exist at character 3614532026-08-20 17:24:18.753 UTC [674] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC1454=== NAME TestPinProtectsFromGC1455 client_integration_test.go:603: unexpected error: bucket creation concurrency limit reached; retry later1456 1457--- FAIL: TestPinProtectsFromGC (5.16s)1458=== CONT TestCompletedNarNotReofferedAcrossClosures1459{"timestamp":"2026-08-20T17:24:18.76405091Z","level":"ERROR","duration":"199.361µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1460{"timestamp":"2026-08-20T17:24:18.764098551Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"d3779ffd-25b3-413f-b6ea-ffd29fbf89a3","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket29/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}14612026/08/20 17:24:18 OK 20241026095416_initial_model.sql (12.43ms)14622026/08/20 17:24:18 OK 20251210153512_drop_unused_gin_index.sql (2.35ms)14632026/08/20 17:24:18 OK 20251218171726_add_pins.sql (4.54ms)1464{"timestamp":"2026-08-20T17:24:18.782412991Z","level":"ERROR","duration":"103.641µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1465{"timestamp":"2026-08-20T17:24:18.782454731Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"d72495a8-cfe4-440f-9695-677bf5a94570","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket22/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}14662026/08/20 17:24:18 OK 20260628120000_add_object_size_and_stats.sql (4.65ms)14672026/08/20 17:24:18 goose: successfully migrated database to version: 2026062812000014682026/08/20 17:24:18 OK 1_commit_pending_closure.sql (4.12ms)14692026/08/20 17:24:18 OK 2_object_stats_trigger.sql (2.03ms)14702026/08/20 17:24:18 goose: up to current file version: 21471{"timestamp":"2026-08-20T17:24:18.793519028Z","level":"ERROR","duration":"553.665µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1472{"timestamp":"2026-08-20T17:24:18.793589329Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"26be5d11-a0c0-446f-869c-861585c38031","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket36/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}14732026-08-20 17:24:18.798 UTC [677] ERROR: relation "goose_db_version" does not exist at character 3614742026-08-20 17:24:18.798 UTC [677] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC1475=== NAME TestClientIntegration1476 client_integration_test.go:252: unexpected error: bucket creation concurrency limit reached; retry later1477 1478--- FAIL: TestClientIntegration (5.21s)1479=== CONT TestIsValidCachePath1480=== RUN TestIsValidCachePath/narinfo1481=== PAUSE TestIsValidCachePath/narinfo1482=== RUN TestIsValidCachePath/narinfo_all_nix_base32_chars1483=== PAUSE TestIsValidCachePath/narinfo_all_nix_base32_chars1484=== RUN TestIsValidCachePath/nar_zst1485=== PAUSE TestIsValidCachePath/nar_zst1486=== RUN TestIsValidCachePath/nar_xz1487=== PAUSE TestIsValidCachePath/nar_xz1488=== RUN TestIsValidCachePath/nar_bz21489=== PAUSE TestIsValidCachePath/nar_bz21490=== RUN TestIsValidCachePath/nar_uncompressed1491=== PAUSE TestIsValidCachePath/nar_uncompressed1492=== RUN TestIsValidCachePath/ls1493=== PAUSE TestIsValidCachePath/ls1494=== RUN TestIsValidCachePath/log1495=== PAUSE TestIsValidCachePath/log1496=== RUN TestIsValidCachePath/realisation1497=== PAUSE TestIsValidCachePath/realisation1498=== RUN TestIsValidCachePath/nix-cache-info1499=== PAUSE TestIsValidCachePath/nix-cache-info1500=== RUN TestIsValidCachePath/index.html1501=== PAUSE TestIsValidCachePath/index.html1502=== RUN TestIsValidCachePath/traversal_parent1503=== PAUSE TestIsValidCachePath/traversal_parent1504=== RUN TestIsValidCachePath/traversal_in_middle1505=== PAUSE TestIsValidCachePath/traversal_in_middle1506=== RUN TestIsValidCachePath/invalid_char_e1507=== PAUSE TestIsValidCachePath/invalid_char_e1508=== RUN TestIsValidCachePath/invalid_char_u1509=== PAUSE TestIsValidCachePath/invalid_char_u1510=== RUN TestIsValidCachePath/random_path1511=== PAUSE TestIsValidCachePath/random_path1512=== RUN TestIsValidCachePath/empty1513=== PAUSE TestIsValidCachePath/empty1514=== RUN TestIsValidCachePath/leading_slash1515=== PAUSE TestIsValidCachePath/leading_slash1516=== RUN TestIsValidCachePath/wrong_extension1517=== PAUSE TestIsValidCachePath/wrong_extension1518=== RUN TestIsValidCachePath/short_hash1519=== PAUSE TestIsValidCachePath/short_hash1520=== CONT TestPresignedUploadRegisteredBeforeCommit15212026-08-20 17:24:18.817 UTC [679] ERROR: relation "goose_db_version" does not exist at character 3615222026-08-20 17:24:18.817 UTC [679] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC15232026/08/20 17:24:18 OK 20241026095416_initial_model.sql (10.78ms)1524{"timestamp":"2026-08-20T17:24:18.820831667Z","level":"ERROR","duration":"230.302µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1525{"timestamp":"2026-08-20T17:24:18.820918808Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"d0717844-f5cf-4c16-873d-c244fef50c8a","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket36/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}15262026/08/20 17:24:18 OK 20251210153512_drop_unused_gin_index.sql (2.44ms)15272026/08/20 17:24:18 OK 20251218171726_add_pins.sql (4.23ms)15282026/08/20 17:24:18 OK 20260628120000_add_object_size_and_stats.sql (4.24ms)15292026/08/20 17:24:18 goose: successfully migrated database to version: 2026062812000015302026/08/20 17:24:18 OK 20241026095416_initial_model.sql (11.17ms)15312026/08/20 17:24:18 OK 1_commit_pending_closure.sql (4.1ms)15322026/08/20 17:24:18 OK 20251210153512_drop_unused_gin_index.sql (2.25ms)15332026/08/20 17:24:18 OK 2_object_stats_trigger.sql (1.86ms)15342026/08/20 17:24:18 goose: up to current file version: 215352026-08-20 17:24:18.838 UTC [681] ERROR: relation "goose_db_version" does not exist at character 3615362026-08-20 17:24:18.838 UTC [681] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC1537{"timestamp":"2026-08-20T17:24:18.839405229Z","level":"ERROR","duration":"573.725µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1538{"timestamp":"2026-08-20T17:24:18.83949663Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"33e8b441-4e9e-4ab4-937e-91e0d1d41064","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket37/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}15392026/08/20 17:24:18 OK 20251218171726_add_pins.sql (4.01ms)15402026/08/20 17:24:18 OK 20260628120000_add_object_size_and_stats.sql (3.52ms)15412026/08/20 17:24:18 goose: successfully migrated database to version: 2026062812000015422026/08/20 17:24:18 OK 1_commit_pending_closure.sql (2.83ms)15432026/08/20 17:24:18 OK 2_object_stats_trigger.sql (1.55ms)15442026/08/20 17:24:18 goose: up to current file version: 21545{"timestamp":"2026-08-20T17:24:18.850529847Z","level":"ERROR","duration":"440.644µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1546{"timestamp":"2026-08-20T17:24:18.850580727Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"a3bf280b-a8fe-440a-9a0f-9ab32334e63b","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket38/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}15472026/08/20 17:24:18 OK 20241026095416_initial_model.sql (10.93ms)15482026/08/20 17:24:18 OK 20251210153512_drop_unused_gin_index.sql (2.24ms)1549=== NAME TestService_AuthMiddleware_OIDC1550 auth_test.go:270: unexpected error: bucket creation concurrency limit reached; retry later1551 15522026/08/20 17:24:18 OK 20251218171726_add_pins.sql (3.98ms)1553--- FAIL: TestService_AuthMiddleware_OIDC (5.26s)1554=== CONT TestReadProxyNarinfoAlreadyDecompressed15552026/08/20 17:24:18 OK 20260628120000_add_object_size_and_stats.sql (4.01ms)15562026/08/20 17:24:18 goose: successfully migrated database to version: 2026062812000015572026/08/20 17:24:18 OK 1_commit_pending_closure.sql (2.1ms)15582026/08/20 17:24:18 OK 2_object_stats_trigger.sql (877.13µs)15592026/08/20 17:24:18 goose: up to current file version: 21560{"timestamp":"2026-08-20T17:24:18.871309288Z","level":"ERROR","duration":"532.804µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1561{"timestamp":"2026-08-20T17:24:18.871382229Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"50c8a1d5-e494-4eb8-9fec-6ac5fc62a3ee","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket39/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}15622026-08-20 17:24:18.877 UTC [684] ERROR: relation "goose_db_version" does not exist at character 3615632026-08-20 17:24:18.877 UTC [684] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC15642026/08/20 17:24:18 OK 20241026095416_initial_model.sql (10.95ms)15652026/08/20 17:24:18 OK 20251210153512_drop_unused_gin_index.sql (2.3ms)15662026/08/20 17:24:18 OK 20251218171726_add_pins.sql (3.62ms)1567{"timestamp":"2026-08-20T17:24:18.901543893Z","level":"ERROR","duration":"217.762µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1568{"timestamp":"2026-08-20T17:24:18.901652494Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"498840b5-c2a4-4c93-bfd8-6b7d57d75e82","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket34/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}15692026/08/20 17:24:18 OK 20260628120000_add_object_size_and_stats.sql (3.68ms)15702026/08/20 17:24:18 goose: successfully migrated database to version: 2026062812000015712026/08/20 17:24:18 OK 1_commit_pending_closure.sql (2.55ms)15722026/08/20 17:24:18 OK 2_object_stats_trigger.sql (1.82ms)15732026/08/20 17:24:18 goose: up to current file version: 21574{"timestamp":"2026-08-20T17:24:18.911377059Z","level":"ERROR","duration":"575.465µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1575{"timestamp":"2026-08-20T17:24:18.91145566Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"b406380a-9804-43a7-9f46-f5ab8cf8aaf0","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket40/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}15762026-08-20 17:24:18.925 UTC [685] ERROR: relation "goose_db_version" does not exist at character 3615772026-08-20 17:24:18.925 UTC [685] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC1578{"timestamp":"2026-08-20T17:24:18.932624385Z","level":"ERROR","duration":"5.034130972s","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>ServiceUnavailable</Code><Message>The service is unavailable. Please retry.</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1579{"timestamp":"2026-08-20T17:24:18.932693245Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"e53ed0b5-08e7-42a4-98a4-d8114aa82d37","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket14/","status_code":503,"duration_ms":5034,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}15802026/08/20 17:24:18 OK 20241026095416_initial_model.sql (9.14ms)15812026/08/20 17:24:18 OK 20251210153512_drop_unused_gin_index.sql (1.09ms)15822026/08/20 17:24:18 OK 20251218171726_add_pins.sql (3.16ms)15832026/08/20 17:24:18 OK 20260628120000_add_object_size_and_stats.sql (2.91ms)15842026/08/20 17:24:18 goose: successfully migrated database to version: 2026062812000015852026/08/20 17:24:18 OK 1_commit_pending_closure.sql (1.72ms)15862026/08/20 17:24:18 OK 2_object_stats_trigger.sql (780.91µs)15872026/08/20 17:24:18 goose: up to current file version: 21588{"timestamp":"2026-08-20T17:24:18.950461001Z","level":"ERROR","duration":"203.642µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1589{"timestamp":"2026-08-20T17:24:18.950549101Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"866877e8-9514-4d9d-9a13-1832f0718c7e","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket39/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1590{"timestamp":"2026-08-20T17:24:18.951392389Z","level":"ERROR","duration":"446.464µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1591{"timestamp":"2026-08-20T17:24:18.951450569Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"2045ec8a-5b75-46dd-986e-a39e0a5c1b10","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket41/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1592{"timestamp":"2026-08-20T17:24:18.953231045Z","level":"ERROR","duration":"197.542µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1593{"timestamp":"2026-08-20T17:24:18.953310266Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"c99abe18-e7aa-4c2b-9a9e-aa58cd152ce2","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket41/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1594{"timestamp":"2026-08-20T17:24:18.953587668Z","level":"ERROR","duration":"107.721µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1595{"timestamp":"2026-08-20T17:24:18.953629069Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"f6216389-d2d2-4c35-a78f-9c2b9c4cde21","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket40/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1596{"timestamp":"2026-08-20T17:24:18.964386082Z","level":"ERROR","duration":"113.381µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1597{"timestamp":"2026-08-20T17:24:18.964431403Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"c6a07f27-9ed9-4952-ab9e-cd0209b14937","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket38/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1598{"timestamp":"2026-08-20T17:24:18.97321712Z","level":"ERROR","duration":"194.702µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1599{"timestamp":"2026-08-20T17:24:18.97328856Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"adfbf444-e322-4dd4-9157-2990969e79a3","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket40/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1600{"timestamp":"2026-08-20T17:24:18.985943491Z","level":"ERROR","duration":"131.741µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1601{"timestamp":"2026-08-20T17:24:18.985997972Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"18374d88-1515-41f3-85db-3a139c859c1c","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket38/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1602{"timestamp":"2026-08-20T17:24:18.993626978Z","level":"ERROR","duration":"91.261µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1603{"timestamp":"2026-08-20T17:24:18.993668759Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"de5d7f57-ece4-452e-86bf-ed25c0965216","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket14/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1604{"timestamp":"2026-08-20T17:24:19.019241662Z","level":"ERROR","duration":"112.82µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1605{"timestamp":"2026-08-20T17:24:19.019286903Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"bdb00c7f-f19d-4560-86f9-caf757e198da","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket28/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1606=== NAME TestRedundantMultipartUpload1607 redundant_multipart_test.go:24: unexpected error: bucket creation concurrency limit reached; retry later1608 1609--- FAIL: TestRedundantMultipartUpload (4.38s)1610=== CONT TestResurrectedObjectNotDeleted1611{"timestamp":"2026-08-20T17:24:19.052207091Z","level":"ERROR","duration":"111.901µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1612{"timestamp":"2026-08-20T17:24:19.052254911Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"6b2ec2c9-5570-44c0-9c8c-3335cbb126f2","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket36/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1613{"timestamp":"2026-08-20T17:24:19.080987663Z","level":"ERROR","duration":"201.381µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1614{"timestamp":"2026-08-20T17:24:19.081036363Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"1663ec23-ed7c-485f-bf5b-5227d120c40c","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket26/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}16152026-08-20 17:24:19.097 UTC [688] ERROR: relation "goose_db_version" does not exist at character 3616162026-08-20 17:24:19.097 UTC [688] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC16172026/08/20 17:24:19 OK 20241026095416_initial_model.sql (9ms)16182026/08/20 17:24:19 OK 20251210153512_drop_unused_gin_index.sql (1.11ms)16192026/08/20 17:24:19 OK 20251218171726_add_pins.sql (2.93ms)16202026/08/20 17:24:19 OK 20260628120000_add_object_size_and_stats.sql (2.24ms)16212026/08/20 17:24:19 goose: successfully migrated database to version: 2026062812000016222026/08/20 17:24:19 OK 1_commit_pending_closure.sql (1.68ms)16232026/08/20 17:24:19 OK 2_object_stats_trigger.sql (705.59µs)16242026/08/20 17:24:19 goose: up to current file version: 21625{"timestamp":"2026-08-20T17:24:19.122292004Z","level":"ERROR","duration":"560.905µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1626{"timestamp":"2026-08-20T17:24:19.122360204Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"d5d71513-1308-4832-83e4-4f3facc7808d","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket42/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1627=== NAME TestCacheStatsHandler1628 cache_stats_test.go:17: unexpected error: bucket creation concurrency limit reached; retry later1629 1630--- FAIL: TestCacheStatsHandler (5.59s)1631=== CONT TestReadProxyNarinfo1632{"timestamp":"2026-08-20T17:24:19.16645783Z","level":"ERROR","duration":"232.682µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1633{"timestamp":"2026-08-20T17:24:19.166564011Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"21a5d6f8-739b-4a82-a423-3eaecfabf8c2","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket33/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1634=== NAME TestGCMetrics1635 gc_metrics_test.go:18: unexpected error: bucket creation concurrency limit reached; retry later1636 1637--- FAIL: TestGCMetrics (5.57s)1638=== CONT TestOrphanedObjectsGCStressTest16392026-08-20 17:24:19.186 UTC [693] ERROR: relation "goose_db_version" does not exist at character 3616402026-08-20 17:24:19.186 UTC [693] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC1641{"timestamp":"2026-08-20T17:24:19.195214381Z","level":"ERROR","duration":"177.321µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1642{"timestamp":"2026-08-20T17:24:19.195273862Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"7931f087-5252-40fc-bb13-8ba6c0c32d47","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket42/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}16432026/08/20 17:24:19 OK 20241026095416_initial_model.sql (10.08ms)16442026/08/20 17:24:19 OK 20251210153512_drop_unused_gin_index.sql (1.9ms)16452026/08/20 17:24:19 OK 20251218171726_add_pins.sql (3.71ms)1646{"timestamp":"2026-08-20T17:24:19.209301365Z","level":"ERROR","duration":"133.241µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1647{"timestamp":"2026-08-20T17:24:19.209352325Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"9dc8efe7-e6c4-4df7-b6a9-c6bd16e89860","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket41/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}16482026/08/20 17:24:19 OK 20260628120000_add_object_size_and_stats.sql (4.03ms)16492026/08/20 17:24:19 goose: successfully migrated database to version: 2026062812000016502026/08/20 17:24:19 OK 1_commit_pending_closure.sql (2.97ms)16512026/08/20 17:24:19 OK 2_object_stats_trigger.sql (1.71ms)16522026/08/20 17:24:19 goose: up to current file version: 21653{"timestamp":"2026-08-20T17:24:19.219571355Z","level":"ERROR","duration":"242.562µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1654{"timestamp":"2026-08-20T17:24:19.219653255Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"fb689265-1095-427d-9223-0ce825d09689","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket38/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1655{"timestamp":"2026-08-20T17:24:19.219789216Z","level":"ERROR","duration":"453.264µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1656{"timestamp":"2026-08-20T17:24:19.219853637Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"1a3f1ed8-7094-4f86-9f2b-2d9516c7066d","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket43/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}16572026-08-20 17:24:19.231 UTC [694] ERROR: relation "goose_db_version" does not exist at character 3616582026-08-20 17:24:19.231 UTC [694] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC16592026/08/20 17:24:19 OK 20241026095416_initial_model.sql (8.79ms)16602026/08/20 17:24:19 OK 20251210153512_drop_unused_gin_index.sql (1.09ms)16612026/08/20 17:24:19 OK 20251218171726_add_pins.sql (2.43ms)16622026/08/20 17:24:19 OK 20260628120000_add_object_size_and_stats.sql (2.21ms)16632026/08/20 17:24:19 goose: successfully migrated database to version: 2026062812000016642026/08/20 17:24:19 OK 1_commit_pending_closure.sql (1.53ms)16652026/08/20 17:24:19 OK 2_object_stats_trigger.sql (691.35µs)16662026/08/20 17:24:19 goose: up to current file version: 21667{"timestamp":"2026-08-20T17:24:19.254171097Z","level":"ERROR","duration":"527.344µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1668{"timestamp":"2026-08-20T17:24:19.254254258Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"3546ccfa-84d4-4d35-b8b0-383a37deae46","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket44/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1669{"timestamp":"2026-08-20T17:24:19.263099355Z","level":"ERROR","duration":"140.021µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1670{"timestamp":"2026-08-20T17:24:19.263146036Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"1decffc1-403f-4b3a-8faa-b74df093b4d7","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket39/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1671{"timestamp":"2026-08-20T17:24:19.27164531Z","level":"ERROR","duration":"94.321µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1672{"timestamp":"2026-08-20T17:24:19.27168741Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"2dd56fe8-7c42-4fb2-86c0-d0b877a1dac4","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket35/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1673{"timestamp":"2026-08-20T17:24:19.313287334Z","level":"ERROR","duration":"149.281µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}1674{"timestamp":"2026-08-20T17:24:19.313333775Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"4b32a099-0d89-4485-949e-1577c277cdef","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket32/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}1675{"timestamp":"2026-08-20T17:24:19.355879987Z","level":"ERROR","duration":"105.861µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}1676{"timestamp":"2026-08-20T17:24:19.355924107Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"56be4b1e-b4a5-44e1-ae67-f5732f6bd0f5","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket43/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}1677{"timestamp":"2026-08-20T17:24:19.360496887Z","level":"ERROR","duration":"88.681µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}1678{"timestamp":"2026-08-20T17:24:19.360537108Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"1057264b-fde5-4686-bd28-72a1b6301c98","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket29/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}1679{"timestamp":"2026-08-20T17:24:19.364157459Z","level":"ERROR","duration":"83.78µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}1680{"timestamp":"2026-08-20T17:24:19.36419642Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"27560f02-6e64-4c6f-aa11-babae31034bb","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket39/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}1681{"timestamp":"2026-08-20T17:24:19.381778893Z","level":"ERROR","duration":"158.921µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}1682{"timestamp":"2026-08-20T17:24:19.381820194Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"91401318-0f18-4526-bc4c-4688739d9d05","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket38/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}1683{"timestamp":"2026-08-20T17:24:19.403410862Z","level":"ERROR","duration":"94.16µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}1684{"timestamp":"2026-08-20T17:24:19.403453203Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"e01ddbb9-bb0d-400f-a87c-7cd04cde5c8c","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket44/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}1685{"timestamp":"2026-08-20T17:24:19.418046891Z","level":"ERROR","duration":"86.181µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}1686{"timestamp":"2026-08-20T17:24:19.418086591Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"79ddb778-6f81-48d4-a6da-00a7011f07f9","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket42/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}1687{"timestamp":"2026-08-20T17:24:19.438845533Z","level":"ERROR","duration":"215.802µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1688{"timestamp":"2026-08-20T17:24:19.438930733Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"f2a88fc4-368f-4efb-9434-7f5f014cf41e","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket36/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1689{"timestamp":"2026-08-20T17:24:19.440417286Z","level":"ERROR","duration":"91.321µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}1690{"timestamp":"2026-08-20T17:24:19.440459267Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"9ccbf731-0988-4f90-b18b-352f4eed5dd6","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket43/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}1691{"timestamp":"2026-08-20T17:24:19.467953827Z","level":"ERROR","duration":"84.441µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}1692{"timestamp":"2026-08-20T17:24:19.467992747Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"a9a1949c-6824-4a69-9e04-4a28a8faf79d","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket41/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}1693{"timestamp":"2026-08-20T17:24:19.471280816Z","level":"ERROR","duration":"5.010341104s","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>ServiceUnavailable</Code><Message>The service is unavailable. Please retry.</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}1694{"timestamp":"2026-08-20T17:24:19.471320817Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"84c7f742-c53c-4696-8a70-978ae5b8a218","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket21/","status_code":503,"duration_ms":5010,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}1695{"timestamp":"2026-08-20T17:24:19.499109259Z","level":"ERROR","duration":"140.861µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1696{"timestamp":"2026-08-20T17:24:19.4991596Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"c438ba25-4775-4840-9181-6a4b22beb853","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket43/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1697{"timestamp":"2026-08-20T17:24:19.507803696Z","level":"ERROR","duration":"102.181µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1698{"timestamp":"2026-08-20T17:24:19.507845636Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"a0409dc7-5a31-4fd8-a694-deba9f1623f7","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket28/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1699{"timestamp":"2026-08-20T17:24:19.53453057Z","level":"ERROR","duration":"145.442µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1700{"timestamp":"2026-08-20T17:24:19.53457561Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"c059a1d3-5aea-4825-b784-47e9f707bfc3","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket33/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1701{"timestamp":"2026-08-20T17:24:19.581248198Z","level":"ERROR","duration":"169.182µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1702{"timestamp":"2026-08-20T17:24:19.581306578Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"7ed0dfcc-20e9-40ea-b7d1-c75a9a1de36b","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket34/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1703{"timestamp":"2026-08-20T17:24:19.631890461Z","level":"ERROR","duration":"107.101µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1704{"timestamp":"2026-08-20T17:24:19.631935281Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"47ba8b94-e27e-4e82-82cb-4127f004a813","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket40/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1705=== NAME TestReadProxyDisabled1706 proxy_test.go:392: unexpected error: bucket creation concurrency limit reached; retry later1707 1708--- FAIL: TestReadProxyDisabled (5.71s)1709=== CONT TestParseSingleRange1710=== RUN TestParseSingleRange/none1711=== PAUSE TestParseSingleRange/none1712=== RUN TestParseSingleRange/unknown_unit1713=== PAUSE TestParseSingleRange/unknown_unit1714=== RUN TestParseSingleRange/multi-range_ignored1715=== PAUSE TestParseSingleRange/multi-range_ignored1716=== RUN TestParseSingleRange/malformed_no_dash1717=== PAUSE TestParseSingleRange/malformed_no_dash1718=== RUN TestParseSingleRange/malformed_both_empty1719=== PAUSE TestParseSingleRange/malformed_both_empty1720=== RUN TestParseSingleRange/malformed_end_before_start1721=== PAUSE TestParseSingleRange/malformed_end_before_start1722=== RUN TestParseSingleRange/closed1723=== PAUSE TestParseSingleRange/closed1724=== RUN TestParseSingleRange/open-ended1725=== PAUSE TestParseSingleRange/open-ended1726=== RUN TestParseSingleRange/end_clamped_to_size1727=== PAUSE TestParseSingleRange/end_clamped_to_size1728=== RUN TestParseSingleRange/suffix1729=== PAUSE TestParseSingleRange/suffix1730=== RUN TestParseSingleRange/suffix_exceeds_size1731=== PAUSE TestParseSingleRange/suffix_exceeds_size1732=== RUN TestParseSingleRange/single_byte1733=== PAUSE TestParseSingleRange/single_byte1734=== RUN TestParseSingleRange/start_past_EOF1735=== PAUSE TestParseSingleRange/start_past_EOF1736=== RUN TestParseSingleRange/start_far_past_EOF1737=== PAUSE TestParseSingleRange/start_far_past_EOF1738=== CONT TestServerTLSConfig/no_client_CA1739=== CONT TestServerTLSConfig/not_a_PEM_file1740=== CONT TestServerTLSConfig/missing_CA_file1741--- PASS: TestServerTLSConfig (0.00s)1742 --- PASS: TestServerTLSConfig/no_client_CA (0.00s)1743 --- PASS: TestServerTLSConfig/not_a_PEM_file (0.00s)1744 --- PASS: TestServerTLSConfig/missing_CA_file (0.00s)1745=== CONT TestClientErrorHandling/InvalidStorePath1746{"timestamp":"2026-08-20T17:24:19.662941973Z","level":"ERROR","duration":"125.121µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1747{"timestamp":"2026-08-20T17:24:19.662990173Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"4d4db978-c4c4-43b0-98b7-322311f23846","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket44/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1748{"timestamp":"2026-08-20T17:24:19.694397968Z","level":"ERROR","duration":"5.007007115s","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>ServiceUnavailable</Code><Message>The service is unavailable. Please retry.</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1749{"timestamp":"2026-08-20T17:24:19.694440628Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"27c2cefc-006b-4bc8-9c03-acaa70e20fc6","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket10/","status_code":503,"duration_ms":5007,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}17502026-08-20 17:24:19.719 UTC [697] ERROR: relation "goose_db_version" does not exist at character 3617512026-08-20 17:24:19.719 UTC [697] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC17522026/08/20 17:24:19 OK 20241026095416_initial_model.sql (8.41ms)17532026/08/20 17:24:19 OK 20251210153512_drop_unused_gin_index.sql (1.34ms)17542026/08/20 17:24:19 OK 20251218171726_add_pins.sql (2.88ms)17552026/08/20 17:24:19 OK 20260628120000_add_object_size_and_stats.sql (2.93ms)17562026/08/20 17:24:19 goose: successfully migrated database to version: 2026062812000017572026/08/20 17:24:19 OK 1_commit_pending_closure.sql (1.63ms)17582026/08/20 17:24:19 OK 2_object_stats_trigger.sql (731.39µs)17592026/08/20 17:24:19 goose: up to current file version: 21760{"timestamp":"2026-08-20T17:24:19.780141018Z","level":"ERROR","duration":"157.562µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1761{"timestamp":"2026-08-20T17:24:19.780213078Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"ecd50544-fef3-4703-9571-9627fa8d4c62","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket35/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1762{"timestamp":"2026-08-20T17:24:19.853958263Z","level":"ERROR","duration":"111.5µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1763{"timestamp":"2026-08-20T17:24:19.854002884Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"3b87fa81-5056-486e-8e53-d7996c1de3b8","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket38/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1764{"timestamp":"2026-08-20T17:24:19.882660994Z","level":"ERROR","duration":"109.581µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1765{"timestamp":"2026-08-20T17:24:19.882704975Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"65d98a1c-d47e-4b6f-88c2-653bff3c69fa","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket36/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1766{"timestamp":"2026-08-20T17:24:19.883170679Z","level":"ERROR","duration":"135.381µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1767{"timestamp":"2026-08-20T17:24:19.883219119Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"ca833c41-9aa4-45c9-8424-6ab36d321510","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket41/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1768{"timestamp":"2026-08-20T17:24:19.890702585Z","level":"ERROR","duration":"99.741µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1769{"timestamp":"2026-08-20T17:24:19.890744305Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"4e94802a-33ef-4483-9b69-e55c92e0bcbd","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket39/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1770=== NAME TestService_AuthMiddleware_MTLSProxyHeader1771 auth_test.go:55: unexpected error: bucket creation concurrency limit reached; retry later1772 1773--- FAIL: TestService_AuthMiddleware_MTLSProxyHeader (6.03s)1774=== CONT TestClientErrorHandling/ServerNotAvailable1775{"timestamp":"2026-08-20T17:24:19.96444853Z","level":"ERROR","duration":"214.822µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}1776{"timestamp":"2026-08-20T17:24:19.96452015Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"f7f82a87-e1ec-483a-a702-425310bd067d","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket43/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}17772026/08/20 17:24:20 WARN Request failed, retrying attempt=1 max_attempts=6 backoff=100ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config1778{"timestamp":"2026-08-20T17:24:20.041470583Z","level":"ERROR","duration":"6.230027932s","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>ServiceUnavailable</Code><Message>The service is unavailable. Please retry.</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}1779{"timestamp":"2026-08-20T17:24:20.041529304Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"2b2683d1-32dd-49ca-bfd8-18dbff7105cb","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket5/","status_code":503,"duration_ms":6230,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}1780{"timestamp":"2026-08-20T17:24:20.055710668Z","level":"ERROR","message":"Scanner data usage save failed","event":"scanner_persist_state","component":"scanner","subsystem":"runtime","path":"buckets/.usage.v2.json","state":"save_failed","error":"Lock error: Lock acquisition timeout for resource '.rustfs.sys/buckets/.usage.v2.json@latest' after 5s","target":"rustfs::scanner","filename":"crates/scanner/src/scanner.rs","line_number":3872,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1781{"timestamp":"2026-08-20T17:24:20.05590307Z","level":"ERROR","message":"Scanner cycle completed without a durable data usage snapshot","event":"scanner_persist_state","component":"scanner","subsystem":"runtime","cycle":4,"state":"usage_not_durable","target":"rustfs::scanner","filename":"crates/scanner/src/scanner.rs","line_number":2763,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1782{"timestamp":"2026-08-20T17:24:20.069814071Z","level":"ERROR","duration":"6.108289987s","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>ServiceUnavailable</Code><Message>The service is unavailable. Please retry.</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1783{"timestamp":"2026-08-20T17:24:20.069874692Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"db403570-9418-4455-a5cc-012b0103bae6","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket11/","status_code":503,"duration_ms":6108,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}1784{"timestamp":"2026-08-20T17:24:20.09597318Z","level":"ERROR","duration":"206.062µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1785{"timestamp":"2026-08-20T17:24:20.096051001Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"8ba74d1b-c511-4a7a-b4c3-25bb63132b6f","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket10/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}17862026/08/20 17:24:20 INFO Received complete multipart upload request method=POST path=/api/multipart/complete1787{"timestamp":"2026-08-20T17:24:20.109316897Z","level":"ERROR","duration":"190.922µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}1788{"timestamp":"2026-08-20T17:24:20.109380578Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"9cedb832-64cc-45b9-a9d1-1d62da6c7d46","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket40/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}17892026/08/20 17:24:20 ERROR Failed to get multipart upload error="no rows in result set" upload_id=does-not-exist object_key=nar/0000000000000000000000000000000000000000000000000000.nar.zst1790--- PASS: TestCompleteMultipartUnregistered (6.58s)1791=== CONT TestClientErrorHandling/InvalidAuthToken1792{"timestamp":"2026-08-20T17:24:20.111250194Z","level":"ERROR","duration":"166.261µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1793{"timestamp":"2026-08-20T17:24:20.111299594Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"5e351c7a-a705-4324-8023-7e628e726166","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket21/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1794{"timestamp":"2026-08-20T17:24:20.127287734Z","level":"ERROR","duration":"224.622µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(312)"}1795{"timestamp":"2026-08-20T17:24:20.127360515Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"e28ee438-30d1-4bb5-9574-2ab2a1a5faab","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket32/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(312)"}17962026/08/20 17:24:20 WARN Request failed, retrying attempt=2 max_attempts=6 backoff=195.788734ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config1797{"timestamp":"2026-08-20T17:24:20.139945945Z","level":"ERROR","duration":"214.142µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1798{"timestamp":"2026-08-20T17:24:20.140020866Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"86158fed-898c-4f58-b344-93190e187555","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket35/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}1799{"timestamp":"2026-08-20T17:24:20.159908579Z","level":"ERROR","duration":"181.141µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(312)"}1800{"timestamp":"2026-08-20T17:24:20.15997716Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"8f253782-f717-4981-adea-d4052ed75023","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket39/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(312)"}1801--- PASS: TestReadProxy404 (1.45s)1802=== CONT TestCacheConfigHandler/full_config,_no_issuer1803=== CONT TestCacheConfigHandler/no_signing_keys1804=== CONT TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator1805=== CONT TestCacheConfigHandler/no_cache_url_configured1806--- PASS: TestCacheConfigHandler (0.00s)1807 --- PASS: TestCacheConfigHandler/full_config,_no_issuer (0.00s)1808 --- PASS: TestCacheConfigHandler/no_signing_keys (0.00s)1809 --- PASS: TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator (0.00s)1810 --- PASS: TestCacheConfigHandler/no_cache_url_configured (0.00s)1811=== CONT TestUploadHandlersRejectOversizedBody/create_pending_closure18122026/08/20 17:24:20 INFO Received uploads request method=POST path=/18132026-08-20 17:24:20.177 UTC [753] ERROR: relation "goose_db_version" does not exist at character 3618142026-08-20 17:24:20.177 UTC [753] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC18152026/08/20 17:24:20 OK 20241026095416_initial_model.sql (9.81ms)18162026/08/20 17:24:20 OK 20251210153512_drop_unused_gin_index.sql (1.29ms)18172026/08/20 17:24:20 OK 20251218171726_add_pins.sql (3.33ms)18182026/08/20 17:24:20 OK 20260628120000_add_object_size_and_stats.sql (2.73ms)18192026/08/20 17:24:20 goose: successfully migrated database to version: 2026062812000018202026/08/20 17:24:20 OK 1_commit_pending_closure.sql (1.73ms)18212026/08/20 17:24:20 OK 2_object_stats_trigger.sql (825.91µs)18222026/08/20 17:24:20 goose: up to current file version: 21823=== CONT TestUploadHandlersRejectOversizedBody/request_more_parts18242026/08/20 17:24:20 INFO Received request for more parts method=POST path=/18252026/08/20 17:24:20 INFO Received uploads request method=POST path=/api/pending_closures18262026/08/20 17:24:20 INFO Received uploads request method=POST path=/api/pending_closures1827--- PASS: TestResurrectedObjectNotDeleted (1.21s)1828=== CONT TestUploadHandlersRejectOversizedBody/complete_multipart18292026/08/20 17:24:20 INFO Received uploads request method=POST path=/api/pending_closures18302026/08/20 17:24:20 INFO Received complete multipart upload request method=POST path=/18312026/08/20 17:24:20 INFO Received uploads request method=POST path=/api/pending_closures18322026/08/20 17:24:20 INFO Received complete multipart upload request method=POST path=/api/multipart/complete18332026/08/20 17:24:20 WARN Request failed, retrying attempt=3 max_attempts=6 backoff=433.204953ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config1834=== CONT TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info18352026/08/20 17:24:20 INFO Received uploads request method=POST path=/1836=== CONT TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key18372026/08/20 17:24:20 INFO Received complete multipart upload request method=POST path=/1838=== CONT TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal18392026/08/20 17:24:20 INFO Received uploads request method=POST path=/1840=== CONT TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key18412026/08/20 17:24:20 INFO Received request for more parts method=POST path=/1842--- PASS: TestUploadHandlersRejectInvalidKeys (0.00s)1843 --- PASS: TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info (0.00s)1844 --- PASS: TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key (0.00s)1845 --- PASS: TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal (0.00s)1846 --- PASS: TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key (0.00s)1847=== CONT TestIsValidUploadKey/narinfo1848=== CONT TestIsValidUploadKey/listing_key,_narinfo_type1849=== CONT TestIsValidUploadKey/nar_key,_narinfo_type1850=== CONT TestIsValidUploadKey/traversal1851=== CONT TestIsValidUploadKey/narinfo_key,_nar_type1852=== CONT TestIsValidUploadKey/index.html1853=== CONT TestIsValidUploadKey/nix-cache-info1854=== CONT TestIsValidUploadKey/realisation_plus_in_output1855=== CONT TestIsValidUploadKey/realisation1856=== CONT TestIsValidUploadKey/build_log_equals1857=== CONT TestIsValidUploadKey/build_log_question_mark1858=== CONT TestIsValidUploadKey/build_log_plus_in_name1859=== CONT TestIsValidUploadKey/build_log_home-manager_file1860=== CONT TestIsValidUploadKey/build_log1861=== CONT TestIsValidUploadKey/listing1862=== CONT TestIsValidUploadKey/nar_plain1863=== CONT TestIsValidUploadKey/nar_xz1864=== CONT TestIsValidUploadKey/nar_zst1865=== CONT TestIsValidUploadKey/unknown_type1866=== CONT TestIsValidUploadKey/absolute1867=== CONT TestIsValidUploadKey/empty_key1868=== CONT TestIsValidUploadKey/traversal_nar1869--- PASS: TestIsValidUploadKey (0.00s)1870 --- PASS: TestIsValidUploadKey/narinfo (0.00s)1871 --- PASS: TestIsValidUploadKey/listing_key,_narinfo_type (0.00s)1872 --- PASS: TestIsValidUploadKey/nar_key,_narinfo_type (0.00s)1873 --- PASS: TestIsValidUploadKey/traversal (0.00s)1874 --- PASS: TestIsValidUploadKey/narinfo_key,_nar_type (0.00s)1875 --- PASS: TestIsValidUploadKey/index.html (0.00s)1876 --- PASS: TestIsValidUploadKey/nix-cache-info (0.00s)1877 --- PASS: TestIsValidUploadKey/realisation_plus_in_output (0.00s)1878 --- PASS: TestIsValidUploadKey/realisation (0.00s)1879 --- PASS: TestIsValidUploadKey/build_log_equals (0.00s)1880 --- PASS: TestIsValidUploadKey/build_log_question_mark (0.00s)1881 --- PASS: TestIsValidUploadKey/build_log_plus_in_name (0.00s)1882 --- PASS: TestIsValidUploadKey/build_log_home-manager_file (0.00s)1883 --- PASS: TestIsValidUploadKey/build_log (0.00s)1884 --- PASS: TestIsValidUploadKey/listing (0.00s)1885 --- PASS: TestIsValidUploadKey/nar_plain (0.00s)1886 --- PASS: TestIsValidUploadKey/nar_xz (0.00s)1887 --- PASS: TestIsValidUploadKey/nar_zst (0.00s)1888 --- PASS: TestIsValidUploadKey/unknown_type (0.00s)1889 --- PASS: TestIsValidUploadKey/absolute (0.00s)1890 --- PASS: TestIsValidUploadKey/empty_key (0.00s)1891 --- PASS: TestIsValidUploadKey/traversal_nar (0.00s)1892=== CONT TestProxyWriteTimeout/narinfo1893=== CONT TestProxyWriteTimeout/10_GiB_nar1894=== CONT TestProxyWriteTimeout/unknown_size1895=== CONT TestProxyWriteTimeout/1_GiB_nar1896--- PASS: TestProxyWriteTimeout (0.00s)1897 --- PASS: TestProxyWriteTimeout/narinfo (0.00s)1898 --- PASS: TestProxyWriteTimeout/10_GiB_nar (0.00s)1899 --- PASS: TestProxyWriteTimeout/unknown_size (0.00s)1900 --- PASS: TestProxyWriteTimeout/1_GiB_nar (0.00s)1901=== CONT TestIsValidCachePath/narinfo1902=== CONT TestIsValidCachePath/short_hash1903=== CONT TestIsValidCachePath/wrong_extension1904=== CONT TestIsValidCachePath/leading_slash1905=== CONT TestIsValidCachePath/empty1906=== CONT TestIsValidCachePath/random_path1907=== CONT TestIsValidCachePath/invalid_char_u1908=== CONT TestIsValidCachePath/invalid_char_e1909=== CONT TestIsValidCachePath/traversal_in_middle1910=== CONT TestIsValidCachePath/traversal_parent1911=== CONT TestIsValidCachePath/index.html1912=== CONT TestIsValidCachePath/nix-cache-info1913=== CONT TestIsValidCachePath/nar_bz21914=== CONT TestIsValidCachePath/nar_xz1915=== CONT TestIsValidCachePath/nar_zst1916=== CONT TestIsValidCachePath/narinfo_all_nix_base32_chars1917=== CONT TestIsValidCachePath/log1918=== CONT TestIsValidCachePath/realisation1919=== CONT TestIsValidCachePath/ls1920=== CONT TestIsValidCachePath/nar_uncompressed1921--- PASS: TestIsValidCachePath (0.00s)1922 --- PASS: TestIsValidCachePath/narinfo (0.00s)1923 --- PASS: TestIsValidCachePath/short_hash (0.00s)1924 --- PASS: TestIsValidCachePath/wrong_extension (0.00s)1925 --- PASS: TestIsValidCachePath/leading_slash (0.00s)1926 --- PASS: TestIsValidCachePath/empty (0.00s)1927 --- PASS: TestIsValidCachePath/random_path (0.00s)1928 --- PASS: TestIsValidCachePath/invalid_char_u (0.00s)1929 --- PASS: TestIsValidCachePath/invalid_char_e (0.00s)1930 --- PASS: TestIsValidCachePath/traversal_in_middle (0.00s)1931 --- PASS: TestIsValidCachePath/traversal_parent (0.00s)1932 --- PASS: TestIsValidCachePath/index.html (0.00s)1933 --- PASS: TestIsValidCachePath/nix-cache-info (0.00s)1934 --- PASS: TestIsValidCachePath/nar_bz2 (0.00s)1935 --- PASS: TestIsValidCachePath/nar_xz (0.00s)1936 --- PASS: TestIsValidCachePath/nar_zst (0.00s)1937 --- PASS: TestIsValidCachePath/narinfo_all_nix_base32_chars (0.00s)1938 --- PASS: TestIsValidCachePath/log (0.00s)1939 --- PASS: TestIsValidCachePath/realisation (0.00s)1940 --- PASS: TestIsValidCachePath/ls (0.00s)1941 --- PASS: TestIsValidCachePath/nar_uncompressed (0.00s)1942=== CONT TestParseSingleRange/none1943=== CONT TestParseSingleRange/suffix_exceeds_size1944=== CONT TestParseSingleRange/suffix1945=== CONT TestParseSingleRange/end_clamped_to_size1946=== CONT TestParseSingleRange/open-ended1947=== CONT TestParseSingleRange/single_byte1948=== CONT TestParseSingleRange/closed1949=== CONT TestParseSingleRange/malformed_end_before_start1950=== CONT TestParseSingleRange/malformed_both_empty1951=== CONT TestParseSingleRange/malformed_no_dash1952=== CONT TestParseSingleRange/multi-range_ignored1953=== CONT TestParseSingleRange/unknown_unit1954=== CONT TestParseSingleRange/start_far_past_EOF1955=== CONT TestParseSingleRange/start_past_EOF1956--- PASS: TestParseSingleRange (0.00s)1957 --- PASS: TestParseSingleRange/none (0.00s)1958 --- PASS: TestParseSingleRange/suffix_exceeds_size (0.00s)1959 --- PASS: TestParseSingleRange/suffix (0.00s)1960 --- PASS: TestParseSingleRange/end_clamped_to_size (0.00s)1961 --- PASS: TestParseSingleRange/open-ended (0.00s)1962 --- PASS: TestParseSingleRange/single_byte (0.00s)1963 --- PASS: TestParseSingleRange/closed (0.00s)1964 --- PASS: TestParseSingleRange/malformed_end_before_start (0.00s)1965 --- PASS: TestParseSingleRange/malformed_both_empty (0.00s)1966 --- PASS: TestParseSingleRange/malformed_no_dash (0.00s)1967 --- PASS: TestParseSingleRange/multi-range_ignored (0.00s)1968 --- PASS: TestParseSingleRange/unknown_unit (0.00s)1969 --- PASS: TestParseSingleRange/start_far_past_EOF (0.00s)1970 --- PASS: TestParseSingleRange/start_past_EOF (0.00s)19712026/08/20 17:24:20 INFO Received cleanup request method=DELETE path=/api/pending_closures19722026/08/20 17:24:20 INFO Aborted multipart uploads count=11973--- PASS: TestMultipartCleanup (6.89s)19742026/08/20 17:24:20 INFO Received cleanup request method=DELETE path=/api/pending_closures19752026/08/20 17:24:20 INFO Aborted multipart uploads count=019762026/08/20 17:24:20 INFO Received uploads request method=POST path=/api/pending_closures19772026/08/20 17:24:20 INFO Received cleanup request method=DELETE path=/api/pending_closures19782026/08/20 17:24:20 INFO Aborted multipart uploads count=119792026/08/20 17:24:20 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete19802026-08-20 17:24:20.465 UTC [600] ERROR: Closure does not exist: id=119812026-08-20 17:24:20.465 UTC [600] CONTEXT: PL/pgSQL function commit_pending_closure(bigint) line 16 at RAISE19822026-08-20 17:24:20.465 UTC [600] STATEMENT: -- name: CommitPendingClosure :exec1983 SELECT commit_pending_closure($1::bigint)1984 1985--- PASS: TestService_cleanupPendingClosuresHandler (6.93s)19862026/08/20 17:24:20 WARN CompleteMultipartUpload errored but object exists; treating as success error="The specified key does not exist." object_key=nar/gggggggggggggggggggggggggggggg0300000000000000000000.nar.zst upload_id=NzJkNzE1NjItNGYyZS00NjRhLThhOTgtZTMwMGRmMjI3YmVjLjY3ZjU0ODFjLWQyMjktNGFmZC04MTgzLWM0NTUyYTE1NzgyOHgxNzg3MjQ2NjYwMjMxNDM2NTA119872026/08/20 17:24:20 WARN mTLS auth: subject not in bound subjects subject="CN=reader"19882026/08/20 17:24:20 WARN mTLS auth: subject not in bound subjects subject="CN=writer"1989--- PASS: TestService_NativeMTLS (7.03s)19902026/08/20 17:24:20 INFO Completed multipart upload object_key=nar/gggggggggggggggggggggggggggggg0300000000000000000000.nar.zst upload_id=NzJkNzE1NjItNGYyZS00NjRhLThhOTgtZTMwMGRmMjI3YmVjLjY3ZjU0ODFjLWQyMjktNGFmZC04MTgzLWM0NTUyYTE1NzgyOHgxNzg3MjQ2NjYwMjMxNDM2NTA1 parts=11991--- PASS: TestCompleteMultipartUpload_ErrorButObjectExists (6.07s)1992--- PASS: TestService_Rustfstest (2.22s)1993--- PASS: TestReadProxyNarinfo (1.50s)1994--- PASS: TestReadProxyRootRedirectsToIndexHTML (3.00s)1995--- PASS: TestReadProxyInvalidPath (1.91s)1996--- PASS: TestReadProxyHead (1.97s)1997--- PASS: TestReadProxyNarinfoAlreadyDecompressed (1.82s)1998--- PASS: TestReadProxyConditionalGet (2.57s)19992026/08/20 17:24:20 WARN Failed to fetch cache config, uploading without size limit error="fetching cache config: server returned 404: 404 page not found\n"2000--- PASS: TestObjectStatsTrigger (7.22s)20012026/08/20 17:24:20 WARN Request failed, retrying attempt=4 max_attempts=6 backoff=840.049035ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config20022026/08/20 17:24:20 INFO Received uploads request method=POST path=/api/pending_closures20032026/08/20 17:24:20 WARN Authentication failed token_preview=invalid-token token_length=13 reason="static API token mismatch"20042026/08/20 17:24:20 INFO Registered completed upload object_key=nar/jjjjjjjjjjjjjjjjjjjjjjjjjjjjjj0100000000000000000000.nar.zst20052026/08/20 17:24:20 INFO Received uploads request method=POST path=/api/pending_closures2006--- PASS: TestPresignedUploadRegisteredBeforeCommit (2.09s)20072026/08/20 17:24:21 INFO Received complete multipart upload request method=POST path=/api/multipart/complete20082026/08/20 17:24:21 INFO Received uploads request method=POST path=/api/pending_closures20092026/08/20 17:24:21 INFO Received uploads request method=POST path=/api/pending_closures20102026/08/20 17:24:21 INFO Received uploads request method=POST path=/api/pending_closures20112026/08/20 17:24:21 INFO Completed multipart upload object_key=nar/dadb44fdadb44fdadb44fdadb44f000000000000000000000000.nar.zst upload_id=NzJkNzE1NjItNGYyZS00NjRhLThhOTgtZTMwMGRmMjI3YmVjLmM0YjY1MTZiLWYwMjEtNGM1MC1iNzNlLTg2NWQxZjg2YWM1NXgxNzg3MjQ2NjYwMjUyOTEzMTkz parts=1020122026/08/20 17:24:21 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete20132026/08/20 17:24:21 INFO Completed upload id=120142026/08/20 17:24:21 INFO Received uploads request method=POST path=/api/pending_closures20152026/08/20 17:24:21 INFO Received uploads request method=POST path=/api/pending_closures20162026/08/20 17:24:21 INFO Object in database but missing from S3 key=dadb44fdadb44fdadb44fdadb44f0000.narinfo20172026/08/20 17:24:21 WARN Found objects in DB but missing from S3, will re-upload count=12018--- PASS: TestService_verifyS3Integrity (7.56s)2019--- PASS: TestReadProxyNarStreaming (4.00s)20202026/08/20 17:24:21 INFO Uploaded nix-cache-info to bucket bucket=bucket212021=== NAME TestClientCADerivations2022 client_ca_test.go:136: Built CA derivation: /build/TestClientCADerivations3831868512/001/store/qlp8b1lcfhdmp940psw4z2irxcbyc8hd-ca-test2023 client_ca_test.go:139: Found 1 dependencies (including self)20242026/08/20 17:24:21 INFO Received complete multipart upload request method=POST path=/api/multipart/complete20252026/08/20 17:24:21 INFO Completed multipart upload object_key=nar/hhhhhhhhhhhhhhhhhhhhhhhhhhhhhh0100000000000000000000.nar.zst upload_id=NzJkNzE1NjItNGYyZS00NjRhLThhOTgtZTMwMGRmMjI3YmVjLjY2YTE4NTMzLWYwODktNDIzMC05MTM4LTllOWUxNDVmMGVkMngxNzg3MjQ2NjYwMjM5NjQyNTE3 parts=1220262026/08/20 17:24:21 INFO Received uploads request method=POST path=/api/pending_closures2027--- PASS: TestCompletedNarNotReofferedAcrossClosures (2.56s)20282026/08/20 17:24:21 WARN Failed to fetch cache config, uploading without size limit error="fetching cache config: server returned 404: 404 page not found\n"20292026/08/20 17:24:21 INFO Received uploads request method=POST path=/api/pending_closures20302026/08/20 17:24:21 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)20312026/08/20 17:24:21 INFO Uploading qlp8b1lcfhdmp940psw4z2irxcbyc8hd-ca-test (144B)20322026/08/20 17:24:21 WARN Failed to register uploaded object key=log/9aqhq7a94nlwfxagbg7jls3vv1dbcdbn-ca-test.drv error="server returned 404: 404 page not found\n"20332026/08/20 17:24:21 WARN Failed to register uploaded object key=nar/04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n.nar.zst error="server returned 404: 404 page not found\n"20342026/08/20 17:24:21 WARN Failed to register uploaded object key=qlp8b1lcfhdmp940psw4z2irxcbyc8hd.ls error="server returned 404: 404 page not found\n"20352026/08/20 17:24:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign20362026/08/20 17:24:21 INFO Signed narinfos id=1 count=120372026/08/20 17:24:21 INFO Uploading 1 narinfos20382026/08/20 17:24:21 WARN Failed to register uploaded object key=qlp8b1lcfhdmp940psw4z2irxcbyc8hd.narinfo error="server returned 404: 404 page not found\n"20392026/08/20 17:24:21 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete20402026/08/20 17:24:21 INFO Completed upload id=120412026/08/20 17:24:21 INFO Upload complete. (89ms)2042=== NAME TestClientCADerivations2043 client_ca_test.go:180: Narinfo contains CA field: StorePath: /build/TestClientCADerivations3831868512/001/store/qlp8b1lcfhdmp940psw4z2irxcbyc8hd-ca-test2044 URL: nar/04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n.nar.zst2045 Compression: zstd2046 NarHash: sha256:04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n2047 NarSize: 1442048 References: 2049 Deriver: /build/TestClientCADerivations3831868512/001/store/9aqhq7a94nlwfxagbg7jls3vv1dbcdbn-ca-test.drv2050 CA: fixed:r:sha256:04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n2051 client_ca_test.go:185: Checking for realisation files in S3...2052 client_ca_test.go:207: No realisation files uploaded - this is expected for locally built CA derivations2053 client_ca_test.go:208: Locally built CA derivations don't have DrvOutput IDs until they're substituted from a cache20542026/08/20 17:24:21 INFO Received complete multipart upload request method=POST path=/api/multipart/complete20552026/08/20 17:24:21 INFO Completed multipart upload object_key=nar/0000000000000000000000000000000000000000000000000000.nar.zst upload_id=NzJkNzE1NjItNGYyZS00NjRhLThhOTgtZTMwMGRmMjI3YmVjLmExNWZhZjBmLTI2MDktNDg0Yi1hYjYzLTY3NjY5MTZlNDNlMXgxNzg3MjQ2NjYxMDgyNTYyMjA5 parts=1020562026/08/20 17:24:21 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete2057 client_ca_test.go:258: nix copy output: warning: you don't have Internet access; disabling some network-dependent features2058 warning: failed to create TLS context for AWS credential providers; SSO, STS WebIdentity, and ECS container authentication will be unavailable2059 error: binary cache 's3://bucket21?endpoint=http://localhost:33415®ion=eu-west-1' is for Nix stores with prefix '/nix/store', not '/build/TestClientCADerivations3831868512/001/store'2060 client_ca_test.go:259: nix copy failed (might be expected with isolated stores): exit status 120612026/08/20 17:24:21 INFO Completed upload id=120622026/08/20 17:24:21 INFO Received get closure request method=GET path=/api/closures/0000000000000000000000000000000020632026/08/20 17:24:21 INFO Received uploads request method=POST path=/api/pending_closures20642026/08/20 17:24:21 INFO Starting cleanup of old closures method=DELETE path=/api/closures2065--- PASS: TestClientCADerivations (7.95s)20662026/08/20 17:24:21 INFO Aborted multipart uploads count=020672026/08/20 17:24:21 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=2 objects-deleted-after-grace-period=0 objects-failed-to-delete=020682026/08/20 17:24:21 INFO Vacuumed table table=pending_closures20692026/08/20 17:24:21 INFO Vacuumed table table=pending_objects20702026/08/20 17:24:21 INFO Vacuumed table table=multipart_uploads20712026/08/20 17:24:21 INFO Vacuumed table table=closures20722026/08/20 17:24:21 INFO Vacuumed table table=objects20732026/08/20 17:24:21 WARN Request failed, retrying attempt=5 max_attempts=6 backoff=1.634228022s error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config20742026/08/20 17:24:21 INFO Received get closure request method=GET path=/api/closures/000000000000000000000000000000002075--- PASS: TestService_createPendingClosureHandler (8.07s)2076=== NAME TestOrphanedObjectsGCStressTest2077 orphaned_objects_gc_test.go:425: Created 10 active closures, 5 to-delete closures, 20 orphaned chains2078 orphaned_objects_gc_test.go:446: Marked 210 objects for deletion2079--- PASS: TestUploadHandlersRejectOversizedBody (0.16s)2080 --- PASS: TestUploadHandlersRejectOversizedBody/request_more_parts (0.11s)2081 --- PASS: TestUploadHandlersRejectOversizedBody/complete_multipart (0.11s)2082 --- PASS: TestUploadHandlersRejectOversizedBody/create_pending_closure (1.62s)2083=== NAME TestOrphanedObjectsGCStressTest2084 orphaned_objects_gc_test.go:509: Stress test completed successfully:2085 orphaned_objects_gc_test.go:510: - Active objects preserved: 202086 orphaned_objects_gc_test.go:511: - Objects deleted: 2102087 orphaned_objects_gc_test.go:512: - Total GC'd: 2102088--- PASS: TestOrphanedObjectsGCStressTest (2.92s)20892026/08/20 17:24:23 WARN Failed to fetch cache config, uploading without size limit error="fetching cache config: sending request: request failed after retries: Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused"20902026/08/20 17:24:23 WARN Request failed, retrying attempt=1 max_attempts=6 backoff=100ms error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures20912026/08/20 17:24:23 WARN Request failed, retrying attempt=2 max_attempts=6 backoff=184.397493ms error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures20922026/08/20 17:24:23 WARN Request failed, retrying attempt=3 max_attempts=6 backoff=425.072459ms error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures20932026/08/20 17:24:23 WARN Request failed, retrying attempt=4 max_attempts=6 backoff=744.986769ms error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures20942026/08/20 17:24:24 WARN Request failed, retrying attempt=5 max_attempts=6 backoff=1.45109695s error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures2095--- PASS: TestClientErrorHandling (0.00s)2096 --- PASS: TestClientErrorHandling/InvalidStorePath (0.56s)2097 --- PASS: TestClientErrorHandling/InvalidAuthToken (0.67s)2098 --- PASS: TestClientErrorHandling/ServerNotAvailable (6.26s)2099FAIL21002026-08-20 17:24:26.477 UTC [111] LOG: received smart shutdown request21012026/08/20 17:24:36 ERROR failed to kill rustfs error="no such process"21022026/08/20 17:24:36 INFO killed rustfs21032026-08-20 17:24:36.480 UTC [610] FATAL: terminating connection due to unexpected postmaster exit21042026-08-20 17:24:36.480 UTC [615] FATAL: terminating connection due to unexpected postmaster exit21052026-08-20 17:24:36.480 UTC [611] FATAL: terminating connection due to unexpected postmaster exit21062026-08-20 17:24:36.480 UTC [616] FATAL: terminating connection due to unexpected postmaster exit21072026-08-20 17:24:36.480 UTC [613] FATAL: terminating connection due to unexpected postmaster exit21082026-08-20 17:24:36.480 UTC [609] FATAL: terminating connection due to unexpected postmaster exit21092026-08-20 17:24:36.480 UTC [607] FATAL: terminating connection due to unexpected postmaster exit21102026-08-20 17:24:36.481 UTC [612] FATAL: terminating connection due to unexpected postmaster exit21112026-08-20 17:24:36.481 UTC [626] FATAL: terminating connection due to unexpected postmaster exit21122026-08-20 17:24:36.481 UTC [655] FATAL: terminating connection due to unexpected postmaster exit21132026-08-20 17:24:36.481 UTC [605] FATAL: terminating connection due to unexpected postmaster exit21142026-08-20 17:24:36.481 UTC [625] FATAL: terminating connection due to unexpected postmaster exit21152026-08-20 17:24:36.481 UTC [627] FATAL: terminating connection due to unexpected postmaster exit21162026-08-20 17:24:36.481 UTC [652] FATAL: terminating connection due to unexpected postmaster exit21172026-08-20 17:24:36.481 UTC [614] FATAL: terminating connection due to unexpected postmaster exit21182026/08/20 17:24:36 ERROR failed to wait for rustfs error="signal: killed"