tribuchet: building on jamie
structuredAttrs is enabled
Sourcing python-remove-tests-dir-hook
Sourcing python-catch-conflicts-hook.sh
Sourcing python-remove-bin-bytecode-hook.sh
Sourcing pypa-build-hook
Using pypaBuildPhase
Sourcing python-runtime-deps-check-hook
Using pythonRuntimeDepsCheckHook
Sourcing pypa-install-hook
Using pypaInstallPhase
Sourcing python-imports-check-hook.sh
Using pythonImportsCheckPhase
Sourcing python-metadata-check-hook.sh
Using pythonMetadataCheckPhase
Sourcing python-namespaces-hook
Sourcing python-catch-conflicts-hook.sh
Sourcing setuptools-rust-hook
Sourcing pytest-check-hook
Using pytestCheckPhase
Running phase: unpackPhase
unpacking source archive /nix/store/fcjinchg0pm7s6bv2r7hh7l24ifvqzw0-source
source root is source/bindings/python
Executing cargoSetupPostUnpackHook
Finished cargoSetupPostUnpackHook
setting SOURCE_DATE_EPOCH to timestamp 315619200 of file "source/bindings/python/tools/stub-gen/src/main.rs"
Running phase: patchPhase
Executing cargoSetupPostPatchHook
Validating consistency between /build/source/bindings/python/Cargo.lock and /build/tokenizers-0.23.2-vendor/Cargo.lock
Finished cargoSetupPostPatchHook
Running phase: updateAutotoolsGnuConfigScriptsPhase
Running phase: configurePhase
no configure script, doing nothing
Running phase: buildPhase
Executing maturinBuildHook
maturinBuildHook flags: --jobs=24 --offline --target x86_64-unknown-linux-gnu --manylinux off --strip --out /build/source/bindings/python/dist --interpreter python3.14 --release
🍹 Building a mixed python/rust project
🐍 Found CPython 3.14 at /nix/store/xahxrjs30p3mw0a42bqg9ikgkikskw8m-python3-3.14.8/bin/python3.14
🔗 Found pyo3 bindings with abi3-py3.10 support
📡 Using build options features, bindings from pyproject.toml
   Compiling proc-macro2 v1.0.107
   Compiling unicode-ident v1.0.24
   Compiling quote v1.0.47
   Compiling libc v0.2.189
   Compiling target-lexicon v0.13.5
   Compiling autocfg v1.5.1
   Compiling serde_core v1.0.229
   Compiling find-msvc-tools v0.1.11
   Compiling shlex v2.0.1
   Compiling memchr v2.8.3
   Compiling crossbeam-utils v0.8.22
   Compiling ident_case v1.0.1
   Compiling fnv v1.0.7
   Compiling crossbeam-epoch v0.9.20
   Compiling serde v1.0.229
   Compiling strsim v0.11.1
   Compiling cfg-if v1.0.4
   Compiling zerocopy v0.8.56
   Compiling getrandom v0.3.4
   Compiling once_cell v1.21.4
   Compiling crossbeam-deque v0.8.7
   Compiling pkg-config v0.3.34
   Compiling rustversion v1.0.23
   Compiling regex-syntax v0.8.11
   Compiling rayon-core v1.13.0
   Compiling heck v0.5.0
   Compiling rawpointer v0.2.1
   Compiling portable-atomic v1.15.0
   Compiling cc v1.4.4
   Compiling zmij v1.0.23
   Compiling version_check v0.9.5
   Compiling either v1.18.0
   Compiling minimal-lexical v0.2.1
   Compiling pin-project-lite v0.2.17
   Compiling num-traits v0.2.19
   Compiling matrixmultiply v0.3.11
   Compiling unicode-width v0.2.2
   Compiling utf8parse v0.2.2
   Compiling itoa v1.0.18
   Compiling ahash v0.8.12
   Compiling thiserror v2.0.20
   Compiling serde_json v1.0.151
   Compiling futures-core v0.3.34
   Compiling log v0.4.34
   Compiling aho-corasick v1.1.5
   Compiling paste v1.0.15
   Compiling nom v7.1.3
   Compiling anstyle-parse v1.0.0
   Compiling itertools v0.14.0
   Compiling unicode-segmentation v1.13.3
   Compiling futures-task v0.3.34
   Compiling unit-prefix v0.5.2
   Compiling pastey v0.2.3
   Compiling anstyle v1.0.14
   Compiling macro_rules_attribute-proc_macro v0.2.3
   Compiling pyo3-build-config v0.29.2
   Compiling ryu v1.0.23
   Compiling jiff-core v0.1.0
   Compiling base64 v0.13.1
   Compiling is_terminal_polyfill v1.70.2
   Compiling smallvec v1.16.0
   Compiling syn v3.0.4
   Compiling syn v2.0.119
   Compiling static_assertions v1.1.0
   Compiling colorchoice v1.0.5
   Compiling anstyle-query v1.1.5
   Compiling castaway v0.2.4
   Compiling bitflags v2.13.1
   Compiling slab v0.4.12
   Compiling anstream v1.0.0
   Compiling futures-channel v0.3.34
   Compiling unicode-normalization-alignments v0.1.12
   Compiling macro_rules_attribute v0.2.3
   Compiling rustc-hash v2.1.3
   Compiling daachorse v3.0.3
   Compiling unicode_categories v0.1.1
   Compiling onig_sys v69.9.3
   Compiling esaxx-rs v0.1.10
   Compiling errno v0.3.14
   Compiling console v0.16.4
   Compiling mio v1.2.3
   Compiling signal-hook-registry v1.4.8
   Compiling pyo3-ffi v0.29.2
   Compiling pyo3 v0.29.2
   Compiling num-complex v0.4.6
   Compiling num-integer v0.1.47
   Compiling rand_core v0.9.5
   Compiling rayon v1.12.0
   Compiling numpy v0.29.0
   Compiling regex-automata v0.4.18
   Compiling indicatif v0.18.6
   Compiling jiff v0.2.35
   Compiling ndarray v0.17.2
   Compiling ndarray v0.16.1
   Compiling serde_derive v1.0.229
   Compiling futures-macro v0.3.34
   Compiling tokio-macros v2.7.2
   Compiling thiserror-impl v2.0.20
   Compiling darling_core v0.20.11
   Compiling pyo3-macros-backend v0.29.2
   Compiling rayon-cond v0.4.0
   Compiling monostate-impl v0.1.18
   Compiling regex v1.13.1
   Compiling ppv-lite86 v0.2.21
   Compiling env_filter v2.0.0
   Compiling rand_chacha v0.9.0
   Compiling monostate v0.1.18
   Compiling env_logger v0.11.11
   Compiling rand v0.9.5
   Compiling futures-util v0.3.34
   Compiling tokio v1.53.1
   Compiling darling_macro v0.20.11
   Compiling pyo3-macros v0.29.2
   Compiling darling v0.20.11
   Compiling dary_heap v0.3.9
   Compiling compact_str v0.9.1
   Compiling spm_precompiled v0.1.4
   Compiling derive_builder_core v0.20.2
   Compiling derive_builder_macro v0.20.2
   Compiling onig v6.5.3
   Compiling derive_builder v0.20.2
   Compiling tokenizers v0.23.2 (/build/source/tokenizers)
   Compiling pyo3-async-runtimes v0.29.0
   Compiling tokenizers-python v0.23.2 (/build/source/bindings/python)
    Finished `release` profile [optimized] target(s) in 1m 03s
🚉 Overriding platform tag from _PYTHON_HOST_PLATFORM environment variable as linux_x86_64.
📦 Built wheel for abi3 Python ≥ 3.10 to /build/source/bindings/python/dist/tokenizers-0.23.2-cp310-abi3-linux_x86_64.whl
Finished maturinBuildHook
buildPhase completed in 1 minutes 4 seconds
Running phase: pythonRuntimeDepsCheckHook
Executing pythonRuntimeDepsCheck
Checking runtime dependencies for tokenizers-0.23.2-cp310-abi3-linux_x86_64.whl
Finished executing pythonRuntimeDepsCheck
Running phase: installPhase
Executing pypaInstallPhase
Successfully installed tokenizers-0.23.2-cp310-abi3-linux_x86_64.whl
Finished executing pypaInstallPhase
Running phase: pythonOutputDistPhase
Executing pythonOutputDistPhase
Finished executing pythonOutputDistPhase
Running phase: fixupPhase
shrinking RPATHs of ELF executables and libraries in /nix/store/2vpij4jimb6vf4xb171wa48g7xpdh7k0-python3.14-tokenizers-0.23.2-dist
checking for references to /build/ in /nix/store/2vpij4jimb6vf4xb171wa48g7xpdh7k0-python3.14-tokenizers-0.23.2-dist...
patching script interpreter paths in /nix/store/2vpij4jimb6vf4xb171wa48g7xpdh7k0-python3.14-tokenizers-0.23.2-dist
shrinking RPATHs of ELF executables and libraries in /nix/store/1yb1bnrcjbcpc2jifs9id6csri1f0lfh-python3.14-tokenizers-0.23.2
shrinking /nix/store/1yb1bnrcjbcpc2jifs9id6csri1f0lfh-python3.14-tokenizers-0.23.2/lib/python3.14/site-packages/tokenizers/tokenizers.abi3.so
checking for references to /build/ in /nix/store/1yb1bnrcjbcpc2jifs9id6csri1f0lfh-python3.14-tokenizers-0.23.2...
patching script interpreter paths in /nix/store/1yb1bnrcjbcpc2jifs9id6csri1f0lfh-python3.14-tokenizers-0.23.2
stripping (with command strip and flags -S -p) in /nix/store/1yb1bnrcjbcpc2jifs9id6csri1f0lfh-python3.14-tokenizers-0.23.2/lib
Executing pythonRemoveTestsDir
Finished executing pythonRemoveTestsDir
Running phase: installCheckPhase
no Makefile or custom installCheckPhase, doing nothing
Running phase: pythonCatchConflictsPhase
Running phase: pythonRemoveBinBytecodePhase
Running phase: pythonImportsCheckPhase
Executing pythonImportsCheckPhase
Check whether the following modules can be imported: tokenizers
Running phase: pythonMetadataCheckPhase
Executing pythonMetadataCheckPhase
Running phase: pytestCheckPhase
Executing pytestCheckPhase
pytest flags: -m pytest --ignore-glob=benches/test_tiktoken.py -k not\ \(TestTrainFromIterators\)\ and\ not\ \(TestAsyncTokenizer\)\ and\ not\ \(test_decode_skip_special_tokens\)\ and\ not\ \(test_decode_stream_fallback\)\ and\ not\ \(test_encode_special_tokens\)\ and\ not\ \(test_from_pretrained\)\ and\ not\ \(test_from_pretrained_revision\)\ and\ not\ \(test_splitting\)
============================= test session starts ==============================
platform linux -- Python 3.14.8, pytest-9.1.1, pluggy-1.6.0
rootdir: /build/source/bindings/python
configfile: pytest.ini (WARNING: ignoring pytest config in setup.cfg!)
plugins: anyio-4.15.1, asyncio-1.4.0
asyncio: mode=Mode.STRICT, debug=False, asyncio_default_fixture_loop_scope=None, asyncio_default_test_loop_scope=function
collected 205 items / 21 deselected / 1 skipped / 184 selected

tests/bindings/test_decoders.py .........................                [ 13%]
tests/bindings/test_encoding.py ...........                              [ 19%]
tests/bindings/test_models.py ........                                   [ 23%]
tests/bindings/test_normalizers.py ......................                [ 35%]
tests/bindings/test_pre_tokenizers.py ........................           [ 48%]
tests/bindings/test_processors.py .............                          [ 55%]
tests/bindings/test_tokenizer.py ..............................          [ 72%]
tests/bindings/test_trainers.py ....................                     [ 83%]
tests/documentation/test_pipeline.py ..                                  [ 84%]
tests/documentation/test_quicktour.py .                                  [ 84%]
tests/implementations/test_base_tokenizer.py .                           [ 85%]
tests/implementations/test_bert_wordpiece.py ...                         [ 86%]
tests/implementations/test_byte_level_bpe.py .....                       [ 89%]
tests/implementations/test_char_bpe.py .....                             [ 92%]
tests/implementations/test_sentencepiece.py .....                        [ 95%]
tests/test_freethreaded.py ...s                                          [ 97%]
tests/test_serialization.py ....s                                        [100%]

=============================== warnings summary ===============================
tests/test_freethreaded.py:32
  /build/source/bindings/python/tests/test_freethreaded.py:32: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo?  You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
    pytestmark = pytest.mark.timeout(60)  # any of these hanging means a deadlock

tests/bindings/test_encoding.py::TestEncoding::test_sequence_ids
  /nix/store/1p2fja7y7dy76d7jbkrc51wrlssdz6zf-python3.14-pytest-9.1.1/lib/python3.14/site-packages/_pytest/fixtures.py:1313: PytestRemovedIn10Warning: Class-scoped fixture defined as instance method is deprecated.
  Instance attributes set in this fixture will NOT be visible to test methods,
  as each test gets a new instance while the fixture runs only once per class.
  Use @classmethod decorator and set attributes on cls instead.
  See https://docs.pytest.org/en/stable/deprecations.html#class-scoped-fixture-as-instance-method
    fixturefunc = resolve_fixture_function(fixturedef, request)

tests/bindings/test_tokenizer.py::TestTokenizer::test_multiprocessing_with_parallelism
tests/bindings/test_tokenizer.py::TestTokenizer::test_multiprocessing_with_parallelism
tests/implementations/test_bert_wordpiece.py::TestBertWordPieceTokenizer::test_multiprocessing_with_parallelism
tests/implementations/test_bert_wordpiece.py::TestBertWordPieceTokenizer::test_multiprocessing_with_parallelism
tests/implementations/test_byte_level_bpe.py::TestByteLevelBPE::test_multiprocessing_with_parallelism
tests/implementations/test_byte_level_bpe.py::TestByteLevelBPE::test_multiprocessing_with_parallelism
tests/implementations/test_char_bpe.py::TestCharBPETokenizer::test_multiprocessing_with_parallelism
tests/implementations/test_char_bpe.py::TestCharBPETokenizer::test_multiprocessing_with_parallelism
  /nix/store/xahxrjs30p3mw0a42bqg9ikgkikskw8m-python3-3.14.8/lib/python3.14/multiprocessing/popen_fork.py:76: DeprecationWarning: This process (pid=3165) is multi-threaded, use of fork() may lead to deadlocks in the child.
    self.pid = os.fork()

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
========= 182 passed, 3 skipped, 21 deselected, 10 warnings in 36.15s ==========
Finished executing pytestCheckPhase
pytestCheckPhase completed in 37 seconds
Running phase: pytestcachePhase
Running phase: pytestRemoveBytecodePhase