code-tokenizer 0.1.0

A string/code tokenizer. Transforms a string with a vector of operators into a vector of keywords.
Documentation

Build #3685679 2026-06-25 15:17:17

# rustc version rustc 1.98.0-nightly (f28ac764c 2026-06-23)

# docs.rs version docsrs 0.0.0 (886bc7a22b1adc4b387ce1343447fe3af98d9ce5 2026-06-14 )

# build log [INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "DOCS_RS=1" "-w" "/opt/rustwide/workdir" "--user" "1001:1001" "9ba20e3112e16e79eebebf0783fd76040b04bd3f5151b7d66bc1850a4b786025" "/opt/rustwide/cargo-home/bin/cargo" "+nightly" "rustdoc" "--lib" "-Zrustdoc-map" "--config" "build.rustdocflags=[\"--cfg\", \"docsrs\", \"-Z\", \"unstable-options\", \"--emit=invocation-specific\", \"--resource-suffix\", \"-20260623-1.98.0-nightly-f28ac764c\", \"--static-root-path\", \"/-/rustdoc.static/\", \"--cap-lints\", \"warn\", \"--extern-html-root-takes-precedence\"]" "--offline" "-Zunstable-options" "--config=doc.extern-map.registries.crates-io=\"https://docs.rs/{pkg_name}/{version}/x86_64-unknown-linux-gnu\"" "-Zrustdoc-scrape-examples" "-j6" "--target" "x86_64-unknown-linux-gnu", kill_on_drop: false }` [INFO] [stderr] warning: target filter specified, but no targets matched; this is a no-op [INFO] [stderr] Documenting code-tokenizer v0.1.0 (/opt/rustwide/workdir) [INFO] [stderr] Finished `dev` profile [unoptimized + debuginfo] target(s) in 0.43s [INFO] [stderr] Generated /opt/rustwide/target/x86_64-unknown-linux-gnu/doc/code_tokenizer/index.html [INFO] running `Command { std: "docker" "inspect" "9ba20e3112e16e79eebebf0783fd76040b04bd3f5151b7d66bc1850a4b786025", kill_on_drop: false }`