Skip to main content

Module tokenize

Module tokenize 

Source
Expand description

shlex-based tokenization: word splitting, base command extraction, env var parsing.

Functionsยง

base_command
Extract the first real command word, skipping leading VAR=value assignments.
env_vars
Extract leading KEY=VALUE pairs from a command string.
tokenize
Tokenize a command segment into words using shlex (POSIX word splitting).