English / 中文

add_space

A command-line tool to improve readability by adding spaces between Chinese and English characters.

Table of Contents

• Significance
• Installation
• Usage
  • Command Line
  • LazyVim Configuration
• Design Philosophy
• Technology Stack
• File Structure
• Historical Anecdote

Significance

In mixed Chinese and English text, adding spaces between Chinese and English words significantly enhances readability. This tool automates the process, saving time and improving the reading experience.

Installation

cargo install add_space

Usage

Command Line

Process a file and print the result to standard output:

add_space <file_path>

Process a file and write the changes back to the file:

add_space <file_path> --write

Use with standard input/output streams:

echo "Hello世界" | add_space

LazyVim Configuration

If you use lazyvim, you can edit ~/.config/nvim/lua/config/autocmds.lua and add the following configuration to automatically add spaces on file save:

vim.api.nvim_create_autocmd("BufWritePost", {
  group = vim.api.nvim_create_augroup("add_space_on_save", { clear = true }),
  pattern = { "*.txt", "*.md", "*.mdt" },
  callback = function()
    local file_path = vim.fn.expand("%:p")
    local command = "add_space -w " .. vim.fn.shellescape(file_path)
    vim.fn.system(command)
    vim.cmd("edit")
  end,
})

Examples

Design Philosophy

The program's entry point is in main.rs, which handles command-line argument parsing and file I/O. The core logic resides in lib.rs.

The add_space function iterates through the text, using a state machine to determine whether a space is needed. It calls the state function to classify each character into one of four types: Char (Chinese, Japanese, etc.), Letter (English, numbers), Space, or Punctuation. A space is inserted when a Char type is followed by a Letter type or vice versa, ensuring proper spacing.

Technology Stack

• Rust: The programming language used for this project.
• clap: A library for parsing command-line arguments.
• unicode-script: A library for determining the script of a Unicode character.

File Structure

.
├── Cargo.toml      # Project configuration file
├── README.mdt      # Project README
├── src
│   ├── lib.rs      # Core logic for adding spaces
│   └── main.rs     # Command-line interface
└── tests
    └── main.rs     # Test cases

Historical Anecdote

The practice of adding spaces between Chinese and English text, often called "pangu spacing," is a convention that emerged with the rise of digital typography. While traditional Chinese text has no spaces, the inclusion of English words and letters necessitated a new approach to maintain readability. Early digital systems and search engines struggled to parse mixed-script text without clear separators. Although modern technology has largely overcome these limitations, the convention persists for aesthetic reasons and to improve the reading experience. This has led to the development of numerous tools and scripts, like this one, dedicated to automating the process.

add_space

一个给中文和英文之间加空格，优化阅读体验的排版命令行工具。

目录

• 项目意义
• 安装
• 使用演示
  • 命令行
  • lazyvim 配置
• 设计思路
• 技术堆栈
• 文件结构
• 历史小故事

项目意义

在混合中英文的文本中，中英文之间添加空格能显著提升阅读体验。此工具可自动化该过程，节省时间。

安装

cargo install add_space

使用演示

命令行

处理文件并将结果打印到标准输出：

add_space <file_path>

处理文件并将更改写回文件：

add_space <file_path> --write

与标准输入/输出流一起使用：

echo "Hello世界" | add_space

lazyvim 配置

如果你使用 lazyvim 的话，可以编辑 ~/.config/nvim/lua/config/autocmds.lua

加入如下的配置，让文件在保存的时候自动添加空格:

vim.api.nvim_create_autocmd("BufWritePost", {
  group = vim.api.nvim_create_augroup("add_space_on_save", { clear = true }),
  pattern = { "*.txt", "*.md", "*.mdt" },
  callback = function()
    local file_path = vim.fn.expand("%:p")
    local command = "add_space -w " .. vim.fn.shellescape(file_path)
    vim.fn.system(command)
    vim.cmd("edit")
  end,
})

示例

设计思路

程序入口位于 main.rs，负责处理命令行参数解析和文件 I/O。核心逻辑位于 lib.rs。

add_space 函数遍历文本，通过状态机确定是否需要添加空格。它调用 state 函数将每个字符分为四种类型之一：Char（中文、日文等）、Letter（英文、数字）、Space 或 Punctuation。当 Char 类型后跟 Letter 类型或反之时，会插入空格，以确保适当的间距。

技术堆栈

• Rust: 项目使用的编程语言。
• clap: 解析命令行参数的库。
• unicode-script: 确定 Unicode 字符脚本的库。

文件结构

.
├── Cargo.toml      # 项目配置文件
├── README.mdt      # 项目 README
├── src
│   ├── lib.rs      # 添加空格的核心逻辑
│   └── main.rs     # 命令行界面
└── tests
    └── main.rs     # 测试用例

历史小故事

在中英文之间添加空格的做法，常被称为“盘古之白”，是随着数字排版的兴起而出现的惯例。传统中文文本没有空格，但英文单词和字母的加入需要新方法来保持可读性。早期数字系统和搜索引擎在没有明确分隔符的情况下难以解析混合脚本的文本。尽管现代技术已在很大程度上克服这些限制，但出于美学原因和改善阅读体验，这种惯例仍然存在。这催生了许多自动化此过程的工具和脚本，如此项目。

About

This project is an open-source component of i18n.site ⋅ Internationalization Solution.

• i18 : MarkDown Command Line Translation Tool

  The translation perfectly maintains the Markdown format.

  It recognizes file changes and only translates the modified files.

  The translated Markdown content is editable; if you modify the original text and translate it again, manually edited translations will not be overwritten (as long as the original text has not been changed).

• i18n.site : MarkDown Multi-language Static Site Generator

  Optimized for a better reading experience

关于

本项目为 i18n.site ⋅ 国际化解决方案 的开源组件。

• i18 : MarkDown 命令行翻译工具

  翻译能够完美保持 Markdown 的格式。能识别文件的修改，仅翻译有变动的文件。

  Markdown 翻译内容可编辑；如果你修改原文并再次机器翻译，手动修改过的翻译不会被覆盖 （ 如果这段原文没有被修改 ）。

• i18n.site : MarkDown 多语言静态站点生成器 为阅读体验而优化。