pprog 0.0.4

An LLM pair programming server with web interface
pprog-0.0.4 is not a library.

p(air) prog(rammer)

pprog is an LLM based pair programmer for working on coding projects. it can generate, edit and answer questions about your code.

This is experimental and unstable code, it may change at any time. It has solid support for Claude models through the Anthropic API, as well as OpenAI (though rate limits make it difficult to use). Still working on support for o1 as the lack of system prompt makes it more difficult to implement. The program should work with any OpenAI compatible API by assigning corresponding api url in config. Some examples of different configs can be found in examples directory.

prereqs

  • rust
  • browser
  • git

To install Rust, go to their website.

install

cargo install pprog

usage

To use pprog, cd into the directory of an existing or template project. pprog depends on git and also uses .gitignore to communicate the available files to LLM, so the project must have git initialized. For this example, we'll create a basic NodeJS project.

mkdir example-project
cd example-project
npm init -y && git init
pprog init

This will generate a config file pprog.toml with sensible defaults depending on the type of project. For this example the pprog.toml will contain

provider = "anthropic"
model = "claude-3-5-haiku-latest"
check_cmd = "node index.js"
api_url = "https://api.anthropic.com/v1/messages"
api_key = "..." // if ANTHROPIC_API_KEY env var is set then it will automatically add it
max_context = 128000
max_output_tokens = 8096

The program that generates and edits code in the backend uses the check_cmd to check compilation or successful operation. In this case node index.js will be run to check for any errors in code changes and then loop to fix these changes if they exist. For compiled projects using a langauge like Rust, check_cmd would be "cargo check". An Anthropic account is assumed on init, but OpenAI-compatible APIs can be used as well. For example, to use OpenAI you can change config to

provider = "openai"
model = "gpt-4o"
check_cmd = "node index.js"
api_url = "https://api.openai.com/v1/chat/completions"
api_key = "<OEPNAI API KEY>"
max_context = 100000
max_output_tokens = 8096

pprog serve

and then enter http://localhost:8080 in your browser. A chat interface will load and you can begin making changes to your code. For example, in this example project you can type in a message like Create an index.js file with basic express server and it will create file and check that it runs properly by using check_cmd command. Then another message like Add GET /ping endpoint and it will make changes to the code and check again. You may also questions about the code or anything in general.

You can run pprog serve for multiple projects at the same time by assigning different ports

pprog serve --port 3002

tools

pprog uses a very small set of tools to make changes. currently it has four.

read_file - read entire file contents
write_file - replace entire file with contents
execute - run general bash, sometimes used by agent to install packages when check fails
compile_check - check for compilation errors, or for interpreted programs checks runtime errors on startup

tips and warnings

  • The system prompt includes instructions to not change any files outside of the root of the project but this is not strictly guaranteed. It has not gone outside the root of a project once, but if you prompt it to it possibly could.
  • If using Anthropic/OpenAI models it can get expensive, but is usually very effective. When using Sonnet 3.5 a single code change request routinely cost 0.20 USD or more. This is because the program is constantly reading/writing entire files to satisfy each request. I shudder to use Opus and haven't even tried. Haiku 3.5 seems to be a good trade-off, usually costing a few cents per change of a medium sized project. I normally use Haiku. DeepSeek is dirt cheap but doesn't seem effective at all. OpenAI models can be effective, but usually get throttled by rate limits almost immediately.
  • It doesn't use RAG and I'm thinking of implementing it or some other chunking logic but in general each file in the project should be considered as a chunk. This means you want to refactor frequently and liberally. Since the program can only read and write entire files you don't want them to get too big.
  • Make sure to commit and push changes frequently. It's ok to sometimes make multiple changes before committing but if it's going to be a large change then best to commit before making them.
  • The system prompt notes that the user may ask questions and the model is usually good at figuring out when a question without needed code changes is asked, but I usually prepend question messages with 'Question: ' to steer the model. In general I've found that when I ask questions about the codebase it reguarly decides to make changes. Still trying to figure out how to steer this behavior better.
  • It's in the system prompt, but models will usually do many file writes and get confused about when a compile check should be run. Explicitly ask for a compile check and it will run and attempt to fix errors.
  • You'll still have to do some coding, sorry anon.

happy hacking!