Cog[-rust]: Containers for machine learning
Cog is an open-source tool that lets you package machine learning models in a standard, production-ready container.
Cog bundles Python models into a Docker image with a simple interface for loading and running models. This project aims to match that interface for Rust models, so they can be used interchangeably (on Replicate or Dyson).
WIP
This is a work in progress. It's not ready for use yet. Check back soon!
To see the proposed DX, check the hello-world example.
- Basic web server
- Rust Cog interface
- Make everything work
- Request validation
- Dockerfile
- CLI?