usls 0.0.14

usls is a Rust library integrated with ONNXRuntime that provides a collection of state-of-the-art models for Computer Vision and Vision-Language tasks, including:

• YOLO Models: YOLOv5, YOLOv6, YOLOv7, YOLOv8, YOLOv9, YOLOv10
• SAM Models: SAM, SAM2, MobileSAM, EdgeSAM, SAM-HQ, FastSAM
• Vision Models: RTDETR, RTMO, DB, SVTR, Depth-Anything-v1-v2, DINOv2, MODNet, Sapiens
• Vision-Language Models: CLIP, BLIP, GroundingDINO, YOLO-World

Supported Models

⛳️ ONNXRuntime Linking

You have two options to link the ONNXRuntime library

• Option 1: Manual Linking

  • For detailed setup instructions, refer to the ORT documentation.

  • For Linux or macOS Users:

    • Download the ONNX Runtime package from the Releases page.
    • Set up the library path by exporting the ORT_DYLIB_PATH environment variable:

      export ORT_DYLIB_PATH=/path/to/onnxruntime/lib/libonnxruntime.so.1.19.0
      

• Option 2: Automatic Download

  Just use --features auto

  cargo run -r --example yolo --features auto
  

🎈 Demo

cargo run -r --example yolo   # blip, clip, yolop, svtr, db, ...

🥂 Integrate Into Your Own Project

• Add usls as a dependency to your project's Cargo.toml

  cargo add usls
  

  Or use a specific commit:

  [dependencies]
  usls = { git = "https://github.com/jamjamjon/usls", rev = "commit-sha" }
  

• Follow the pipeline

  • Build model with the provided models and Options

  • Load images, video and stream with DataLoader

  • Do inference

  • Annotate inference results with Annotator

  • Retrieve inference results from Vec<Y>

      use usls::{models::YOLO, Annotator, DataLoader, Nms, Options, Vision, YOLOTask, YOLOVersion};
    
      fn main() -> anyhow::Result<()> {
          // Build model with Options
          let options = Options::new()
              .with_trt(0)
              .with_model("yolo/v8-m-dyn.onnx")?
              .with_yolo_version(YOLOVersion::V8) // YOLOVersion: V5, V6, V7, V8, V9, V10, RTDETR
              .with_yolo_task(YOLOTask::Detect) // YOLOTask: Classify, Detect, Pose, Segment, Obb
              .with_i00((1, 2, 4).into())
              .with_i02((0, 640, 640).into())
              .with_i03((0, 640, 640).into())
              .with_confs(&[0.2]);
          let mut model = YOLO::new(options)?;
      
          // Build DataLoader to load image(s), video, stream
          let dl = DataLoader::new(
              // "./assets/bus.jpg", // local image
              // "images/bus.jpg",  // remote image
              // "../images-folder",  // local images (from folder)
              // "../demo.mp4",  // local video
              // "http://commondatastorage.googleapis.com/gtv-videos-bucket/sample/BigBuckBunny.mp4",  // remote video
              "rtsp://admin:kkasd1234@192.168.2.217:554/h264/ch1/",  // stream
          )?
          .with_batch(2)  // iterate with batch_size = 2
          .build()?;
      
          // Build annotator
          let annotator = Annotator::new()
              .with_bboxes_thickness(4)
              .with_saveout("YOLO-DataLoader");
      
          // Run and annotate results
          for (xs, _) in dl {
              let ys = model.forward(&xs, false)?;
              annotator.annotate(&xs, &ys);
    
              // Retrieve inference results
              for y in ys {
                  // bboxes
                  if let Some(bboxes) = y.bboxes() {
                      for bbox in bboxes {
                          println!(
                              "Bbox: {}, {}, {}, {}, {}, {}",
                              bbox.xmin(),
                              bbox.ymin(),
                              bbox.xmax(),
                              bbox.ymax(),
                              bbox.confidence(),
                              bbox.id(),
                          );
                      }
                  }
              }
          }
      
          Ok(())
      }
    

📌 License

This project is licensed under LICENSE.