Module zero_optimizer 

Main ZeRO Optimizer Implementation

This module provides the main ZeRO optimizer wrapper that coordinates between different ZeRO stages and manages the optimization process.

Structs

ZeROConfig

Configuration for ZeRO optimizer

ZeROOptimizer

Main ZeRO optimizer that wraps an underlying optimizer

Enums

ZeROStage

ZeRO optimization stages