pub struct RerunObserver { /* private fields */ }Expand description
Rerun observer for real-time optimization visualization.
This observer logs comprehensive optimization data to Rerun for interactive
visualization and debugging. It implements the OptObserver trait, enabling
clean integration with any optimizer through the observer pattern.
§What Gets Visualized
- Time series: Cost, gradient norm, damping (LM), step norm, step quality
- Matrices: Sparse Hessian (downsampled heat map), gradient vector
- Poses: SE2/SE3 manifold states updated each iteration
- 3D Landmarks: Rn variables with dimension=3 visualized as point clouds
- Status: Convergence information
§Observer Pattern Benefits
- Decoupled from optimizer internals
- Can be combined with other observers (CSV, metrics, etc.)
- No
#[cfg(feature = "visualization")]scattered through optimizer code - Easy to enable/disable without changing optimizer logic
§Performance
The observer is designed to have minimal overhead:
- Matrix visualizations use downsampling (100×100 for Hessian)
- Rerun logging is asynchronous
- When disabled,
is_enabled()returns false immediately - 3D landmarks are batch-logged as a single point cloud for efficiency
§Pose Convention Support
For bundle adjustment (BAL datasets), camera poses are stored as world-to-camera
transforms (T_wc). Set invert_camera_poses = true to display cameras correctly
by converting to camera-to-world (T_cw) convention for Rerun visualization.
Implementations§
Source§impl RerunObserver
impl RerunObserver
Sourcepub fn new(enabled: bool) -> ObserverResult<Self>
pub fn new(enabled: bool) -> ObserverResult<Self>
Sourcepub fn new_with_options(
enabled: bool,
save_path: Option<&str>,
) -> ObserverResult<Self>
pub fn new_with_options( enabled: bool, save_path: Option<&str>, ) -> ObserverResult<Self>
Create a new Rerun observer with file save option.
§Arguments
enabled- Whether to enable visualizationsave_path- Optional path to save recording to file instead of spawning viewer
§Examples
use apex_solver::observers::RerunObserver;
// Save to file
let observer = RerunObserver::new_with_options(true, Some("opt.rrd"))?;
// Spawn live viewer
let observer2 = RerunObserver::new_with_options(true, None)?;Sourcepub fn with_config(
enabled: bool,
save_path: Option<&str>,
config: VisualizationConfig,
) -> ObserverResult<Self>
pub fn with_config( enabled: bool, save_path: Option<&str>, config: VisualizationConfig, ) -> ObserverResult<Self>
Create a new Rerun observer with full configuration.
This is the primary constructor for full control over visualization.
§Arguments
enabled- Whether to enable visualizationsave_path- Optional path to save recording to file instead of spawning viewerconfig- Visualization configuration
§Examples
use apex_solver::observers::{RerunObserver, VisualizationConfig};
let config = VisualizationConfig::new()
.with_show_cameras(true)
.with_show_landmarks(false)
.with_camera_fov(0.8);
let observer = RerunObserver::with_config(true, None, config)?;Sourcepub fn new_for_bundle_adjustment(
enabled: bool,
save_path: Option<&str>,
invert_camera_poses: bool,
) -> ObserverResult<Self>
pub fn new_for_bundle_adjustment( enabled: bool, save_path: Option<&str>, invert_camera_poses: bool, ) -> ObserverResult<Self>
Create a new Rerun observer configured for bundle adjustment.
This constructor is designed for bundle adjustment / structure-from-motion problems where camera poses are stored in world-to-camera convention (T_wc) but need to be displayed in camera-to-world convention (T_cw).
§Arguments
enabled- Whether to enable visualizationsave_path- Optional path to save recording to file instead of spawning viewerinvert_camera_poses- If true, invert SE3 poses before logging (T_wc -> T_cw)
§Use Cases
- Pose graph optimization: Use
invert_camera_poses = false(poses are already T_cw) - Bundle adjustment (BAL): Use
invert_camera_poses = true(BAL stores T_wc)
§Examples
use apex_solver::observers::RerunObserver;
// For bundle adjustment with BAL datasets (world-to-camera poses)
let observer = RerunObserver::new_for_bundle_adjustment(true, None, true)?;
// For pose graph optimization (camera-to-world poses)
let observer = RerunObserver::new_for_bundle_adjustment(true, None, false)?;Sourcepub fn config(&self) -> &VisualizationConfig
pub fn config(&self) -> &VisualizationConfig
Get the current visualization configuration.
Sourcepub fn is_enabled(&self) -> bool
pub fn is_enabled(&self) -> bool
Check if visualization is enabled and active.
Sourcepub fn set_iteration_metrics(
&self,
cost: f64,
gradient_norm: f64,
damping: Option<f64>,
step_norm: f64,
step_quality: Option<f64>,
)
pub fn set_iteration_metrics( &self, cost: f64, gradient_norm: f64, damping: Option<f64>, step_norm: f64, step_quality: Option<f64>, )
Set iteration metrics for the next on_step call.
This method should be called by optimizers before notifying observers to provide context like cost, gradient norm, damping, etc.
§Arguments
cost- Current cost valuegradient_norm- L2 norm of gradientdamping- Current damping parameter (LM-specific, use None for GN/DogLeg)step_norm- L2 norm of parameter updatestep_quality- Step quality metric ρ (actual vs predicted reduction)
§Examples
observer.set_iteration_metrics(
1.234, // cost
0.056, // gradient_norm
Some(0.01), // damping (LM only)
0.023, // step_norm
Some(0.95), // step_quality
);Sourcepub fn set_matrix_data(
&self,
hessian: Option<SparseColMat<usize, f64>>,
gradient: Option<Mat<f64>>,
)
pub fn set_matrix_data( &self, hessian: Option<SparseColMat<usize, f64>>, gradient: Option<Mat<f64>>, )
Set matrix data (Hessian and gradient) for visualization.
This should be called before on_step if you want to visualize matrices.
§Arguments
hessian- Optional sparse Hessian matrix (J^T J)gradient- Optional gradient vector (J^T r)
Sourcepub fn log_initial_graph(&self, graph: &Graph, scale: f32) -> ObserverResult<()>
pub fn log_initial_graph(&self, graph: &Graph, scale: f32) -> ObserverResult<()>
Log the initial graph structure before optimization.
This should be called once before optimization starts to visualize the initial configuration.
§Arguments
graph- The graph structure loaded from G2O filescale- Scale factor for visualization
Sourcepub fn log_convergence(&self, status: &str) -> ObserverResult<()>
pub fn log_convergence(&self, status: &str) -> ObserverResult<()>
Log convergence status and final summary.
Call this after optimization completes.
§Arguments
status- Convergence status message
Sourcepub fn log_initial_ba_state(&self, problem: &Problem) -> ObserverResult<()>
pub fn log_initial_ba_state(&self, problem: &Problem) -> ObserverResult<()>
Log initial bundle adjustment state before optimization.
This method visualizes the initial camera poses and 3D landmarks before optimization begins, allowing comparison with optimized results.
§Arguments
problem- The optimization problem containing the initial variables
§Examples
use apex_solver::observers::RerunObserver;
use apex_solver::core::problem::Problem;
let observer = RerunObserver::new_for_bundle_adjustment(true, None, true)?;
let mut problem = Problem::new(apex_solver::linalg::JacobianMode::Sparse);
// ... add variables and factors ...
observer.log_initial_ba_state(&problem)?;Trait Implementations§
Source§impl Default for RerunObserver
impl Default for RerunObserver
Source§impl OptObserver for RerunObserver
impl OptObserver for RerunObserver
Source§fn on_step(
&self,
values: &SlotMap<VarKey, Box<dyn ManifoldVariable>>,
iteration: usize,
)
fn on_step( &self, values: &SlotMap<VarKey, Box<dyn ManifoldVariable>>, iteration: usize, )
Called at each optimization iteration.
This logs all visualization data to Rerun, including:
- Time series plots (cost, gradient, damping, step quality)
- Matrix visualizations (Hessian, gradient) if set via
set_matrix_data - Manifold states (SE2/SE3 poses)
In InitialAndFinal mode, this method only logs scalar metrics (plots)
during intermediate iterations. The full manifold state is logged at
iteration 0 (initial) and in on_optimization_complete (final).
§Arguments
values- Current variable values (manifold states)iteration- Current iteration number
Source§fn on_optimization_complete(
&self,
values: &SlotMap<VarKey, Box<dyn ManifoldVariable>>,
iterations: usize,
)
fn on_optimization_complete( &self, values: &SlotMap<VarKey, Box<dyn ManifoldVariable>>, iterations: usize, )
Called when optimization completes.
In InitialAndFinal mode, this logs the final optimized state.
In Iterative mode, the final state was already logged via on_step.
§Arguments
values- Final optimized variable valuesiterations- Total number of iterations performed
Auto Trait Implementations§
impl !Freeze for RerunObserver
impl !RefUnwindSafe for RerunObserver
impl !Sync for RerunObserver
impl !UnwindSafe for RerunObserver
impl Send for RerunObserver
impl Unpin for RerunObserver
impl UnsafeUnpin for RerunObserver
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CheckedAs for T
impl<T> CheckedAs for T
Source§fn checked_as<Dst>(self) -> Option<Dst>where
T: CheckedCast<Dst>,
fn checked_as<Dst>(self) -> Option<Dst>where
T: CheckedCast<Dst>,
Source§impl<Src, Dst> CheckedCastFrom<Src> for Dstwhere
Src: CheckedCast<Dst>,
impl<Src, Dst> CheckedCastFrom<Src> for Dstwhere
Src: CheckedCast<Dst>,
Source§fn checked_cast_from(src: Src) -> Option<Dst>
fn checked_cast_from(src: Src) -> Option<Dst>
Source§impl<T> DistributionExt for Twhere
T: ?Sized,
impl<T> DistributionExt for Twhere
T: ?Sized,
impl<T, U> Imply<T> for U
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§impl<T> IntoRequest<T> for T
impl<T> IntoRequest<T> for T
Source§fn into_request(self) -> Request<T>
fn into_request(self) -> Request<T>
T in a tonic::RequestSource§impl<Src, Dst> LosslessTryInto<Dst> for Srcwhere
Dst: LosslessTryFrom<Src>,
impl<Src, Dst> LosslessTryInto<Dst> for Srcwhere
Dst: LosslessTryFrom<Src>,
Source§fn lossless_try_into(self) -> Option<Dst>
fn lossless_try_into(self) -> Option<Dst>
Source§impl<Src, Dst> LossyInto<Dst> for Srcwhere
Dst: LossyFrom<Src>,
impl<Src, Dst> LossyInto<Dst> for Srcwhere
Dst: LossyFrom<Src>,
Source§fn lossy_into(self) -> Dst
fn lossy_into(self) -> Dst
Source§impl<T> OverflowingAs for T
impl<T> OverflowingAs for T
Source§fn overflowing_as<Dst>(self) -> (Dst, bool)where
T: OverflowingCast<Dst>,
fn overflowing_as<Dst>(self) -> (Dst, bool)where
T: OverflowingCast<Dst>,
Source§impl<Src, Dst> OverflowingCastFrom<Src> for Dstwhere
Src: OverflowingCast<Dst>,
impl<Src, Dst> OverflowingCastFrom<Src> for Dstwhere
Src: OverflowingCast<Dst>,
Source§fn overflowing_cast_from(src: Src) -> (Dst, bool)
fn overflowing_cast_from(src: Src) -> (Dst, bool)
Source§impl<T> Pipe for Twhere
T: ?Sized,
impl<T> Pipe for Twhere
T: ?Sized,
Source§fn pipe<R>(self, func: impl FnOnce(Self) -> R) -> Rwhere
Self: Sized,
fn pipe<R>(self, func: impl FnOnce(Self) -> R) -> Rwhere
Self: Sized,
Source§fn pipe_ref<'a, R>(&'a self, func: impl FnOnce(&'a Self) -> R) -> Rwhere
R: 'a,
fn pipe_ref<'a, R>(&'a self, func: impl FnOnce(&'a Self) -> R) -> Rwhere
R: 'a,
self and passes that borrow into the pipe function. Read moreSource§fn pipe_ref_mut<'a, R>(&'a mut self, func: impl FnOnce(&'a mut Self) -> R) -> Rwhere
R: 'a,
fn pipe_ref_mut<'a, R>(&'a mut self, func: impl FnOnce(&'a mut Self) -> R) -> Rwhere
R: 'a,
self and passes that borrow into the pipe function. Read moreSource§fn pipe_borrow<'a, B, R>(&'a self, func: impl FnOnce(&'a B) -> R) -> R
fn pipe_borrow<'a, B, R>(&'a self, func: impl FnOnce(&'a B) -> R) -> R
Source§fn pipe_borrow_mut<'a, B, R>(
&'a mut self,
func: impl FnOnce(&'a mut B) -> R,
) -> R
fn pipe_borrow_mut<'a, B, R>( &'a mut self, func: impl FnOnce(&'a mut B) -> R, ) -> R
Source§fn pipe_as_ref<'a, U, R>(&'a self, func: impl FnOnce(&'a U) -> R) -> R
fn pipe_as_ref<'a, U, R>(&'a self, func: impl FnOnce(&'a U) -> R) -> R
self, then passes self.as_ref() into the pipe function.Source§fn pipe_as_mut<'a, U, R>(&'a mut self, func: impl FnOnce(&'a mut U) -> R) -> R
fn pipe_as_mut<'a, U, R>(&'a mut self, func: impl FnOnce(&'a mut U) -> R) -> R
self, then passes self.as_mut() into the pipe
function.Source§fn pipe_deref<'a, T, R>(&'a self, func: impl FnOnce(&'a T) -> R) -> R
fn pipe_deref<'a, T, R>(&'a self, func: impl FnOnce(&'a T) -> R) -> R
self, then passes self.deref() into the pipe function.Source§impl<T> Pointable for T
impl<T> Pointable for T
impl<T> Read<Exclusive, BecauseExclusive> for Twhere
T: ?Sized,
Source§impl<R, P> ReadPrimitive<R> for P
impl<R, P> ReadPrimitive<R> for P
Source§fn read_from_little_endian(read: &mut R) -> Result<Self, Error>
fn read_from_little_endian(read: &mut R) -> Result<Self, Error>
ReadEndian::read_from_little_endian().Source§impl<T> SaturatingAs for T
impl<T> SaturatingAs for T
Source§fn saturating_as<Dst>(self) -> Dstwhere
T: SaturatingCast<Dst>,
fn saturating_as<Dst>(self) -> Dstwhere
T: SaturatingCast<Dst>,
Source§impl<Src, Dst> SaturatingCastFrom<Src> for Dstwhere
Src: SaturatingCast<Dst>,
impl<Src, Dst> SaturatingCastFrom<Src> for Dstwhere
Src: SaturatingCast<Dst>,
Source§fn saturating_cast_from(src: Src) -> Dst
fn saturating_cast_from(src: Src) -> Dst
Source§impl<T> StrictAs for T
impl<T> StrictAs for T
Source§fn strict_as<Dst>(self) -> Dstwhere
T: StrictCast<Dst>,
fn strict_as<Dst>(self) -> Dstwhere
T: StrictCast<Dst>,
Source§impl<Src, Dst> StrictCastFrom<Src> for Dstwhere
Src: StrictCast<Dst>,
impl<Src, Dst> StrictCastFrom<Src> for Dstwhere
Src: StrictCast<Dst>,
Source§fn strict_cast_from(src: Src) -> Dst
fn strict_cast_from(src: Src) -> Dst
Source§impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
Source§fn to_subset(&self) -> Option<SS>
fn to_subset(&self) -> Option<SS>
self from the equivalent element of its
superset. Read moreSource§fn is_in_subset(&self) -> bool
fn is_in_subset(&self) -> bool
self is actually part of its subset T (and can be converted to it).Source§fn to_subset_unchecked(&self) -> SS
fn to_subset_unchecked(&self) -> SS
self.to_subset but without any property checks. Always succeeds.Source§fn from_subset(element: &SS) -> SP
fn from_subset(element: &SS) -> SP
self to the equivalent element of its superset.Source§impl<T> Tap for T
impl<T> Tap for T
Source§fn tap_borrow<B>(self, func: impl FnOnce(&B)) -> Self
fn tap_borrow<B>(self, func: impl FnOnce(&B)) -> Self
Borrow<B> of a value. Read moreSource§fn tap_borrow_mut<B>(self, func: impl FnOnce(&mut B)) -> Self
fn tap_borrow_mut<B>(self, func: impl FnOnce(&mut B)) -> Self
BorrowMut<B> of a value. Read moreSource§fn tap_ref<R>(self, func: impl FnOnce(&R)) -> Self
fn tap_ref<R>(self, func: impl FnOnce(&R)) -> Self
AsRef<R> view of a value. Read moreSource§fn tap_ref_mut<R>(self, func: impl FnOnce(&mut R)) -> Self
fn tap_ref_mut<R>(self, func: impl FnOnce(&mut R)) -> Self
AsMut<R> view of a value. Read moreSource§fn tap_deref<T>(self, func: impl FnOnce(&T)) -> Self
fn tap_deref<T>(self, func: impl FnOnce(&T)) -> Self
Deref::Target of a value. Read moreSource§fn tap_deref_mut<T>(self, func: impl FnOnce(&mut T)) -> Self
fn tap_deref_mut<T>(self, func: impl FnOnce(&mut T)) -> Self
Deref::Target of a value. Read moreSource§fn tap_dbg(self, func: impl FnOnce(&Self)) -> Self
fn tap_dbg(self, func: impl FnOnce(&Self)) -> Self
.tap() only in debug builds, and is erased in release builds.Source§fn tap_mut_dbg(self, func: impl FnOnce(&mut Self)) -> Self
fn tap_mut_dbg(self, func: impl FnOnce(&mut Self)) -> Self
.tap_mut() only in debug builds, and is erased in release
builds.Source§fn tap_borrow_dbg<B>(self, func: impl FnOnce(&B)) -> Self
fn tap_borrow_dbg<B>(self, func: impl FnOnce(&B)) -> Self
.tap_borrow() only in debug builds, and is erased in release
builds.Source§fn tap_borrow_mut_dbg<B>(self, func: impl FnOnce(&mut B)) -> Self
fn tap_borrow_mut_dbg<B>(self, func: impl FnOnce(&mut B)) -> Self
.tap_borrow_mut() only in debug builds, and is erased in release
builds.Source§fn tap_ref_dbg<R>(self, func: impl FnOnce(&R)) -> Self
fn tap_ref_dbg<R>(self, func: impl FnOnce(&R)) -> Self
.tap_ref() only in debug builds, and is erased in release
builds.Source§fn tap_ref_mut_dbg<R>(self, func: impl FnOnce(&mut R)) -> Self
fn tap_ref_mut_dbg<R>(self, func: impl FnOnce(&mut R)) -> Self
.tap_ref_mut() only in debug builds, and is erased in release
builds.Source§fn tap_deref_dbg<T>(self, func: impl FnOnce(&T)) -> Self
fn tap_deref_dbg<T>(self, func: impl FnOnce(&T)) -> Self
.tap_deref() only in debug builds, and is erased in release
builds.