Skip to main content

FastPathProcessor

Struct FastPathProcessor 

Source
pub struct FastPathProcessor { /* private fields */ }
Expand description

Fast-path request processor for high RPS scenarios

Implements aggressive caching and optimization strategies for frequently accessed resources. Uses in-memory caches with configurable eviction policies and request pattern analysis for optimal performance.

Implementations§

Source§

impl FastPathProcessor

Source

pub fn new(router: Arc<Router>, metrics: Arc<PerformanceMetrics>) -> Self

Create a new fast-path processor

§Arguments
  • router - The application router for processing requests
  • metrics - Metrics collector for performance tracking
Source

pub async fn process(&self, request: Request) -> Result<Response>

Process a request using fast-path optimizations

Attempts to serve requests from cache when possible, falling back to full router processing for cache misses. Automatically populates the cache with cacheable responses based on HTTP headers.

§Arguments
  • request - The HTTP request to process
§Returns

The HTTP response, either from cache or freshly generated

§Performance Characteristics
  • Cache hits: ~1-2μs response time
  • Cache misses: Full router processing time + cache population overhead
  • Memory usage: Bounded by cache size limit (default 1000 entries)
Source

pub fn clear_cache(&self)

Clear the response cache

Removes all cached responses. Useful for cache invalidation scenarios or memory management in long-running servers.

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> ErasedDestructor for T
where T: 'static,

Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

Source§

fn vzip(self) -> V

Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more