Struct AsyncPolicy 

pub struct AsyncPolicy<B: Backend, P: Policy<B>> { /* private fields */ }

An asynchronous policy using an inference server with autobatching.

Implementations

impl<B, P> AsyncPolicy<B, P>

where B: Backend, P: Policy<B> + Clone + Send + 'static, P::ActionContext: Clone + Send, P::PolicyState: Send, P::Observation: Clone + Send + Batchable, P::ActionDistribution: Clone + Send + Batchable, P::Action: Clone + Send + Batchable,

pub fn new(autobatch_size: usize, inner_policy: P) -> Self

Create the policy.

Arguments

• autobatch_size - Number of observations to accumulate before running a pass of inference.
• inner_policy - The policy used to take actions.

pub fn increment_agents(&self, num: usize)

Increment the number of agents using the inference server.

pub fn decrement_agents(&self, num: usize)

Decrement the number of agents using the inference server.

Trait Implementations

impl<B: Clone + Backend, P: Clone + Policy<B>> Clone for AsyncPolicy<B, P>

fn clone(&self) -> AsyncPolicy<B, P>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<B, P> Policy<B> for AsyncPolicy<B, P>

where B: Backend, P: Policy<B> + Send + 'static,

type ActionContext = <P as Policy<B>>::ActionContext

Additional context on the policy’s decision.

type PolicyState = <P as Policy<B>>::PolicyState

The current parameterization of the policy.

type Observation = <P as Policy<B>>::Observation

The observation given as input to the policy.

type ActionDistribution = <P as Policy<B>>::ActionDistribution

The action distribution parameters defining how the action will be sampled.

type Action = <P as Policy<B>>::Action

The action.

fn forward(&mut self, states: Self::Observation) -> Self::ActionDistribution

Produces the action distribution from a batch of observations.

fn action( &mut self, states: Self::Observation, deterministic: bool, ) -> (Self::Action, Vec<Self::ActionContext>)

Gives the action from a batch of observations.

fn update(&mut self, update: Self::PolicyState)

Update the policy’s parameters.

fn state(&self) -> Self::PolicyState

Returns the current parameterization.

fn load_record( self, _record: <Self::PolicyState as PolicyState<B>>::Record, ) -> Self

Loads the policy parameters from a record.