Skip to main content

PackageCache

Struct PackageCache 

Source
pub struct PackageCache { /* private fields */ }
Expand description

A PackageCache manages a cache of extracted Conda packages on disk.

The store does not provide an implementation to get the data into the store. Instead, this is left up to the user when the package is requested. If the package is found in the cache it is returned immediately. However, if the cache is stale a user defined function is called to populate the cache. This separates the concerns between caching and fetching of the content.

Implementations§

Source§

impl PackageCache

Source

pub fn new(path: impl Into<PathBuf>) -> Self

Constructs a new PackageCache with only one layer.

Source

pub fn with_cached_origin(self) -> Self

Adds the origin (url or path) to the cache key to avoid unwanted cache hits of packages with packages with similar properties.

Source

pub async fn acquire_global_lock( &self, ) -> Result<CacheGlobalLock, PackageCacheError>

Acquires a global lock on the package cache.

This lock can be used to coordinate multiple package operations, reducing the overhead of acquiring individual locks for each package. The lock is held until the returned CacheGlobalLock is dropped.

This is particularly useful when installing many packages at once, as it significantly reduces the number of file locking syscalls.

Source

pub fn new_layered<I>( paths: I, cache_origin: bool, validation_mode: ValidationMode, ) -> Self
where I: IntoIterator, I::Item: Into<PathBuf>,

Constructs a new PackageCache located at the specified paths. Layers are queried in the order they are provided. The first writable layer is written to.

Source

pub fn split_layers(&self) -> (Vec<&PackageCacheLayer>, Vec<&PackageCacheLayer>)

Returns a tuple containing two sets of layers:

  • A collection of read-only layers.
  • A collection of writable layers.

The permissions are checked at the time of the function call.

Source

pub async fn get_or_fetch<F, Fut, E>( &self, pkg: impl Into<CacheKey>, fetch: F, reporter: Option<Arc<dyn CacheReporter>>, ) -> Result<CacheMetadata, PackageCacheError>
where F: Fn(PathBuf) -> Fut + Send + 'static, Fut: Future<Output = Result<(), E>> + Send + 'static, E: Error + Send + Sync + 'static,

Returns the directory that contains the specified package.

If the package was previously successfully fetched and stored in the cache the directory containing the data is returned immediately. If the package was not previously fetch the filesystem is checked to see if a directory with valid package content exists. Otherwise, the user provided fetch function is called to populate the cache.

§Layer Priority

Layers are checked in the order they were provided to PackageCache::new_layered. If a valid package is found in any layer, it is returned immediately. If no valid package is found in any layer, the package is fetched and written to the first writable layer.

If the package is already being fetched by another task/thread the request is coalesced. No duplicate fetch is performed.

Source

pub async fn get_or_fetch_from_url( &self, pkg: impl Into<CacheKey>, url: Url, client: LazyClient, reporter: Option<Arc<dyn CacheReporter>>, concurrent_requests_semaphore: Option<Arc<Semaphore>>, ) -> Result<CacheMetadata, PackageCacheError>

Returns the directory that contains the specified package.

This is a convenience wrapper around get_or_fetch which fetches the package from the given URL if the package could not be found in the cache.

Source

pub async fn get_or_fetch_from_path( &self, path: &Path, record: Option<&PackageRecord>, reporter: Option<Arc<dyn CacheReporter>>, ) -> Result<CacheMetadata, PackageCacheError>

Returns the directory that contains the specified package.

This is a convenience wrapper around get_or_fetch which fetches the package from the given path if the package could not be found in the cache.

If a PackageRecord is provided, the cache key is derived from the record, which includes its hashes. This ensures that packages that share the same name, version and build string but have different content do not collide in the cache. Otherwise, the cache key is derived from the package filename only.

Source

pub async fn get_or_fetch_from_url_with_retry( &self, pkg: impl Into<CacheKey>, url: Url, client: LazyClient, retry_policy: impl RetryPolicy + Send + 'static + Clone, reporter: Option<Arc<dyn CacheReporter>>, concurrent_requests_semaphore: Option<Arc<Semaphore>>, ) -> Result<CacheMetadata, PackageCacheError>

Returns the directory that contains the specified package.

This is a convenience wrapper around get_or_fetch which fetches the package from the given URL if the package could not be found in the cache.

This function assumes that the client is already configured with a retry middleware that will retry any request that fails. This function uses the passed in retry_policy if, after the request has been sent and the response is successful, streaming of the package data fails and the whole request must be retried.

The optional concurrent_requests_semaphore limits the number of simultaneous downloads. A permit is acquired only when a download is actually started (i.e. the package is not already cached), and is held for the duration of the download and extraction.

Trait Implementations§

Source§

impl Clone for PackageCache

Source§

fn clone(&self) -> PackageCache

Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
where ST: ?Sized, DT: ?Sized,

Source§

impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
where ST: ?Sized, DT: ?Sized,

Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> IntoEither for T

Source§

fn into_either(self, into_left: bool) -> Either<Self, Self>

Converts self into a Left variant of Either<Self, Self> if into_left is true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
where F: FnOnce(&Self) -> bool,

Converts self into a Left variant of Either<Self, Self> if into_left(&self) returns true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

impl<T> Pointable for T

Source§

const ALIGN: usize

The alignment of pointer.
Source§

type Init = T

The type for initializers.
Source§

unsafe fn init(init: <T as Pointable>::Init) -> usize

Initializes a with the given initializer. Read more
Source§

unsafe fn deref<'a>(ptr: usize) -> &'a T

Dereferences the given pointer. Read more
Source§

unsafe fn deref_mut<'a>(ptr: usize) -> &'a mut T

Mutably dereferences the given pointer. Read more
Source§

unsafe fn drop(ptr: usize)

Drops the object pointed to by the given pointer. Read more
Source§

impl<T> PolicyExt for T
where T: ?Sized,

Source§

fn and<P, B, E>(self, other: P) -> And<T, P>
where T: Sized + Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow only if self and other return Action::Follow. Read more
Source§

fn or<P, B, E>(self, other: P) -> Or<T, P>
where T: Sized + Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow if either self or other returns Action::Follow. Read more
Source§

impl<T> Read<Exclusive, BecauseExclusive> for T
where T: ?Sized,

Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more