pub struct AddPipeline { /* private fields */ }Expand description
Ingest pipeline driven by the cognee-core task framework.
Routes add / add_with_params
through cognee_core::pipeline::execute so the executor’s lifecycle
hooks fire and TaskContext-aware tasks can publish run-scoped payload
(LIB-06 / gap 08-07).
Backend handles required by cognee_core::TaskContextBuilder
— thread_pool, graph_db, vector_db, database — must be attached
via the chainable builders before calling add(). AddPipeline::new
does not populate them; calling add() on an under-configured
pipeline returns IngestionError::MissingBackend { ... }.
For composable pipeline-based execution (with concurrency, retry, etc.),
use build_add_pipeline + cognee_core::execute directly.
Implementations§
Source§impl AddPipeline
impl AddPipeline
Sourcepub fn new(
storage: Arc<dyn StorageTrait>,
database: Arc<dyn IngestDb>,
) -> AddPipeline
pub fn new( storage: Arc<dyn StorageTrait>, database: Arc<dyn IngestDb>, ) -> AddPipeline
Create with the default MD5 hashing (Python-compatible).
Note: add() routes through cognee_core::pipeline::execute
and requires the four executor-context handles attached via
with_thread_pool,
with_graph_db,
with_vector_db,
with_database. A missing handle surfaces as
IngestionError::MissingBackend at add() time.
Sourcepub fn new_with_algorithm(
storage: Arc<dyn StorageTrait>,
database: Arc<dyn IngestDb>,
hash_algorithm: HashAlgorithm,
) -> AddPipeline
pub fn new_with_algorithm( storage: Arc<dyn StorageTrait>, database: Arc<dyn IngestDb>, hash_algorithm: HashAlgorithm, ) -> AddPipeline
Create with an explicit hash algorithm.
Sourcepub fn with_acl_db(self, acl_db: Arc<dyn AclDb>) -> AddPipeline
pub fn with_acl_db(self, acl_db: Arc<dyn AclDb>) -> AddPipeline
Enable ACL permission grants on newly created datasets.
When set, the pipeline grants all four permissions (read, write, delete,
share) to the owner on each newly created dataset, matching Python’s
create_authorized_dataset() behavior.
Sourcepub fn with_thread_pool(self, pool: Arc<dyn CpuPool>) -> AddPipeline
pub fn with_thread_pool(self, pool: Arc<dyn CpuPool>) -> AddPipeline
Attach the CPU pool used by cognee_core::TaskContext.
Sourcepub fn with_graph_db(self, graph: Arc<dyn GraphDBTrait>) -> AddPipeline
pub fn with_graph_db(self, graph: Arc<dyn GraphDBTrait>) -> AddPipeline
Attach the graph database backend used by cognee_core::TaskContext.
Sourcepub fn with_vector_db(self, vectors: Arc<dyn VectorDB>) -> AddPipeline
pub fn with_vector_db(self, vectors: Arc<dyn VectorDB>) -> AddPipeline
Attach the vector database backend used by cognee_core::TaskContext.
Sourcepub fn with_database(self, db: Arc<DatabaseConnection>) -> AddPipeline
pub fn with_database(self, db: Arc<DatabaseConnection>) -> AddPipeline
Attach the relational DatabaseConnection used by
cognee_core::TaskContext. This is the same SeaORM handle the
SQL-backed IngestDb is built on.
Sourcepub fn with_pipeline_run_repo(
self,
repo: Arc<dyn PipelineRunRepository>,
) -> AddPipeline
pub fn with_pipeline_run_repo( self, repo: Arc<dyn PipelineRunRepository>, ) -> AddPipeline
Attach the PipelineRunRepository used to persist the four-state
pipeline_runs trail (gap 08-07).
Embedded callers pass Arc::new(NoopPipelineRunRepository::new())
(or simply omit this call — the pipeline defaults to no-op). CLI
and HTTP callers pass Arc::new(SeaOrmPipelineRunRepository::new(db))
so the rows surface in /api/v1/activity/pipeline-runs.
pub async fn add( &self, inputs: Vec<DataInput>, dataset_name: &str, owner_id: Uuid, tenant_id: Option<Uuid>, ) -> Result<Vec<Data>, Box<dyn Error>>
Auto Trait Implementations§
impl !RefUnwindSafe for AddPipeline
impl !UnwindSafe for AddPipeline
impl Freeze for AddPipeline
impl Send for AddPipeline
impl Sync for AddPipeline
impl Unpin for AddPipeline
impl UnsafeUnpin for AddPipeline
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> FmtForward for T
impl<T> FmtForward for T
Source§fn fmt_binary(self) -> FmtBinary<Self>where
Self: Binary,
fn fmt_binary(self) -> FmtBinary<Self>where
Self: Binary,
self to use its Binary implementation when Debug-formatted.Source§fn fmt_display(self) -> FmtDisplay<Self>where
Self: Display,
fn fmt_display(self) -> FmtDisplay<Self>where
Self: Display,
self to use its Display implementation when
Debug-formatted.Source§fn fmt_lower_exp(self) -> FmtLowerExp<Self>where
Self: LowerExp,
fn fmt_lower_exp(self) -> FmtLowerExp<Self>where
Self: LowerExp,
self to use its LowerExp implementation when
Debug-formatted.Source§fn fmt_lower_hex(self) -> FmtLowerHex<Self>where
Self: LowerHex,
fn fmt_lower_hex(self) -> FmtLowerHex<Self>where
Self: LowerHex,
self to use its LowerHex implementation when
Debug-formatted.Source§fn fmt_octal(self) -> FmtOctal<Self>where
Self: Octal,
fn fmt_octal(self) -> FmtOctal<Self>where
Self: Octal,
self to use its Octal implementation when Debug-formatted.Source§fn fmt_pointer(self) -> FmtPointer<Self>where
Self: Pointer,
fn fmt_pointer(self) -> FmtPointer<Self>where
Self: Pointer,
self to use its Pointer implementation when
Debug-formatted.Source§fn fmt_upper_exp(self) -> FmtUpperExp<Self>where
Self: UpperExp,
fn fmt_upper_exp(self) -> FmtUpperExp<Self>where
Self: UpperExp,
self to use its UpperExp implementation when
Debug-formatted.Source§fn fmt_upper_hex(self) -> FmtUpperHex<Self>where
Self: UpperHex,
fn fmt_upper_hex(self) -> FmtUpperHex<Self>where
Self: UpperHex,
self to use its UpperHex implementation when
Debug-formatted.Source§impl<T> FutureExt for T
impl<T> FutureExt for T
Source§fn with_context(self, otel_cx: Context) -> WithContext<Self>
fn with_context(self, otel_cx: Context) -> WithContext<Self>
Source§fn with_current_context(self) -> WithContext<Self>
fn with_current_context(self) -> WithContext<Self>
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§impl<T> IntoRequest<T> for T
impl<T> IntoRequest<T> for T
Source§fn into_request(self) -> Request<T>
fn into_request(self) -> Request<T>
T in a tonic::RequestSource§impl<T, U, C> IntoWithContext<U, C> for Twhere
U: FromWithContext<T, C>,
impl<T, U, C> IntoWithContext<U, C> for Twhere
U: FromWithContext<T, C>,
Source§impl<T> Pipe for Twhere
T: ?Sized,
impl<T> Pipe for Twhere
T: ?Sized,
Source§fn pipe<R>(self, func: impl FnOnce(Self) -> R) -> Rwhere
Self: Sized,
fn pipe<R>(self, func: impl FnOnce(Self) -> R) -> Rwhere
Self: Sized,
Source§fn pipe_ref<'a, R>(&'a self, func: impl FnOnce(&'a Self) -> R) -> Rwhere
R: 'a,
fn pipe_ref<'a, R>(&'a self, func: impl FnOnce(&'a Self) -> R) -> Rwhere
R: 'a,
self and passes that borrow into the pipe function. Read moreSource§fn pipe_ref_mut<'a, R>(&'a mut self, func: impl FnOnce(&'a mut Self) -> R) -> Rwhere
R: 'a,
fn pipe_ref_mut<'a, R>(&'a mut self, func: impl FnOnce(&'a mut Self) -> R) -> Rwhere
R: 'a,
self and passes that borrow into the pipe function. Read moreSource§fn pipe_borrow<'a, B, R>(&'a self, func: impl FnOnce(&'a B) -> R) -> R
fn pipe_borrow<'a, B, R>(&'a self, func: impl FnOnce(&'a B) -> R) -> R
Source§fn pipe_borrow_mut<'a, B, R>(
&'a mut self,
func: impl FnOnce(&'a mut B) -> R,
) -> R
fn pipe_borrow_mut<'a, B, R>( &'a mut self, func: impl FnOnce(&'a mut B) -> R, ) -> R
Source§fn pipe_as_ref<'a, U, R>(&'a self, func: impl FnOnce(&'a U) -> R) -> R
fn pipe_as_ref<'a, U, R>(&'a self, func: impl FnOnce(&'a U) -> R) -> R
self, then passes self.as_ref() into the pipe function.Source§fn pipe_as_mut<'a, U, R>(&'a mut self, func: impl FnOnce(&'a mut U) -> R) -> R
fn pipe_as_mut<'a, U, R>(&'a mut self, func: impl FnOnce(&'a mut U) -> R) -> R
self, then passes self.as_mut() into the pipe
function.Source§fn pipe_deref<'a, T, R>(&'a self, func: impl FnOnce(&'a T) -> R) -> R
fn pipe_deref<'a, T, R>(&'a self, func: impl FnOnce(&'a T) -> R) -> R
self, then passes self.deref() into the pipe function.Source§impl<T> Pointable for T
impl<T> Pointable for T
Source§impl<T> PolicyExt for Twhere
T: ?Sized,
impl<T> PolicyExt for Twhere
T: ?Sized,
impl<T> Read<Exclusive, BecauseExclusive> for Twhere
T: ?Sized,
Source§impl<T> Tap for T
impl<T> Tap for T
Source§fn tap_borrow<B>(self, func: impl FnOnce(&B)) -> Self
fn tap_borrow<B>(self, func: impl FnOnce(&B)) -> Self
Borrow<B> of a value. Read moreSource§fn tap_borrow_mut<B>(self, func: impl FnOnce(&mut B)) -> Self
fn tap_borrow_mut<B>(self, func: impl FnOnce(&mut B)) -> Self
BorrowMut<B> of a value. Read moreSource§fn tap_ref<R>(self, func: impl FnOnce(&R)) -> Self
fn tap_ref<R>(self, func: impl FnOnce(&R)) -> Self
AsRef<R> view of a value. Read moreSource§fn tap_ref_mut<R>(self, func: impl FnOnce(&mut R)) -> Self
fn tap_ref_mut<R>(self, func: impl FnOnce(&mut R)) -> Self
AsMut<R> view of a value. Read moreSource§fn tap_deref<T>(self, func: impl FnOnce(&T)) -> Self
fn tap_deref<T>(self, func: impl FnOnce(&T)) -> Self
Deref::Target of a value. Read moreSource§fn tap_deref_mut<T>(self, func: impl FnOnce(&mut T)) -> Self
fn tap_deref_mut<T>(self, func: impl FnOnce(&mut T)) -> Self
Deref::Target of a value. Read moreSource§fn tap_dbg(self, func: impl FnOnce(&Self)) -> Self
fn tap_dbg(self, func: impl FnOnce(&Self)) -> Self
.tap() only in debug builds, and is erased in release builds.Source§fn tap_mut_dbg(self, func: impl FnOnce(&mut Self)) -> Self
fn tap_mut_dbg(self, func: impl FnOnce(&mut Self)) -> Self
.tap_mut() only in debug builds, and is erased in release
builds.Source§fn tap_borrow_dbg<B>(self, func: impl FnOnce(&B)) -> Self
fn tap_borrow_dbg<B>(self, func: impl FnOnce(&B)) -> Self
.tap_borrow() only in debug builds, and is erased in release
builds.Source§fn tap_borrow_mut_dbg<B>(self, func: impl FnOnce(&mut B)) -> Self
fn tap_borrow_mut_dbg<B>(self, func: impl FnOnce(&mut B)) -> Self
.tap_borrow_mut() only in debug builds, and is erased in release
builds.Source§fn tap_ref_dbg<R>(self, func: impl FnOnce(&R)) -> Self
fn tap_ref_dbg<R>(self, func: impl FnOnce(&R)) -> Self
.tap_ref() only in debug builds, and is erased in release
builds.Source§fn tap_ref_mut_dbg<R>(self, func: impl FnOnce(&mut R)) -> Self
fn tap_ref_mut_dbg<R>(self, func: impl FnOnce(&mut R)) -> Self
.tap_ref_mut() only in debug builds, and is erased in release
builds.Source§fn tap_deref_dbg<T>(self, func: impl FnOnce(&T)) -> Self
fn tap_deref_dbg<T>(self, func: impl FnOnce(&T)) -> Self
.tap_deref() only in debug builds, and is erased in release
builds.