Module bulk_migration 

Bulk migration tools for importing from other vector databases

This module provides specialized importers for migrating data from popular vector databases to VecStore:

• Pinecone export files
• Qdrant snapshots
• Weaviate backups
• ChromaDB exports
• Milvus dumps

Features

• Batch processing with progress tracking
• Automatic schema mapping
• Resume capability for large migrations
• Validation and error reporting
• Memory-efficient streaming

Example

use vecstore::bulk_migration::{PineconeMigration, MigrationConfig};

let config = MigrationConfig {
    batch_size: 1000,
    validate: true,
    resume_from: None,
};

let migration = PineconeMigration::new(config);
let stats = migration.import_from_file("pinecone_export.json", &mut store)?;

println!("Migrated {} vectors in {:?}", stats.total_vectors, stats.duration);

Structs

BulkMigrationStats

Bulk migration statistics

ChromaDBMigration

ChromaDB format migration

FormatConverter

Universal format converter

MigrationConfig

Migration configuration

PineconeMigration

Pinecone format migration

QdrantMigration

Qdrant format migration

Type Aliases

ProgressCallback

Progress callback function type