Expand description
§OxiRS Federation - Federated Query Engine
Status: Production Release (v0.1.0) Stability: Public APIs are stable. Production-ready with comprehensive testing.
Federated query processing capabilities for SPARQL and GraphQL with service discovery, query decomposition, result integration, and fault tolerance.
§Features
- SPARQL SERVICE planner and executor for federated SPARQL queries
- GraphQL schema stitching and federation
- Service discovery and capability detection
- Query decomposition and optimization across multiple sources
- Result integration with fault tolerance and partial result handling
- Load balancing and performance monitoring
§Architecture
The federation engine consists of several key components:
ServiceRegistry: Manages available federated services and their capabilitiesQueryPlanner: Decomposes queries across multiple servicesExecutor: Executes federated queries with parallel processingResultIntegrator: Combines results from multiple sourcesFaultHandler: Manages service failures and retries
Re-exports§
pub use adaptive_load_balancer::AdaptiveLoadBalancer;pub use advanced_query_optimizer::AdvancedOptimizerConfig;pub use advanced_query_optimizer::AdvancedQueryOptimizer;pub use advanced_query_optimizer::HardwareProfile;pub use advanced_query_optimizer::OptimizedPlan;pub use advanced_query_optimizer::QueryPlan;pub use advanced_query_optimizer::TrainingExample;pub use advanced_ml_optimizer::ActivationType;pub use advanced_ml_optimizer::AdvancedMLConfig;pub use advanced_ml_optimizer::AdvancedMLOptimizer;pub use advanced_ml_optimizer::AutoML;pub use advanced_ml_optimizer::DeepCardinalityEstimator;pub use advanced_ml_optimizer::ExplainableAI;pub use advanced_ml_optimizer::JoinType;pub use advanced_ml_optimizer::NeuralArchitectureSearch;pub use advanced_ml_optimizer::OnlineLearningManager;pub use advanced_ml_optimizer::RLJoinOptimizer;pub use advanced_ml_optimizer::TrainingEpoch;pub use advanced_ml_optimizer::TransferLearningManager;pub use advanced_benchmarking::AdvancedBenchmarkConfig;pub use advanced_benchmarking::AdvancedBenchmarkSuite;pub use advanced_benchmarking::BenchmarkResult;pub use advanced_benchmarking::CustomBenchmarkConfig;pub use advanced_benchmarking::CustomBenchmarkGenerator;pub use advanced_benchmarking::LUBMSuite;pub use advanced_benchmarking::RegressionDetectionResult;pub use advanced_benchmarking::SP2BenchSuite;pub use advanced_benchmarking::ScalabilityTestResult;pub use advanced_benchmarking::StressTestResult;pub use advanced_benchmarking::WatDivSuite;pub use advanced_benchmarking::WorkloadCharacterization;pub use advanced_semantic_features::AdvancedSemanticConfig;pub use advanced_semantic_features::AdvancedSemanticFeatures;pub use advanced_semantic_features::AutoMapping;pub use advanced_semantic_features::AutoMappingGenerator;pub use advanced_semantic_features::ChangeType;pub use advanced_semantic_features::ConceptRelationship;pub use advanced_semantic_features::DeepOntologyMatcher;pub use advanced_semantic_features::Entity;pub use advanced_semantic_features::EntityMatch;pub use advanced_semantic_features::EntityResolver;pub use advanced_semantic_features::MappingType;pub use advanced_semantic_features::MatchType;pub use advanced_semantic_features::MultiLingualConcept;pub use advanced_semantic_features::MultiLingualSchemaManager;pub use advanced_semantic_features::OntologyConcept;pub use advanced_semantic_features::OntologyMatch;pub use advanced_semantic_features::RelationType;pub use advanced_semantic_features::SchemaChange;pub use advanced_semantic_features::SchemaEvolutionTracker;pub use advanced_semantic_features::SchemaVersion;pub use advanced_anomaly_detection::AdvancedAnomalyConfig;pub use advanced_anomaly_detection::AdvancedAnomalyDetection;pub use advanced_anomaly_detection::HealingAction;pub use advanced_anomaly_detection::HealingActionType;pub use advanced_anomaly_detection::IsolationForest;pub use advanced_anomaly_detection::IssueType;pub use advanced_anomaly_detection::LSTMPredictor;pub use advanced_anomaly_detection::MaintenancePriority;pub use advanced_anomaly_detection::MaintenanceTask;pub use advanced_anomaly_detection::PredictiveMaintenanceScheduler;pub use advanced_anomaly_detection::RootCause;pub use advanced_anomaly_detection::RootCauseAnalyzer;pub use advanced_anomaly_detection::SelfHealingEngine;pub use advanced_anomaly_detection::Severity as AnomalySeverity;pub use advanced_consensus::AdvancedConsensusSystem;pub use advanced_consensus::ByzantineFaultTolerance;pub use advanced_consensus::DistributedLock;pub use advanced_consensus::GCounter;pub use advanced_consensus::NetworkPartitionDetector;pub use advanced_consensus::PNCounter;pub use advanced_consensus::VectorClock;pub use advanced_enterprise_features::AdvancedEnterpriseFeatures;pub use advanced_enterprise_features::AuditLogEntry;pub use advanced_enterprise_features::AuditLogger;pub use advanced_enterprise_features::AuditResult;pub use advanced_enterprise_features::DataLineageTracker;pub use advanced_enterprise_features::DataSubject;pub use advanced_enterprise_features::DeletionRequest;pub use advanced_enterprise_features::EdgeComputingManager;pub use advanced_enterprise_features::EdgeNode;pub use advanced_enterprise_features::EdgeNodeStatus;pub use advanced_enterprise_features::GDPRComplianceManager;pub use advanced_enterprise_features::GeoLocation;pub use advanced_enterprise_features::GeographicQueryRouter;pub use advanced_enterprise_features::LineageNode;pub use advanced_enterprise_features::MultiTenancyConfig;pub use advanced_enterprise_features::MultiTenancyManager;pub use advanced_enterprise_features::PrivacyPreservingFederation;pub use advanced_enterprise_features::QuantumResistantSecurity;pub use advanced_enterprise_features::ResourceQuota;pub use advanced_enterprise_features::ResourceUsage;pub use advanced_enterprise_features::Tenant;pub use advanced_security_hardening::AdvancedRateLimiter;pub use advanced_security_hardening::AdvancedSecurityHardening;pub use advanced_security_hardening::AuditConfig;pub use advanced_security_hardening::AuditEvent;pub use advanced_security_hardening::AuditEventType;pub use advanced_security_hardening::AuthMethod;pub use advanced_security_hardening::AuthSession;pub use advanced_security_hardening::AuthenticationManager;pub use advanced_security_hardening::ComplianceChecker;pub use advanced_security_hardening::ComplianceFramework;pub use advanced_security_hardening::ComplianceStatus;pub use advanced_security_hardening::EncryptionConfig;pub use advanced_security_hardening::EncryptionKey;pub use advanced_security_hardening::EncryptionManager;pub use advanced_security_hardening::IdsConfig;pub use advanced_security_hardening::IdsResult;pub use advanced_security_hardening::IntrusionDetectionSystem;pub use advanced_security_hardening::MtlsCertificate;pub use advanced_security_hardening::OAuth2Provider;pub use advanced_security_hardening::OidcProvider;pub use advanced_security_hardening::RateLimitConfig;pub use advanced_security_hardening::SecurityAlert;pub use advanced_security_hardening::SecurityCheckResult;pub use advanced_security_hardening::SecurityConfig;pub use advanced_security_hardening::SecurityContext;pub use advanced_security_hardening::ThreatCategory;pub use advanced_security_hardening::ThreatSeverity;pub use advanced_security_hardening::ThreatSignature;pub use advanced_security_hardening::TrustScore;pub use advanced_security_hardening::UserInfo;pub use advanced_security_hardening::Vulnerability;pub use advanced_security_hardening::VulnerabilityScanResult;pub use advanced_security_hardening::VulnerabilityScanner;pub use advanced_security_hardening::VulnerabilitySeverity;pub use advanced_security_hardening::ZeroTrustConfig;pub use advanced_security_hardening::ZeroTrustController;pub use advanced_visualization::AdvancedVisualization;pub use advanced_visualization::AggregationType;pub use advanced_visualization::Alert;pub use advanced_visualization::AlertGrouping;pub use advanced_visualization::AlertSeverity;pub use advanced_visualization::AlertTimeline;pub use advanced_visualization::AlertVisualizer;pub use advanced_visualization::ChartData;pub use advanced_visualization::ChartGenerator;pub use advanced_visualization::ChartSeries;pub use advanced_visualization::ChartTheme;pub use advanced_visualization::ColorScale;pub use advanced_visualization::CustomTheme;pub use advanced_visualization::Dashboard;pub use advanced_visualization::DashboardLayout;pub use advanced_visualization::DataSource;pub use advanced_visualization::EdgeType;pub use advanced_visualization::ExportFormat;pub use advanced_visualization::HeatmapCell;pub use advanced_visualization::HeatmapData;pub use advanced_visualization::LayoutAlgorithm;pub use advanced_visualization::MetricAggregation;pub use advanced_visualization::MetricsCollector;pub use advanced_visualization::NodeStatus;pub use advanced_visualization::NodeType;pub use advanced_visualization::PieChartData;pub use advanced_visualization::PieSlice;pub use advanced_visualization::PositionedNode;pub use advanced_visualization::TimeSeries;pub use advanced_visualization::TopologyEdge;pub use advanced_visualization::TopologyNode;pub use advanced_visualization::TopologyVisualization;pub use advanced_visualization::TopologyVisualizer;pub use advanced_visualization::VisualizationConfig;pub use advanced_visualization::VisualizationType;pub use advanced_visualization::Widget;pub use advanced_visualization::WidgetConfig;pub use advanced_visualization::WidgetPosition;pub use advanced_visualization::WidgetSize;pub use advanced_visualization::WidgetType;pub use advanced_visualization::DataPoint as VizDataPoint;pub use anomaly_detection::AnomalyAlert;pub use anomaly_detection::AnomalyDetector;pub use anomaly_detection::AnomalyDetectorConfig;pub use anomaly_detection::DataPoint;pub use anomaly_detection::Severity;pub use anomaly_detection::Trend;pub use anomaly_detection::TrendAnalysis;pub use auth::AuthManager;pub use automl_pipeline::ArchitectureCandidate;pub use automl_pipeline::AutoMLConfig;pub use automl_pipeline::AutoMLPipeline;pub use automl_pipeline::HyperparameterConfig;pub use automl_pipeline::LayerType;pub use automl_pipeline::MetaLearningTask;pub use automl_pipeline::OptimizationStatistics;pub use automl_pipeline::SearchSpace;pub use automl_pipeline::TrialMetrics;pub use automl_pipeline::TrialResult;pub use cloud_cost_optimizer::CloudCostOptimizer;pub use cloud_cost_optimizer::CloudInstance;pub use cloud_cost_optimizer::CloudProvider;pub use cloud_cost_optimizer::CostOptimizerConfig;pub use cloud_cost_optimizer::CostRecommendation;pub use cloud_cost_optimizer::CostTracking;pub use cloud_cost_optimizer::DeploymentConfig;pub use cloud_cost_optimizer::InstanceStatus;pub use cloud_cost_optimizer::OptimizationStrategy;pub use cloud_cost_optimizer::RecommendationPriority;pub use cloud_cost_optimizer::RecommendationType;pub use cloud_cost_optimizer::RoutingDecision;pub use cloud_cost_optimizer::WorkloadMetrics;pub use connection_pool_manager::ConnectionPoolManager;pub use distributed_ml_trainer::AggregationStrategy;pub use distributed_ml_trainer::DistributedMLConfig;pub use distributed_ml_trainer::DistributedMLTrainer;pub use distributed_ml_trainer::TrainingMetrics;pub use distributed_ml_trainer::TrainingMode;pub use distributed_ml_trainer::WorkerInfo;pub use distributed_ml_trainer::WorkerMetrics;pub use distributed_ml_trainer::WorkerStatus;pub use distributed_tracing::TracingConfig;pub use distributed_transactions::DistributedTransactionCoordinator;pub use distributed_transactions::IsolationLevel;pub use distributed_transactions::Operation;pub use distributed_transactions::OperationState;pub use distributed_transactions::OperationType;pub use distributed_transactions::Participant;pub use distributed_transactions::ParticipantState;pub use distributed_transactions::SagaLog;pub use distributed_transactions::SagaStep;pub use distributed_transactions::SagaStepState;pub use distributed_transactions::Transaction;pub use distributed_transactions::TransactionConfig;pub use distributed_transactions::TransactionProtocol;pub use distributed_transactions::TransactionResult;pub use distributed_transactions::TransactionState;pub use executor::ExecutionStatus;pub use external_ml_integration::ConversionResult;pub use external_ml_integration::DataType;pub use external_ml_integration::ExternalMLIntegration;pub use external_ml_integration::FrameworkAdapter;pub use external_ml_integration::FrameworkCapabilities;pub use external_ml_integration::HuggingFaceAdapter;pub use external_ml_integration::InferenceBackend;pub use external_ml_integration::InferenceEngine;pub use external_ml_integration::MLFramework;pub use external_ml_integration::MLIntegrationConfig;pub use external_ml_integration::MLModel;pub use external_ml_integration::MLTaskType;pub use external_ml_integration::MockModel;pub use external_ml_integration::ModelConverter;pub use external_ml_integration::ModelFormat;pub use external_ml_integration::ModelMetadata;pub use external_ml_integration::ModelRegistry;pub use external_ml_integration::ModelVersion;pub use external_ml_integration::ONNXAdapter;pub use external_ml_integration::OptimizationConfig;pub use external_ml_integration::OptimizationResult;pub use external_ml_integration::PerformanceMetrics;pub use external_ml_integration::PyTorchAdapter;pub use external_ml_integration::RegisteredModel;pub use external_ml_integration::TensorFlowAdapter;pub use external_ml_integration::TensorSpec;pub use gpu_accelerated_query::FilterCondition;pub use gpu_accelerated_query::FilterOperator;pub use gpu_accelerated_query::GpuAccelerationConfig;pub use gpu_accelerated_query::GpuBackendType;pub use gpu_accelerated_query::GpuJoinProcessor;pub use gpu_accelerated_query::GpuProcessingResult;pub use gpu_accelerated_query::GpuProcessingStats;pub use gpu_accelerated_query::GpuQueryProcessor;pub use gpu_accelerated_query::QueryBatch;pub use graph_algorithms::AStar;pub use graph_algorithms::BellmanFord;pub use graph_algorithms::CentralityAnalyzer;pub use graph_algorithms::ConnectivityAnalyzer;pub use graph_algorithms::Dijkstra;pub use graph_algorithms::Edge;pub use graph_algorithms::FederationGraph;pub use graph_algorithms::FloydWarshall;pub use graph_algorithms::PrimMST;pub use graph_algorithms::ShortestPathResult;pub use jit_query_compiler::CompiledQuery;pub use jit_query_compiler::ExecutionMode;pub use jit_query_compiler::JitCompilationConfig;pub use jit_query_compiler::JitCompilationStats;pub use jit_query_compiler::JitQueryCompiler;pub use jit_query_compiler::JitQueryOptimizer;pub use jit_query_compiler::OptimizationRule;pub use ml_model_serving::ABTestConfig;pub use ml_model_serving::ABTestResults;pub use ml_model_serving::MLModelServing;pub use ml_model_serving::ModelMetrics;pub use ml_model_serving::ModelServingConfig;pub use ml_model_serving::ModelStatus;pub use ml_model_serving::ModelType;pub use ml_model_serving::QueryTransformerModel;pub use ml_model_serving::TransformerConfig;pub use ml_model_serving::ModelVersion as MLModelVersion;pub use simd_optimized_joins::JoinAlgorithm;pub use simd_optimized_joins::JoinStatistics;pub use simd_optimized_joins::SimdJoinConfig;pub use simd_optimized_joins::SimdJoinProcessor;pub use ml_optimizer::MLOptimizer;pub use multi_level_federation::FederationCapability;pub use multi_level_federation::FederationMetrics;pub use multi_level_federation::FederationNode;pub use multi_level_federation::MultiLevelConfig;pub use multi_level_federation::MultiLevelFederation;pub use multi_level_federation::TopologyOptimizationResult;pub use multi_level_federation::TopologyStats;pub use network_optimizer::NetworkOptimizer;pub use optimization_cache::OptimizationCache;pub use production_hardening::CircuitBreakerState;pub use production_hardening::ComplexityResult;pub use production_hardening::HardeningConfig;pub use production_hardening::HardeningStatistics;pub use production_hardening::ProductionHardening;pub use production_hardening::QueryRequest as HardeningQueryRequest;pub use production_hardening::ValidationResult;pub use schema_alignment::Alignment;pub use schema_alignment::AlignmentConfig;pub use schema_alignment::AlignmentResult;pub use schema_alignment::AlignmentType;pub use schema_alignment::ClassMetadata;pub use schema_alignment::MappingExample;pub use schema_alignment::PropertyMetadata;pub use schema_alignment::SchemaAligner;pub use schema_alignment::VocabularyMetadata;pub use semantic_reasoner::InconsistencyReport;pub use semantic_reasoner::InconsistencyType;pub use semantic_reasoner::ReasonerConfig;pub use semantic_reasoner::SemanticReasoner;pub use semantic_reasoner::Triple;pub use join_optimizer::JoinOptimizer;pub use planner::EntityResolutionPlan;pub use planner::EntityResolutionStep;pub use planner::ExecutionContext;pub use planner::ExecutionPlan;pub use planner::ExecutionStep;pub use planner::FederatedQueryPlanner;pub use planner::FederatedSchema;pub use planner::FilterExpression;pub use planner::GraphQLOperationType;pub use planner::HistoricalPerformance;pub use planner::ParsedQuery;pub use planner::QueryInfo;pub use planner::QueryType;pub use planner::ReoptimizationAnalysis;pub use planner::RetryConfig;pub use planner::ServiceQuery;pub use planner::StepType;pub use planner::TriplePattern;pub use planner::UnifiedSchema;pub use query_decomposition::advanced_pattern_analysis::AdvancedPatternAnalyzer;pub use query_decomposition::advanced_pattern_analysis::ComplexityAssessment;pub use query_decomposition::advanced_pattern_analysis::OptimizationOpportunity;pub use query_decomposition::advanced_pattern_analysis::PatternAnalysisResult;pub use query_decomposition::advanced_pattern_analysis::ServiceRecommendation;pub use query_decomposition::types::QueryDecomposer;pub use query_plan_explainer::ExplainFormat;pub use query_plan_explainer::OptimizationSuggestion;pub use query_plan_explainer::PlanExplanation;pub use query_plan_explainer::QueryPlanExplainer;pub use query_plan_explainer::StepExplanation;pub use query_plan_explainer::SuggestionCategory;pub use query_plan_explainer::SuggestionSeverity;pub use request_batcher::RequestBatcher;pub use result_streaming::ResultStreamingManager;pub use semantic_enhancer::SemanticEnhancer;pub use service::AuthCredentials;pub use service::FederatedService;pub use service::ServiceAuthConfig;pub use service::ServiceCapability;pub use service::ServicePerformance;pub use service::ServiceType;pub use service_client::ServiceClient;pub use service_executor::ServiceExecutor;pub use service_optimizer::ServiceOptimizer;pub use service_registry::GraphQLService;pub use service_registry::HealthStatus as ServiceHealthStatus;pub use service_registry::ServiceCapabilities;pub use service_registry::SparqlEndpoint;pub use materialized_views::PatternFeatures;pub use materialized_views::TemporalRange;pub use privacy::*;
Modules§
- adaptive_
load_ balancer - Adaptive Load Balancer for Federated Services
- advanced_
anomaly_ detection - Advanced Anomaly Detection and Self-Healing
- advanced_
benchmarking - Advanced Benchmarking Suite for Federated Query Optimization
- advanced_
consensus - Advanced Consensus Features
- advanced_
enterprise_ features - Advanced Enterprise Features
- advanced_
ml_ optimizer - Advanced Machine Learning Query Optimization Module
- advanced_
query_ optimizer - Advanced Query Optimization for Federated SPARQL/GraphQL
- advanced_
security_ hardening - Advanced Security Hardening Module
- advanced_
semantic_ features - Advanced Semantic Features for Federation
- advanced_
visualization - Advanced Visualization & Dashboarding Module
- anomaly_
detection - Advanced Anomaly Detection for Failure Prediction
- auth
- Multi-Service Authentication and Identity Propagation
- auto_
discovery - Automatic Service Discovery
- automl_
pipeline - Enhanced AutoML Pipeline for Federated Query Optimization
- cache
- Advanced Caching System for Federation
- capability_
assessment - Service Capability Assessment
- cdc
- Change Data Capture (CDC) Module
- cloud_
cost_ optimizer - Cloud-Native Deployment and Cost Optimization
- connection_
pool_ manager - Enhanced Connection Pool Manager
- discovery
- Service Discovery and Capability Detection
- distributed_
consensus - Distributed Consensus for Multi-Level Federations
- distributed_
ml_ trainer - Distributed ML Training Infrastructure for Federated Query Optimization
- distributed_
tracing - Distributed Tracing for Federation Queries
- distributed_
transactions - Distributed Transaction Coordinator
- executor
- Federated Query Execution Engine
- external_
ml_ integration - External ML Frameworks Integration
- gpu_
accelerated_ query - This module provides GPU acceleration for federated query operations using scirs2-core’s GPU abstractions. It enables high-performance parallel processing of large-scale RDF graph queries across distributed endpoints.
- graph_
algorithms - Graph Algorithms for Federation Routing
- graphql
- GraphQL Federation and Schema Stitching
- integration
- Result Integration and Processing
- jit_
query_ compiler - JIT Query Compilation Module
- join_
optimizer - Join Optimizer - Modular Implementation
- k8s_
discovery - Kubernetes Service Discovery for Federated Services
- materialized_
views - Materialized Views Module
- memory_
efficient_ datasets - Memory-Efficient Large Dataset Handler
- metadata
- Extended metadata management for federated services
- ml_
model_ serving - ML Model Serving Infrastructure for Federated Query Optimization
- ml_
optimizer - Machine Learning-Driven Query Optimization Module
- monitoring
- Federation Monitoring and Metrics
- multi_
level_ federation - Multi-Level (Hierarchical) Federation Support
- nats_
federation - NATS-based Federation Communication
- network_
optimizer - Network Optimization for Federated Queries
- optimization_
cache - Intelligent Query Optimization Cache Module
- performance_
analyzer - Comprehensive Performance Analysis Engine
- performance_
benchmarks - Performance Benchmarking Suite for Federation Operations
- planner
- Federated Query Planner
- privacy
- Privacy Protection and Compliance Module
- production_
hardening - Production Hardening - Resilience, Security, and Operational Excellence
- profiling_
metrics - Advanced Profiling and Metrics Integration
- query_
decomposition - Advanced Query Decomposition for Federated Execution
- query_
plan_ explainer - Query Plan Explainer and Visualizer
- request_
batcher - Request Batching Optimization
- result_
streaming - Query Result Compression and Streaming
- schema_
alignment - Schema Alignment and Ontology Mapping for Federated RDF/SPARQL
- semantic_
enhancer - Semantic Enhancement and Knowledge Graph Completion Module
- semantic_
reasoner - Semantic Reasoner for RDFS/OWL Inference
- service
- Service Registry and Management
- service_
client - Service Clients for SPARQL and GraphQL endpoints
- service_
executor - Advanced SERVICE Clause Execution
- service_
optimizer - SERVICE Clause Optimization and Rewriting
- service_
registry - Auto-generated module structure
- simd_
optimized_ joins - SIMD-Optimized Join Operations Module
- source_
selection - Advanced Source Selection Algorithms
- streaming
- Real-Time Streaming Query Support Module
- streaming_
optimizer - Streaming Protocols Optimization
- test_
infrastructure - Enhanced Test Infrastructure for Federation Testing
- vector_
similarity_ federation - Vector Similarity Federation
Structs§
- Execution
Metadata - Metadata about query execution
- Extended
Service Metadata - Extended service metadata for enhanced optimization
- Federated
Result - Result of a federated query execution
- Federation
Config - Configuration for the federation engine
- Federation
Engine - Main federation engine that coordinates all federated query processing
- Federation
Stats - Statistics about federation performance
- Health
Status - Health status of the federation system
- Numeric
Range - Numeric range for numeric services
- Performance
Record - Performance record for service history
- Spatial
Coverage - Spatial coverage for geospatial services
Enums§
- Federation
Error - Federation-specific error types
- Query
Result - Enumeration of different query result types
- Service
Status - Service status enumeration
- Spatial
Coverage Type - Types of spatial coverage