1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
"""
Briefcase SDK - OpenTelemetry instrumentation for AI applications.
This module provides comprehensive observability, versioning, and compliance
features for AI applications including lakeFS integration, multi-agent
correlation, RAG versioning, and external data tracking.
Phase 1 Features:
- lakeFS commit SHA capture for knowledge base versioning
- Multi-agent workflow correlation with automatic trace propagation
- Compliance report generation (SOC2, HIPAA, GDPR)
Phase 2 Features:
- RAG component versioning (documents, embeddings, indices)
- External data source versioning and snapshot management
- Vector database integrations (Pinecone, Weaviate, Chroma)
Phase 3 Features:
- Prompt-knowledge validation engine (3-layer architecture)
- Reference extraction and resolution against lakeFS
- Semantic validation with LLM-based content checking
- Multiple validation modes (strict, tolerant, warn-only)
Usage:
from briefcase.integrations.lakefs import lakefs_context, lakefs_versioned
from briefcase.correlation import briefcase_workflow
from briefcase.compliance.reports import SOC2ReportGenerator
from briefcase.rag import VersionedEmbeddingPipeline
from briefcase.external_data import ExternalDataTracker
from briefcase.validation import PromptValidationEngine
Example:
# lakeFS versioning
with lakefs_context(client, "acme-healthcare", "main") as lakefs:
policy = lakefs.read_object("policies/policy.pdf")
# Multi-agent correlation
with briefcase_workflow("prior_auth", client) as workflow:
result1 = agent1.process(data)
result2 = agent2.process(result1)
# Compliance reporting
generator = SOC2ReportGenerator(client)
report = generator.evaluate("acme", "main", start_date, end_date)
Version: 2.4.1
"""
=
# Import key components
=