Production infrastructure for AI agents

Website · Documentation · Guides · Core · Template · Discord

systemprompt-content

Markdown content management, sources, and event tracking for systemprompt.io AI governance dashboards. Governed publishing pipeline for the MCP governance platform with content ingestion, full-text search, link tracking, and UTM analytics.

Layer: Domain — business-logic modules that implement systemprompt.io features. Part of the systemprompt-core workspace.

Overview

Integrations · Skill Marketplace

This crate handles all content-related functionality:

• Content Management: CRUD operations for markdown content with frontmatter metadata
• Content Ingestion: Parse and ingest markdown files from configured directories
• Search: Full-text search across content with category filtering
• Link Tracking: Campaign links with UTM parameters and click analytics
• Configuration: Validated content source configuration with routing

Usage

[dependencies]
systemprompt-content = "0.9.0"

use systemprompt_content::{
    // Models
    Content, ContentMetadata, IngestionOptions, IngestionReport,
    IngestionSource, SearchFilters, SearchRequest, SearchResponse,
    SearchResult, UpdateContentParams, LinkType, TrackClickParams, UtmParams,

    // Repositories
    ContentRepository, LinkAnalyticsRepository, SearchRepository,

    // Services
    DefaultContentProvider, IngestionService, LinkAnalyticsService,
    LinkGenerationService, SearchService, GenerateLinkParams,

    // Jobs
    execute_content_ingestion,

    // Extension
    ContentExtension,

    // Default providers
    DefaultBrandingProvider, DefaultHomepagePrerenderer,
    DefaultListBrandingProvider, ListItemsCardRenderer,

    // Config
    ContentConfigValidated, ContentReady, ContentSourceConfigValidated,
    LoadStats, ParsedContent, ValidationResult,

    // Error
    ContentError, ContentResult,

    // Validation
    validate_content_metadata,
};

File Structure

src/
├── config/
│   ├── mod.rs                      # Config exports
│   ├── validated.rs                # ContentConfigValidated (validation logic)
│   └── ready.rs                    # ContentReady (loaded content cache)
├── jobs/
│   ├── mod.rs                      # Job exports
│   └── content_ingestion.rs        # execute_content_ingestion entrypoint
├── models/
│   ├── mod.rs                      # Model exports
│   ├── builders/
│   │   ├── mod.rs                  # Builder exports
│   │   ├── content.rs              # CreateContentParams, UpdateContentParams
│   │   └── link.rs                 # CreateLinkParams, RecordClickParams, TrackClickParams
│   ├── content.rs                  # Content, ContentMetadata, IngestionReport, Tag
│   ├── content_error.rs            # ContentValidationError
│   ├── link.rs                     # CampaignLink, LinkClick, LinkPerformance, UtmParams
│   └── search.rs                   # SearchRequest, SearchResponse, SearchResult
├── repository/
│   ├── mod.rs                      # Repository exports
│   ├── content/
│   │   ├── mod.rs                  # ContentRepository
│   │   ├── queries.rs              # Read operations (get, list)
│   │   └── mutations.rs            # Write operations (create, update, delete)
│   ├── link/
│   │   ├── mod.rs                  # LinkRepository
│   │   └── analytics.rs            # LinkAnalyticsRepository
│   └── search/
│       └── mod.rs                  # SearchRepository
├── services/
│   ├── mod.rs                      # Service exports
│   ├── content_provider.rs         # DefaultContentProvider (implements ContentProvider)
│   ├── ingestion/
│   │   ├── mod.rs                  # IngestionService
│   │   └── scanner.rs              # Directory scanning, file validation
│   ├── link/
│   │   ├── mod.rs                  # Link service exports
│   │   ├── analytics.rs            # LinkAnalyticsService
│   │   └── generation.rs           # LinkGenerationService
│   ├── search/
│   │   └── mod.rs                  # SearchService
│   └── validation/
│       └── mod.rs                  # Content metadata validation
├── branding_provider.rs            # DefaultBrandingProvider
├── homepage_prerenderer.rs         # DefaultHomepagePrerenderer
├── list_branding_provider.rs       # DefaultListBrandingProvider
├── list_items_renderer.rs          # ListItemsCardRenderer
├── extension.rs                    # ContentExtension (schema + job registration)
├── error.rs                        # ContentError enum (thiserror)
└── lib.rs                          # Crate root with public exports

Modules

config/

Content source configuration validation and caching. ContentConfigValidated validates YAML configuration, ContentReady loads and caches parsed content for fast access.

jobs/

Background jobs for content processing. execute_content_ingestion scans configured directories and syncs markdown content to the database, registered via ContentExtension.

models/

Domain types for content, links, and search. Builder pattern used for complex parameter types (CreateContentParams, TrackClickParams).

repository/

Database access layer using SQLX macros for compile-time SQL verification. Repositories handle data persistence with no business logic. Split into queries.rs (reads) and mutations.rs (writes) for clarity.

services/

Business logic layer. Services coordinate repositories and implement domain operations:

• DefaultContentProvider: Implements the ContentProvider trait for downstream consumers
• IngestionService: Directory scanning and content parsing
• SearchService: Category and keyword search
• LinkGenerationService: Campaign link creation with UTM parameters
• LinkAnalyticsService: Click tracking and performance metrics

Dependencies

Internal (shared/):

• systemprompt-models - Cross-crate model types
• systemprompt-identifiers - Typed IDs (ContentId, LinkId, etc.)
• systemprompt-traits - ContentProvider, Job traits
• systemprompt-provider-contracts - Job registration macros

Internal (infra/):

• systemprompt-database - Database pool abstraction
• systemprompt-logging - Logging infrastructure
• systemprompt-cloud - Cloud integration types
• systemprompt-extension - Extension framework

Traits Implemented

• ContentProvider (systemprompt-traits) - DefaultContentProvider
• Extension (systemprompt-extension) - ContentExtension (registers schema + ingestion job)
• ContentRouting (systemprompt-models) - ContentConfigValidated, ContentReady

License

BSL-1.1 (Business Source License). Source-available for evaluation, testing, and non-production use. Production use requires a commercial license. Each version converts to Apache 2.0 four years after publication. See LICENSE.

systemprompt.io · Documentation · Guides · Live Demo · Template · crates.io · docs.rs · Discord

Domain layer · Own how your organization uses AI.