Skip to main content

ScrapingService

stygian_graph::ports

Trait ScrapingService 

Source 
pub trait ScrapingService: Send + Sync {
    // Required methods
    fn execute<'life0, 'async_trait>(
        &'life0 self,
        input: ServiceInput,
    ) -> Pin<Box<dyn Future<Output = Result<ServiceOutput>> + Send + 'async_trait>>
       where Self: 'async_trait,
             'life0: 'async_trait;
    fn name(&self) -> &'static str;
}
Expand description

Primary port: ScrapingService trait

All scraping modules (HTTP, browser, JavaScript rendering) implement this trait. Uses async_trait for dyn compatibility with service registry.

§Example Implementation

use stygian_graph::ports::{ScrapingService, ServiceInput, ServiceOutput};
use stygian_graph::error::Result;
use async_trait::async_trait;
use serde_json::json;

struct MyService;

#[async_trait]
impl ScrapingService for MyService {
    async fn execute(&self, input: ServiceInput) -> Result<ServiceOutput> {
        Ok(ServiceOutput {
            data: format!("Scraped: {}", input.url),
            metadata: json!({"status": "ok"}),
        })
    }
     
    fn name(&self) -> &'static str {
        "my-service"
    }
}

Required Methods§

Source

fn execute<'life0, 'async_trait>( &'life0 self, input: ServiceInput, ) -> Pin<Box<dyn Future<Output = Result<ServiceOutput>> + Send + 'async_trait>>
where Self: 'async_trait, 'life0: 'async_trait,

Execute the scraping operation

§Arguments
  • input - Service input containing URL and parameters
§Returns
  • Ok(ServiceOutput) - Successful scraping result
  • Err(StygianError) - Service error, timeout, or network failure
§Example
let input = ServiceInput {
    url: "https://example.com".to_string(),
    params: json!({}),
};
let output = service.execute(input).await.unwrap();
println!("Data: {}", output.data);
Source

fn name(&self) -> &'static str

Service name for identification in logs and metrics

§Example
println!("Using service: {}", service.name());

Dyn Compatibility§

This trait is dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety".

Implementors§