Struct HtmlToMarkdownTransformer 

pub struct HtmlToMarkdownTransformer { /* private fields */ }

Available on crate feature scraping only.

Transforms HTML content into markdown.

Useful for converting scraping results into markdown.

Implementations

impl HtmlToMarkdownTransformer

pub fn builder() -> HtmlToMarkdownTransformerBuilder

Creates a new builder for the transformer

pub fn from_client( client: impl SimplePrompt + 'static, ) -> HtmlToMarkdownTransformerBuilder

Build a new transformer from a client

pub fn new(client: impl SimplePrompt + 'static) -> Self

Create a new transformer from a client

pub fn with_concurrency(self, concurrency: usize) -> Self

Set the concurrency level for the transformer

Trait Implementations

impl Clone for HtmlToMarkdownTransformer

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for HtmlToMarkdownTransformer

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for HtmlToMarkdownTransformer

fn default() -> Self

Returns the “default value” for a type.

impl Transformer for HtmlToMarkdownTransformer

fn transform_node<'life0, 'async_trait>( &'life0 self, node: TextNode, ) -> Pin<Box<dyn Future<Output = Result<TextNode>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Converts the HTML content in the TextNode to markdown.

Will Err the node if the conversion fails.

type Input = String

type Output = String

fn concurrency(&self) -> Option<usize>

Overrides the default concurrency of the pipeline

fn name(&self) -> &'static str

impl WithIndexingDefaults for HtmlToMarkdownTransformer

fn with_indexing_defaults(&mut self, defaults: IndexingDefaults)