Struct SeedUrlConfiguration 

#[non_exhaustive]
pub struct SeedUrlConfiguration {
    pub seed_urls: Vec<String>,
    pub web_crawler_mode: Option<WebCrawlerMode>,
}

Provides the configuration information for the seed or starting point URLs to crawl.

When selecting websites to index, you must adhere to the Amazon Acceptable Use Policy and all other Amazon terms. Remember that you must only use Amazon Kendra Web Crawler to index your own web pages, or web pages that you have authorization to index.

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

seed_urls: Vec<String>

The list of seed or starting point URLs of the websites you want to crawl.

The list can include a maximum of 100 seed URLs.

web_crawler_mode: Option<WebCrawlerMode>

You can choose one of the following modes:

• HOST_ONLY—crawl only the website host names. For example, if the seed URL is "abc.example.com", then only URLs with host name "abc.example.com" are crawled.

• SUBDOMAINS—crawl the website host names with subdomains. For example, if the seed URL is "abc.example.com", then "a.abc.example.com" and "b.abc.example.com" are also crawled.

• EVERYTHING—crawl the website host names with subdomains and other domains that the web pages link to.

The default mode is set to HOST_ONLY.

Implementations

impl SeedUrlConfiguration

pub fn seed_urls(&self) -> &[String]

The list of seed or starting point URLs of the websites you want to crawl.

The list can include a maximum of 100 seed URLs.

pub fn web_crawler_mode(&self) -> Option<&WebCrawlerMode>

You can choose one of the following modes:

• HOST_ONLY—crawl only the website host names. For example, if the seed URL is "abc.example.com", then only URLs with host name "abc.example.com" are crawled.

• SUBDOMAINS—crawl the website host names with subdomains. For example, if the seed URL is "abc.example.com", then "a.abc.example.com" and "b.abc.example.com" are also crawled.

• EVERYTHING—crawl the website host names with subdomains and other domains that the web pages link to.

The default mode is set to HOST_ONLY.

impl SeedUrlConfiguration

pub fn builder() -> SeedUrlConfigurationBuilder

Creates a new builder-style object to manufacture SeedUrlConfiguration.

Trait Implementations

impl Clone for SeedUrlConfiguration

fn clone(&self) -> SeedUrlConfiguration

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SeedUrlConfiguration

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for SeedUrlConfiguration

fn eq(&self, other: &SeedUrlConfiguration) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for SeedUrlConfiguration