Struct rusoto_kendra::SeedUrlConfiguration [−][src]
pub struct SeedUrlConfiguration { pub seed_urls: Vec<String>, pub web_crawler_mode: Option<String>, }
Expand description
Provides the configuration information of the seed or starting point URLs to crawl.
When selecting websites to index, you must adhere to the Amazon Acceptable Use Policy and all other Amazon terms. Remember that you must only use the Amazon Kendra web crawler to index your own webpages, or webpages that you have authorization to index.
Fields
seed_urls: Vec<String>
The list of seed or starting point URLs of the websites you want to crawl.
The list can include a maximum of 100 seed URLs.
web_crawler_mode: Option<String>
You can choose one of the following modes:
-
HOST_ONLY
– crawl only the website host names. For example, if the seed URL is "abc.example.com", then only URLs with host name "abc.example.com" are crawled. -
SUBDOMAINS
– crawl the website host names with subdomains. For example, if the seed URL is "abc.example.com", then "a.abc.example.com" and "b.abc.example.com" are also crawled. -
EVERYTHING
– crawl the website host names with subdomains and other domains that the webpages link to.
The default mode is set to HOST_ONLY
.
Trait Implementations
Returns the “default value” for a type. Read more
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error> where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error> where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
This method tests for self
and other
values to be equal, and is used
by ==
. Read more
This method tests for !=
.
Auto Trait Implementations
impl RefUnwindSafe for SeedUrlConfiguration
impl Send for SeedUrlConfiguration
impl Sync for SeedUrlConfiguration
impl Unpin for SeedUrlConfiguration
impl UnwindSafe for SeedUrlConfiguration
Blanket Implementations
Mutably borrows from an owned value. Read more
Instruments this type with the provided Span
, returning an
Instrumented
wrapper. Read more
type Output = T
type Output = T
Should always be Self