Struct ItemList 

pub struct ItemList(/* private fields */);

A collection of scraped JSON items with serialization helpers.

ItemList wraps a Vec<serde_json::Value> and adds convenience methods for writing the collected data to disk as JSON or JSON Lines. It implements IntoIterator, Index, and the standard len / is_empty API so you can treat it like a regular collection.

Implementations

impl ItemList

pub fn new() -> Self

Creates an empty item list. This is equivalent to ItemList::default() and is what the crawler engine uses at the start of every crawl run.

pub fn push(&mut self, item: Value)

Appends a JSON item to the list. The engine calls this for every item that passes through Spider::on_scraped_item without being dropped.

pub fn len(&self) -> usize

Returns the number of items in the list.

pub fn is_empty(&self) -> bool

Returns true if the list contains no items.

pub fn iter(&self) -> Iter<'_, Value>

Returns an iterator over the items.

pub fn to_json(&self, path: &Path, indent: bool) -> Result<()>

Writes all items to a JSON file at path, optionally pretty-printed. Parent directories are created automatically if they do not exist. Pass indent: true for human-readable output or false for compact output.

pub fn to_jsonl(&self, path: &Path) -> Result<()>

Writes all items to a JSON Lines file (one JSON object per line). This format is convenient for streaming ingestion into data pipelines because each line is a self-contained JSON document. Parent directories are created automatically.

Trait Implementations

impl Debug for ItemList

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ItemList

fn default() -> ItemList

Returns the “default value” for a type.

impl Index<usize> for ItemList

type Output = Value

The returned type after indexing.

fn index(&self, idx: usize) -> &Self::Output

Performs the indexing (container[index]) operation.

impl<'a> IntoIterator for &'a ItemList

type Item = &'a Value

The type of the elements being iterated over.

type IntoIter = Iter<'a, Value>

Which kind of iterator are we turning this into?

fn into_iter(self) -> Self::IntoIter

Creates an iterator from a value.

impl IntoIterator for ItemList

type Item = Value

The type of the elements being iterated over.

type IntoIter = IntoIter<Value>

Which kind of iterator are we turning this into?

fn into_iter(self) -> Self::IntoIter

Creates an iterator from a value.