Struct nom_locate::LocatedSpanEx

pub struct LocatedSpanEx<T, X> {
    pub offset: usize,
    pub line: u32,
    pub fragment: T,
    pub extra: X,
}

A LocatedSpanEx is a set of meta information about the location of a token, including extra information.

The LocatedSpanEx structure can be used as an input of the nom parsers. It implements all the necessary traits for LocatedSpanEx<&str,X> and LocatedSpanEx<&[u8],X>

Fields

offset: usize

The offset represents the position of the fragment relatively to the input of the parser. It starts at offset 0.

line: u32

The line number of the fragment relatively to the input of the parser. It starts at line 1.

fragment: T

The fragment that is spanned. The fragment represents a part of the input of the parser.

extra: X

Extra information that can be embededd by the user. Example: the parsed file name

Methods

impl<T: AsBytes> LocatedSpanEx<T, ()>

pub fn new(program: T) -> LocatedSpanEx<T, ()>

Create a span for a particular input with default offset and line values and empty extra data. You can compute the column through the get_column or get_utf8_column methods.

offset starts at 0, line starts at 1, and column starts at 1.

Example of use

use nom_locate::LocatedSpanEx;

let span = LocatedSpanEx::new(b"foobar");

assert_eq!(span.offset,         0);
assert_eq!(span.line,           1);
assert_eq!(span.get_column(),   1);
assert_eq!(span.fragment,       &b"foobar"[..]);

impl<T: AsBytes, X> LocatedSpanEx<T, X>

pub fn new_extra(program: T, extra: X) -> LocatedSpanEx<T, X>

Create a span for a particular input with default offset and line values. You can compute the column through the get_column or get_utf8_column methods.

offset starts at 0, line starts at 1, and column starts at 1.

Example of use

use nom_locate::LocatedSpanEx;

let span = LocatedSpanEx::new_extra(b"foobar", "extra");

assert_eq!(span.offset,         0);
assert_eq!(span.line,           1);
assert_eq!(span.get_column(),   1);
assert_eq!(span.fragment,       &b"foobar"[..]);
assert_eq!(span.extra,          "extra");

pub fn get_column(&self) -> usize

Return the column index, assuming 1 byte = 1 column.

Use it for ascii text, or use get_utf8_column for UTF8.

Example of use

let span = LocatedSpanEx::new("foobar");

assert_eq!(span.slice(3..).get_column(), 4);

pub fn get_utf8_column(&self) -> usize

Return the column index for UTF8 text. Return value is unspecified for non-utf8 text.

This version uses bytecount's hyper algorithm to count characters. This is much faster for long lines, but is non-negligibly slower for short slices (below around 100 bytes). This is also sped up significantly more depending on architecture and enabling the simd feature gates. If you expect primarily short lines, you may get a noticeable speedup in parsing by using naive_get_utf8_column instead. Benchmark your specific use case!

Example of use

let span = LocatedSpanEx::new("メカジキ");
let indexOf3dKanji = span.find_substring("ジ").unwrap();

assert_eq!(span.slice(indexOf3dKanji..).get_column(), 7);
assert_eq!(span.slice(indexOf3dKanji..).get_utf8_column(), 3);

pub fn naive_get_utf8_column(&self) -> usize

Return the column index for UTF8 text. Return value is unspecified for non-utf8 text.

A simpler implementation of get_utf8_column that may be faster on shorter lines. If benchmarking shows that this is faster, you can use it instead of get_utf8_column. Prefer defaulting to get_utf8_column unless this legitimately is a performance bottleneck.

Example of use

let span = LocatedSpanEx::new("メカジキ");
let indexOf3dKanji = span.find_substring("ジ").unwrap();

assert_eq!(span.slice(indexOf3dKanji..).get_column(), 7);
assert_eq!(span.slice(indexOf3dKanji..).naive_get_utf8_column(), 3);

Trait Implementations

impl<T: Clone, X: Clone> Clone for LocatedSpanEx<T, X>

fn clone(&self) -> LocatedSpanEx<T, X>

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<T: ToString, X> ToString for LocatedSpanEx<T, X>

fn to_string(&self) -> String

Converts the given value to a String.

impl<T: PartialEq, X: PartialEq> PartialEq<LocatedSpanEx<T, X>> for LocatedSpanEx<T, X>

fn eq(&self, other: &LocatedSpanEx<T, X>) -> bool

This method tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &LocatedSpanEx<T, X>) -> bool

This method tests for !=.

impl<T: Copy, X: Copy> Copy for LocatedSpanEx<T, X>

impl<T: Debug, X: Debug> Debug for LocatedSpanEx<T, X>

fn fmt(&self, f: &mut Formatter) -> Result

Formats the value using the given formatter.

impl<'a, X> HexDisplay for LocatedSpanEx<&'a str, X>

fn to_hex(&self, chunk_size: usize) -> String

Converts the value of self to a hex dump, returning the owned string.

fn to_hex_from(&self, chunk_size: usize, from: usize) -> String

Converts the value of self to a hex dump beginning at from address, returning the owned string.

impl<'a, X> HexDisplay for LocatedSpanEx<&'a [u8], X>

fn to_hex(&self, chunk_size: usize) -> String

Converts the value of self to a hex dump, returning the owned string.

fn to_hex_from(&self, chunk_size: usize, from: usize) -> String

Converts the value of self to a hex dump beginning at from address, returning the owned string.

impl<T: InputLength, X> InputLength for LocatedSpanEx<T, X>

fn input_len(&self) -> usize

calculates the input length, as indicated by its name, and the name of the trait itself

impl<T, X> Offset for LocatedSpanEx<T, X>

fn offset(&self, second: &Self) -> usize

offset between the first byte of self and the first byte of the argument

impl<T: AsBytes, X> AsBytes for LocatedSpanEx<T, X>

Important traits for &'_ [u8]

impl<'_> Read for &'_ [u8]impl<'_> Write for &'_ mut [u8]

fn as_bytes(&self) -> &[u8]

casts the input type to a byte slice

impl<'a, X> InputIter for LocatedSpanEx<&'a str, X>

type Item = char

the current input type is a sequence of that Item type.

type Iter = CharIndices<'a>

an iterator over the input type, producing the item and its position for use with [Slice]. If we're iterating over &str, the position corresponds to the byte index of the character

type IterElem = Chars<'a>

an iterator over the input type, producing the item

fn iter_indices(&self) -> Self::Iter

returns an iterator over the elements and their byte offsets

fn iter_elements(&self) -> Self::IterElem

returns an iterator over the elements

fn position<P>(&self, predicate: P) -> Option<usize> where
    P: Fn(Self::Item) -> bool, 

finds the byte position of the element

fn slice_index(&self, count: usize) -> Option<usize>

get the byte offset from the element's position in the stream

impl<'a, X> InputIter for LocatedSpanEx<&'a [u8], X>

type Item = u8

the current input type is a sequence of that Item type.

type Iter = Enumerate<Self::IterElem>

an iterator over the input type, producing the item and its position for use with [Slice]. If we're iterating over &str, the position corresponds to the byte index of the character

type IterElem = Map<Iter<'a, Self::Item>, fn(_: &u8) -> u8>

an iterator over the input type, producing the item

fn iter_indices(&self) -> Self::Iter

returns an iterator over the elements and their byte offsets

fn iter_elements(&self) -> Self::IterElem

returns an iterator over the elements

fn position<P>(&self, predicate: P) -> Option<usize> where
    P: Fn(Self::Item) -> bool, 

finds the byte position of the element

fn slice_index(&self, count: usize) -> Option<usize>

get the byte offset from the element's position in the stream

impl<T, X> InputTake for LocatedSpanEx<T, X> where
    Self: Slice<RangeFrom<usize>> + Slice<RangeTo<usize>>, 

fn take(&self, count: usize) -> Self

returns a slice of count bytes. panics if count > length

fn take_split(&self, count: usize) -> (Self, Self)

split the stream at the count byte offset. panics if count > length

impl<T, X> InputTakeAtPosition for LocatedSpanEx<T, X> where
    T: InputTakeAtPosition + InputLength + InputIter,
    Self: Slice<RangeFrom<usize>> + Slice<RangeTo<usize>> + Clone, 

type Item = <T as InputIter>::Item

the current input type is a sequence of that Item type.

fn split_at_position_complete<P, E: ParseError<Self>>(
    &self,
    predicate: P
) -> IResult<Self, Self, E> where
    P: Fn(Self::Item) -> bool, 

looks for the first element of the input type for which the condition returns true, and returns the input up to this position

fn split_at_position<P, E: ParseError<Self>>(
    &self,
    predicate: P
) -> IResult<Self, Self, E> where
    P: Fn(Self::Item) -> bool, 

looks for the first element of the input type for which the condition returns true, and returns the input up to this position

fn split_at_position1<P, E: ParseError<Self>>(
    &self,
    predicate: P,
    e: ErrorKind
) -> IResult<Self, Self, E> where
    P: Fn(Self::Item) -> bool, 

looks for the first element of the input type for which the condition returns true and returns the input up to this position

fn split_at_position1_complete<P, E: ParseError<Self>>(
    &self,
    predicate: P,
    e: ErrorKind
) -> IResult<Self, Self, E> where
    P: Fn(Self::Item) -> bool, 

looks for the first element of the input type for which the condition returns true and returns the input up to this position

impl<'a, 'b, X> Compare<&'a str> for LocatedSpanEx<&'b str, X>

fn compare(&self, t: &'a str) -> CompareResult

compares self to another value for equality

fn compare_no_case(&self, t: &'a str) -> CompareResult

compares self to another value for equality independently of the case.

impl<'a, 'b, X> Compare<&'a [u8]> for LocatedSpanEx<&'b [u8], X>

fn compare(&self, t: &'a [u8]) -> CompareResult

compares self to another value for equality

fn compare_no_case(&self, t: &'a [u8]) -> CompareResult

compares self to another value for equality independently of the case.

impl<'a, 'b, X> Compare<&'a str> for LocatedSpanEx<&'b [u8], X>

fn compare(&self, t: &'a str) -> CompareResult

compares self to another value for equality

fn compare_no_case(&self, t: &'a str) -> CompareResult

compares self to another value for equality independently of the case.

impl<A: Compare<B>, B, X, Y> Compare<LocatedSpanEx<B, X>> for LocatedSpanEx<A, Y>

fn compare(&self, t: LocatedSpanEx<B, X>) -> CompareResult

compares self to another value for equality

fn compare_no_case(&self, t: LocatedSpanEx<B, X>) -> CompareResult

compares self to another value for equality independently of the case.

impl<Fragment: FindToken<Token>, Token, X> FindToken<Token> for LocatedSpanEx<Fragment, X>

fn find_token(&self, token: Token) -> bool

returns true if self contains the token

impl<'a, T, X> FindSubstring<&'a str> for LocatedSpanEx<T, X> where
    T: FindSubstring<&'a str>, 

fn find_substring(&self, substr: &'a str) -> Option<usize>

returns the byte position of the substring if it is found

impl<R: FromStr, T, X> ParseTo<R> for LocatedSpanEx<T, X> where
    T: ParseTo<R>, 

fn parse_to(&self) -> Option<R>

succeeds if parse() succeeded. The byte slice implementation will first convert it to a &str, then apply the parse() function

impl<'a, X: Clone> Slice<Range<usize>> for LocatedSpanEx<&'a str, X>

fn slice(&self, range: Range<usize>) -> Self

slices self according to the range argument

impl<'a, X: Clone> Slice<RangeTo<usize>> for LocatedSpanEx<&'a str, X>

fn slice(&self, range: RangeTo<usize>) -> Self

slices self according to the range argument

impl<'a, X: Clone> Slice<RangeFrom<usize>> for LocatedSpanEx<&'a str, X>

fn slice(&self, range: RangeFrom<usize>) -> Self

slices self according to the range argument

impl<'a, X: Clone> Slice<RangeFull> for LocatedSpanEx<&'a str, X>

fn slice(&self, range: RangeFull) -> Self

slices self according to the range argument

impl<'a, X: Clone> Slice<Range<usize>> for LocatedSpanEx<&'a [u8], X>

fn slice(&self, range: Range<usize>) -> Self

slices self according to the range argument

impl<'a, X: Clone> Slice<RangeTo<usize>> for LocatedSpanEx<&'a [u8], X>

fn slice(&self, range: RangeTo<usize>) -> Self

slices self according to the range argument

impl<'a, X: Clone> Slice<RangeFrom<usize>> for LocatedSpanEx<&'a [u8], X>

fn slice(&self, range: RangeFrom<usize>) -> Self

slices self according to the range argument

impl<'a, X: Clone> Slice<RangeFull> for LocatedSpanEx<&'a [u8], X>

fn slice(&self, range: RangeFull) -> Self

slices self according to the range argument

impl<'a, X> ExtendInto for LocatedSpanEx<&'a str, X>

type Item = char

the current input type is a sequence of that Item type.

type Extender = String

the type that will be produced

fn new_builder(&self) -> Self::Extender

create a new Extend of the correct type

fn extend_into(&self, acc: &mut Self::Extender)

accumulate the input into an accumulator

impl<'a, X> ExtendInto for LocatedSpanEx<&'a [u8], X>

type Item = u8

the current input type is a sequence of that Item type.

type Extender = Vec<u8>

the type that will be produced

fn new_builder(&self) -> Self::Extender

create a new Extend of the correct type

fn extend_into(&self, acc: &mut Self::Extender)

accumulate the input into an accumulator