Struct nom_locate::LocatedSpan

source ·
pub struct LocatedSpan<T, X = ()> {
    pub extra: X,
    /* private fields */
}
Expand description

A LocatedSpan is a set of meta information about the location of a token, including extra information.

The LocatedSpan structure can be used as an input of the nom parsers. It implements all the necessary traits for LocatedSpan<&str,X> and LocatedSpan<&[u8],X>

Fields§

§extra: X

Extra information that can be embedded by the user. Example: the parsed file name

Implementations§

source§

impl<T> LocatedSpan<T, ()>

source

pub fn new(program: T) -> LocatedSpan<T, ()>

Create a span for a particular input with default offset and line values and empty extra data. You can compute the column through the get_column or get_utf8_column methods.

offset starts at 0, line starts at 1, and column starts at 1.

Do not use this constructor in parser functions; nom and nom_locate assume span offsets are relative to the beginning of the same input. In these cases, you probably want to use the nom::traits::Slice trait instead.

Example of use
use nom_locate::LocatedSpan;

let span = LocatedSpan::new(b"foobar");

assert_eq!(span.location_offset(), 0);
assert_eq!(span.location_line(),   1);
assert_eq!(span.get_column(),      1);
assert_eq!(span.fragment(),        &&b"foobar"[..]);
Examples found in repository?
examples/position.rs (line 33)
32
33
34
35
36
37
38
39
40
41
42
43
44
45
fn main() {
    let input = Span::new("Lorem ipsum \n foobar");
    let output = parse_foobar(input);
    let position = output.unwrap().1.position;
    assert_eq!(position, unsafe {
        Span::new_from_raw_offset(
            14, // offset
            2,  // line
            "", // fragment
            (), // extra
        )
    });
    assert_eq!(position.get_column(), 2);
}
source§

impl<T, X> LocatedSpan<T, X>

source

pub fn new_extra(program: T, extra: X) -> LocatedSpan<T, X>

Create a span for a particular input with default offset and line values. You can compute the column through the get_column or get_utf8_column methods.

offset starts at 0, line starts at 1, and column starts at 1.

Do not use this constructor in parser functions; nom and nom_locate assume span offsets are relative to the beginning of the same input. In these cases, you probably want to use the nom::traits::Slice trait instead.

Example of use
use nom_locate::LocatedSpan;

let span = LocatedSpan::new_extra(b"foobar", "extra");

assert_eq!(span.location_offset(), 0);
assert_eq!(span.location_line(),   1);
assert_eq!(span.get_column(),      1);
assert_eq!(span.fragment(),        &&b"foobar"[..]);
assert_eq!(span.extra,             "extra");
source

pub unsafe fn new_from_raw_offset( offset: usize, line: u32, fragment: T, extra: X ) -> LocatedSpan<T, X>

Similar to new_extra, but allows overriding offset and line. This is unsafe, because giving an offset too large may result in undefined behavior, as some methods move back along the fragment assuming any negative index within the offset is valid.

Examples found in repository?
examples/position.rs (lines 37-42)
32
33
34
35
36
37
38
39
40
41
42
43
44
45
fn main() {
    let input = Span::new("Lorem ipsum \n foobar");
    let output = parse_foobar(input);
    let position = output.unwrap().1.position;
    assert_eq!(position, unsafe {
        Span::new_from_raw_offset(
            14, // offset
            2,  // line
            "", // fragment
            (), // extra
        )
    });
    assert_eq!(position.get_column(), 2);
}
source

pub fn location_offset(&self) -> usize

The offset represents the position of the fragment relatively to the input of the parser. It starts at offset 0.

source

pub fn location_line(&self) -> u32

The line number of the fragment relatively to the input of the parser. It starts at line 1.

source

pub fn fragment(&self) -> &T

The fragment that is spanned. The fragment represents a part of the input of the parser.

Examples found in repository?
examples/position.rs (line 26)
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
fn parse_foobar(s: Span) -> IResult<Span, Token> {
    let (s, _) = take_until("foo")(s)?;
    let (s, pos) = position(s)?;
    let (s, foo) = tag("foo")(s)?;
    let (s, bar) = tag("bar")(s)?;

    Ok((
        s,
        Token {
            position: pos,
            _foo: foo.fragment(),
            _bar: bar.fragment(),
        },
    ))
}
source

pub fn map_extra<U, F: FnOnce(X) -> U>(self, f: F) -> LocatedSpan<T, U>

Transform the extra inside into another type

Example of use
use nom::{
  IResult,
  combinator::{recognize, map_res},
  sequence::{terminated, tuple},
  character::{complete::{char, one_of}, is_digit},
  bytes::complete::{tag, take_while1}
};

fn decimal(input: LocatedSpan<&str>) -> IResult<LocatedSpan<&str>, LocatedSpan<&str>> {
  recognize(
       take_while1(|c| is_digit(c as u8) || c == '_')
  )(input)
}

fn main() {
    let span = LocatedSpan::new("$10");
    // matches the $ and then matches the decimal number afterwards,
    // converting it into a `u8` and putting that value in the span
    let (_, (_, n)) = tuple((
                        tag("$"),
                        map_res(
                            decimal,
                            |x| x.fragment().parse::<u8>().map(|n| x.map_extra(|_| n))
                        )
                      ))(span).unwrap();
    assert_eq!(n.extra, 10);
}
source

pub fn into_fragment(self) -> T

Takes ownership of the fragment without (re)borrowing it.

Example of use
use nom::{
    IResult,
    bytes::complete::{take_till, tag},
    combinator::rest,
};

fn parse_pair<'a>(input: LocatedSpan<&'a str>) -> IResult<LocatedSpan<&'a str>, (&'a str, &'a str)> {
    let (input, key) = take_till(|c| c == '=')(input)?;
    let (input, _) = tag("=")(input)?;
    let (input, value) = rest(input)?;

    Ok((input, (key.into_fragment(), value.into_fragment())))
}

fn main() {
    let span = LocatedSpan::new("key=value");
    let (_, pair) = parse_pair(span).unwrap();
    assert_eq!(pair, ("key", "value"));
}
source

pub fn into_fragment_and_extra(self) -> (T, X)

Takes ownership of the fragment and extra data without (re)borrowing them.

source§

impl<T: AsBytes, X> LocatedSpan<T, X>

source

pub fn get_line_beginning(&self) -> &[u8]

Return the line that contains this LocatedSpan.

The get_column and get_utf8_column functions returns indexes that corresponds to the line returned by this function.

Note that if this LocatedSpan ends before the end of the original data, the result of calling get_line_beginning() will not include any data from after the LocatedSpan.

let program = LocatedSpan::new(
    "Hello World!\
    \nThis is a multi-line input\
    \nthat ends after this line.\n");
let multi = program.find_substring("multi").unwrap();

assert_eq!(
    program.slice(multi..).get_line_beginning(),
    "This is a multi-line input".as_bytes(),
);
source

pub fn get_column(&self) -> usize

Return the column index, assuming 1 byte = 1 column.

Use it for ascii text, or use get_utf8_column for UTF8.

Example of use

let span = LocatedSpan::new("foobar");

assert_eq!(span.slice(3..).get_column(), 4);
Examples found in repository?
examples/position.rs (line 44)
32
33
34
35
36
37
38
39
40
41
42
43
44
45
fn main() {
    let input = Span::new("Lorem ipsum \n foobar");
    let output = parse_foobar(input);
    let position = output.unwrap().1.position;
    assert_eq!(position, unsafe {
        Span::new_from_raw_offset(
            14, // offset
            2,  // line
            "", // fragment
            (), // extra
        )
    });
    assert_eq!(position.get_column(), 2);
}
source

pub fn get_utf8_column(&self) -> usize

Return the column index for UTF8 text. Return value is unspecified for non-utf8 text.

This version uses bytecount’s hyper algorithm to count characters. This is much faster for long lines, but is non-negligibly slower for short slices (below around 100 bytes). This is also sped up significantly more depending on architecture and enabling the simd feature gates. If you expect primarily short lines, you may get a noticeable speedup in parsing by using naive_get_utf8_column instead. Benchmark your specific use case!

Example of use

let span = LocatedSpan::new("メカジキ");
let indexOf3dKanji = span.find_substring("ジ").unwrap();

assert_eq!(span.slice(indexOf3dKanji..).get_column(), 7);
assert_eq!(span.slice(indexOf3dKanji..).get_utf8_column(), 3);
source

pub fn naive_get_utf8_column(&self) -> usize

Return the column index for UTF8 text. Return value is unspecified for non-utf8 text.

A simpler implementation of get_utf8_column that may be faster on shorter lines. If benchmarking shows that this is faster, you can use it instead of get_utf8_column. Prefer defaulting to get_utf8_column unless this legitimately is a performance bottleneck.

Example of use

let span = LocatedSpan::new("メカジキ");
let indexOf3dKanji = span.find_substring("ジ").unwrap();

assert_eq!(span.slice(indexOf3dKanji..).get_column(), 7);
assert_eq!(span.slice(indexOf3dKanji..).naive_get_utf8_column(), 3);

Trait Implementations§

source§

impl<T: AsBytes, X> AsBytes for LocatedSpan<T, X>

source§

fn as_bytes(&self) -> &[u8]

Casts the input type to a byte slice
source§

impl<T, U, X> AsRef<U> for LocatedSpan<&T, X>where T: ?Sized + AsRef<U>, U: ?Sized,

source§

fn as_ref(&self) -> &U

Converts this type into a shared reference of the (usually inferred) input type.
source§

impl<T: Clone, X: Clone> Clone for LocatedSpan<T, X>

source§

fn clone(&self) -> LocatedSpan<T, X>

Returns a copy of the value. Read more
1.0.0 · source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
source§

impl<A: Compare<B>, B: Into<LocatedSpan<B>>, X> Compare<B> for LocatedSpan<A, X>

source§

fn compare(&self, t: B) -> CompareResult

Compares self to another value for equality
source§

fn compare_no_case(&self, t: B) -> CompareResult

Compares self to another value for equality independently of the case. Read more
source§

impl<T: Debug, X: Debug> Debug for LocatedSpan<T, X>

source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
source§

impl<T, X> Deref for LocatedSpan<T, X>

§

type Target = T

The resulting type after dereferencing.
source§

fn deref(&self) -> &Self::Target

Dereferences the value.
source§

impl<T: ToString, X> Display for LocatedSpan<T, X>

source§

fn fmt(&self, fmt: &mut Formatter<'_>) -> FmtResult

Formats the value using the given formatter. Read more
source§

impl<'a, T, X> ExtendInto for LocatedSpan<T, X>where T: ExtendInto,

§

type Item = <T as ExtendInto>::Item

The current input type is a sequence of that Item type. Read more
§

type Extender = <T as ExtendInto>::Extender

The type that will be produced
source§

fn new_builder(&self) -> Self::Extender

Create a new Extend of the correct type
source§

fn extend_into(&self, acc: &mut Self::Extender)

Accumulate the input into an accumulator
source§

impl<T, U, X> FindSubstring<U> for LocatedSpan<T, X>where T: FindSubstring<U>,

source§

fn find_substring(&self, substr: U) -> Option<usize>

Returns the byte position of the substring if it is found
source§

impl<Fragment: FindToken<Token>, Token, X> FindToken<Token> for LocatedSpan<Fragment, X>

source§

fn find_token(&self, token: Token) -> bool

Returns true if self contains the token
source§

impl<T: AsBytes, X: Default> From<T> for LocatedSpan<T, X>

source§

fn from(i: T) -> Self

Converts to this type from the input type.
source§

impl<T: Hash, X> Hash for LocatedSpan<T, X>

source§

fn hash<H: Hasher>(&self, state: &mut H)

Feeds this value into the given Hasher. Read more
1.3.0 · source§

fn hash_slice<H>(data: &[Self], state: &mut H)where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher. Read more
source§

impl<'a, T, X> InputIter for LocatedSpan<T, X>where T: InputIter,

§

type Item = <T as InputIter>::Item

The current input type is a sequence of that Item type. Read more
§

type Iter = <T as InputIter>::Iter

An iterator over the input type, producing the item and its position for use with Slice. If we’re iterating over &str, the position corresponds to the byte index of the character
§

type IterElem = <T as InputIter>::IterElem

An iterator over the input type, producing the item
source§

fn iter_indices(&self) -> Self::Iter

Returns an iterator over the elements and their byte offsets
source§

fn iter_elements(&self) -> Self::IterElem

Returns an iterator over the elements
source§

fn position<P>(&self, predicate: P) -> Option<usize>where P: Fn(Self::Item) -> bool,

Finds the byte position of the element
source§

fn slice_index(&self, count: usize) -> Result<usize, Needed>

Get the byte offset from the element’s position in the stream
source§

impl<T: InputLength, X> InputLength for LocatedSpan<T, X>

source§

fn input_len(&self) -> usize

Calculates the input length, as indicated by its name, and the name of the trait itself
source§

impl<T, X> InputTake for LocatedSpan<T, X>where Self: Slice<RangeFrom<usize>> + Slice<RangeTo<usize>>,

source§

fn take(&self, count: usize) -> Self

Returns a slice of count bytes. panics if count > length
source§

fn take_split(&self, count: usize) -> (Self, Self)

Split the stream at the count byte offset. panics if count > length
source§

impl<T, X> InputTakeAtPosition for LocatedSpan<T, X>where T: InputTakeAtPosition + InputLength + InputIter, Self: Slice<RangeFrom<usize>> + Slice<RangeTo<usize>> + Clone,

§

type Item = <T as InputIter>::Item

The current input type is a sequence of that Item type. Read more
source§

fn split_at_position_complete<P, E: ParseError<Self>>( &self, predicate: P ) -> IResult<Self, Self, E>where P: Fn(Self::Item) -> bool,

Looks for the first element of the input type for which the condition returns true, and returns the input up to this position. Read more
source§

fn split_at_position<P, E: ParseError<Self>>( &self, predicate: P ) -> IResult<Self, Self, E>where P: Fn(Self::Item) -> bool,

Looks for the first element of the input type for which the condition returns true, and returns the input up to this position. Read more
source§

fn split_at_position1<P, E: ParseError<Self>>( &self, predicate: P, e: ErrorKind ) -> IResult<Self, Self, E>where P: Fn(Self::Item) -> bool,

Looks for the first element of the input type for which the condition returns true and returns the input up to this position. Read more
source§

fn split_at_position1_complete<P, E: ParseError<Self>>( &self, predicate: P, e: ErrorKind ) -> IResult<Self, Self, E>where P: Fn(Self::Item) -> bool,

Looks for the first element of the input type for which the condition returns true and returns the input up to this position. Read more
source§

impl<T, X> Offset for LocatedSpan<T, X>

source§

fn offset(&self, second: &Self) -> usize

Offset between the first byte of self and the first byte of the argument
source§

impl<R: FromStr, T, X> ParseTo<R> for LocatedSpan<T, X>where T: ParseTo<R>,

source§

fn parse_to(&self) -> Option<R>

Succeeds if parse() succeeded. The byte slice implementation will first convert it to a &str, then apply the parse() function
source§

impl<T: AsBytes + PartialEq, X> PartialEq<LocatedSpan<T, X>> for LocatedSpan<T, X>

source§

fn eq(&self, other: &Self) -> bool

This method tests for self and other values to be equal, and is used by ==.
1.0.0 · source§

fn ne(&self, other: &Rhs) -> bool

This method tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.
source§

impl<'a, T, R, X: Clone> Slice<R> for LocatedSpan<T, X>where T: Slice<R> + Offset + AsBytes + Slice<RangeTo<usize>>,

source§

fn slice(&self, range: R) -> Self

Slices self according to the range argument
source§

impl<T: Copy, X: Copy> Copy for LocatedSpan<T, X>

source§

impl<T: AsBytes + Eq, X> Eq for LocatedSpan<T, X>

Auto Trait Implementations§

§

impl<T, X> RefUnwindSafe for LocatedSpan<T, X>where T: RefUnwindSafe, X: RefUnwindSafe,

§

impl<T, X> Send for LocatedSpan<T, X>where T: Send, X: Send,

§

impl<T, X> Sync for LocatedSpan<T, X>where T: Sync, X: Sync,

§

impl<T, X> Unpin for LocatedSpan<T, X>where T: Unpin, X: Unpin,

§

impl<T, X> UnwindSafe for LocatedSpan<T, X>where T: UnwindSafe, X: UnwindSafe,

Blanket Implementations§

source§

impl<T> Any for Twhere T: 'static + ?Sized,

source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
source§

impl<T> Borrow<T> for Twhere T: ?Sized,

source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
source§

impl<T> BorrowMut<T> for Twhere T: ?Sized,

source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
source§

impl<T> From<T> for T

source§

fn from(t: T) -> T

Returns the argument unchanged.

source§

impl<T, U> Into<U> for Twhere U: From<T>,

source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

source§

impl<T> ToOwned for Twhere T: Clone,

§

type Owned = T

The resulting type after obtaining ownership.
source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
source§

impl<T> ToString for Twhere T: Display + ?Sized,

source§

default fn to_string(&self) -> String

Converts the given value to a String. Read more
source§

impl<T, U> TryFrom<U> for Twhere U: Into<T>,

§

type Error = Infallible

The type returned in the event of a conversion error.
source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
source§

impl<T, U> TryInto<U> for Twhere U: TryFrom<T>,

§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.