Enum rustc_ast::token::TokenKind [−][src]
pub enum TokenKind {
Show 37 variants
Eq,
Lt,
Le,
EqEq,
Ne,
Ge,
Gt,
AndAnd,
OrOr,
Not,
Tilde,
BinOp(BinOpToken),
BinOpEq(BinOpToken),
At,
Dot,
DotDot,
DotDotDot,
DotDotEq,
Comma,
Semi,
Colon,
ModSep,
RArrow,
LArrow,
FatArrow,
Pound,
Dollar,
Question,
SingleQuote,
OpenDelim(DelimToken),
CloseDelim(DelimToken),
Literal(Lit),
Ident(Symbol, bool),
Lifetime(Symbol),
Interpolated(Lrc<Nonterminal>),
DocComment(CommentKind, AttrStyle, Symbol),
Eof,
}
Variants
BinOp(BinOpToken)
Tuple Fields of BinOp
0: BinOpToken
BinOpEq(BinOpToken)
Tuple Fields of BinOpEq
0: BinOpToken
Used by proc macros for representing lifetimes, not generated by lexer right now.
OpenDelim(DelimToken)
An opening delimiter (e.g., {
).
Tuple Fields of OpenDelim
0: DelimToken
CloseDelim(DelimToken)
A closing delimiter (e.g., }
).
Tuple Fields of CloseDelim
0: DelimToken
Literal(Lit)
Tuple Fields of Literal
0: Lit
Identifier token.
Do not forget about NtIdent
when you want to match on identifiers.
It’s recommended to use Token::(ident,uninterpolate,uninterpolated_span)
to
treat regular and interpolated identifiers in the same way.
Lifetime(Symbol)
Lifetime identifier token.
Do not forget about NtLifetime
when you want to match on lifetime identifiers.
It’s recommended to use Token::(lifetime,uninterpolate,uninterpolated_span)
to
treat regular and interpolated lifetime identifiers in the same way.
Tuple Fields of Lifetime
0: Symbol
Interpolated(Lrc<Nonterminal>)
Tuple Fields of Interpolated
0: Lrc<Nonterminal>
DocComment(CommentKind, AttrStyle, Symbol)
A doc comment token.
Symbol
is the doc comment’s data excluding its “quotes” (///
, /**
, etc)
similarly to symbols in string literal tokens.
Tuple Fields of DocComment
Implementations
Returns tokens that are likely to be typed accidentally instead of the current token. Enables better error recovery when the wrong token is found.
Trait Implementations
Auto Trait Implementations
impl !RefUnwindSafe for TokenKind
impl !UnwindSafe for TokenKind
Blanket Implementations
Mutably borrows from an owned value. Read more
Layout
Note: Most layout information is completely unstable and may even differ between compilations. The only exception is types with certain repr(...)
attributes. Please see the Rust Reference’s “Type Layout” chapter for details on type layout guarantees.
Size: 16 bytes
Size for each variant:
Eq
: 0 bytesLt
: 0 bytesLe
: 0 bytesEqEq
: 0 bytesNe
: 0 bytesGe
: 0 bytesGt
: 0 bytesAndAnd
: 0 bytesOrOr
: 0 bytesNot
: 0 bytesTilde
: 0 bytesBinOp
: 1 byteBinOpEq
: 1 byteAt
: 0 bytesDot
: 0 bytesDotDot
: 0 bytesDotDotDot
: 0 bytesDotDotEq
: 0 bytesComma
: 0 bytesSemi
: 0 bytesColon
: 0 bytesModSep
: 0 bytesRArrow
: 0 bytesLArrow
: 0 bytesFatArrow
: 0 bytesPound
: 0 bytesDollar
: 0 bytesQuestion
: 0 bytesSingleQuote
: 0 bytesOpenDelim
: 1 byteCloseDelim
: 1 byteLiteral
: 15 bytesIdent
: 7 bytesLifetime
: 7 bytesInterpolated
: 15 bytesDocComment
: 7 bytesEof
: 0 bytes