Enum rustc_ast::token::TokenKind [−][src]
pub enum TokenKind {
Show 37 variants
Eq,
Lt,
Le,
EqEq,
Ne,
Ge,
Gt,
AndAnd,
OrOr,
Not,
Tilde,
BinOp(BinOpToken),
BinOpEq(BinOpToken),
At,
Dot,
DotDot,
DotDotDot,
DotDotEq,
Comma,
Semi,
Colon,
ModSep,
RArrow,
LArrow,
FatArrow,
Pound,
Dollar,
Question,
SingleQuote,
OpenDelim(DelimToken),
CloseDelim(DelimToken),
Literal(Lit),
Ident(Symbol, bool),
Lifetime(Symbol),
Interpolated(Lrc<Nonterminal>),
DocComment(CommentKind, AttrStyle, Symbol),
Eof,
}Variants
BinOp(BinOpToken)Tuple Fields of BinOp
0: BinOpTokenBinOpEq(BinOpToken)Tuple Fields of BinOpEq
0: BinOpTokenUsed by proc macros for representing lifetimes, not generated by lexer right now.
OpenDelim(DelimToken)An opening delimiter (e.g., {).
Tuple Fields of OpenDelim
0: DelimTokenCloseDelim(DelimToken)A closing delimiter (e.g., }).
Tuple Fields of CloseDelim
0: DelimTokenLiteral(Lit)Tuple Fields of Literal
0: LitIdentifier token.
Do not forget about NtIdent when you want to match on identifiers.
It’s recommended to use Token::(ident,uninterpolate,uninterpolated_span) to
treat regular and interpolated identifiers in the same way.
Lifetime(Symbol)Lifetime identifier token.
Do not forget about NtLifetime when you want to match on lifetime identifiers.
It’s recommended to use Token::(lifetime,uninterpolate,uninterpolated_span) to
treat regular and interpolated lifetime identifiers in the same way.
Tuple Fields of Lifetime
0: SymbolInterpolated(Lrc<Nonterminal>)Tuple Fields of Interpolated
0: Lrc<Nonterminal>DocComment(CommentKind, AttrStyle, Symbol)A doc comment token.
Symbol is the doc comment’s data excluding its “quotes” (///, /**, etc)
similarly to symbols in string literal tokens.
Tuple Fields of DocComment
Implementations
Returns tokens that are likely to be typed accidentally instead of the current token. Enables better error recovery when the wrong token is found.
Trait Implementations
Auto Trait Implementations
impl !RefUnwindSafe for TokenKind
impl !UnwindSafe for TokenKind
Blanket Implementations
Mutably borrows from an owned value. Read more
Layout
Note: Most layout information is completely unstable and may even differ between compilations. The only exception is types with certain repr(...) attributes. Please see the Rust Reference’s “Type Layout” chapter for details on type layout guarantees.
Size: 16 bytes
Size for each variant:
Eq: 0 bytesLt: 0 bytesLe: 0 bytesEqEq: 0 bytesNe: 0 bytesGe: 0 bytesGt: 0 bytesAndAnd: 0 bytesOrOr: 0 bytesNot: 0 bytesTilde: 0 bytesBinOp: 1 byteBinOpEq: 1 byteAt: 0 bytesDot: 0 bytesDotDot: 0 bytesDotDotDot: 0 bytesDotDotEq: 0 bytesComma: 0 bytesSemi: 0 bytesColon: 0 bytesModSep: 0 bytesRArrow: 0 bytesLArrow: 0 bytesFatArrow: 0 bytesPound: 0 bytesDollar: 0 bytesQuestion: 0 bytesSingleQuote: 0 bytesOpenDelim: 1 byteCloseDelim: 1 byteLiteral: 15 bytesIdent: 7 bytesLifetime: 7 bytesInterpolated: 15 bytesDocComment: 7 bytesEof: 0 bytes