C++/スクリプト/言語仕様/字句 のバックアップ(No.3)

  0
  1
  2
  3
  4
  5
  6
  7

WhiteSpace:
    Space
    Space WhiteSpace
 
Space:
    0x0020
    0x0009
    0x000B
    0x000C

  0
  1
  2
  3

EndOfLine:
    0x000D
    0x000A
    0x000D 0x000A
    EndOfFile

  0
  1
  2

EndOfFile:
    physical end of the file
    0x0000
    0x001A

  0
  1
  2
  3
  4
  5
  6
  7
  8
  9
 10
 11
 12
 13
 14
 15
 16
 17
 18

Comment:
    "/*" Characters "*/"
    "//" Characters EndOfLine
    NestingBlockComment
 
Characters:
    Character
    Character Characters
 
NestingBlockComment:
    "/+" NestingBlockCommentCharacters "+/"
 
NestingBlockCommentCharacters:
    NestingBlockCommentCharacter
    NestingBlockCommentCharacter NestingBlockCommentCharacters
 
NestingBlockCommentCharacter:
    Character
    NestingBlockComment

  0
  1
  2
  3
  4
  5
  6
  7
  8
  9
 10
 11
 12
 13
 14
 15
 16
 17
 18
 19
 20
 21
 22
 23
 24
 25
 26
 27
 28
 29
 30
 31
 32
 33
 34
 35
 36
 37
 38
 39
 40
 41
 42
 43
 44
 45
 46
 47
 48
 49
 50

Token:
    Identifier
    StringLiteral
    CharacterLiteral
    IntegerLiteral
    FloatLiteral
    Keyword
    "/"
    "/="
    "."
    "&"
    "&="
    "&&"
    "|"
    "|="
    "||"
    "-"
    "-="
    "--"
    "+"
    "+="
    "++"
    "<"
    "<="
    "<<"
    "<<="
    ">"
    ">="
    ">>="
    ">>"
    "!"
    "!="
    "("
    ")"
    "["
    "]"
    "{"
    "}"
    "?"
    ","
    ";"
    ":"
    "="
    "=="
    "*"
    "*="
    "%"
    "%="
    "^"
    "^="
    "~"
    "~="

  0
  1
  2
  3
  4
  5
  6
  7
  8
  9
 10
 11
 12
 13
 14
 15
 16
 17
 18
 19
 20

Identifier:
    IdentiferStart
    IdentiferStart IdentifierChars
 
IdentifierChars:
    IdentiferChar
    IdentiferChar IdentifierChars
 
IdentifierStart:
    Letter
    UniversalAlpha
 
IdentifierChar:
    IdentiferStart
    NonZeroDigit
    "0"
 
Letter:
    a-zA-Z
 
UniversalAlpha:
    あいうえお...