Non-finite numeric literals

[sfkleach]

Goal: The inclusion of non-finite numeric literals: ∞, -∞, ⦰.

• IF non-ascii characters used THEN verify the token.go implementation is safe
  • I think the AI was keen on direct indexing of t.input, which won't work for multi-byte runes
• Implement infinities/nullity
• Add the --decimal option to the test tool
• Add decision record
• Add unit tests
• Add functional tests
• Update the token-rules diagram
• Update the documentation on token-rules
• Update the CHANGELOG
• Merge request
• Respond to code review
• Merge to main

Issues

• We should not use identifiers for literal infinities.
• We may want to distinguish integer and floating point infinities.
• We will need to add a radix field, we may also want to add a type field (i, f, t).

Syntax

• 0n1, -0n1, 0n0, 0n1.0, -0n1.0, 0n0.0
• ∞, -∞, ⦰, ∞.0, -∞.0, ⦰.0