From 80288d2ad278e66a0aa62c4339d03b0d8531973f Mon Sep 17 00:00:00 2001 From: Donald Pipowitch Date: Mon, 10 Apr 2017 12:52:16 +0200 Subject: [PATCH] update tokenizer comment --- the-super-tiny-compiler.js | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/the-super-tiny-compiler.js b/the-super-tiny-compiler.js index 2bafccc..446cc0e 100755 --- a/the-super-tiny-compiler.js +++ b/the-super-tiny-compiler.js @@ -122,7 +122,7 @@ * Syntactic Analysis. * * 1. *Lexical Analysis* takes the raw code and splits it apart into these things - * called tokens by a thing called a tokenizer (or lexer). + * called tokens by a thing called a tokenizer (or lexer or scanner). * * Tokens are an array of tiny little objects that describe an isolated piece * of the syntax. They could be numbers, labels, punctuation, operators,