Part 1: Tokenizer
In this series, we will develop a new scripting language and describe that process step by step.
The first question that spontaneously comes to the mind of any wondering reader is likely to be: “Do we really need a new programming language?”
Do We Really Need a New Programming Language?
Tokenizer’s Little Helpers
That concludes the first part of our series. Perhaps it wasn’t too exciting, but we now have a useful tokenizer, along with basic parsing error handling. Both are crucial building blocks for the more interesting stuff that I am going to write about in the coming articles.
I hope that you got some good ideas from this post, and if you want to explore the details, go to my GitHub page.