VSinerva/compiler-course
Archived
1
0
Fork 0
Code Activity

Initial tokenizer implementation

Browse source
This commit is contained in:
Vili Sinervä 2025-01-18 18:58:14 +02:00
parent f6ac3e60a9
commit 66bdd5f917
No known key found for this signature in database
GPG key ID: DF8FEAF54EFAC996
7 changed files with 276 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

6
src/compiler.rs Normal file
View file

@ -0,0 +1,6 @@
mod token;
mod tokenizer;
pub fn compile(code: &str) {
tokenizer::tokenize(code);
}