4 Commits

Author	SHA1	Message	Date
Aryadev Chavali	50e9a4eef5	Implemented tokenise_literal_char (tokenise_char_literal) ... I made the escape sequence parsing occur here instead of leaving it to the main tokenise_buffer function as I think it's better suited here.	2024-04-14 17:01:35 +06:30
Aryadev Chavali	3c46fde66a	Implemented tokenise_literal_hex ... Note the overall size of this function in comparison to the C version, as well as its clarity. Of course, it is doing allocations in the background through std::string which requires more profiling if I want to make this super efficient™ but honestly the assembler just needs to work, whereas the runtime needs to be fast.	2024-04-14 16:57:46 +06:30
Aryadev Chavali	4f8f511168	Implemented tokenise_literal_number (tokenise_number)	2024-04-14 16:56:58 +06:30
Aryadev Chavali	585aff1cbb	Started implementing lexer in lexer.cpp ... The implementation for tokenise_symbol is already a lot nicer to look at and add to due to string/string_view operator overloading of ==. Furthermore, error handling through pair<> instead of making some custom structure which essentially does the same thing is already making me happy for this rewrite.	2024-04-14 16:56:43 +06:30