Quote:
|
Originally Posted by jake13jake
geez stefan, you're making this hard. now you have me wanting to make my own custom tokenizers for parsing calculation scripts in gscript and everything. btw, pls give tokenize() the option to return the delimiters. it would increase my love for you tenfold. Perhaps even having whole string delimiters rather than simply characters.
|
Return the delimiters? Why would you want that? Just add them manually to whatever you're doing if you need them that badly.
I, for one, would rather not have commas and other crap in my tokens to make them look ugly :|