I'm trying to wrap my head around how to handle C-style multiline comments (/* */) with a recursive descent parser. Because these comments can appear anywhere, how do you account for them? For example, suppose you're parsing a sentence into word tokens, what do we do if there's a comment inside a word?
Ex.
This is a sentence = word word word word
vs
This is a sen/*sible*/tence = ???
Thanks!
/*and*/when breaking your program text into tokens. - eigenchris