> >
> > That's exactly the solution I'm proposing. However, it's pretty painful
> > to make the lexer do it directly (consider intervening comments, for
> > example)
>
> Comments are a pain in the parser. What if something prior to the lexer
> filtered out comments before either the lexer or parser could see them?
> Would it be as easy as s/--.*// before the lexer?
It probably wouldn't be that simple, but I do think that the solution
is sound. Such a design is recommended by the Dragon book and has
the benefit of simplifying both the lexer and the parser.
-Andy