| Module | RDoc::TokenStream |
| In: |
tokenstream.rb
doc-tmp/rdoc/tokenstream.rb |
A TokenStream is a list of tokens, gathered during the parse of some entity (say a method). Entities populate these streams by being registered with the lexer. Any class can collect tokens by including TokenStream. From the outside, you use such an object by calling the start_collecting_tokens method, followed by calls to add_token and pop_token.
# File doc-tmp/rdoc/tokenstream.rb, line 24
24: def add_tokens(tks)
25: tks.each {|tk| add_token(tk)}
26: end
# File doc-tmp/rdoc/tokenstream.rb, line 16
16: def start_collecting_tokens
17: @token_stream = []
18: end