Module TokenStream
In: tokenstream.rb

A TokenStream is a list of tokens, gathered during the parse of some entity (say a method). Entities populate these streams by being registered with the lexer. Any class can collect tokens by including TokenStream. From the outside, you use such an object by calling the start_collecting_tokens method, followed by calls to add_token and pop_token

Methods

Public Instance methods

[Source]

    # File tokenstream.rb, line 16
16:   def add_token(tk)
17:     @token_stream << tk
18:   end

[Source]

    # File tokenstream.rb, line 19
19:   def add_tokens(tks)
20:     tks.each  {|tk| add_token(tk)}
21:   end

[Source]

    # File tokenstream.rb, line 22
22:   def pop_token
23:     @token_stream.pop
24:   end

[Source]

    # File tokenstream.rb, line 13
13:   def start_collecting_tokens
14:     @token_stream = []
15:   end

[Source]

    # File tokenstream.rb, line 9
 9:   def token_stream
10:     @token_stream
11:   end

[Validate]