Function rustc_parse::source_file_to_stream

pub fn source_file_to_stream(
    sess: &ParseSess,
    source_file: Lrc<SourceFile>,
    override_span: Option<Span>
) -> (TokenStream, Vec<UnmatchedBrace>)

Given a source_file, produces a sequence of token trees.