Fix Tokenizer issue

Updated Tokenizer running generate_parser.sh on Windows. Test: make Change-Id: I128a70a61907bb4ce3b0a8031667bda4197b6a2d Reviewed-on: https://chromium-review.googlesource.com/988802Reviewed-by: Jamie Madill <jmadill@chromium.org> Reviewed-by: Yuly Novikov <ynovikov@chromium.org> Commit-Queue: Courtney Goeltzenleuchter <courtneygo@google.com>

Fix Tokenizer issue
bab086a7 · U-GOOGLE\courtneygo · Commit Bot · fd643283 · bab086a7 · bab086a7
Commit bab086a7 authored Mar 30, 2018 by $U-GOOGLE\courtneygo's avatar$ U-GOOGLE\courtneygo Committed by Commit Bot Apr 04, 2018
Hide whitespace changes
Inline Side-by-side

Showing with 2 additions and 0 deletions

Tokenizer.cpp src/compiler/preprocessor/Tokenizer.cpp +1 -0

Tokenizer.l src/compiler/preprocessor/Tokenizer.l +1 -0

No files found.
--- a/src/compiler/preprocessor/Tokenizer.cpp
+++ b/src/compiler/preprocessor/Tokenizer.cpp
@@ -937,6 +937,7 @@ typedef pp::SourceLocation YYLTYPE;
        yyextra->lineStart = true;     \
    } while(0);

+#define YY_NO_INPUT
 #define YY_USER_ACTION                                              \
    do                                                              \
    {                                                               \

--- a/src/compiler/preprocessor/Tokenizer.l
+++ b/src/compiler/preprocessor/Tokenizer.l
@@ -64,6 +64,7 @@ typedef pp::SourceLocation YYLTYPE;
        yyextra->lineStart = true;     \
    } while(0);

+#define YY_NO_INPUT
 #define YY_USER_ACTION                                              \
    do                                                              \
    {                                                               \