#3367 from Kristjan Valur Jonsson:

If a PyTokenizer_FromString() is called with an empty string, the 
tokenizer's line_start member never gets initialized.  Later, it is 
compared with the token pointer 'a' in parsetok.c:193 and that behavior 
can result in undefined behavior.


git-svn-id: http://svn.python.org/projects/python/trunk@65539 6015fed2-1504-0410-9fe1-9d1591cc4771

Author: andrew.kuchling

Parser/tokenizer.c

@@ -1117,7 +1117,7 @@ tok_get(register struct tok_state *tok, char **p_start, char **p_end)
 	register int c;
 	int blankline;
 
-	*p_start = *p_end = NULL;
+	tok->line_start = *p_start = *p_end = NULL;
   nextline:
 	tok->start = NULL;
 	blankline = 0;