Read chunked data from companion server

[ItsNiklas]

Problem Description

While developing a new parser for competitive companion, a strange bug occurred where some problems did not consistently get transferred. Thinking that the problem was with the parser, this was investigated first. However, all problems were successfully sent.

Other companion clients were able to receive the problems, so I investigated cph. When not ignoring the error, the JSON.parse was throwing Error parsing problem from companion "SyntaxError: Incomplete string in JSON at position 64975".

This indicated that the buffer of the read() call was full and only a single chunk of data was being read. This only appeared on problems where the parsed test data was large enough to trigger this.

Solution

Changing the listener to data and parsing chunk now works for all submitted problems and contests.

[agrawal-d]

Awesome, thanks! What crazy URL are you parsing? 😝

[ItsNiklas]

Awesome, thanks! What crazy URL are you parsing? 😝

The JSON content came from a zip containing sample test cases where the input can be orders of magnitude larger than what you would probably put on a website to parse. Probably why this was not an issue before.