Clarification on Handling nullSequence and missingValue Properties

[Seddryck]

Hi maintainers,

I have a question regarding the handling of nullSequence from the dialect descriptor versus the missingValues property from the resource or field descriptors. Both properties essentially serve the purpose of replacing a specific sequence of characters with another value.

The specification is clear that the missingValues property of a field overrides the one in the descriptor, but should it also override the nullSequence property? Alternatively, is it expected that nullSequence is always applied first, before considering missingValue?

Thank you for your clarification!

[roll]

Alternatively, is it expected that nullSequence is always applied first, before considering missingValue?

Hi, yes, it is the case. Usually, in implementations the data reading part takes the nullSequence (dialect) into consideration and then on the data processing part missingValues (schema) comes to play.