We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Currently we are using the following default values for ColumnConfig. run_for_all_data_type and ColumnConfig. limit_data_type :
ColumnConfig. run_for_all_data_type
ColumnConfig. limit_data_type
run_for_all_data_type: Optional[List[SparkDatatype]] = [None] limit_data_type: Optional[List[SparkDatatype]] = [None] data_type_strict_mode: bool = False
and we have checks for validating that run_for_all_data_type exists:
run_for_all_data_type
if columns[0] == "*" and not run_for_all_data_type: raise ValueError("Cannot use '*' as a column name when no run_for_all_data_type is set")
but [None] is always exists, as it is list with 1 element which is equal None.
[None]
Default value should be changed to None and code should be fixed to provide correct behavior.
None
The text was updated successfully, but these errors were encountered:
mikita-sakalouski
When branches are created from issues, their pull requests are automatically linked.
Describe the bug
Currently we are using the following default values for
ColumnConfig. run_for_all_data_type
andColumnConfig. limit_data_type
:and we have checks for validating that
run_for_all_data_type
exists:but
[None]
is always exists, as it is list with 1 element which is equal None.Steps to Reproduce
Expected behavior
Default value should be changed to
None
and code should be fixed to provide correct behavior.The text was updated successfully, but these errors were encountered: