You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently, pipeline expressions are required to be terminated with as_list or first based on the data type required at the output. However, given the fact that the required data type is known beforehand, it would be optimal and lead to more terse expressions if this were passed to the evaluate function, thus making the final transformation implicit.
Notwithstanding the current quirks in the re_search function, which will be fixed separately as part of #30, the current expression which looks like this
r"sub(r',', '') | re_search(r'#(\d+)') | filter(lambda x: x) | first | int | first"
could have all 3 terminating pipe functions | first | int | first peeled away based on certain conditions.
We will need to evaluate how this will impact us in terms of overall robustness of the pipeline as well as it's comprehensibility. Will send a PR so that we discuss the ramifications of implicit vs explicit transformations.
Currently, pipeline expressions are required to be terminated with as_list or first based on the data type required at the output. However, given the fact that the required data type is known beforehand, it would be optimal and lead to more terse expressions if this were passed to the evaluate function, thus making the final transformation implicit.
@peonone @BurnzZ does this make sense?
The text was updated successfully, but these errors were encountered: