You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Trying to repartition an AlignmentRecordRDD yields the following exception:
java.lang.IllegalArgumentException: requirement failed: Cannot evenly repartition an unsorted RDD.
This occurs even when the RDD is "sorted", as in one of the sortByReadsXxx methods or sort has just been called prior to the repartitioning.
Looking at the code, the sorting check is actually looking to see if optPartitionMap.isDefined. I was unable to figure out exactly where this property would be set, but its not in any of the sort methods, so at least this is a confusing error.
The text was updated successfully, but these errors were encountered:
Hello @pauldwolfe, how are you attempting to repartition the AlignmentRecordRDD? It appears the partition map is recalculated only in some of the sort methods, and then only when bound to RDD instead of Dataset.
Trying to repartition an AlignmentRecordRDD yields the following exception:
java.lang.IllegalArgumentException: requirement failed: Cannot evenly repartition an unsorted RDD.
This occurs even when the RDD is "sorted", as in one of the sortByReadsXxx methods or sort has just been called prior to the repartitioning.
Looking at the code, the sorting check is actually looking to see if optPartitionMap.isDefined. I was unable to figure out exactly where this property would be set, but its not in any of the sort methods, so at least this is a confusing error.
The text was updated successfully, but these errors were encountered: