[FEATURE] Add the partition checksum to ensure data consistency #2659
Description
Code of Conduct
- I agree to follow this project's Code of Conduct
Search before asking
- I have searched in the issues and found no similar issues.
Describe the feature
In #2653, we introduced a mechanism to verify the record count of each partition. To enable more precise consistency checks, we should also support computing and validating partition-level checksums.
Motivation
No response
Describe the solution
No response
Additional context
No response
Are you willing to submit PR?
- Yes I am willing to submit a PR!