You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
BloomIndex cannot filter stripes in workers.
As shown below, in AbstractOrcRecordReader.filterStripeUsingIndex(), bloomIndex throws IndexLookUpException, this method always return false, which means no need to filter the stripe.
Describe the expected behavior
BloomIndex is used on workers for filtering stripes when reading orc files.
Steps to reproduce the issue
create index idx using bloom on hive.hindex.users (id);
I think bloom/bitmap/minMax Index created before can be used in workers for filtering stripes/rows by using lookup/matches, but now only bitmapIndex works.
The text was updated successfully, but these errors were encountered:
Software Environment:
OpenLooKeng version (source or binary):
1.6.0-SNAPSHOT
OS platform & distribution (eg., Linux Ubuntu 16.04):
Linux 4.9.0-8-amd64 Bump libthrift from 0.9.3-1 to 0.12.0 in /hetu-heuristic-index #1 SMP Debian 4.9.144-3 (2019-02-02) x86_64 GNU/Linux
Java version:
Describe the current behavior
BloomIndex cannot filter stripes in workers.
As shown below, in AbstractOrcRecordReader.filterStripeUsingIndex(), bloomIndex throws IndexLookUpException, this method always return false, which means no need to filter the stripe.
Describe the expected behavior
BloomIndex is used on workers for filtering stripes when reading orc files.
Steps to reproduce the issue
Related log/screenshots
Special notes for this issue
I think bloom/bitmap/minMax Index created before can be used in workers for filtering stripes/rows by using lookup/matches, but now only bitmapIndex works.
The text was updated successfully, but these errors were encountered: