support scan metrics #184

TanUkkii007 · 2017-12-01T09:55:19Z

Add scan metrics functions in the Scanner.

Following scan metrics are added. Those lists are part of the metrics from the official HBase client.

Integration tests are also included and checked with HBase 1.2.6.

It seems the count of RPCs is different among HBase versions. I tested with HBase 0.94 and the number of RPCs is higher than 1.2.6. This fails the integration tests against 0.94.
Server-side metrics is supported for HBase 0.95 and higher. Tests about server-side metrics are skipped if the server-side metrics show zero value.

still missing MILLIS_BETWEEN_NEXTS and RPC_RETRIES

TanUkkii007 · 2018-02-28T03:53:45Z

BTW, recently I talked about migration to asynchbase. Scan metrics I implemented in this PR are shown in my slides.
https://www.slideshare.net/TanUkkii/nonblocking-io-to-tame-distributed-systems-how-and-why-chatwork-uses-asynchbase

TanUkkii007 added 12 commits November 27, 2017 19:40

add server-side scan metrics

0898a0d

add client-side scan metrics

0570862

still missing MILLIS_BETWEEN_NEXTS and RPC_RETRIES

fix server-side metrics collection place

18f3bf4

add MILLIS_BETWEEN_NEXTS metrics

6e9a946

use internal class for metrics classes

b09895d

update count of bytes when scanner is opened

ac32ea7

collect server-side metrics when scanner is opened

bd756e7

add tests for scan metrics

a6633e0

update test to include GetNextRowsRequest

f0e48b9

add tests of scan metrics of filtered rows

1dbe27c

delete countOfRPCRetries

6bcce6e

skip server-side metrics check for HBase < 0.95

f09ed77

TanUkkii007 force-pushed the feature/scanner-metrics branch from 71d089d to f09ed77 Compare December 1, 2017 10:39

add RPC_RETRIES metrics

72a18b9

Provide feedback