Meaning of H_bitstring and H_original

[ShaohuaTong]

Hi, in most cases of my experiment from 'ea_non_iid', H_bitstring * bit-wide < H_original (Bitstring estimate * bit-wide < literal estimate).

In a few cases H_original < H_bitstring * bit-wide, I would like to ask what is the implicit meaning behind H_original < H_bitstring * bit-wide, What could have caused this?

[joshuaehill]

These terms are described in NIST's SP 800-90B document. It is difficult to interpret the results of this program without first reading this document, so I encourage you to do so if you haven't yet.

Testing the bitstring representation of the data stream (resulting in the H_bitstring estimate) allows all of the 90B entropy estimators to be used (as only a subset of entropy estimators support non-binary data). If bit-width * H_bitstring is less than H_original, then likely one of the binary-only estimators produced a lower estimate than suggested by the non-binary estimators.