[BYDB-Replica] Replace Any with []byte Between Liaison and Data Nodes

[hanahmily]

Search before asking

• I had searched in the issues and found no similar feature requirement.

Description

Enhance the communication protocol between Liaison and Data Nodes in BanyanDB by replacing the existing google.protobuf.Any type with a []byte field in the gRPC definitions. This modification eliminates the overhead associated with the Any type, such as additional metadata and increased serialization/deserialization latency.

To accomplish this, implement custom marshal and unmarshal functions within Liaison and Data Nodes. These functions will handle the serialization and deserialization of data more efficiently using optimized encoding libraries. By directly managing byte slices, we can reduce payload sizes, lower CPU usage, and improve overall performance and resource utilization.

Use case

No response

Related issues

No response

Are you willing to submit a pull request to implement this on your own?

• Yes I am willing to submit a pull request on my own!

Code of Conduct

• I agree to follow this project's Code of Conduct