Doris 3.0.1 - Broker Load Performance #40887
Unanswered
falexsandro
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi People!
I'm using Doris 3.0.1, with 1 instance of fe and be.
I'm trying to test the capabilities of Doris.
One of my tests is load an amount of data that resides on the S3 repository (MinIO) on another host.
This host runs exclusivelly the docker of FE and another for BE.
This is a 4 core ARM64, with 32Gb of Memory and more than 1 Tb of disk.
In this moment, using the broker load, i got a 600M rows loaded, that took 06:13h to execute.
This appears to be slow.
I don't know what to change in the configuration of Doris to improve the performance.
I even don't know, what to monitor to determine, what could be improved !
I know, that this server, can run a transformations (docker VM with Spark), with performance of 150K rows/s.
Any guidance/suggestion here ?
Thanks for all!
Beta Was this translation helpful? Give feedback.
All reactions