Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Optimizing cluster sizing using a real world benchmark #597

Merged
merged 8 commits into from
Oct 30, 2024

Conversation

rodrigo-lourenco-lopes
Copy link
Contributor

@rodrigo-lourenco-lopes rodrigo-lourenco-lopes commented Oct 17, 2024

This PR adds a new chaos day esperiment: "Optimizing cluster sizing using a real world benchmark".

Additionally, it fixes some links and typos in the readme.md.

@rodrigo-lourenco-lopes
Copy link
Contributor Author

Hey @npepinpe this is still a draft and I have still to update the benchmark values to reflect the changes that were made in the gateway by adding more memory, among some other improvements to the text, but I just wanted to ask before some things that we should include or not.

  • Should we add as a background and motivation the Saas advanced Offering topic?
  • Should we add the cost reduction as a motivation, or is that something that might not be ideal for external reading? And if the answer yes should we also display some metrics on cost reduction?
  • Is it too much to include all the resources of out clusters as we currently have laid out in the tables?

@rodrigo-lourenco-lopes rodrigo-lourenco-lopes changed the title Draft: Using realist benchmarks to test performance to derive new cluster configurations [Draft]: Using realist benchmarks to test performance to derive new cluster configurations Oct 17, 2024
"Using realist benchmarks to test performance to derive new cluster configurations"

(cherry picked from commit 1455b19)
@npepinpe
Copy link
Member

Should we add as a background and motivation the Saas advanced Offering topic?

I don't think this is relevant for most people reading this.

Should we add the cost reduction as a motivation, or is that something that might not be ideal for external reading? And if the answer yes should we also display some metrics on cost reduction?

Same, I think we don't need to mention that.

Copy link
Member

@npepinpe npepinpe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚀 Generally looks good

I would remove the link to accounts though, this is private so not relevant for most people.

chaos-days/blog/2024-10-14-realistic-benchmarks/index.md Outdated Show resolved Hide resolved
chaos-days/blog/2024-10-14-realistic-benchmarks/index.md Outdated Show resolved Hide resolved
chaos-days/blog/2024-10-14-realistic-benchmarks/index.md Outdated Show resolved Hide resolved
chaos-days/blog/2024-10-14-realistic-benchmarks/index.md Outdated Show resolved Hide resolved
chaos-days/blog/2024-10-14-realistic-benchmarks/index.md Outdated Show resolved Hide resolved
chaos-days/blog/2024-10-14-realistic-benchmarks/index.md Outdated Show resolved Hide resolved
chaos-days/blog/2024-10-14-realistic-benchmarks/index.md Outdated Show resolved Hide resolved
chaos-days/blog/2024-10-14-realistic-benchmarks/index.md Outdated Show resolved Hide resolved
chaos-days/blog/2024-10-14-realistic-benchmarks/index.md Outdated Show resolved Hide resolved
Comment on lines 51 to 54
#### Benchmarking a realistic process model

In our previous benchmarks we used a simple process model with a single
task with several decision symbols. For the newer benchmarks we wanted to
Copy link
Member

@ChrisKujawa ChrisKujawa Oct 24, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TBH I personally would separate this from this blog post. As the idea for this and work came from the Camunda Exporter Project and was then reused for this project as well.

What you could do here is to say we used a different way of benchmark with more realistic workload. You will not go into more details as this deserves an own blog post, which is upcoming.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ups, I did not know this was an upcoming post, should we cut this completely, or still use as motivation and link it to the upcoming post?

@rodrigo-lourenco-lopes rodrigo-lourenco-lopes marked this pull request as ready for review October 24, 2024 12:57
@rodrigo-lourenco-lopes rodrigo-lourenco-lopes changed the title [Draft]: Using realist benchmarks to test performance to derive new cluster configurations Optimizing cluster sizing using a real world benchmark Oct 24, 2024
@rodrigo-lourenco-lopes
Copy link
Contributor Author

Now with the new values for the gateway with more memory, I changed the original motivation of 40 tasks/s to 100 to be easier to explain in this post. Instead of trying to explain all the iterations of benchmarking we went through.
@npepinpe @Zelldon does this make sense to you?

@rodrigo-lourenco-lopes rodrigo-lourenco-lopes merged commit d028ba3 into main Oct 30, 2024
3 checks passed
@rodrigo-lourenco-lopes rodrigo-lourenco-lopes deleted the rl-realistic-benchmark branch October 30, 2024 15:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants