Skip to content

Conversation

@hvarfner
Copy link

Summary: Updates benchmark.py to use the new Noise module architecture: passes problem.noise instead of problem.noise_std to BenchmarkRunner, and removes the obsolete add_custom_noise replacement since noise is now handled entirely by the Noise object on the runner.

Differential Revision: D90597013

@meta-cla meta-cla bot added the CLA Signed Do not delete this pull request or issue due to inactivity. label Jan 13, 2026
@meta-codesync
Copy link

meta-codesync bot commented Jan 13, 2026

@hvarfner has exported this pull request. If you are a Meta employee, you can view the originating Diff in D90597013.

@codecov-commenter
Copy link

codecov-commenter commented Jan 13, 2026

Codecov Report

❌ Patch coverage is 83.33333% with 8 lines in your changes missing coverage. Please review.
✅ Project coverage is 96.71%. Comparing base (3156389) to head (c258292).

Files with missing lines Patch % Lines
ax/benchmark/benchmark_problem.py 55.55% 4 Missing ⚠️
ax/benchmark/benchmark_runner.py 60.00% 4 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #4761      +/-   ##
==========================================
- Coverage   96.73%   96.71%   -0.02%     
==========================================
  Files         585      585              
  Lines       61196    61122      -74     
==========================================
- Hits        59195    59113      -82     
- Misses       2001     2009       +8     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

hvarfner pushed a commit to hvarfner/Ax that referenced this pull request Jan 13, 2026
Summary:

Updates `benchmark.py` to use the new Noise module architecture: passes `problem.noise` instead of `problem.noise_std` to `BenchmarkRunner`, and removes the obsolete `add_custom_noise` replacement since noise is now handled entirely by the `Noise` object on the runner.

Differential Revision: D90597013
hvarfner pushed a commit to hvarfner/Ax that referenced this pull request Jan 14, 2026
Summary:

Updates `benchmark.py` to use the new Noise module architecture: 
- passes `problem.noise` instead of `problem.noise_std` to `BenchmarkRunner`
- removes the obsolete `add_custom_noise` replacement since noise is now handled entirely by the `Noise` object on the runner.
- Kept `noise_std` argument around to ensure backwards compatibility.

Differential Revision: D90597013
hvarfner pushed a commit to hvarfner/Ax that referenced this pull request Jan 14, 2026
Summary:
Pull Request resolved: facebook#4761

Updates `benchmark.py` to use the new Noise module architecture:
- passes `problem.noise` instead of `problem.noise_std` to `BenchmarkRunner`
- removes the obsolete `add_custom_noise` replacement since noise is now handled entirely by the `Noise` object on the runner.
- Kept `noise_std` argument around to ensure backwards compatibility.

Differential Revision: D90597013
hvarfner pushed a commit to hvarfner/Ax that referenced this pull request Jan 14, 2026
Summary:

Updates `benchmark.py` to use the new Noise module architecture: 
- passes `problem.noise` instead of `problem.noise_std` to `BenchmarkRunner`
- removes the obsolete `add_custom_noise` replacement since noise is now handled entirely by the `Noise` object on the runner.
- Kept `noise_std` argument around to ensure backwards compatibility.

Differential Revision: D90597013
hvarfner pushed a commit to hvarfner/Ax that referenced this pull request Jan 14, 2026
Summary:

Updates `benchmark.py` to use the new Noise module architecture:
- passes `problem.noise` instead of `problem.noise_std` to `BenchmarkRunner`
- removes the obsolete `add_custom_noise` replacement since noise is now handled entirely by the `Noise` object on the runner.
- Kept `noise_std` argument around to ensure backwards compatibility.

Differential Revision: D90597013
@hvarfner hvarfner force-pushed the export-D90597013 branch 2 times, most recently from 110ae85 to 34d8888 Compare January 14, 2026 19:57
hvarfner pushed a commit to hvarfner/Ax that referenced this pull request Jan 14, 2026
Summary:

Updates `benchmark.py` to use the new Noise module architecture:
- passes `problem.noise` instead of `problem.noise_std` to `BenchmarkRunner`
- removes the obsolete `add_custom_noise` replacement since noise is now handled entirely by the `Noise` object on the runner.
- Kept `noise_std` argument around to ensure backwards compatibility.

Differential Revision: D90597013
hvarfner pushed a commit to hvarfner/Ax that referenced this pull request Jan 15, 2026
Summary:

Updates `benchmark.py` to use the new Noise module architecture:
- passes `problem.noise` instead of `problem.noise_std` to `BenchmarkRunner`
- removes the obsolete `add_custom_noise` replacement since noise is now handled entirely by the `Noise` object on the runner.
- Kept `noise_std` argument around to ensure backwards compatibility.

Differential Revision:
D90597013

Privacy Context Container: L1307644
hvarfner pushed a commit to hvarfner/Ax that referenced this pull request Jan 15, 2026
Summary:

Updates `benchmark.py` to use the new Noise module architecture:
- passes `problem.noise` instead of `problem.noise_std` to `BenchmarkRunner`
- removes the obsolete `add_custom_noise` replacement since noise is now handled entirely by the `Noise` object on the runner.
- Kept `noise_std` argument around to ensure backwards compatibility.

Differential Revision:
D90597013

Privacy Context Container: L1307644
@hvarfner hvarfner force-pushed the export-D90597013 branch 2 times, most recently from 8c8c3c5 to 234a51c Compare January 16, 2026 00:42
hvarfner pushed a commit to hvarfner/Ax that referenced this pull request Jan 16, 2026
Summary:

Updates `benchmark.py` to use the new Noise module architecture:
- passes `problem.noise` instead of `problem.noise_std` to `BenchmarkRunner`
- removes the obsolete `add_custom_noise` replacement since noise is now handled entirely by the `Noise` object on the runner.
- Kept `noise_std` argument around to ensure backwards compatibility.

Reviewed By: saitcakmak

Differential Revision:
D90597013

Privacy Context Container: L1307644
hvarfner pushed a commit to hvarfner/Ax that referenced this pull request Jan 16, 2026
Summary:

Updates `benchmark.py` to use the new Noise module architecture:
- passes `problem.noise` instead of `problem.noise_std` to `BenchmarkRunner`
- removes the obsolete `add_custom_noise` replacement since noise is now handled entirely by the `Noise` object on the runner.
- Kept `noise_std` argument around to ensure backwards compatibility.

Reviewed By: saitcakmak

Differential Revision:
D90597013

Privacy Context Container: L1307644
Summary:

Updates `benchmark.py` to use the new Noise module architecture:
- passes `problem.noise` instead of `problem.noise_std` to `BenchmarkRunner`
- removes the obsolete `add_custom_noise` replacement since noise is now handled entirely by the `Noise` object on the runner.
- Kept `noise_std` argument around to ensure backwards compatibility.

Reviewed By: saitcakmak

Differential Revision:
D90597013

Privacy Context Container: L1307644
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed Do not delete this pull request or issue due to inactivity. fb-exported meta-exported

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants