You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I left the initial_search_radius at the default of 0.3. I saw in the README and in a warning that I needed to adjust the scale of Linear spaces so I started performing some tests to try and figure out a good scale value. I would initialize carbs with 1 parameter space, set num_random_samples to 1000, gather 1000 suggestions and take note of the min, max, mean, and standard deviation. I did this with the initial_search_radius at 1.0 because as I understand it, carbs will increase the search radius as more observations suggestions are made. My thought was to find a scale value that will allow carbs to search the entire Linear space.
This worked OK in practice, for example, the minimum suggestions for the update_epochs parameter was 2 and the max was 8 after 24 suggestions (12 of which were random). I was surprised to see several Log and Logit parameter spaces not explored very much though. gamma for example had a min suggested value of 0.9821 and a max of 0.9987. I'm assuming this has to do with the search center being set so close to the max.
All this to say, I don't entirely understand how scale is supposed to be set and how it interacts with initial_search_radius. How should I set scale so that the min and max values of a space can be reached, in all types of parameter spaces? 'Set it >3' wasn't enough information for me to find good scale values for Linear spaces, and I have no idea how to set the scale for Log and Logit spaces, or if I even need to, perhaps in these cases carbs was working as expected.
Thanks for carbs, despite my confusion with parameter space scaling it's been very useful!
The text was updated successfully, but these errors were encountered:
Hello, I've been using carbs with decent success but noticed some parameter spaces were not getting explored very well. Here are my parameters:
I left the
initial_search_radius
at the default of0.3
. I saw in the README and in a warning that I needed to adjust the scale of Linear spaces so I started performing some tests to try and figure out a good scale value. I would initialize carbs with 1 parameter space, setnum_random_samples
to 1000, gather 1000 suggestions and take note of the min, max, mean, and standard deviation. I did this with theinitial_search_radius
at1.0
because as I understand it, carbs will increase the search radius as more observations suggestions are made. My thought was to find a scale value that will allow carbs to search the entire Linear space.This worked OK in practice, for example, the minimum suggestions for the
update_epochs
parameter was 2 and the max was 8 after 24 suggestions (12 of which were random). I was surprised to see several Log and Logit parameter spaces not explored very much though.gamma
for example had a min suggested value of0.9821
and a max of0.9987
. I'm assuming this has to do with the search center being set so close to the max.All this to say, I don't entirely understand how
scale
is supposed to be set and how it interacts withinitial_search_radius
. How should I setscale
so that the min and max values of a space can be reached, in all types of parameter spaces? 'Set it >3' wasn't enough information for me to find good scale values for Linear spaces, and I have no idea how to set the scale for Log and Logit spaces, or if I even need to, perhaps in these cases carbs was working as expected.Thanks for carbs, despite my confusion with parameter space scaling it's been very useful!
The text was updated successfully, but these errors were encountered: