Skip to content

Commit db7e580

Browse files
committed
perf: refine context heuristics
1 parent e018e27 commit db7e580

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

mostlyai/engine/_tabular/argn.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -164,7 +164,7 @@ def _regressor_heuristic(id: str, model_size: ModelSizeOrUnits, dim_input: int,
164164
def _flat_context_heuristic(id: str, model_size: ModelSizeOrUnits, dim_input: int) -> list[int]:
165165
if isinstance(model_size, dict):
166166
return model_size[id]
167-
model_size_layers = dict(S=[4], M=[16], L=[64])
167+
model_size_layers = dict(S=[2], M=[8], L=[32])
168168
layers = model_size_layers[model_size]
169169
coefficient = round(np.log(max(dim_input, np.e)))
170170
dims = [unit * coefficient for unit in layers]

0 commit comments

Comments
 (0)