fix: 4209 - Inconsistent max tokens value persistence

[louis-jan]

Describe Your Changes

This PR addresses an issue where selecting the max_tokens parameter in the thread.json file doesn’t get updated when the model is changed.

Fixes Issues

• bug: [0.5.10] max_tokens value inconsistency between Jan UI and json file #4209

Changes made

The code change involves adjustments to how model parameters are handled in two different files: ModelDropdown/index.tsx and useCreateNewThread.ts.

1. ModelDropdown/index.tsx Changes:

   • The overriddenSettings logic is replaced with overriddenParameters.
   • A new defaultContextLength variable is defined, which chooses the minimum between 8192 and the model's ctx_len setting (defaulting to 8192 if not specified).
   • The overriddenParameters object now includes both ctx_len and max_tokens, both set to this new defaultContextLength.

2. useCreateNewThread.ts Changes:

   • Similar to the changes in ModelDropdown, a defaultContextLength variable is introduced.
   • The overriddenSettings object now consistently uses this defaultContextLength for ctx_len.
   • The overriddenParameters object is reconstructed to set max_tokens using the same defaultContextLength.

Overall, the changes standardize how ctx_len and max_tokens are determined and used, defaulting these settings to a maximum of 8192.

[github-actions]

Barecheck - Code coverage report

Total: 69.29%

Your code coverage diff: 0.00% ▴

Uncovered files and lines

File	Lines
web/containers/ModelDropdown/index.tsx	102, 113, 123-124, 127, 129-130, 132-133, 135-138, 140, 148, 165-167, 169, 171, 190, 194, 199, 206, 209-210, 245-247, 251, 275-277, 279, 283, 286-291, 298-299, 310, 314, 332, 348, 369, 378, 384, 392-393, 396-401, 404, 407, 459-460, 462, 488, 496, 498, 523, 528-529, 531, 535-537, 539-540, 542, 552-555, 583, 591, 593
web/hooks/useCreateNewThread.ts	42, 44, 49-50, 53-54