Allow follow up questions #287
Replies: 1 comment 4 replies
-
|
Thank you for taking the time to provide your feedback! Unfortunately, adding a chat feature with the model isn't currently feasible due to the app's structure. The app was specifically designed for a single-shot prompt. However, I am continually working on enhancing the structure, and it may become possible in the future. Therefore, I will convert this issue into an idea to explore it further. |
Beta Was this translation helpful? Give feedback.
-
|
Okay! |
Beta Was this translation helpful? Give feedback.
-
|
I see the app has changed a lot! Good job! Is the follow up questions thing still not feasable? |
Beta Was this translation helpful? Give feedback.
-
|
@dillfrescott, glad to see that you're still following this project! Indeed, it's now more feasible. We'll need to incorporate some logic to work around the context limit, which is quite restricted due to the memory reserved for WASM. The idea is to adopt the same strategies that the LLM UIs used in the past when the models had only 2K context: discard any previous text from the conversation and maintain a window of "<2K tokens + space for the response". Let's turn this back into an issue so I can address it in my next available time slot: |
Beta Was this translation helpful? Give feedback.
-
|
Awesome! Sounds good! |
Beta Was this translation helpful? Give feedback.
-
Is your feature request related to a problem? Please describe.
Yes, i am unable to ask any follow up questions :(
Describe the solution you'd like
An option to converse with the model.
Describe alternatives you've considered
No response
Additional context
No response
Beta Was this translation helpful? Give feedback.
All reactions