Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Resolve the failures that sometimes emerge in follow up questions #69

Open
Emmanuel-Develops opened this issue Mar 13, 2024 · 1 comment
Assignees
Labels
bug Something isn't working medium priority

Comments

@Emmanuel-Develops
Copy link
Collaborator

The follow up regex in

FOLLOW_UP_QUESTIONS: `In addition, generate four follow up questions related to the answer generated. Each question should be in this format -{QUESTION_INDEX_HERE}-{{QUESTION_HERE}} and each question should be seperated by a new line. DO NOT ADD AN INTRODUCTORY TEXT TO THE FOLLOW UP QUESTIONS.`,

Isn't always reproducible by gpt.
Here is one of the ways it fails

-{QUESTION_1}-{{What are the potential risks associated with not upgrading to SegWit?}}
-{QUESTION_2}-{{How does SegWit affect the verification process for Bitcoin transactions?}}

instead of

-{1}-{{What are the potential risks associated with not upgrading to SegWit?}}
-{2}-{{How does SegWit affect the verification process for Bitcoin transactions?}}

proposal:

  • higher fault tolerance (more robust regex to accommodate for slight changes)
  • simpler regex using subtle cues e.g (start and terminate on a single line) removes the need to enclose them {{, }} and other simpler delimiters that may be easier for gpt to follow
@kouloumos
Copy link
Contributor

I'm also observing followup questions not rendering correctly.
image

@rejeses rejeses added this to ChatBTC Mar 15, 2024
@rejeses rejeses moved this to Todo in ChatBTC Mar 15, 2024
@Extheoisah Extheoisah added bug Something isn't working medium priority labels Apr 8, 2024
@Emmanuel-Develops Emmanuel-Develops self-assigned this May 13, 2024
@Emmanuel-Develops Emmanuel-Develops moved this from 🆕 Todo to 🏗 In Progress in The Bitcoin Development Project Roadmap May 16, 2024
@Emmanuel-Develops Emmanuel-Develops moved this from 🏗 In Progress to 👀 In Review in The Bitcoin Development Project Roadmap May 18, 2024
@Emmanuel-Develops Emmanuel-Develops moved this from 👀 In Review to ✅ Done in The Bitcoin Development Project Roadmap May 27, 2024
@aassoiants aassoiants changed the title Follow up questions regex has some failure rate Resolve the failures that sometimes emerge in follow up questions Sep 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working medium priority
Projects
Status: 🏗 In Progress
Development

No branches or pull requests

3 participants