Skip to content

Commit

Permalink
Merge pull request #400 from abhi1092/knowledge_tag_fix
Browse files Browse the repository at this point in the history
Add [End] to parser cleanup tags
  • Loading branch information
mergify[bot] authored Nov 19, 2024
2 parents 8bb8e3b + 6a88422 commit 336734f
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions src/instructlab/sdg/pipelines/full/knowledge.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -43,6 +43,7 @@ blocks:
parsing_pattern: '\[(?:Question|QUESTION)\]\s*(.*?)\s*\[(?:Answer|ANSWER)\]\s*(.*?)\s*(?=\[(?:Question|QUESTION)\]|$)'
parser_cleanup_tags:
- "[END]"
- "[End]"
gen_kwargs:
max_tokens: 2048
drop_duplicates:
Expand Down

0 comments on commit 336734f

Please sign in to comment.