Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add TextGenerationWithCotReflection task #1031

Open
wants to merge 4 commits into
base: develop
Choose a base branch
from

Conversation

gabrielmbmb
Copy link
Member

Description

This PR adds a new task called TextGenerationWithCotReflection that uses Chain of Thought (CoT) and reflection to generate a response.

@gabrielmbmb gabrielmbmb added the enhancement New feature or request label Oct 10, 2024
@gabrielmbmb gabrielmbmb added this to the 1.5.0 milestone Oct 10, 2024
@gabrielmbmb gabrielmbmb requested a review from plaguss October 10, 2024 11:00
@gabrielmbmb gabrielmbmb self-assigned this Oct 10, 2024
@gabrielmbmb gabrielmbmb changed the title Cot reflection prompt Add TextGenerationWithCotReflection task Oct 10, 2024
Copy link

Documentation for this PR has been built. You can view it at: https://distilabel.argilla.io/pr-1031/

Copy link

codspeed-hq bot commented Oct 10, 2024

CodSpeed Performance Report

Merging #1031 will create unknown performance changes

Comparing cot-reflection-prompt (0be6b86) with develop (dc06161)

Summary

🆕 1 new benchmarks

Benchmarks breakdown

Benchmark develop cot-reflection-prompt Change
🆕 test_cache_time N/A 566.3 ms N/A

Copy link
Contributor

@plaguss plaguss left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we add a default structured generation in this task, or is not worth it?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
Status: No status
Development

Successfully merging this pull request may close these issues.

2 participants