Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

support CUDNN FA #68360

Open
wants to merge 4 commits into
base: incubate/fleety
Choose a base branch
from
Open

support CUDNN FA #68360

wants to merge 4 commits into from
+1,872 −2,439

Conversation

GuoxiaWang
Copy link
Contributor

PR Category

Performance Optimization

PR Types

Improvements

Description

support CUDNN FA

Wong4j and others added 4 commits September 18, 2024 10:43
@Wong4j @GuoxiaWang
update cudnn flash attention (PaddlePaddle#63028)
ece960f 
update cudnn flash attention
@deepllz @Wong4j @GuoxiaWang
Unify fused_dot_product_attention with scaled_dot_product_attention (P…
6c4c669 
…addlePaddle#65507)

* update cudnn flash attention

fix error

fix pir pass

fix ci

add more ut

minor changes

remove workspace_opt env

minor change

update api doc

* polish

* fix static test

* revert graph_pattern_detector.cc modify

---------

Co-authored-by: Shijie Wang <[email protected]>
@GuoxiaWang
add hopper arch support for flash_attention
cd3a7a7
@GuoxiaWang
add flag PADDLE_DISABLE_CUDNN_FA to disable use cudnn fa
5f0c5d9
@CLAassistant
Copy link

CLAassistant commented Sep 22, 2024 •
edited
Loading

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.
1 out of 3 committers have signed the CLA.

✅ deepllz
❌ GuoxiaWang
❌ Wong4j
You have signed the CLA already but the status is still pending? Let us recheck it.

@CLAassistant
Copy link

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.
1 out of 3 committers have signed the CLA.

✅ deepllz
❌ Wong4j
❌ GuoxiaWang
You have signed the CLA already but the status is still pending? Let us recheck it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@GuoxiaWang @CLAassistant @Wong4j @deepllz