diff --git a/README.md b/README.md index e6f4ee8..7f849b4 100644 --- a/README.md +++ b/README.md @@ -4,6 +4,8 @@ Implementation of Perceiver AR, Deepmind's new long-context attention network based on Perceiver architecture, in Pytorch. +Generated piano samples + I am building this out of popular demand, not because I believe in the architecture. As someone else puts it succinctly, this is equivalent to an encoder / decoder transformer architecture where the encoder has 0 layers (and the decoder cross attention is restricted to 1 layer) However, the experimental results they provided are still worthwhile and I'll build it out so students and researchers alike can explore along this avenue.