From bfa7526f3e8067620f094080abbd98be337474b3 Mon Sep 17 00:00:00 2001 From: Phil Wang Date: Sat, 18 Jun 2022 13:50:41 -0700 Subject: [PATCH] piano samples --- README.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/README.md b/README.md index e6f4ee8..7f849b4 100644 --- a/README.md +++ b/README.md @@ -4,6 +4,8 @@ Implementation of Perceiver AR, Deepmind's new long-context attention network based on Perceiver architecture, in Pytorch. +Generated piano samples + I am building this out of popular demand, not because I believe in the architecture. As someone else puts it succinctly, this is equivalent to an encoder / decoder transformer architecture where the encoder has 0 layers (and the decoder cross attention is restricted to 1 layer) However, the experimental results they provided are still worthwhile and I'll build it out so students and researchers alike can explore along this avenue.