Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Parler TTS #791

Open
wants to merge 4 commits into
base: master
Choose a base branch
from
Open

Add Parler TTS #791

wants to merge 4 commits into from

Conversation

EricLBuehler
Copy link
Owner

@EricLBuehler EricLBuehler commented Sep 25, 2024

Model: parler-tts/parler-tts-mini-v1

TODO list:

  • ParlerForCausalGen
    • T5 encoder-decoder
    • ParlerTTSForCausalLM decoder
      • ParlerTTSDecoder
        • ParlerTTSSinusoidalPositionalEmbedding
        • Other RoPE is same as Llama, gptx=true
        • ParlerTTSDecoderLayer
          • Self and cross attn: ParlerTTSAttention
          • FC parts
    • Parler DAC model
      • DAC
        • Encoder
        • Decoder
        • Residual vector quantizer
    • Forward pass

@EricLBuehler EricLBuehler added new feature New feature or request models Additions to model or architectures labels Sep 25, 2024
Copy link

github-actions bot commented Sep 25, 2024

Code Metrics Report
  ===============================================================================
 Language            Files        Lines         Code     Comments       Blanks
===============================================================================
 C Header                2           35           28            0            7
 Dockerfile              1           34           25            0            9
 Happy                   1          442          369            0           73
 JSON                   12          105          104            0            1
 Python                 52         2280         1940           68          272
 TOML                   20          630          564            2           64
 YAML                    2           21           19            2            0
-------------------------------------------------------------------------------
 Jupyter Notebooks       4            0            0            0            0
 |- Markdown             2           77           32           31           14
 |- Python               2          196          169            1           26
 (Total)                            273          201           32           40
-------------------------------------------------------------------------------
 Markdown               38         2802            0         2131          671
 |- BASH                 6          103          100            0            3
 |- JSON                 1           12           12            0            0
 |- Python               5           92           82            0           10
 |- Rust                 9          322          274            0           48
 |- TOML                 2           75           63            0           12
 (Total)                           3406          531         2131          744
-------------------------------------------------------------------------------
 Rust                  268        79270        71157         1678         6435
 |- Markdown           131         1363           25         1243           95
 (Total)                          80633        71182         2921         6530
===============================================================================
 Total                 401        85619        74206         3881         7532
===============================================================================
  

@EricLBuehler EricLBuehler mentioned this pull request Sep 30, 2024
11 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
models Additions to model or architectures new feature New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant