Add Replicate demo and API #42
Conversation
|
Hi @chenxwh - Sure! Would be lovely to transfer it to my account: https://replicate.com/vaibhavs10 🤗 |
|
Great, it's https://replicate.com/vaibhavs10/incredibly-fast-whisper now! |
| @@ -16,6 +16,9 @@ Not convinced? Here are some benchmarks we ran on a free [Google Colab T4 GPU](/ | |||
| | Faster Whisper (`fp16` + `beam_size [1]`) | ~9.23 (*9 min 23 sec*) | | |||
| | Faster Whisper (`8-bit` + `beam_size [1]`) | ~8 (*8 min 15 sec*) | | |||
|
|
|||
| Try the Relicate demo here: [](https://replicate.com/cjwbw/insanely-fast-whisper) | |||
There was a problem hiding this comment.
That redirects to https://replicate.com/vaibhavs10/incredibly-fast-whisper .
Does it help you track incoming users?
There was a problem hiding this comment.
No that's just a leftover old URL that redirects to the renamed model.
| @@ -16,6 +16,9 @@ Not convinced? Here are some benchmarks we ran on a free [Google Colab T4 GPU](/ | |||
| | Faster Whisper (`fp16` + `beam_size [1]`) | ~9.23 (*9 min 23 sec*) | | |||
| | Faster Whisper (`8-bit` + `beam_size [1]`) | ~8 (*8 min 15 sec*) | | |||
|
|
|||
| Try the Relicate demo here: [](https://replicate.com/cjwbw/insanely-fast-whisper) | |||
There was a problem hiding this comment.
| Try the Relicate demo here: [](https://replicate.com/cjwbw/insanely-fast-whisper) | |
| Try the Relicate demo here: [](https://replicate.com/vaibhavs10/incredibly-fast-whisper) |
|
Sorry folks! been busy trying to figure out the best API and adding speaker diarization. Once I do that, we can update that on replicate, too, and perhaps do another round of comms. :) |
|
Sounds good. Would love to help with that. |
|
I unfortunately haven't! Would anyone of you be able to do that for me? |
|
@Vaibhavs10 Sure it's added! (btw GMT here) :D |
|
Ayy! lovely! @chenxwh nice to meet ya!! - How should we push this to Replicate? |
|
Oh, I just checked that it is already pushed to Replicate! I'm happy for y'all to do comms for this ofc (it is better if it comes from y'all than me 🤗)! |
|
Got a possible bug report about the replicate UI: #123 (comment) Feel free to ignore if not relevant! 🤗 |
|
☝🏼 That bug is still open but I don't think it should block this release. The Replicate model already has 44000 runs, so it's definitely working for people. @Vaibhavs10 anything else blocking getting this merged? |
|
Whatever is out there right now at https://replicate.com/vaibhavs10/incredibly-fast-whisper is definitely pretty broken , so if this pull request also fixes that it would be nice.
|
|
Looks like @chenxwh pushed a fix for that. |
|
Hey, can you add support for the whisper turbo model? |
Hi @Vaibhavs10!
Impressive work on
insanely-fast-whisper, especially for processing long audio inputs!This pull request makes it possible to run
insanely-fast-whisperon Replicate (https://replicate.com/cjwbw/insanely-fast-whisper) and via API (https://replicate.com/cjwbw/insanely-fast-whisper/api). Also happy to transfer the demo page to your account for easier modification :)