Skip to content

Audio docs#527

Open
tukwila wants to merge 2 commits intovllm-project:mainfrom
tukwila:audio_docs
Open

Audio docs#527
tukwila wants to merge 2 commits intovllm-project:mainfrom
tukwila:audio_docs

Conversation

@tukwila
Copy link
Contributor

@tukwila tukwila commented Jan 13, 2026

Summary

Details

  • [ ]

Provide audio benchmark practice guide based on mock-server.

Test Plan

Related Issues

  • Resolves #

  • "I certify that all code in this PR is my own, except as noted below."

Use of AI

  • Includes AI-assisted code completion
  • Includes code generated by an AI application
  • Includes AI-generated tests (NOTE: AI written tests should have a docstring that includes ## WRITTEN BY AI ##)

Signed-off-by: guangli.bao <guangli.bao@daocloud.io>
Signed-off-by: guangli.bao <guangli.bao@daocloud.io>
@jaredoconnell
Copy link
Collaborator

Please fill in the necessary components of the PR template. Especially the certification that the work is your own, and the AI section if applicable.

Copy link
Collaborator

@sjmonson sjmonson left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Needs python -m mdformat docs/examples/practice_on_audio_benchmark.md to make lintier happy.

In a new terminal, start the mock server using:

```bash
guidellm mock-server --host 0.0.0.0 --port 8080
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Since everything below refers to 127.0.0.1, just bind to the one address:

Suggested change
guidellm mock-server --host 0.0.0.0 --port 8080
guidellm mock-server --host 127.0.0.1--port 8080

Comment on lines +19 to +21
git clone https://github.com/vllm-project/guidellm.git
cd guidellm
pip install guidellm
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
git clone https://github.com/vllm-project/guidellm.git
cd guidellm
pip install guidellm
pip install guidellm

-F "file=@/hello.mp3"
```

#### 1.7 Benchmark Test Data Generation
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Since you install gTTS above, why not use it to generate a dataset here? Something like:

from gtts import gTTS
from faker import Faker
import wave

...

for i in range(count):
    prompt = faker.text(max_nb_chars=100)
    tts = gTTS(prompt)
    tts.save(audio_filename)

    ...

I did not do any verification on this so it may not work.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants