0.8.1

What's Changed

Exciting New Features 🎉

• feat: add endpoint label to the code metrics by @kemingy in #437
• feat: add py 3.12 test and release by @kemingy in #447

More Documentation 📚

• docs: add build from source code guide by @kemingy in #431

Minor changes 🧹

• chore: fix CI docker release tag by @kemingy in #428
• chore: bump utoipa version, update dep license file by @kemingy in #453

Full Changelog: 0.8.0...0.8.1

0.8.0

What's Changed

Exciting New Features 🎉

• feat: support swagger-ui for the openapi by @n063h in #407
• feat: support multi-route with shared workers by @kemingy in #423

More Documentation 📚

• docs: update readme about pid 1 and dynamic batching by @kemingy in #400
• docs: fix readthedocs build config by @kemingy in #401
• docs: add performance tuning guide by @kemingy in #409
• docs: add concepts, faq, migration guide by @kemingy in #411

Minor changes 🧹

• chore: add readthedoc support by @kemingy in #396
• chore: add gpu docker image in release by @kemingy in #398
• chore: align the naming, fix the test lint by @kemingy in #399
• chore: add the codeql lint config by @kemingy in #406
• chore: fix the sphinx ci by @kemingy in #412
• chore: use collapsible readme by @lkevinzc in #413
• chore: add conda-forge badge to the readme by @kemingy in #425
• chore: increase the timeout for stable diffusion example by @kemingy in #427

Full Changelog: 0.7.2...0.8.0

0.7.2

What's Changed

Exciting New Features 🎉

• feat: provide openapi doc by @n063h in #370
• feat: support server sent event by @kemingy in #333
• feat: support --log-level CLI argument by @kemingy in #394

Refactoring 🧬

• refactor: sse abstraction in worker and coordinator by @kemingy in #391

Minor changes 🧹

• chore: add sleep to service test to catch the check bug by @kemingy in #380

Full Changelog: 0.7.1...0.7.2

v0.7.1

What's Changed

Changes 🛠

• fix: check child process exit code by @kemingy in #379

Full Changelog: 0.7.0...0.7.1

v0.7.0

What's Changed

Changes 🛠

• fix: use try to import msgspec by @lkevinzc in #368
• fix: plasma mixin should use super serde with shm storage by @kemingy in #369
• fix: args should only be checked when server is used by @kemingy in #371

Exciting New Features 🎉

• feat: add content type to the inference response header by @kemingy in #360
• feat: support redis shm mixin by @n063h in #367
• feat: support dynamic inference route by @cutecutecat in #374

More Documentation 📚

• docs: mark ipc wrapper as deprecated by @kemingy in #378

Minor changes 🧹

• chore: better logo for night mode by @lkevinzc in #365

New Contributors

• @cutecutecat made their first contribution in #374

Full Changelog: 0.6.7...0.7.0

v0.6.7

What's Changed

Exciting New Features 🎉

• feat: change plasma plugin to mixin by @kemingy in #350
• feat: support request validation according to annotation by @kemingy in #352

More Documentation 📚

• docs: fix plasma related doc, add deprecate warning by @kemingy in #354
• docs: combine the metrics related page by @kemingy in #358

Minor changes 🧹

• chore: only enable nightly test for Linux by @kemingy in #346
• chore: Add tencent cloud by @gaocegege in #356

Full Changelog: 0.6.6...0.6.7

v0.6.6

What's Changed

More Documentation 📚

• docs: add monitoring demo by @n063h in #325
• docs: rm the outdated comparison by @kemingy in #334

Refactoring 🧬

• refactor: switch to official prometheus client by @n063h in #335

Minor changes 🧹

• chore: Update adopters by @gaocegege in #336
• chore: add image by @lkevinzc in #337
• chore: add dependencies license file by @kemingy in #341

Full Changelog: 0.6.5...0.6.6

v0.6.5

What's Changed

Changes 🛠

• fix: avoid timeout test failing and orphan service in CI by @kemingy in #323

Exciting New Features 🎉

• feat: change parking lot mutex to std mutex by @kemingy in #315
• feat: add prefix to differentiate Mosec & user logs by @n063h in #318
• feat: use axum instead of pure hyper by @kemingy in #322
• feat: Set timeout for worker.forward by @n063h in #321

New Contributors

• @n063h made their first contribution in #318

Full Changelog: 0.6.4...0.6.5

v0.6.4

What's Changed

Changes 🛠

• fix: hold one lock at a time to avoid the deadlock in nested function by @kemingy in #316

Minor changes 🧹

• chore: skip the lint&test step in release by @kemingy in #312
• chore: add nightly bad req test by @kemingy in #313
• chore: use absolute import path by @lkevinzc in #314

Full Changelog: 0.6.3...0.6.4

v0.6.3

What's Changed

Changes 🛠

• fix: resolve deadlock when lots of client requests closed before response by @kemingy in #311

Full Changelog: 0.6.2...0.6.3