v0.6.0
What's Changed
- New requests queue by @irar2 in #214
- Make writing to channels non-blocking by @irar2 in #225
- Change packages' dependencies by @irar2 in #229
- Added port header to response by @irar2 in #232
- Test fix: number of running requests can be one request less when scheduling requests by @irar2 in #231
- fix occasional ttft and tpot metrics test failures by @mayabar in #233
- Configure the tool_choice option to use a specific tool by @MondayCha in #234
- Additional latency related metrics by @mayabar in #237
- Changed random from static to a field in the simulator by @irar2 in #238
- Made workers' requests channel non-blocking by @irar2 in #239
New Contributors
- @MondayCha made their first contribution in #234
Full Changelog: v0.5.2...v0.6.0