- #4
日志
日志
25.2.19
在下一次停机维护时, 我们会测试使用lmdeploy替代vllm的效果, 也许能提高生成速度.
我之前也试过一次, 但是当时lmdeploy还很不成熟.
25.2.19
We'll try using lmdeploy instead of vllm to increase speed, when next time doing maintaince work.
I tried it once before, but lmdeploy was fairly immature back to then.