Vidur is a high-fidelity LLM inference simulator, designed to aid capacity planning and deployment configuration optimization. Please refer to our MLSys'24 paper for more details. We have a live demo ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results
Feedback