AIs solving shallow problems is NOT the most critical issue.
lmsys.org @lmsysorg Introducing VTC: the first fair scheduler for LLM serving. Are you troubled by OpenAI’s rate limit? Although it’s a necessary mechanism to prevent any single client from monopolizing the request queue, we demonstrate that it doesn’t guarantee either fairness among clients or… https://pic.twitter.com/Bs42RloLHS Replying to @lmsysorg I would much rather have a price
Read More »