LLM Evaluation

SIGNAL ANALYSIS

Evaluating large language models in conversations is expensive and key events like jailbreaks emerge late. Dynamic budget allocation can help. This method could make LLM evaluation more efficient, but we don't know yet if it holds up outside the lab.