사내대장부의 AI 사내대장부의 AI

AI/논문 리뷰

• OLMES: A Standard for Language Model Evaluations

  AI/논문 리뷰 2024. 7. 9. 20:17

  현재까지 language model을 evaluate하는 standard setup이 존재하지 않음.본 논문에서 제안하는 OLMES 는 standard, reproducible LLM evaluation.https://github.com/allenai/OLMo-Eval/tree/main GitHub - allenai/OLMo-Eval: Evaluation suite for LLMsEvaluation suite for LLMs. Contribute to allenai/OLMo-Eval development by creating an account on GitHub.github.com 1. IntroductionCurrently, there is no standard way to decide how to p..

  Read More