Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

LangGraph has been used to create a multi-agent large language model (LLM) coding framework. This framework is designed to automate various software development tasks, including coding, testing, and ...