Rails World 2026 · September 2026
Your LLM Changed. Did It Get Better?
When you change the model or the prompt behind a Rails AI feature, how do you know the answers got better? I use a Rails and RubyLLM example app to show how LLM-as-judge metrics (relevance, faithfulness, correctness, factual accuracy, and context precision) turn that question into numbers you can compare.