Curated resources: AI Product x How to eval?
List of resouces for building a solid eval pipeline for your AI product
Mar 9, 20252 min read523
Command Palette
Search for a command to run...
#evals
Articles tagged with #evals
Order of fields in Structured output can hurt LLMs output
Evals on how does the order of fields in prompts w/ structured output(JSON) affect the LLM response quality
Jan 5, 20254 min read3.3K
Experiments with gpt-4o vision and architecture diagrams
Eval based experimentation to figure out how well it works with architecture diagrams
Oct 22, 20244 min read859
Notes on evals in LLM-based applications
A big lesson I've learned while building LLM-based applications: "Unless you have a closed feedback loop, nothing you do will be good enough" Allow me to explain. When building an LLM app, I constantly found myself chasing 100s of different optimizat...
Jul 22, 20242 min read191