{"product_id":"evals-for-ai-engineers-systematically-measuring-and-improving-ai-applications","title":"Evals for AI Engineers: Systematically Measuring and Improving AI Applications","description":"\u003cp\u003e\u003cspan\u003eEvals for AI Engineers: Systematically Measuring and Improving AI Applications\u003c\/span\u003e\u003c\/p\u003e\n\u003cp\u003e\u003cspan\u003eStop relying on guesswork to determine how well your AI applications perform. \u003c\/span\u003e\u003cspan\u003eEvals for AI Engineers\u003c\/span\u003e\u003cspan\u003e by Shreya Shankar and Hamel Husain provides a practical, systematic approach to testing, measuring, and improving AI applications, particularly those powered by Large Language Models (LLMs).\u003c\/span\u003e\u003c\/p\u003e\n\u003cp\u003e\u003cspan\u003eDrawing on their extensive experience working with more than 35 AI products and cutting-edge research, the authors explain how to build reliable, high-quality AI systems that perform consistently in real-world production environments.\u003c\/span\u003e\u003c\/p\u003e\n\u003cp\u003e\u003cspan\u003eThis hands-on guide helps AI engineers, software developers, technical product managers, and technical leads establish effective evaluation processes that evolve alongside their applications.\u003c\/span\u003e\u003c\/p\u003e\n\u003cp\u003e\u003cstrong\u003e\u003cspan style=\"color: rgb(255, 42, 0);\"\u003eWhat You Will Learn:\u003c\/span\u003e\u003c\/strong\u003e\u003c\/p\u003e\n\u003cul\u003e\n\u003cli\u003e\n\u003cdiv\u003e\n\u003cdiv\u003e\n\u003cp\u003e\u003cspan\u003eIdentify and Prioritize Failures:\u003c\/span\u003e\u003cspan\u003e Perform systematic error analysis, identify recurring issues, and create representative test sets to uncover weaknesses in AI applications.\u003c\/span\u003e\u003c\/p\u003e\n\u003c\/div\u003e\n\u003c\/div\u003e\n\u003c\/li\u003e\n\u003cli\u003e\n\u003cdiv\u003e\n\u003cdiv\u003e\n\u003cp\u003e\u003cspan\u003eBuild Reliable Evaluations:\u003c\/span\u003e\u003cspan\u003e Combine code-based checks, LLM-as-a-judge techniques, human feedback, and synthetic data to create trustworthy evaluation systems.\u003c\/span\u003e\u003c\/p\u003e\n\u003c\/div\u003e\n\u003c\/div\u003e\n\u003c\/li\u003e\n\u003cli\u003e\n\u003cdiv\u003e\n\u003cdiv\u003e\n\u003cp\u003e\u003cspan\u003eImprove AI Application Quality:\u003c\/span\u003e\u003cspan\u003e Develop continuous evaluation processes to measure and improve the accuracy, reliability, and overall performance of AI applications.\u003c\/span\u003e\u003c\/p\u003e\n\u003c\/div\u003e\n\u003c\/div\u003e\n\u003c\/li\u003e\n\u003cli\u003e\n\u003cdiv\u003e\n\u003cdiv\u003e\n\u003cp\u003e\u003cspan\u003eMonitor Production Systems:\u003c\/span\u003e\u003cspan\u003e Track regressions, identify performance issues, and maintain consistent quality as AI applications evolve.\u003c\/span\u003e\u003c\/p\u003e\n\u003c\/div\u003e\n\u003c\/div\u003e\n\u003c\/li\u003e\n\u003cli\u003e\n\u003cdiv\u003e\n\u003cdiv\u003e\n\u003cp\u003e\u003cspan\u003eOptimize Performance and Costs:\u003c\/span\u003e\u003cspan\u003e Balance application quality, response latency, and operational costs when deploying AI systems at scale.\u003c\/span\u003e\u003c\/p\u003e\n\u003c\/div\u003e\n\u003c\/div\u003e\n\u003c\/li\u003e\n\u003c\/ul\u003e\n\u003cp\u003e\u003cstrong\u003e\u003cspan style=\"color: rgb(255, 42, 0);\"\u003eWho Should Read This Book?\u003c\/span\u003e\u003c\/strong\u003e\u003c\/p\u003e\n\u003cul\u003e\n\u003cli\u003e\n\u003cdiv\u003e\n\u003cdiv\u003e\n\u003cp\u003e\u003cspan\u003eAI Engineers and Machine Learning Engineers\u003c\/span\u003e\u003c\/p\u003e\n\u003c\/div\u003e\n\u003c\/div\u003e\n\u003c\/li\u003e\n\u003cli\u003e\n\u003cdiv\u003e\n\u003cdiv\u003e\n\u003cp\u003e\u003cspan\u003eSoftware Engineers and AI Developers\u003c\/span\u003e\u003c\/p\u003e\n\u003c\/div\u003e\n\u003c\/div\u003e\n\u003c\/li\u003e\n\u003cli\u003e\n\u003cdiv\u003e\n\u003cdiv\u003e\n\u003cp\u003e\u003cspan\u003eGenerative AI and LLM Application Developers\u003c\/span\u003e\u003c\/p\u003e\n\u003c\/div\u003e\n\u003c\/div\u003e\n\u003c\/li\u003e\n\u003cli\u003e\n\u003cdiv\u003e\n\u003cdiv\u003e\n\u003cp\u003e\u003cspan\u003eTechnical Product Managers\u003c\/span\u003e\u003c\/p\u003e\n\u003c\/div\u003e\n\u003c\/div\u003e\n\u003c\/li\u003e\n\u003cli\u003e\n\u003cdiv\u003e\n\u003cdiv\u003e\n\u003cp\u003e\u003cspan\u003eTechnical Leads and Engineering Teams\u003c\/span\u003e\u003c\/p\u003e\n\u003c\/div\u003e\n\u003c\/div\u003e\n\u003c\/li\u003e\n\u003c\/ul\u003e","brand":"Shroff\/O'Reilly","offers":[{"title":"Default Title","offer_id":50915626123334,"sku":"9789368083085","price":1260.0,"currency_code":"INR","in_stock":true}],"thumbnail_url":"\/\/cdn.shopify.com\/s\/files\/1\/0754\/2797\/1142\/files\/9789368083085.png?v=1793688906","url":"https:\/\/cb-india.com\/products\/evals-for-ai-engineers-systematically-measuring-and-improving-ai-applications","provider":"Computer Bookshop (India) Pvt Ltd","version":"1.0","type":"link"}