Practical LLM Evaluation for Production Systems
Idioma: inglés
Editorial: Packt Publishing, 2026
- Tapa blanda
- Nuevo

Librería: PBShop.store US, Wood Dale, IL, Estados Unidos de AmericaPBShop.store US
Vendedor de IberLibro desde 7 de abril de 2005
Condición: Nuevo
EUR 61,07
Cantidad disponible: Más de 20 disponibles
Añadir al carritoDescripción del artículo del vendedor
New Book. Shipped from UK. THIS BOOK IS PRINTED ON DEMAND. Established seller since 2000.
N° de ref. del artículo L0-9781807423896
- Título
- Practical LLM Evaluation for Production Systems
- Autor
- Kar, Indrajit
- Editorial
- Packt Publishing
- Año de publicación
- 2026
- Estado
- New
- Encuadernación
- PAP
- Idioma
- inglés
- ISBN 10
- 1807423891
- ISBN 13
- 9781807423896
- Peso del artículo
- 902 gramos
Build reliable Build reliable AI evaluation frameworks that measure quality, safety, grounding, and production readiness across modern LLM and SLM applications
Free with your book: DRM-free PDF version + access to Packt's next-gen Reader*
Key Features
- Design evaluation frameworks for LLMs, SLMs, multimodal, reasoning, and agentic AI systems
- Measure quality, safety, grounding, robustness, and production readiness with practical metrics
- Apply unified evaluation methods to text, multimodal, and agentic AI systems
Book Description
Modern AI systems are expected to do far more than generate fluent text. They should be able to retrieve information, reason through complex problems, understand images and documents, call external tools, execute workflows, and support critical business decisions. Evaluating these systems requires methods that go beyond traditional NLP benchmarks.
Taking a product-first approach, this book presents evaluation as a continuous operational capability spanning training, inference, and end-to-end system operation. You'll learn how to connect evaluation metrics directly to deployment gates, rollback criteria, monitoring systems, and production reliability objectives.
Using practical examples and real-world workflows, you'll explore evaluation strategies for text LLMs, vision-language models, multimodal conversational systems, mixture-of-experts architectures, reasoning models, agentic systems, retrieval pipelines, Text2SQL and Text2Cypher systems, embedding models, OCR workflows, and guardrail SLMs. You'll also learn how to manage non-determinism, design repeatable test suites, validate tool execution, and measure long-horizon agent behavior in production.
By the end of the book, you'll be able to design robust evaluation systems that help teams deploy reliable, safe, and economically viable LLM-powered applications with confidence.
*Email sign-up and proof of purchase required
What you will learn
- Design repeatable evaluation pipelines for LLM systems
- Assess inference quality, latency, and operational cost
- Evaluate multimodal, agentic, and reasoning AI systems
- Build regression gates and deployment evaluation workflows
- Detect hallucinations and grounding failures in VLMs
- Assess routing stability in mixture-of-experts models
- Evaluate Text2SQL, OCR, and retrieval-based systems
- Translate evaluation signals into production decisions
Who this book is for
ML engineers, GenAI engineers, AI architects, data scientists, platform engineers, and engineering managers responsible for deploying LLM-powered systems in production will benefit from this book. Applied AI researchers and technical decision-makers looking to measure reliability, safety, and operational readiness across modern AI systems will also find it valuable. Readers should have a working understanding of machine learning, Python, and modern LLM concepts.
Table of Contents
- Foundations of LLM Evaluation: Core Concepts and Primitives
- Building Reliable Text-Only LLMs Through Training-Time Evaluation
- Controlling Text-Only LLM Behavior at Inference Time
- Grounding and Reliability in Vision Language Models During Training
- Evaluating Visual Grounding and Reliability at Inference Time
- Evaluating Multimodal Conversational LLMs Across Training and Inference
- Evaluating Routing and Reliability in Mixture of Experts LLMs
- Evaluating Reliability and Control in Computer-Using Agent Systems
- Evaluating Information Extraction and Document-Understanding LLMs
- Evaluating Reasoning LLMs in Depth
- Evaluating Specialized LLM Systems
“Sinopsis” puede pertenecer a otra edición de este título.
Acerca del autor
Ammar Mohanna, PhD, is an AI and machine learning specialist based in Beirut, Lebanon. His work focuses on practical LLM systems, evaluation, MLOps/LLMOps, and applied generative AI. He teaches and consults on production AI, AI agents, and graph-based machine learning, with an emphasis on turning research ideas into reliable, usable systems for real-world teams.
Indrajit Kar comes with 18 years of various Industry experience, leading all three division, AI consulting R&D and solution engineering. He and his team build cutting edge AI and deep learning solutions to address some of the toughest problems for his customers. He has 14 research papers and 12 patents in NLP, Timeseries, Computer Vision, and Deep learning. In his spare time, Indrajit enjoys giving advice to small and medium-sized entrepreneurs on how to enter the AI and data science markets, attract customers, develop their products, and monetize their existing data. He's won many accolades in his career from ace innovator, services excellence awards, and 40 top data scientist under the age of 40 award. He has enabled AI & Data science program for sectors like Smart Cities, Retail, supply chain, automotive factories, Healthcare, pharma, infrastructure & utilities. Also heading research and development in the area of Deep learning, predictive maintenance using IIoT/sensor data, edgeAi, Lidar tech, NLP and GPU powered computer vision. In the past, he spearheaded complex Analytics projects helping industries like BFSI, Retail, CPG, FMCG, petroleum/oil & gas, to take data driven decision, predict business outcomes, allocate budget, predict customer behaviour, retention customers, acquire new customers, maximize revenue & forecasting for key areas Pricing, marketing, sale, advertisement and promotion.
Zonunfeli Ralte is an Artificial Intelligence entrepreneur, researcher, and technology leader. She founded RastrAI Private Limited, the first AI startup from India's North East region, advancing innovation in emerging technologies. Recognized as Mizoram's first woman specializing in Artificial Intelligence and Machine Learning, she has authored three books on Artificial Intelligence, Generative AI, and Computer Vision. She is also an accomplished researcher with 16 published research papers and six Best Research Awards, reflecting her significant contributions to Artificial Intelligence, Deep Learning, and applied AI innovation.
“Acerca de” puede pertenecer a otra edición de este título.
PBShop.store US
Wood Dale, IL, Estados Unidos de America
Vendedor de IberLibro desde 7 de abril de 2005
Tarifas de envío en Estados Unidos de America
| Artículo | De 7 a 14 días hábiles | De 7 a 14 días hábiles |
|---|---|---|
| Primer artículo | EUR 0,00 | EUR 0,00 |
Métodos de pago
Descripción de la tienda
We first started out as “The Paperback Exchange,” a chain of physical bookstores where we would part exchange your beloved books for new stories to transport you to faraway places. However, as shopping started to evolve to online shops and marketplaces, we bid our stores goodbye to become “PBShop.” This transition has only allowed us to blossom as we now ship thousands of titles to book lovers across the globe. We pride ourselves in being a community of local book lovers which allows our passion and devotion to shine in everything we do. In 2020 we not only celebrated our 20th birthday but our 1st birthday as being completely employee owned after becoming an E.O.T in September 2019. We are proud to be different and embrace standing apart on a book mountain by working from a virtual inventory which allows us to provide thousands of books that may be difficult to get for your bookshelf or your studies. Working with a number of different suppliers allows us to explore other avenues such as puzzles, sheet music and even stationery so we really do have something for everyone. Life is about being versatile in all realms of existence. If this is your first visit or you are a returning customer, we would like to welcome you to the PBShop family, for there is no friend as loyal as a book. We are a company who put our customers at the centre of everything we do as we understand the importance of reading because once you learn to read, you will forever be free. There are a whole lot of things in this world of ours that we are yet to explore, which is why we will forever inspire curious minds.…
Especialidad
Hardbacks, PaperbacksInformación empresarial del vendedor
Pbshop.co.uk Ltd
Unit 22 Horcott Industrial Estate, Horcott Road
Fairford, Reino Unido GL7 4BX
Condiciones de venta
Returns Policy
We ask all customers to contact us for authorisation should they wish to return their order. Orders returned without authorisation may not be credited.
If you wish to return, please contact us within 14 days of receiving your order to obtain authorisation.
Returns requested beyond this time will not be authorised.
Our team will provide full instructions on how to return your order and once received our returns department will process your refund.
Please note the cost to return any unwanted order to us is borne by the buyer.
Should your order arrive damaged, not as advertised or faulty, we must be advised of this within 14 days of delivery. Please contact us so we can find the best solution for you.
Our Customer Care Team can be contacted via emailing paperback-us@paperbackshop.co.uk, or by calling our UK Office on +441285 712 917. We are available 9:00am till 5:30pm GMT weekdays and 9:00am till 1:00pm GMT on Saturdays.
Derecho al desistimiento
Si es un consumidor, puede rescindir el contrato de acuerdo con lo siguiente. Por consumidor se entiende cualquier persona física que actúe con fines ajenos a su actividad comercial, empresarial, oficio o profesión.
Información sobre el derecho de desistimiento
Derecho legal de desistimiento
Tiene derecho a rescindir este contrato en un plazo de 14 días sin dar ningún motivo.
El periodo de desistimiento vencerá a los 14 días desde que usted, o un tercero que no sea el transportista e indicado por usted, adquiera la posesión física del último bien o del último lote o pieza.
Para ejercer el derecho de desistimiento, complete de forma electrónica y envíe una declaración clara en nuestro sitio web, desde "Mis compras" en "Mi cuenta". Le enviaremos sin demora un acuse de recibo de dicho desistimiento a través de un soporte duradero (por ejemplo, por correo electrónico).
Para cumplir con el plazo de desistimiento, basta con que envíe su comunicación relativa al ejercicio del derecho de desistimiento antes de que venza el periodo de desistimiento.
Efectos del desistimiento
Si rescinde este contrato, le reembolsaremos todos los pagos que hayamos recibido de usted, incluidos los gastos de envío (excepto los gastos adicionales que surjan si elige un tipo de envío que no sea el tipo de envío estándar más económico que ofrecemos).
Podemos hacer una deducción del reembolso por la pérdida de valor de cualquier bien suministrado, si la pérdida es el resultado de una manipulación innecesaria por su parte.
Efectuaremos el reembolso sin demoras indebidas y, a más tardar, 14 días después de que se nos informe de su decisión de rescindir este contrato.
Efectuaremos el reembolso utilizando el mismo medio de pago que utilizó para la transacción inicial, a menos que haya acordado expresamente lo contrario; en cualquier caso, no incurrirá en ningún cargo como resultado de dicho reembolso.
Podremos retener el reembolso hasta que hayamos recibido los bienes o hasta que nos haya presentado una prueba de que los ha devuelto, lo que ocurra primero.
Deberá devolver los bienes o entregarlos a PBShop.store US, Springfield Gardens, New York, U.S.A., +44 1285 712917, sin demoras indebidas y, en cualquier caso, en un plazo máximo de 14 días a partir del día en que nos comunique su desistimiento del presente contrato. El plazo se cumple si devuelve la mercancía antes de que venza el periodo de 14 días. Tendrá que asumir los gastos directos de devolución de los bienes. Usted solo es responsable de la disminución del valor de los bienes como resultado de una manipulación distinta a la necesaria para establecer la naturaleza, las características y el funcionamiento de los bienes.
Excepciones al derecho de desistimiento
El derecho de desistimiento no se aplica a lo siguiente:
- La entrega de periódicos, diarios o revistas, con la excepción de los contratos de suscripción; y
- El suministro de contenido digital que no se proporcione en un soporte tangible (por ejemplo, en un CD o DVD) si, al hacer el pedido, aceptó que podíamos empezar a entregarlo y que no podría desistir una vez iniciada la entrega.
Condiciones de envío
Books are shipped from our US or UK warehouses. Delivery estimates allow for delivery from either location.
Privacidad y seguridad
PRIVACY POLICY
We are committed to protecting the privacy and security of personal data. This policy tells you how we will collect and use your personal data, and what you should expect in respect of the personal information about you that we have collected.
We are PBShop.co.uk Limited (registered in England & Wales with Company No: 9366362). Our registered office is at Swatton Barn, Badbury, Swindon, SN4 0EU, United Kingdom.
The person with responsibility for our data protection compliance is the Managing Director and they can be contacted via email at help@pbshop.store.
We are the data controller of the personal data that we keep and use, and we are therefore responsible for making sure that our systems, processes and people comply with the relevant data protection laws in respect of that personal data.
We will act in respect of personal data to comply with the six principles of the General Data Protection Regulation (“GDPR”), which are:
Lawfulness, fairness and transparency;
Purpose limitation;
Data minimisation;
Accuracy;
Storage limitation;
Integrity and confidentiality.
You have rights in respect of how your personal data can be processed; these include the right to request:
a copy of your personal data;
that inaccurate data is rectified; and
that your personal data is, in certain circumstances, erased or restricted.
You have the right to complain to the Information Commissioner, which you can do by contacting the Information Commissioner’s Office (ICO) directly. Full contact details, including a helpline number, can be found on the ICO website (www.ico.org.uk). This website also has useful information on your rights and our obligations. However, please raise any concerns or issues with us first so that we may deal with this as quickly as possible for you.
COLLECTION, USE AND DISCLOSURE OF PERSONAL DATA
We collect and process data for the following reasons:
personal data collected and created in relation to our selling books and other items; and
personal data relating to our people (which means those people working for our company, or providing services to us, or potentially working or providing services to us, including employees, consultants, temporary or casual workers and contractors).
All of our people are required to abide by our Privacy Policy when handling personal data, and are provided with appropriate data protection training. Any breach of data protection will be taken seriously, and may result in disciplinary action.
Selling books and other items
COLLECTION:
We will collect personal information which may include names, addresses and other information for our customers. This will be done for the management of the commercial relationship with our customers.
We may collect this personal data from you directly, and also from third parties, including publicly available third party sources. Additional personal data will be collected as it is created by or supplied to us in the course of anything we do for you.
USE:
We will use the personal data in the course of making sales and to comply with requirements that we are required to undertake.
We will only use your personal data when the law allows us to. Most commonly, we will use your personal data in the following circumstances:
in performance of a contract (the agreement to sell books and other items); and/or
compliance with a legal obligation; and/or
vital interests of the data subject; and/or
where it is necessary for our legitimate interests (or those of a third party) and your interests and fundamental rights do not override those interests.
We may also use your personal data in the following situations, which are likely to be far less common:
where we need to protect your interests (or someone else’s interests);
where it is needed in the public interest or for official purposes.
DISCLOSURE:
We may share personal data with third parties as is necessary in the sale of books and other items, including to third party providers who deliver services to support the operation of our company.
In respect of all disclosures of personal data, we will only share the personal information which is necessary for the particular purpose for which it is provided, or where we have another legitimate interest in doing so, and we will ensure that the personal data is appropriately protected.
RETENTION PERIOD:
We will keep personal data only for as long as is necessary to fulfil the purposes for which we collected it, including for the purposes of satisfying any legal, accounting or reporting requirements. Normally, our retention period for personal data collected for this purpose is a minimum of 6 years after the end of the period that we are selling books and other items.
Our people
COLLECTION:
We will collect names, addresses, contact details, education and employment history, identity and other background checks (which may include appropriate criminal and financial checks and confirmation of the right to work in the UK), marital status and information on next of kin and dependents, financial information (such as bank details and NI numbers), date of birth, gender, a copy of your passport and driving licence, performance information and compensation history, recruitment information (including references), salary, benefits, pension and annual leave information, disciplinary and grievance information, photographs, information about your use of our information and communications systems and CCTV footage or other information obtained through electronic means.
We may collect and use special categories of personal data as required in the carrying out of obligations and exercising specific rights of us or the data subject in the field of employment. This may include information relating to matters such as health, racial origin, religious belief and offences or alleged offences.
Personal data may be collected from you during the selection process (for example via your application form and CV) and during your employment (including holiday forms, expense claims, performance reviews, any disciplinary or grievance processes), or from third parties, including referees, health service providers, background check providers.
USE:
Personal data of our people will be used for HR administration and management, both in respect of the selection of people to work for us (including suitability, eligibility and/or fitness to work), and those who do work for us, to include learning and development, disciplinary and security (of people, offices and data) requirements, providing and liaising with benefits providers, business management and planning (including accounting and auditing), paying you and dealing with tax and NI deductions, assessing and deciding on salary reviews and compensation, conducting performance reviews and managing performance, dealing with legal disputes involving you or others, preventing fraud, monitoring your use of our information and communications systems, ensuring compliance with our policies, and equal opportunities monitoring.
We will only use your personal data when the law allows us to. Most commonly, we will use your personal data in the following circumstances:
In performance of a contract with you; and/or
compliance with a legal obligation; and/or
vital interests of the data subject; and/or
where it is necessary for our legitimate interests (or those of a third party) and your interests and fundamental rights do not override those interests.
We may also use your personal data in the following situations, which are likely to be less common:
where we need to protect your interests (or someone else’s interests);
where it is needed in the public interest or for official purposes.
In respect of all disclosures of personal data, we will only share the personal information which is necessary for the particular purpose for which it is provided, or where we have another legitimate interest in doing so, and we will ensure that the personal data is appropriately protected.
In respect of special categories of personal data, we may process this in the following circumstances:
in limited circumstances with your explicit written consent; and/or
where we need to carry out our legal obligations and in line with our policies; and/or
where it is needed in the public interest (such as for equal opportunities monitoring or in relation to our occupational pension scheme), and in line with our policies; and/or
where it is needed to assess your working capacity on health grounds, subject to appropriate confidentiality safeguards.
Less commonly, we may process this type of information where it is needed in relation to legal claims or where it is needed to protect your (or someone else’s) interests and you are not capable of giving your consent, or where you have already made the information public. We may also process such information about our people (or former people) in the course of our legitimate business activities with the appropriate safeguards.
The special categories of personal data may be used in the following ways:
in relation to leaves of absence, to comply with employment and other laws;
in relation to your physical or mental health, or disability status, to ensure your health and safety in the workplace and to assess your fitness to work, to monitor, manage and administer benefits and absences;
in relation to your race, national or ethnic origin, religious, philosophical or moral beliefs, or your sexual life or sexual orientation, to ensure meaningful equal opportunity monitoring and reporting.
DISCLOSURE:
Personal data may be transferred to service providers who support the operation of our business (such as payroll service providers), to other third parties reasonably necessary in the conduct of our business (including insurers, professional advisors, regulators). These third parties may be acting as processor, or controller of personal data in their own right.
In respect of all disclosures of personal data, we will only share the personal information which is necessary for the particular purpose for which it is provided, or where we have another legitimate interest in doing so, and we will ensure that the personal data is appropriately protected.
RETENTION PERIOD:
We will keep personal data only for as long as is necessary to fulfil the purposes for which we collected it, including for the purposes of satisfying any legal, accounting or reporting requirements. We will normally keep personal data of applicants who we do not employ for six months after we receive it.
We will keep personal data of employees throughout your employment and normally for a minimum of six years after your employment ends.
Changes to your personal data
It is very important that the personal information that we hold about you is accurate and current. Please tell us if your personal information changes during your relationship with us.
Data Security
We have put in place measures to prevent your personal data from being accidentally lost, used or accessed in an unauthorised way, altered or disclosed. In addition, we limit access to your personal data to those of our people and other third parties who have a business need to know. They will only process your personal data on our instructions and where they have agreed to treat the information confidentially and to keep it secure. We have put in place procedures to deal with any suspected data security breach and will notify you and the ICO of a suspected breach where we are legally required to do so.
Where we store your personal data
We principally store data, both electronically and on file, at our office.
Personal data may be transferred outside of the EEA by processors acting on our behalf. For transfers to countries not considered adequate by the EC, we will ensure that personal data is adequately protected, as required by the GDPR. This would include by use of the Standard Contractual Clauses adopted by the EC to protect personal data.
Your rights
Under certain circumstances, you have the right by law to request:
access to your personal data. This enables you to ask to receive a copy of the personal data that we hold about you and to check that we are lawfully processing it.
correction of the personal data that we hold about you.
erasure of your personal data.
object to processing of your personal data where we are relying on our legitimate interest and there is something about your particular situation which makes you want to object to processing on this ground. You also have the right to object where we are processing your personal information for direct marketing purposes.
restriction of processing of your personal data.
transfer of your personal data to another party.
Links from our website
Our website may, from time to time, contain links to and from the websites of third parties that we permit to make such links. If you follow a link to any of these websites, please note that these websites have their own privacy policies and that we do not accept any responsibility or liability for these policies. We recommend that you check these policies before you submit any personal data to these websites.
CHANGES TO THIS PRIVACY POLICY
Any changes we may make to our privacy policy in the future will be posted on our website, so please ensure that you are viewing the correct version.
Please contact us if you have any questions, comments or requests regarding this Privacy Policy.
Last amended May 2021.