Data-driven experimental analysis has become the main evaluation tool of Natural Language Processing (NLP) algorithms. In fact, in the last decade, it has become rare to see an NLP paper, particularly one that proposes a new algorithm, that does not include extensive experimental analysis, and the number of involved tasks, datasets, domains, and languages is constantly growing. This emphasis on empirical results highlights the role of statistical significance testing in NLP research: If we, as a community, rely on empirical evaluation to validate our hypotheses and reveal the correct language processing mechanisms, we better be sure that our results are not coincidental.

The goal of this book is to discuss the main aspects of statistical significance testing in NLP. Our guiding assumption throughout the book is that the basic question NLP researchers and engineers deal with is whether or not one algorithm can be considered better than another one. This question drivesthe field forward as it allows the constant progress of developing better technology for language processing challenges. In practice, researchers and engineers would like to draw the right conclusion from a limited set of experiments, and this conclusion should hold for other experiments with datasets they do not have at their disposal or that they cannot perform due to limited time and resources. The book hence discusses the opportunities and challenges in using statistical significance testing in NLP, from the point of view of experimental comparison between two algorithms. We cover topics such as choosing an appropriate significance test for the major NLP tasks, dealing with the unique aspects of significance testing for non-convex deep neural networks, accounting for a large number of comparisons between two NLP algorithms in a statistically valid manner (multiple hypothesis testing), and, finally, the unique challenges yielded by the nature of the data and practices of the field.

Acerca del autor

Rotem Dror is a Ph.D. student in the Natural Language Processing Research Group under the supervision of Professor Roi Reichart at the Technion, Israel Institute of Technology. Rotem's research interests lie in the intersection of Machine Learning, Statistics, Optimization, and Natural Language Processing. In her Ph.D., she focuses mainly on developing statistical methods for evaluating results of NLP tasks and on novel algorithms for structured prediction in NLP. Rotem's papers have been published in the top-tier conferences and journals of the NLP community. Rotem is a recipient of the Google Ph.D. Fellowship 2018.Lotem Peled-Cohen holds an M.Sc. in Natural Language Processing (cum laude) from the Technion, under the supervision of Professor Roi Reichart. Lotem's research revolved around textual sarcasm, and her work about sarcasm interpretation using monolingual Machine Translation was published in the ACL 2017 Proceedings and appeared in multiple media channels. After her studies, Lotem worked as a Data Scientist, focusing mostly on Conversational AI. She later became an independent consultant and lecturer at ML, NLP, and Deep Learning. Lotem was a lecturer at multiple colleges and presented in conferences worldwide. Nowadays, Lotem brings her ML & NLP expertise to the world of product management at Samsung Next, as part of the Whisk product department. Lotem works as an ML Product Manager who leadsa collaboration between Samsung offices worldwide (Korea, Russia, US, and Israel) responsible for building innovative, intelligent, and trustworthy ML products.Segev Shlomov is a Ph.D. student under the supervision of Associate Professor Yakov Babichenko at the Technion, Israel Institute of Technology. Segev's research interests lie at the intersection of Statistics, Social Learning, and Information Theory. Segev holds an M.Sc. in Operations Research (summa cum laude) from the Technion. He was three-time a summer intern at the Artificial Intelligence department of the IBM research labs, Haifa, Israel, and he is one of the main contributors to IBM's Lambada AI service. Segev's papers have been published in top-tier conferences and journals of both the NLP community and the Economics and Computation communities. Segev is a recipient of the Jacobs Outstanding Ph.D. Scholarship for the year 2020.Roi Reichart is an Associate Professor at the Technion, Israel Institute of Technology. Before joining the Technion, on July 2013, he was a post-doctoral researcher at the Computer Laboratory of the University of Cambridge, UK, and at the Computer Science and Artificial Intelligence Laboratory (CSAIL) of MIT. Prior to this, he was a Ph.D. student under the supervision of Professor Ari Rappoport at the Interdisciplinary Center for Neural Computation (ICNC) of Hebrew University of Jerusalem. His main research interest is NLP, with a focus on language learning in its context and designing models that integrate domain and world knowledgewith data-driven methods. He has hence worked on problems such as domain adaptation, learning with minimal human annotation (and involvement), language transfer and multilingual learning, multi-modal (text and vision) processing, and NLP of Web data. He has focused on structured aspects of language and has developed effective algorithms for inference across linguistic structures. Finally, he is interested in proper evaluation of NLP algorithms and has worked on problems such as measuring statistical significance in NLP, word embedding evaluation, and unsupervised learning (particularly clustering) evaluation.

"Sobre este t�tulo" puede pertenecer a otra edici�n de este libro.

Descripci�n de la librer�a

Ver la p�gina web de la librer�a

Informaci�n empresarial del vendedor

WRAP Ltd
Unit 4, 119 Loverock Rd, Reading, RG30 1DZ, United Kingdom

Condiciones de venta y env�o

Condiciones de venta

TBA

Derecho al desistimiento

Si es un consumidor, puede rescindir el contrato de acuerdo con lo siguiente. Por consumidor se entiende cualquier persona f�sica que act�e con fines ajenos a su actividad comercial, empresarial, oficio o profesi�n.

Informaci�n sobre el derecho de desistimiento

Derecho legal de desistimiento

Tiene derecho a rescindir este contrato en un plazo de 14 d�as sin dar ning�n motivo.

El periodo de desistimiento vencer� a los 14 d�as desde que usted, o un tercero que no sea el transportista e indicado por usted, adquiera la posesi�n f�sica del �ltimo bien o del �ltimo lote o pieza.

Para ejercer el derecho de desistimiento, complete de forma electr�nica y env�e una declaraci�n clara en nuestro sitio web, desde "Mis compras" en "Mi cuenta". Le enviaremos sin demora un acuse de recibo de dicho desistimiento a trav�s de un soporte duradero (por ejemplo, por correo electr�nico).

Para cumplir con el plazo de desistimiento, basta con que env�e su comunicaci�n relativa al ejercicio del derecho de desistimiento antes de que venza el periodo de desistimiento.

Efectos del desistimiento

Si rescinde este contrato, le reembolsaremos todos los pagos que hayamos recibido de usted, incluidos los gastos de env�o (excepto los gastos adicionales que surjan si elige un tipo de env�o que no sea el tipo de env�o est�ndar m�s econ�mico que ofrecemos).

Podemos hacer una deducci�n del reembolso por la p�rdida de valor de cualquier bien suministrado, si la p�rdida es el resultado de una manipulaci�n innecesaria por su parte.

Efectuaremos el reembolso sin demoras indebidas y, a m�s tardar, 14 d�as despu�s de que se nos informe de su decisi�n de rescindir este contrato.

Efectuaremos el reembolso utilizando el mismo medio de pago que utiliz� para la transacci�n inicial, a menos que haya acordado expresamente lo contrario; en cualquier caso, no incurrir� en ning�n cargo como resultado de dicho reembolso.

Podremos retener el reembolso hasta que hayamos recibido los bienes o hasta que nos haya presentado una prueba de que los ha devuelto, lo que ocurra primero.

Deber� devolver los bienes o entregarlos a Chiron Media, Wallingford, United Kingdom, sin demoras indebidas y, en cualquier caso, en un plazo m�ximo de 14 d�as a partir del d�a en que nos comunique su desistimiento del presente contrato. El plazo se cumple si devuelve la mercanc�a antes de que venza el periodo de 14 d�as. Tendr� que asumir los gastos directos de devoluci�n de los bienes. Usted solo es responsable de la disminuci�n del valor de los bienes como resultado de una manipulaci�n distinta a la necesaria para establecer la naturaleza, las caracter�sticas y el funcionamiento de los bienes.

Excepciones al derecho de desistimiento

El derecho de desistimiento no se aplica a lo siguiente:

La entrega de peri�dicos, diarios o revistas, con la excepci�n de los contratos de suscripci�n; y
El suministro de contenido digital que no se proporcione en un soporte tangible (por ejemplo, en un CD o DVD) si, al hacer el pedido, acept� que pod�amos empezar a entregarlo y que no podr�a desistir una vez iniciada la entrega.

Condiciones de env�o

Shipping costs are based on books weighing 2.2 LB, or 1 KG. If your book order is heavy or oversized, we may contact you to let you know extra shipping is required.

Tarifas de env�o de Reino Unido a Estados Unidos de America

Tarifas de env�o de Reino Unido a Estados Unidos de America
Cantidad del pedido	De 14 a 21 d�as h�biles	De 14 a 21 d�as h�biles
Primer art�culo	EUR 18.19	EUR 18.19

Los plazos de entrega los establecen los vendedores y var�an seg�n el transportista y la ubicaci�n. Los pedidos que pasan por la aduana pueden sufrir retrasos y los compradores son responsables de los aranceles o tarifas asociadas. Los vendedores pueden ponerse en contacto con usted en relaci�n con cargos adicionales para cubrir cualquier aumento en los costes de env�o de los art�culos.