Transformers for Natural Language Processing | Build innovative deep neural network architectures for NLP with Python, PyTorch, TensorFlow, BERT, RoBERTa, and more

Editor

Packt Publishing

Fecha de publicaci�n

2021

Idioma

Ingl�s

ISBN 10

1800565798

ISBN 13

9781800565791

Encuadernaci�n

Taschenbuch

Estado

Neu

Dimensiones

Peso

715 gramos

Cat�logos de vendedores

B�cher

Acerca de

Sinopsis

Become an AI language understanding expert by mastering the quantum leap of Transformer neural network models

Key Features

Build and implement state-of-the-art language models, such as the original Transformer, BERT, T5, and GPT-2, using concepts that outperform classical deep learning models
Go through hands-on applications in Python using Google Colaboratory Notebooks with nothing to install on a local machine
Learn training tips and alternative language understanding methods to illustrate important key concepts

Book Description

The transformer architecture has proved to be revolutionary in outperforming the classical RNN and CNN models in use today. With an apply-as-you-learn approach, Transformers for Natural Language Processing investigates in vast detail the deep learning for machine translations, speech-to-text, text-to-speech, language modeling, question answering, and many more NLP domains with transformers.

The book takes you through NLP with Python and examines various eminent models and datasets within the transformer architecture created by pioneers such as Google, Facebook, Microsoft, OpenAI, and Hugging Face.

The book trains you in three stages. The first stage introduces you to transformer architectures, starting with the original transformer, before moving on to RoBERTa, BERT, and DistilBERT models. You will discover training methods for smaller transformers that can outperform GPT-3 in some cases. In the second stage, you will apply transformers for Natural Language Understanding (NLU) and Natural Language Generation (NLG). Finally, the third stage will help you grasp advanced language understanding techniques such as optimizing social network datasets and fake news identification.

By the end of this NLP book, you will understand transformers from a cognitive science perspective and be proficient in applying pretrained transformer models by tech giants to various datasets.

What you will learn

Use the latest pretrained transformer models
Grasp the workings of the original Transformer, GPT-2, BERT, T5, and other transformer models
Create language understanding Python programs using concepts that outperform classical deep learning models
Use a variety of NLP platforms, including Hugging Face, Trax, and AllenNLP
Apply Python, TensorFlow, and Keras programs to sentiment analysis, text summarization, speech recognition, machine translations, and more
Measure the productivity of key transformers to define their scope, potential, and limits in production

Who this book is for

Since the book does not teach basic programming, you must be familiar with neural networks, Python, PyTorch, and TensorFlow in order to learn their implementation with Transformers.

Readers who can benefit the most from this book include deep learning & NLP practitioners, data analysts and data scientists who want an introduction to AI language understanding to process the increasing amounts of language-driven functions.

Getting Started with the Model Architecture of the Transformer
Fine-Tuning BERT Models
Pretraining a RoBERTa Model from Scratch
Downstream NLP Tasks with Transformers
Machine Translation with the Transformer
Text Generation with OpenAI GPT-2 and GPT-3 Models
Applying Transformers to Legal and Financial Documents for AI Text Summarization
Matching Tokenizers and Datasets
Semantic Role Labeling with BERT-Based Transformers
Let Your Data Do the Talking: Story, Questions, and Answers
Detecting Customer Emotions to Make Predictions
Analyzing Fake News with Transformers
Appendix: Answers to the Questions

Acerca del autor

Denis Rothman graduated from Sorbonne University and Paris-Diderot University, patenting one of the very first word2matrix embedding solutions. Denis Rothman is the author of three cutting-edge AI solutions: one of the first AI cognitive chatbots more than 30 years ago; a profit-orientated AI resource optimizing system; and an AI APS (Advanced Planning and Scheduling) solution based on cognitive patterns used worldwide in aerospace, rail, energy, apparel, and many other fields. Designed initially as a cognitive AI bot for IBM, it then went on to become a robust APS solution used to this day.

"Sobre este t�tulo" puede pertenecer a otra edici�n de este libro.

Descripci�n de la librer�a

preigu betreibt einen Onlineversandhandel mit �ber 1 Mio. Produkten in verschiedenen Sortimenten. Das Kernsortiment besteht aus B�chern, Medien und Spielwaren. Ein gelungenes Einkaufserlebnis ist das Ziel einer jeden Bestellung bei preigu, denn der Kunde und seine Zufriedenheit stehen an erster Stelle. preigu setzt daher auf einen kompetenten Kundenservice, funktionierende Prozesse und schnelle Reaktion.

Ver la p�gina web de la librer�a

Informaci�n empresarial del vendedor

preigu GmbH & Co. KG
Lengericher Landstra�e 19, Osnabr�ck, 49078, Germany

Condiciones de venta y env�o

Condiciones de venta

Standard Business Terms and customer information / data protection declaration / battery disposal

I. Standard business terms

� 1 Basic provisions

(1) The following terms and conditions of business apply for all contracts concluded with us as the supplier (preigu GmbH & Co. KG) via the websites AbeBooks and/or ZVAB. Unless otherwise agreed, the inclusion of your own terms and conditions is explicitly rejected.

(2) A ?consumer' in the sense of the following regulations is every natural person who ...

M�s informaci�n

Derecho a cancelaci�n

Instructions for revocation

Revocation right for consumers
(A ‘consumer' is any natural person who concludes a legal transaction which, to an overwhelming extent, cannot be attributed to either his commercial or independent professional activities.)

Instructions for revocation

Revocation right
You have the right to revoke this contract within 14 days without specifying any reasons.
The revocation period is 14 days with effect from the day,

on which you or a third party nominated by you, which is not the carrier, had taken possession of the products, provided you had ordered one or more products within the scope of a standard order and this/these product/products is/are delivered uniformly;
on which you or a third party nominated by you, which is not the carrier, had taken possession of the last product, provided you had ordered several products within the scope of a standard order and these products are delivered separately;
on which you or a third party nominated by you, which is not the carrier, had taken possession of the last part delivery or the last unit, provided you had ordered a product, which is delivered in several part deliveries or units;

To exercise your right of withdrawal, you must inform us (preigu GmbH & Co. KG, Lengericher Landstr. 19, 49078 Osnabr�ck, Telephone number: +49 (0) 541 / 580 72 84, E-Mail address: mail@preigu.de) by means of a clear declaration (e.g. a letter sent by post, or an e-mail) of your decision to withdraw from this contract. You can use the attached model withdrawal form for this purpose, which is, however, not mandatory.

In order to safeguard the revocation period, it is sufficient that you send the notification about the exercise of the revocation right before the expiry of the revocation period.

Consequences of the revocation

If you revoke this contract, we shall repay all the payments, which we received from you, including the delivery costs (with the exception of additional costs, which arise from that fact that you selected a form of delivery other than the most reasonable standard delivery offered by us), immediately and at the latest within 14 days from the day on which we received the notification about the revocation of this contract from you. We use the same means of payment, which you had originally used during the original transaction, for this repayment unless expressly agreed otherwise with you; you will not be charged any fees owing to this repayment.

We can refuse the repayment until the products are returned to us or until you have furnished evidence that you have sent the products back to us, depending on whichever is earlier.

You must return or transfer the products to us immediately and, in any case, at the latest within 14 days with effect from the day on which you inform us of the revocation of this contract. The deadline is maintained if you send the products before the expiry of the 14 day deadline.

You bear the direct costs for returning the products.

You must pay for any depreciation of the products only if this depreciation can be attributed to any handling with you that was not necessary for checking the condition, features and functionality of the products.

Criteria for exclusion or expiry

The revocation right is not available for contracts

for delivery of products, which are not prefabricated and for whose manufacturing an individual selection or stipulation by the consumer is important or which are clearly tailored to the personal requirements of the consumer;
for delivery of products, which can spoil quickly or whose use-by date would be exceeded quickly;
for delivery of alcoholic drinks, whose price was agreed at the time of concluding the contract, which however can be delivered 30 days after the conclusion of the contract at the earliest and whose current value depends on the fluctuations in the market, on which the entrepreneur has no influence;
for delivery of newspapers, periodicals or magazines with the exception of subscription contracts. The revocation right expires prematurely in case of contracts
for delivery of sealed products, which are not suitable for return for reasons of health protection or hygiene if their seal has been removed after the delivery;
for delivery of products if they have been mixed inseparably with other goods after the delivery, owing to their condition;
for delivery of sound or video recording or computer software in a sealed package if the seal has been removed after the delivery.

Specimen - revocation form

(If you wish to revoke the contract, please fill up this form and send it back to us.)

To preigu GmbH & Co. KG, Lengericher Landstr. 19, 49078 Osnabr�ck, Email address: mail@preigu.de :
I/we () herewith revoke the contract concluded by me/ us () regarding the purchase of the following products ()/
the provision of the following service ()
Ordered on ()/ received on ()
Name of the consumer(s)
Address of the consumer(s)
Signature of the consumer(s) (only in case of a notification on paper)
Date

(*) Cross out the incorrect option.

Condiciones de env�o

Tarifas de env�o de Alemania a Estados Unidos de America

Tarifas de env�o de Alemania a Estados Unidos de America
Cantidad del pedido	De 60 a 60 d�as h�biles	De 60 a 60 d�as h�biles
Primer art�culo	EUR 70.00	EUR 70.00

Los plazos de entrega los establecen los vendedores y var�an seg�n el transportista y la ubicaci�n. Los pedidos que pasan por la aduana pueden sufrir retrasos y los compradores son responsables de los aranceles o tarifas asociadas. Los vendedores pueden ponerse en contacto con usted en relaci�n con cargos adicionales para cubrir cualquier aumento en los costes de env�o de los art�culos.

Informaci�n detallada sobre el vendedor