The goal is not simply to memorize commands. It is to develop an understanding that helps you decide which operation to use, when to use it, and what happens when PySpark executes it.

## What if you already know Python?

Then you have an excellent foundation to build upon.

This book helps connect familiar Python programming ideas with distributed data processing. You will see how Python code can be used to describe operations on large datasets while PySpark handles the underlying distributed execution.

You will also learn why some approaches that work well with small datasets may become inefficient when data volume increases.

That distinction matters.

Writing code that produces the correct result is one skill. Understanding how that code behaves when the dataset becomes much larger is another.

What about DataFrames?

DataFrames receive significant attention because they provide a structured way to work with distributed data.

You will learn how to create DataFrames, define schemas, inspect their structure, select columns, create calculated fields, filter records, sort results, handle missing values, perform aggregations, join related datasets, and save processed information.

You will also learn how DataFrame operations connect with PySpark's execution process, giving you a better understanding of what happens beyond the Python code you write. The current PySpark API provides extensive DataFrame functionality for operations such as select, filter, groupBy, join, orderBy, cache, repartition, write, and related processing tasks. ([Apache Spark][2])

## What if your data is messy?

Real datasets are rarely perfect.

A practical data-processing workflow may contain missing values, malformed numbers, inconsistent text, duplicate records, unexpected dates, invalid identifiers, or incomplete relationships between datasets.

This book addresses those situations directly.

You will learn how to identify problematic records, standardize information, validate values, separate invalid data when appropriate, and build repeatable cleaning processes rather than relying on one-time manual corrections.

## How do joins, aggregations, and window functions fit together?

As your skills develop, the book moves beyond basic transformations.

You will learn how separate datasets can be connected through joins, how grouped information can be summarized through aggregations, and how window functions can provide analytical calculations while preserving individual records.

You will work with concepts such as customer totals, transaction summaries, rankings, running calculations, previous and subsequent records, and other analytical patterns.

This helps turn PySpark from a collection of commands into a practical tool for building complete data-processing workflows.

## What happens when your application becomes slow?

Correct results are important, but performance matters too.

The book introduces the concepts that influence PySpark performance, including partitions, shuffles, data movement, joins, aggregation, caching, partition imbalance, data skew, memory usage, and execution plans.

You will learn why some operations require substantial data movement and why reducing unnecessary work can make a significant difference.

You will also learn how to approach performance problems systematically instead of simply adding more resources and hoping the application becomes faster.

## Can PySpark handle more than batch processing?

Yes, and the book introduces that broader picture.

You will explore structured streaming concepts, including streaming DataFrames, output modes, checkpoints, event-time processing, windows, and late-arriving data.

“Sinopsis” puede pertenecer a otra edición de este título.

PBShop.store UK

Fairford, GLOS, Reino Unido

Vendedor de 5 estrellas

Vendedor de AbeBooks desde el 11 de junio de 1999

Tarifas de envío de Reino Unido a Estados Unidos de America

Artículo	De 10 a 20 días hábiles	De 10 a 20 días hábiles
Primer artículo	EUR 5,91	EUR 5,91

Los plazos de entrega los establecen los vendedores y varían según el transportista y la ubicación. Los pedidos que pasan por la aduana pueden sufrir retrasos y los compradores son responsables de los aranceles o tarifas asociadas. Los vendedores pueden ponerse en contacto con usted en relación con cargos adicionales para cubrir cualquier aumento en los costes de envío de los artículos.

Métodos de pago

Descripción de la tienda

**Please note our transit times are from the date of dispatch.** We first started out as “The Paperback Exchange,” a chain of physical bookstores where we would part exchange your beloved books for new stories to transport you to faraway places. However, as shopping started to evolve to online shops and marketplaces, we bid our stores goodbye to become “PBShop.” This transition has only allowed us to blossom as we now ship thousands of titles to book lovers across the globe. We pride ourselves in being a community of local book lovers which allows our passion and devotion to shine in everything we do. In 2020 we not only celebrated our 20th birthday but our 1st birthday as being completely employee owned after becoming an E.O.T in September 2019. We are proud to be different and embrace standing apart on a book mountain by working from a virtual inventory which allows us to provide thousands of books that may be difficult to get for your bookshelf or your studies. Working with a number of different suppliers allows us to explore other avenues such as puzzles, sheet music and even stationery so we really do have something for everyone. Life is about being versatile in all realms of existence. If this is your first purchase with us, or you are a returning customer, we would like to welcome you to the PBShop family, for there is no friend as loyal as a book. We are a company who put our customers at the centre of everything we do as we understand the importance of reading because once you learn to read, you will forever be free. There are a whole lot of things in this world of ours that we are yet to explore, which is why we will forever inspire curious minds.…

Especialidad

Hardbacks, Paperbacks

Información empresarial del vendedor

Pbshop.co.uk

Unit 22 Horcott Industrial Estate, Horcott Road
Fairford, Reino Unido GL7 4BX

Contactar con el vendedorVer los artículos de este vendedorVer la página principal del vendedor

Condiciones de venta

Returns Policy
We ask all customers to contact us for authorisation should they wish to return their order. Orders returned without authorisation may not be credited.
If you wish to return, please contact us within 14 days of receiving your order to obtain authorisation.
Returns requested beyond this time will not be authorised.
Our team will provide full instructions on how to return your order and once received our returns department will process your refund.
Please note the cost to return any unwanted order to us is borne by the buyer.
Should your order arrive damaged, not as advertised or faulty, we must be advised of this within 14 days of delivery. Please contact us so we can find the best solution for you.

Our Customer Care Team can be contacted by emailing alborders@paperbackshop.co.uk, or by calling our UK Office on +441285 712 917. We are available 9:00am till 5:30pm GMT Monday to Friday.

Derecho al desistimiento

Si es un consumidor, puede rescindir el contrato de acuerdo con lo siguiente. Por consumidor se entiende cualquier persona física que actúe con fines ajenos a su actividad comercial, empresarial, oficio o profesión.

Información sobre el derecho de desistimiento

Derecho legal de desistimiento

Tiene derecho a rescindir este contrato en un plazo de 14 días sin dar ningún motivo.

El periodo de desistimiento vencerá a los 14 días desde que usted, o un tercero que no sea el transportista e indicado por usted, adquiera la posesión física del último bien o del último lote o pieza.

Para ejercer el derecho de desistimiento, complete de forma electrónica y envíe una declaración clara en nuestro sitio web, desde "Mis compras" en "Mi cuenta". Le enviaremos sin demora un acuse de recibo de dicho desistimiento a través de un soporte duradero (por ejemplo, por correo electrónico).

Para cumplir con el plazo de desistimiento, basta con que envíe su comunicación relativa al ejercicio del derecho de desistimiento antes de que venza el periodo de desistimiento.

Efectos del desistimiento

Si rescinde este contrato, le reembolsaremos todos los pagos que hayamos recibido de usted, incluidos los gastos de envío (excepto los gastos adicionales que surjan si elige un tipo de envío que no sea el tipo de envío estándar más económico que ofrecemos).

Podemos hacer una deducción del reembolso por la pérdida de valor de cualquier bien suministrado, si la pérdida es el resultado de una manipulación innecesaria por su parte.

Efectuaremos el reembolso sin demoras indebidas y, a más tardar, 14 días después de que se nos informe de su decisión de rescindir este contrato.

Efectuaremos el reembolso utilizando el mismo medio de pago que utilizó para la transacción inicial, a menos que haya acordado expresamente lo contrario; en cualquier caso, no incurrirá en ningún cargo como resultado de dicho reembolso.

Podremos retener el reembolso hasta que hayamos recibido los bienes o hasta que nos haya presentado una prueba de que los ha devuelto, lo que ocurra primero.

Deberá devolver los bienes o entregarlos a PBShop.store UK, Fairford, United Kingdom, +44 1285 712917, sin demoras indebidas y, en cualquier caso, en un plazo máximo de 14 días a partir del día en que nos comunique su desistimiento del presente contrato. El plazo se cumple si devuelve la mercancía antes de que venza el periodo de 14 días. Tendrá que asumir los gastos directos de devolución de los bienes. Usted solo es responsable de la disminución del valor de los bienes como resultado de una manipulación distinta a la necesaria para establecer la naturaleza, las características y el funcionamiento de los bienes.

Excepciones al derecho de desistimiento

El derecho de desistimiento no se aplica a lo siguiente:

La entrega de periódicos, diarios o revistas, con la excepción de los contratos de suscripción; y
El suministro de contenido digital que no se proporcione en un soporte tangible (por ejemplo, en un CD o DVD) si, al hacer el pedido, aceptó que podíamos empezar a entregarlo y que no podría desistir una vez iniciada la entrega.

Condiciones de envío

Orders are shipped from our UK warehouse. Delivery thereafter is between 4 and 14 business days. Please contact us if you have any queries about our services or products.

Learning PySpark from Scratch

Descripción del artículo del vendedor

Detalles bibliográficos

Sinopsis