Programming MapReduce with Scalding: A practical guide to designing, testing, and implementing complex MapReduce applications in Scala - Tapa blanda

Sinopsis

Scalding is a Scala library that makes it easy to write MapReduce jobs in Hadoop. It's similar to other MapReduce platforms like Pig and Hive, but offers a higher level of abstraction by leveraging the full power of Scala and the JVM. Scalding is built on top of Cascading, which is an application framework for Java developers designed to create data analytics and management systems.

This book is a practical guide to setting up a development environment and implementing simple and complex MapReduce transformations in Scala using a Test-driven Methodology and best practices. The book also presents how to integrate your projects with external data stores and execute machine learning algorithms.

This book will first introduce you to how the Cascading framework allows for higher abstraction reasoning over MapReduce applications and then dive into how Scala, through Scalding, provides a DSL that allows elegant development of testable applications. It will then teach you how to test Scalding jobs and how to define specifications and Behavior-driven Development (BDD) with Scalding. This book will then demonstrate how to monitor and maintain cluster stability and efficiently access MySQL, HBase, and HIVE tables.

This book provides hands-on information starting from proof of concept applications and progressing to production-ready implementations. If you have some development experience and are willing to be introduced to functional programming for the purpose of implementing scalable MapReduce applications, then this book is for you.

"Sinopsis" puede pertenecer a otra edición de este libro.