1264 mapreduce design patterns

251 127 0
1264 mapreduce design patterns

Đang tải... (xem toàn văn)

Tài liệu hạn chế xem trước, để xem đầy đủ mời bạn chọn Tải xuống

Thông tin tài liệu

... ix Design Patterns and MapReduce Design Patterns MapReduce History MapReduce and Hadoop Refresher Hadoop Example:... we’ll talk a bit about how and why design patterns and MapReduce together make sense, and a bit of a history lesson of how we got here Design Patterns Design patterns have been making developers’...www.it-ebooks.info MapReduce Design Patterns Donald Miner and Adam Shook www.it-ebooks.info MapReduce Design Patterns by Donald Miner and Adam Shook Copyright ©

Ngày đăng: 11/07/2018, 16:17

Mục lục

  • Copyright

  • Table of Contents

  • Preface

    • Intended Audience

    • Pattern Format

    • The Examples in This Book

    • Conventions Used in This Book

    • Using Code Examples

    • Safari® Books Online

    • How to Contact Us

    • Acknowldgements

  • Chapter 1. Design Patterns and MapReduce

    • Design Patterns

    • MapReduce History

    • MapReduce and Hadoop Refresher

    • Hadoop Example: Word Count

    • Pig and Hive

  • Chapter 2. Summarization Patterns

    • Numerical Summarizations

      • Pattern Description

      • Numerical Summarization Examples

    • Inverted Index Summarizations

      • Pattern Description

      • Inverted Index Example

    • Counting with Counters

      • Pattern Description

      • Counting with Counters Example

  • Chapter 3. Filtering Patterns

    • Filtering

      • Pattern Description

      • Filtering Examples

    • Bloom Filtering

      • Pattern Description

      • Bloom Filtering Examples

    • Top Ten

      • Pattern Description

      • Top Ten Examples

    • Distinct

      • Pattern Description

      • Distinct Examples

  • Chapter 4. Data Organization Patterns

    • Structured to Hierarchical

      • Pattern Description

      • Structured to Hierarchical Examples

    • Partitioning

      • Pattern Description

      • Partitioning Examples

    • Binning

      • Pattern Description

      • Binning Examples

    • Total Order Sorting

      • Pattern Description

      • Total Order Sorting Examples

    • Shuffling

      • Pattern Description

      • Shuffle Examples

  • Chapter 5. Join Patterns

    • A Refresher on Joins

    • Reduce Side Join

      • Pattern Description

      • Reduce Side Join Example

      • Reduce Side Join with Bloom Filter

    • Replicated Join

      • Pattern Description

      • Replicated Join Examples

    • Composite Join

      • Pattern Description

      • Composite Join Examples

    • Cartesian Product

      • Pattern Description

      • Cartesian Product Examples

  • Chapter 6. Metapatterns

    • Job Chaining

      • With the Driver

      • Job Chaining Examples

      • With Shell Scripting

      • With JobControl

    • Chain Folding

      • The ChainMapper and ChainReducer Approach

      • Chain Folding Example

    • Job Merging

      • Job Merging Examples

  • Chapter 7. Input and Output Patterns

    • Customizing Input and Output in Hadoop

      • InputFormat

      • RecordReader

      • OutputFormat

      • RecordWriter

    • Generating Data

      • Pattern Description

      • Generating Data Examples

    • External Source Output

      • Pattern Description

      • External Source Output Example

    • External Source Input

      • Pattern Description

      • External Source Input Example

    • Partition Pruning

      • Pattern Description

      • Partition Pruning Examples

  • Chapter 8. Final Thoughts and the Future of Design Patterns

    • Trends in the Nature of Data

      • Images, Audio, and Video

      • Streaming Data

    • The Effects of YARN

    • Patterns as a Library or Component

    • How You Can Help

  • Appendix A. Bloom Filters

    • Overview

    • Use Cases

      • Representing a Data Set

      • Reduce Queries to External Database

      • Google BigTable

    • Downsides

    • Tweaking Your Bloom Filter

  • Index

  • About the Authors

Tài liệu cùng người dùng

  • Đang cập nhật ...

Tài liệu liên quan