Interface | Description |
---|---|
BigqueryFieldMarshaller |
Defines how a
Field s should be interpreted and marshalled while generating its
TableFieldSchema for loading data into bigquery. |
IncrementalTaskWithContext |
A simple extension of
IncrementalTask to add information for display in a UI. |
Class | Description |
---|---|
BaseContext |
Base class for all Context implementations.
|
BaseShardContext<O> |
Base class for all ShardContext implementations.
|
BigQueryConstants | |
BigqueryFieldMarshallers | |
BigQueryFieldUtil |
Utility class for processing
Field and BigQuery data fields. |
BigQueryMarshallerByType<T> |
Validates and generates
TableSchema of a bigquery table and marshals objects into json
for loading into that table using annotations and reflection on type T. |
CountersImpl | |
FilesByShard |
A convenience datastructure to track sets of files on a per-shard basis
|
GoogleCloudStorageMapOutput<K,V> |
An
Output that is used for the map stage. |
GoogleCloudStorageMapOutputWriter<K,V> |
An
OutputWriter that is used by the map stage and writes bytes to GCS,
later to be used by the sort/merge stages. |
GoogleCloudStorageMergeInput |
Defines the way the data is read in by the merger.
|
GoogleCloudStorageMergeOutput |
Defines the way data is written out by the merging stage.
|
GoogleCloudStorageReduceInput<K,V> |
Defines the way the data is read in by the reducer.
|
GoogleCloudStorageSortInput |
Defines the way the data is read in by the Sort phase.
|
GoogleCloudStorageSortOutput |
Defines the way data is written out by the sorter.
|
HashingSharder |
Splits input by hashing the key.
|
IncrementalTaskContext |
Context used by incremental tasks.
|
InProcessMap<I,O,R> |
Runs a Map only in the current process.
|
InProcessMapReduce<I,K,V,O,R> |
Runs a MapReduce in the current process.
|
InProcessUtil | |
KeyValueMarshaller<K,V> |
Marshalls KeyValue pairs given a Marshaller for the Key and the Value.
|
KeyValuesMarshaller<K,V> |
Marshalls KeyValue pairs where the value is an iterator.
|
MapOnlyShardTask<I,O> | |
MapReduceConstants | |
MapReduceResultImpl<R> |
Implementation of
MapReduceResult . |
MapShardTask<I,K,V> | |
ReducerInputs |
Utilities related to
ReducerInput . |
ReduceShardTask<K,V,O> | |
WorkerController<I,O,R,C extends WorkerContext<O>> | |
WorkerShardTask<I,O,C extends WorkerContext<O>> |
Base class for the specific MR stage workers.
|
Copyright © 2015 Google. All rights reserved.