Modifier and Type | Interface and Description |
---|---|
interface |
IncrementalTaskWithContext
A simple extension of
IncrementalTask to add information for display in a UI. |
Modifier and Type | Class and Description |
---|---|
class |
MapOnlyShardTask<I,O> |
class |
MapShardTask<I,K,V> |
class |
ReduceShardTask<K,V,O> |
class |
WorkerShardTask<I,O,C extends WorkerContext<O>>
Base class for the specific MR stage workers.
|
Modifier and Type | Class and Description |
---|---|
class |
ShardedJob<T extends IncrementalTask>
ShardedJob pipeline.
|
Modifier and Type | Class and Description |
---|---|
class |
IncrementalTaskState<T extends IncrementalTask>
Information about execution of an
IncrementalTask . |
class |
ShardedJobController<T extends IncrementalTask>
Aggregates results from
IncrementalTask s and receives notification
when the job completes. |
class |
ShardedJobRunner<T extends IncrementalTask>
Contains all logic to manage and run sharded jobs.
|
class |
ShardRetryState<T extends IncrementalTask>
Retry information for a shard.
|
Modifier and Type | Method and Description |
---|---|
static <T extends IncrementalTask> |
IncrementalTaskState.Serializer.fromEntity(com.google.appengine.api.datastore.Entity in,
boolean lenient) |
static <T extends IncrementalTask> |
InProcessShardedJobRunner.runJob(List<T> initialTasks,
ShardedJobController<T> controller)
Runs the given job and returns its result.
|
<T extends IncrementalTask> |
ShardedJobService.startJob(String jobId,
List<? extends T> initialTasks,
ShardedJobController<T> controller,
ShardedJobSettings settings)
Starts a new sharded job with the given ID and parameters.
|
Modifier and Type | Method and Description |
---|---|
Iterator<IncrementalTaskState<IncrementalTask>> |
ShardedJobService.lookupTasks(ShardedJobState state)
Returns the tasks associated with this ShardedJob.
|
Modifier and Type | Class and Description |
---|---|
class |
MergeShardTask
Passes input to the output.
|
class |
SortShardTask
Keeps accepting inputs and passing them to a SortWorker until the worker's buffer is full.
|
Copyright © 2015 Google. All rights reserved.