Modifier and Type | Method and Description |
---|---|
abstract List<? extends InputReader<I>> |
Input.createReaders()
Returns a list of readers for this input.
|
Modifier and Type | Method and Description |
---|---|
protected abstract InputReader<I> |
WorkerShardTask.getInputReader() |
InputReader<KeyValue<K,Iterator<V>>> |
ReduceShardTask.getInputReader() |
InputReader<I> |
MapShardTask.getInputReader() |
InputReader<I> |
MapOnlyShardTask.getInputReader() |
Modifier and Type | Method and Description |
---|---|
List<? extends InputReader<KeyValue<ByteBuffer,Iterator<ByteBuffer>>>> |
GoogleCloudStorageMergeInput.createReaders()
Creates multiple merging readers for each shard using
GoogleCloudStorageMergeInput.createReaderForShard(com.google.appengine.tools.mapreduce.Marshaller<com.google.appengine.tools.mapreduce.KeyValue<java.nio.ByteBuffer, ? extends java.lang.Iterable<java.nio.ByteBuffer>>>, com.google.appengine.tools.mapreduce.GoogleCloudStorageFileSet) below. |
List<? extends InputReader<KeyValue<ByteBuffer,ByteBuffer>>> |
GoogleCloudStorageSortInput.createReaders() |
List<? extends InputReader<KeyValue<K,Iterator<V>>>> |
GoogleCloudStorageReduceInput.createReaders() |
Constructor and Description |
---|
MapOnlyShardTask(String mrJobId,
int shardNumber,
int shardCount,
InputReader<I> in,
MapOnlyMapper<I,O> mapper,
OutputWriter<O> out,
long millisPerSlice) |
MapShardTask(String mrJobId,
int shardNumber,
int shardCount,
InputReader<I> in,
Mapper<I,K,V> mapper,
OutputWriter<KeyValue<K,V>> out,
long millisPerSlice) |
ReduceShardTask(String mrJobId,
int shardNumber,
int shardCount,
InputReader<KeyValue<K,Iterator<V>>> in,
Reducer<K,V,O> reducer,
OutputWriter<O> out,
long millisPerSlice) |
Modifier and Type | Method and Description |
---|---|
InputReader<KeyValue<ByteBuffer,Iterator<ByteBuffer>>> |
MergeShardTask.getInputReader() |
InputReader<KeyValue<ByteBuffer,ByteBuffer>> |
SortShardTask.getInputReader() |
Constructor and Description |
---|
MergeShardTask(String mrJobId,
int shardNumber,
int shardCount,
InputReader<KeyValue<ByteBuffer,Iterator<ByteBuffer>>> in,
OutputWriter<KeyValue<ByteBuffer,List<ByteBuffer>>> out,
int sortReadTimeMillis) |
SortShardTask(String mrJobId,
int shardNumber,
int shardCount,
InputReader<KeyValue<ByteBuffer,ByteBuffer>> in,
SortWorker worker,
OutputWriter<KeyValue<ByteBuffer,List<ByteBuffer>>> out,
int sortReadTimeMillis) |
Modifier and Type | Class and Description |
---|---|
class |
ConcatenatingInputReader<I>
Reads multiple inputs in sequence.
|
class |
DatastoreInputReader
An InputReader for Datastore entities.
|
class |
DatastoreKeyInputReader
An InputReader for Datastore entity keys.
|
class |
ForwardingInputReader<T>
An
InputReader delegates to another implementation. |
class |
GoogleCloudStorageLevelDbInputReader
A simple wrapper of LevelDb wrapper for GCS to provide getProgress() and do lazy initialization.
|
class |
LevelDbInputReader
Reads LevelDB formatted input.
|
class |
LogInputReader
Reads App Engine RequestLogs for a specified time range.
|
class |
PeekingInputReader<T>
An
InputReader that allows peeking at records without consuming them. |
class |
UnmarshallingInputReader<T>
An
InputReader that unmarshals records. |
Modifier and Type | Method and Description |
---|---|
protected abstract InputReader<T> |
ForwardingInputReader.getDelegate() |
Modifier and Type | Method and Description |
---|---|
List<? extends InputReader<com.google.appengine.api.log.RequestLogs>> |
LogInput.createReaders() |
List<? extends InputReader<I>> |
NoInput.createReaders() |
List<? extends InputReader<I>> |
InMemoryInput.createReaders() |
List<InputReader<ByteBuffer>> |
GoogleCloudStorageLevelDbInput.createReaders() |
List<? extends InputReader<Long>> |
ConsecutiveLongInput.createReaders() |
List<? extends InputReader<Long>> |
RandomLongInput.createReaders() |
List<? extends InputReader<byte[]>> |
GoogleCloudStorageLineInput.createReaders() |
List<InputReader<I>> |
UnmarshallingInput.createReaders() |
List<? extends InputReader<byte[]>> |
BlobstoreInput.createReaders() |
Constructor and Description |
---|
PeekingInputReader(InputReader<ByteBuffer> reader,
Marshaller<T> marshaller) |
UnmarshallingInputReader(InputReader<ByteBuffer> reader,
Marshaller<T> marshaller) |
Constructor and Description |
---|
ConcatenatingInputReader(List<? extends InputReader<I>> readers) |
Copyright © 2015 Google. All rights reserved.