Uses of Class
com.google.appengine.tools.mapreduce.OutputWriter

Packages that use OutputWriter

Package	Description
com.google.appengine.tools.mapreduce
com.google.appengine.tools.mapreduce.impl
com.google.appengine.tools.mapreduce.impl.sort
com.google.appengine.tools.mapreduce.outputs

Uses of OutputWriter in com.google.appengine.tools.mapreduce

Methods in com.google.appengine.tools.mapreduce that return types with arguments of type OutputWriter

Modifier and Type	Method and Description
abstract List<? extends OutputWriter<O>>	Output.createWriters(int numShards) Returns a list of writers, one for each shard, for this output.

Method parameters in com.google.appengine.tools.mapreduce with type arguments of type OutputWriter

Modifier and Type	Method and Description
abstract R	Output.finish(Collection<? extends OutputWriter<O>> writers) Returns a result to be made available through MapReduceResult.getOutputResult().

Uses of OutputWriter in com.google.appengine.tools.mapreduce.impl

Subclasses of OutputWriter in com.google.appengine.tools.mapreduce.impl

Modifier and Type	Class and Description
class	GoogleCloudStorageMapOutputWriter<K,V> An OutputWriter that is used by the map stage and writes bytes to GCS, later to be used by the sort/merge stages.

Methods in com.google.appengine.tools.mapreduce.impl that return OutputWriter

Modifier and Type	Method and Description
abstract OutputWriter<O>	WorkerShardTask.getOutputWriter()
OutputWriter<O>	ReduceShardTask.getOutputWriter()
OutputWriter<KeyValue<K,V>>	MapShardTask.getOutputWriter()
OutputWriter<O>	MapOnlyShardTask.getOutputWriter()

Methods in com.google.appengine.tools.mapreduce.impl that return types with arguments of type OutputWriter

Modifier and Type	Method and Description
List<? extends OutputWriter<KeyValue<ByteBuffer,List<ByteBuffer>>>>	GoogleCloudStorageSortOutput.createWriters(int shards)
List<? extends OutputWriter<KeyValue<ByteBuffer,List<ByteBuffer>>>>	GoogleCloudStorageMergeOutput.createWriters(int shards) Returns a writer that writes the data the same way that the sort does, splitting the output every time the key goes backwards in sequence.
List<? extends OutputWriter<KeyValue<K,V>>>	GoogleCloudStorageMapOutput.createWriters(int shards)

Method parameters in com.google.appengine.tools.mapreduce.impl with type arguments of type OutputWriter

Modifier and Type	Method and Description
FilesByShard	GoogleCloudStorageSortOutput.finish(Collection<? extends OutputWriter<KeyValue<ByteBuffer,List<ByteBuffer>>>> writers)
FilesByShard	GoogleCloudStorageMergeOutput.finish(Collection<? extends OutputWriter<KeyValue<ByteBuffer,List<ByteBuffer>>>> writers)
FilesByShard	GoogleCloudStorageMapOutput.finish(Collection<? extends OutputWriter<KeyValue<K,V>>> outputWriters)

Constructors in com.google.appengine.tools.mapreduce.impl with parameters of type OutputWriter

Constructor and Description
BaseShardContext(IncrementalTaskContext taskContext, OutputWriter<O> outputWriter)
MapOnlyShardTask(String mrJobId, int shardNumber, int shardCount, InputReader<I> in, MapOnlyMapper<I,O> mapper, OutputWriter<O> out, long millisPerSlice)
MapShardTask(String mrJobId, int shardNumber, int shardCount, InputReader<I> in, Mapper<I,K,V> mapper, OutputWriter<KeyValue<K,V>> out, long millisPerSlice)
ReduceShardTask(String mrJobId, int shardNumber, int shardCount, InputReader<KeyValue<K,Iterator<V>>> in, Reducer<K,V,O> reducer, OutputWriter<O> out, long millisPerSlice)

Uses of OutputWriter in com.google.appengine.tools.mapreduce.impl.sort

Methods in com.google.appengine.tools.mapreduce.impl.sort that return OutputWriter

Modifier and Type	Method and Description
OutputWriter<KeyValue<ByteBuffer,List<ByteBuffer>>>	MergeShardTask.getOutputWriter()
OutputWriter<KeyValue<ByteBuffer,List<ByteBuffer>>>	SortShardTask.getOutputWriter()

Constructors in com.google.appengine.tools.mapreduce.impl.sort with parameters of type OutputWriter

Constructor and Description
MergeShardTask(String mrJobId, int shardNumber, int shardCount, InputReader<KeyValue<ByteBuffer,Iterator<ByteBuffer>>> in, OutputWriter<KeyValue<ByteBuffer,List<ByteBuffer>>> out, int sortReadTimeMillis)
SortShardTask(String mrJobId, int shardNumber, int shardCount, InputReader<KeyValue<ByteBuffer,ByteBuffer>> in, SortWorker worker, OutputWriter<KeyValue<ByteBuffer,List<ByteBuffer>>> out, int sortReadTimeMillis)

Uses of OutputWriter in com.google.appengine.tools.mapreduce.outputs

Classes in com.google.appengine.tools.mapreduce.outputs with type parameters of type OutputWriter

Modifier and Type	Class and Description
class	ShardingOutputWriter<K,V,WriterT extends OutputWriter<KeyValue<K,V>>> Writes KeyValues out to a number of output writers each corresponding to a different shard A sharder and an Output object are provided in the constructor.
class	SliceSegmentingOutputWriter<O,WriterT extends OutputWriter<O>> Segments data by using a separate writer for each slice.

Subclasses of OutputWriter in com.google.appengine.tools.mapreduce.outputs

Modifier and Type	Class and Description
class	BlobFileOutputWriter An OutputWriter that writes bytes to a blob file that it creates.
static class	DatastoreOutput.DatastoreOutputWriter
class	ForwardingOutputWriter<O>
class	GoogleCloudStorageFileOutputWriter An OutputWriter that writes bytes to a GCS file that it creates.
class	GoogleCloudStorageLevelDbOutputWriter A decorator for LevelDbOutputWriter that delegates to GoogleCloudStorageFileOutputWriter and pads blocks to GCS write boundaries on end of slice.
class	InMemoryOutputWriter<O>
class	ItemSegmentingOutputWriter<O> Segments data by using a separate writer each time ItemSegmentingOutputWriter.shouldSegment(O) returns true.
class	LevelDbOutputWriter An implementation of a LevelDb format writer.
class	MarshallingOutputWriter<O> An OutputWriter that marshalls records.
class	ShardingOutputWriter<K,V,WriterT extends OutputWriter<KeyValue<K,V>>> Writes KeyValues out to a number of output writers each corresponding to a different shard A sharder and an Output object are provided in the constructor.
class	SizeSegmentingOutputWriter Segments the output base on the specified size limit.
class	SliceSegmentingOutputWriter<O,WriterT extends OutputWriter<O>> Segments data by using a separate writer for each slice.

Methods in com.google.appengine.tools.mapreduce.outputs that return OutputWriter

Modifier and Type	Method and Description
protected OutputWriter<ByteBuffer>	SizeSegmentingOutputWriter.createNextWriter(int fileNum)
protected abstract OutputWriter<O>	ItemSegmentingOutputWriter.createNextWriter(int fileNum)
protected abstract OutputWriter<ByteBuffer>	SizeSegmentingOutputWriter.createWriter(int fileNum)
protected abstract OutputWriter<?>	ForwardingOutputWriter.getDelegate()
protected OutputWriter<O>	ItemSegmentingOutputWriter.getDelegate()
protected OutputWriter<ByteBuffer>	MarshallingOutputWriter.getDelegate()
protected OutputWriter<ByteBuffer>	LevelDbOutputWriter.getDelegate()

Methods in com.google.appengine.tools.mapreduce.outputs that return types with arguments of type OutputWriter

Modifier and Type	Method and Description
List<? extends OutputWriter<O>>	InMemoryOutput.createWriters(int numShards)
List<? extends OutputWriter<O>>	StringOutput.createWriters(int numShards)
List<? extends OutputWriter<ByteBuffer>>	SizeSegmentedGoogleCloudStorageFileOutput.createWriters(int numShards) Returns OutputWriters that write files to GCS but segments the files based on the maximum allowed file size.
List<? extends OutputWriter<O>>	NoOutput.createWriters(int numShards)

Method parameters in com.google.appengine.tools.mapreduce.outputs with type arguments of type OutputWriter

Modifier and Type	Method and Description
List<com.google.appengine.api.files.AppEngineFile>	BlobFileOutput.finish(Collection<? extends OutputWriter<ByteBuffer>> writers) Returns a list of AppEngineFiles that has one element for each reduce shard.
GoogleCloudStorageFileSet	SizeSegmentedGoogleCloudStorageFileOutput.finish(Collection<? extends OutputWriter<ByteBuffer>> writers) Returns a list of all the filenames written by the output writers
GoogleCloudStorageFileSet	GoogleCloudStorageLevelDbOutput.finish(Collection<? extends OutputWriter<ByteBuffer>> writers)
GoogleCloudStorageFileSet	GoogleCloudStorageFileOutput.finish(Collection<? extends OutputWriter<ByteBuffer>> writers) Returns a list of GcsFilename that has one element for each reduce shard.
R	LevelDbOutput.finish(Collection<? extends OutputWriter<ByteBuffer>> writers)
Void	DatastoreOutput.finish(Collection<? extends OutputWriter<com.google.appengine.api.datastore.Entity>> writers) Returns null.
BigQueryStoreResult<GoogleCloudStorageFileSet>	BigQueryGoogleCloudStorageStoreOutput.finish(Collection<? extends OutputWriter<O>> writers)
List<List<O>>	InMemoryOutput.finish(Collection<? extends OutputWriter<O>> writers) Returns a list of lists where the outer list has one element for each reduce shard, which is a list of the values emitted by that shard, in order.
R	StringOutput.finish(Collection<? extends OutputWriter<O>> writers) Returns whatever the underlying Output's StringOutput.finish(java.util.Collection<? extends com.google.appengine.tools.mapreduce.OutputWriter<O>>) method returns.
R	MarshallingOutput.finish(Collection<? extends OutputWriter<O>> writers)
R	NoOutput.finish(Collection<? extends OutputWriter<O>> writers) Returns null.

Constructors in com.google.appengine.tools.mapreduce.outputs with parameters of type OutputWriter

Constructor and Description
GoogleCloudStorageLevelDbOutputWriter(OutputWriter<ByteBuffer> delegate)
LevelDbOutputWriter(OutputWriter<ByteBuffer> delegate)
MarshallingOutputWriter(OutputWriter<ByteBuffer> writer, Marshaller<? super O> marshaller)