com.google.appengine.tools.mapreduce.outputs

Class GoogleCloudStorageLevelDbOutputWriter

java.lang.Object

com.google.appengine.tools.mapreduce.OutputWriter<O>

com.google.appengine.tools.mapreduce.outputs.ForwardingOutputWriter<ByteBuffer>

com.google.appengine.tools.mapreduce.outputs.LevelDbOutputWriter

com.google.appengine.tools.mapreduce.outputs.GoogleCloudStorageLevelDbOutputWriter

All Implemented Interfaces:

Serializable

public class GoogleCloudStorageLevelDbOutputWriter
extends LevelDbOutputWriter

A decorator for LevelDbOutputWriter that delegates to GoogleCloudStorageFileOutputWriter and pads blocks to GCS write boundaries on end of slice. This is needed because GCS requires data to be passed in in 256kb but LevelDb uses 32kb blocks this class provides a way get this class to pad the output by writing empty blocks.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
GoogleCloudStorageLevelDbOutputWriter(OutputWriter<ByteBuffer> delegate)

Method Summary

Methods

Modifier and Type	Method and Description
void	endSlice() Prepares the writer for possible serialization.

Methods inherited from class com.google.appengine.tools.mapreduce.outputs.LevelDbOutputWriter

beginSlice, endShard, getDelegate, getNumBlocksWritten, write

Methods inherited from class com.google.appengine.tools.mapreduce.outputs.ForwardingOutputWriter

allowSliceRetry, beginShard, estimateMemoryRequirement, getContext, setContext

Methods inherited from class com.google.appengine.tools.mapreduce.OutputWriter

cleanup, close, open

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GoogleCloudStorageLevelDbOutputWriter

public GoogleCloudStorageLevelDbOutputWriter(OutputWriter<ByteBuffer> delegate)

Method Detail

endSlice

public void endSlice()
              throws IOException

Description copied from class: OutputWriter

Prepares the writer for possible serialization.

Overrides:

endSlice in class LevelDbOutputWriter

Throws:

IOException - in the event of failure