com.google.appengine.tools.mapreduce.outputs

Class SizeSegmentingOutputWriter

java.lang.Object

com.google.appengine.tools.mapreduce.OutputWriter<O>

com.google.appengine.tools.mapreduce.outputs.ForwardingOutputWriter<O>

com.google.appengine.tools.mapreduce.outputs.ItemSegmentingOutputWriter<ByteBuffer>

com.google.appengine.tools.mapreduce.outputs.SizeSegmentingOutputWriter

All Implemented Interfaces:

Serializable

public abstract class SizeSegmentingOutputWriter
extends ItemSegmentingOutputWriter<ByteBuffer>

Segments the output base on the specified size limit. Creates a new writer if the sum of number of bytes written by the current writer and number of bytes to write exceeds segment size limit

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
SizeSegmentingOutputWriter(long segmentSizeLimit)

Method Summary

Methods

Modifier and Type	Method and Description
void	beginShard() Will be called once before any calls to write.
protected OutputWriter<ByteBuffer>	createNextWriter(int fileNum)
protected abstract OutputWriter<ByteBuffer>	createWriter(int fileNum)
protected boolean	shouldSegment(ByteBuffer value)
void	write(ByteBuffer value) Writes a value to the output.

Methods inherited from class com.google.appengine.tools.mapreduce.outputs.ItemSegmentingOutputWriter

allowSliceRetry, estimateMemoryRequirement, getContext, getDelegate, setContext

Methods inherited from class com.google.appengine.tools.mapreduce.outputs.ForwardingOutputWriter

beginSlice, endShard, endSlice

Methods inherited from class com.google.appengine.tools.mapreduce.OutputWriter

cleanup, close, open

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SizeSegmentingOutputWriter

public SizeSegmentingOutputWriter(long segmentSizeLimit)

Method Detail

beginShard

public void beginShard()
                throws IOException

Description copied from class: OutputWriter

Will be called once before any calls to write. Prepares the writer for processing, after possibly having gone through serialization and deserialization.

Overrides:

beginShard in class ItemSegmentingOutputWriter<ByteBuffer>

Throws:

IOException - in the event of failure

shouldSegment

protected boolean shouldSegment(ByteBuffer value)

Specified by:

shouldSegment in class ItemSegmentingOutputWriter<ByteBuffer>

write

public void write(ByteBuffer value)
           throws IOException

Description copied from class: OutputWriter

Writes a value to the output.

Overrides:

write in class ItemSegmentingOutputWriter<ByteBuffer>

Throws:

IOException

createNextWriter

protected final OutputWriter<ByteBuffer> createNextWriter(int fileNum)

Specified by:

createNextWriter in class ItemSegmentingOutputWriter<ByteBuffer>

createWriter

protected abstract OutputWriter<ByteBuffer> createWriter(int fileNum)