com.google.appengine.tools.mapreduce.inputs

Class GoogleCloudStorageLineInput

java.lang.Object

com.google.appengine.tools.mapreduce.Input<byte[]>

com.google.appengine.tools.mapreduce.inputs.GoogleCloudStorageLineInput

All Implemented Interfaces:

Serializable

public class GoogleCloudStorageLineInput
extends Input<byte[]>

CloudStorageLineInput shards files in Cloud Storage on separator boundries.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
GoogleCloudStorageLineInput(com.google.appengine.tools.cloudstorage.GcsFilename file, byte separator, int shardCount)
GoogleCloudStorageLineInput(com.google.appengine.tools.cloudstorage.GcsFilename file, byte separator, int shardCount, int bufferSize)

Method Summary

Methods

Modifier and Type	Method and Description
List<? extends InputReader<byte[]>>	createReaders() Returns a list of readers for this input.

Methods inherited from class com.google.appengine.tools.mapreduce.Input

getContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GoogleCloudStorageLineInput

public GoogleCloudStorageLineInput(com.google.appengine.tools.cloudstorage.GcsFilename file,
                           byte separator,
                           int shardCount)

GoogleCloudStorageLineInput

public GoogleCloudStorageLineInput(com.google.appengine.tools.cloudstorage.GcsFilename file,
                           byte separator,
                           int shardCount,
                           int bufferSize)

Method Detail

createReaders

public List<? extends InputReader<byte[]>> createReaders()

Description copied from class: Input

Returns a list of readers for this input. It is the Input's responsibility to determine an appropriate number of readers to split into. This could be specified by the user or determined algorithmically. The number of input readers returned determines the number of map shards.

Specified by:

createReaders in class Input<byte[]>