com.google.appengine.tools.mapreduce.impl

Class FilesByShard

java.lang.Object

com.google.appengine.tools.mapreduce.impl.FilesByShard

All Implemented Interfaces:

Serializable

public final class FilesByShard
extends Object
implements Serializable

A convenience datastructure to track sets of files on a per-shard basis

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
FilesByShard(int shardCount, String bucket)

Method Summary

Methods

Modifier and Type	Method and Description
void	addFilesToShard(int shardNumber, Iterable<String> newFiles)
void	addFileToShard(int shardNumber, String newFile)
boolean	equals(Object obj)
String	getBucket()
GoogleCloudStorageFileSet	getFilesForShard(int shardNumber)
int	getShardCount()
int	hashCode()
void	splitShards(int targetNumShards) Splits the provided input if needed to ensure there are approximately targetNumShards shards.
String	toString()

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

FilesByShard

public FilesByShard(int shardCount,
            String bucket)

Method Detail

getFilesForShard

public GoogleCloudStorageFileSet getFilesForShard(int shardNumber)

hashCode

public int hashCode()

Overrides:

hashCode in class Object

equals

public boolean equals(Object obj)

Overrides:

equals in class Object

addFilesToShard

public void addFilesToShard(int shardNumber,
                   Iterable<String> newFiles)

addFileToShard

public void addFileToShard(int shardNumber,
                  String newFile)

getShardCount

public int getShardCount()

toString

public String toString()

Overrides:

toString in class Object

getBucket

public String getBucket()

splitShards

public void splitShards(int targetNumShards)

Splits the provided input if needed to ensure there are approximately targetNumShards shards. (Note that it will not combine files from different input shards into a single output shard)