com.google.appengine.tools.mapreduce.inputs

Class LogInput

java.lang.Object

com.google.appengine.tools.mapreduce.Input<com.google.appengine.api.log.RequestLogs>

com.google.appengine.tools.mapreduce.inputs.LogInput

All Implemented Interfaces:

Serializable

public final class LogInput
extends Input<com.google.appengine.api.log.RequestLogs>

Reads RequestLogs from the App Engine Logs API

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
static long	EARLIEST_LOG_TIME

Constructor Summary

Constructors

Constructor and Description
LogInput(com.google.appengine.api.log.LogQuery logQuery, int shardCount) Create a new Input for getting App Engine Logs Shards are created by assuming a uniform distribution of logs over the entire time specified and naively dividing the distance between the start and end times equally.

Method Summary

Methods

Modifier and Type	Method and Description
List<? extends InputReader<com.google.appengine.api.log.RequestLogs>>	createReaders() Returns a list of readers for this input.

Methods inherited from class com.google.appengine.tools.mapreduce.Input

getContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

EARLIEST_LOG_TIME

public static final long EARLIEST_LOG_TIME

See Also:

Constant Field Values

Constructor Detail

LogInput

public LogInput(com.google.appengine.api.log.LogQuery logQuery,
        int shardCount)

Create a new Input for getting App Engine Logs Shards are created by assuming a uniform distribution of logs over the entire time specified and naively dividing the distance between the start and end times equally. If the logs are not uniformly distributed between the start and end time then the distribution of work performed by each shard will not be equal. For example using a start time of 0 (Jan 1, 1970) will likely cause all work to be performed by the last shard(s).

Parameters:

logQuery - a query with at least a start and end time specified. Additional query options may also be specified to indicate which log data should be read.

shardCount - the desired number of shards

Method Detail

createReaders

public List<? extends InputReader<com.google.appengine.api.log.RequestLogs>> createReaders()

Description copied from class: Input

Returns a list of readers for this input. It is the Input's responsibility to determine an appropriate number of readers to split into. This could be specified by the user or determined algorithmically. The number of input readers returned determines the number of map shards.

Specified by:

createReaders in class Input<com.google.appengine.api.log.RequestLogs>