- BaseContext - Class in com.google.appengine.tools.mapreduce.impl
-
Base class for all Context implementations.
- BaseContext(String) - Constructor for class com.google.appengine.tools.mapreduce.impl.BaseContext
-
- BaseShardContext<O> - Class in com.google.appengine.tools.mapreduce.impl
-
Base class for all ShardContext implementations.
- BaseShardContext(IncrementalTaskContext, OutputWriter<O>) - Constructor for class com.google.appengine.tools.mapreduce.impl.BaseShardContext
-
- beginShard() - Method in class com.google.appengine.tools.mapreduce.InputReader
-
Performs setup at the beginning of the shard.
- beginShard() - Method in class com.google.appengine.tools.mapreduce.inputs.ConcatenatingInputReader
-
- beginShard() - Method in class com.google.appengine.tools.mapreduce.inputs.ForwardingInputReader
-
- beginShard() - Method in class com.google.appengine.tools.mapreduce.inputs.LevelDbInputReader
-
- beginShard() - Method in class com.google.appengine.tools.mapreduce.inputs.LogInputReader
-
- beginShard() - Method in class com.google.appengine.tools.mapreduce.inputs.UnmarshallingInputReader
-
- beginShard() - Method in class com.google.appengine.tools.mapreduce.outputs.BlobFileOutputWriter
-
- beginShard() - Method in class com.google.appengine.tools.mapreduce.outputs.ForwardingOutputWriter
-
- beginShard() - Method in class com.google.appengine.tools.mapreduce.outputs.GoogleCloudStorageFileOutputWriter
-
- beginShard() - Method in class com.google.appengine.tools.mapreduce.outputs.InMemoryOutputWriter
-
- beginShard() - Method in class com.google.appengine.tools.mapreduce.outputs.ItemSegmentingOutputWriter
-
- beginShard() - Method in class com.google.appengine.tools.mapreduce.outputs.ShardingOutputWriter
-
- beginShard() - Method in class com.google.appengine.tools.mapreduce.outputs.SizeSegmentingOutputWriter
-
- beginShard() - Method in class com.google.appengine.tools.mapreduce.outputs.SliceSegmentingOutputWriter
-
- beginShard() - Method in class com.google.appengine.tools.mapreduce.OutputWriter
-
Will be called once before any calls to write.
- beginShard() - Method in class com.google.appengine.tools.mapreduce.Worker
-
Prepares the worker for processing a new shard, after possibly having gone
through serialization and deserialization.
- beginSlice() - Method in class com.google.appengine.tools.mapreduce.impl.sort.SortWorker
-
- beginSlice() - Method in class com.google.appengine.tools.mapreduce.InputReader
-
Prepares the InputReader
for reading, after possibly having gone
through serialization and deserialization.
- beginSlice() - Method in class com.google.appengine.tools.mapreduce.inputs.ConcatenatingInputReader
-
- beginSlice() - Method in class com.google.appengine.tools.mapreduce.inputs.ForwardingInputReader
-
- beginSlice() - Method in class com.google.appengine.tools.mapreduce.inputs.LevelDbInputReader
-
- beginSlice() - Method in class com.google.appengine.tools.mapreduce.inputs.LogInputReader
-
Prepare this slice for reading.
- beginSlice() - Method in class com.google.appengine.tools.mapreduce.inputs.UnmarshallingInputReader
-
- beginSlice() - Method in class com.google.appengine.tools.mapreduce.outputs.BlobFileOutputWriter
-
- beginSlice() - Method in class com.google.appengine.tools.mapreduce.outputs.DatastoreOutput.DatastoreOutputWriter
-
- beginSlice() - Method in class com.google.appengine.tools.mapreduce.outputs.ForwardingOutputWriter
-
- beginSlice() - Method in class com.google.appengine.tools.mapreduce.outputs.GoogleCloudStorageFileOutputWriter
-
- beginSlice() - Method in class com.google.appengine.tools.mapreduce.outputs.InMemoryOutputWriter
-
- beginSlice() - Method in class com.google.appengine.tools.mapreduce.outputs.LevelDbOutputWriter
-
- beginSlice() - Method in class com.google.appengine.tools.mapreduce.outputs.ShardingOutputWriter
-
- beginSlice() - Method in class com.google.appengine.tools.mapreduce.outputs.SliceSegmentingOutputWriter
-
Creates a new writer.
- beginSlice() - Method in class com.google.appengine.tools.mapreduce.OutputWriter
-
Prepares the writer for writing after possibly having gone through
serialization or deserialization.
- beginSlice() - Method in class com.google.appengine.tools.mapreduce.Worker
-
Prepares the worker for processing a new slice, after possibly having gone
through serialization and deserialization.
- BIGQUERY_LOAD_DATA_SIZE_LIMIT - Static variable in class com.google.appengine.tools.mapreduce.impl.BigQueryConstants
-
- BigQueryConstants - Class in com.google.appengine.tools.mapreduce.impl
-
- BigQueryDataField - Annotation Type in com.google.appengine.tools.mapreduce
-
Annotation to provide additional information related to BigQuery data fields.
- BigQueryDataTypeUtil - Class in com.google.appengine.tools.mapreduce.impl.util
-
Utility class for converting java types to BigQuery data types
- BigQueryDataTypeUtil() - Constructor for class com.google.appengine.tools.mapreduce.impl.util.BigQueryDataTypeUtil
-
- BigqueryFieldMarshaller - Interface in com.google.appengine.tools.mapreduce.impl
-
Defines how a
Field
s should be interpreted and marshalled while generating its
TableFieldSchema
for loading data into bigquery.
- BigqueryFieldMarshallers - Class in com.google.appengine.tools.mapreduce.impl
-
- BigQueryFieldMode - Enum in com.google.appengine.tools.mapreduce
-
The supported bigquery field modes.
- BigQueryFieldUtil - Class in com.google.appengine.tools.mapreduce.impl
-
Utility class for processing
Field
and BigQuery data fields.
- BigQueryGoogleCloudStorageStoreOutput<O> - Class in com.google.appengine.tools.mapreduce.outputs
-
An
Output
that writes files in Google cloud storage using a format compatible with
bigquery ingestion.
- BigQueryGoogleCloudStorageStoreOutput(BigQueryMarshaller<O>, String, String) - Constructor for class com.google.appengine.tools.mapreduce.outputs.BigQueryGoogleCloudStorageStoreOutput
-
- BigQueryIgnore - Annotation Type in com.google.appengine.tools.mapreduce
-
A annotation for fields that should not be part of the bigquery output.
- BigQueryLoadGoogleCloudStorageFilesJob - Class in com.google.appengine.tools.mapreduce.bigqueryjobs
-
A pipeline job that loads files stored in Google Cloud Storage into a bigquery table.
- BigQueryLoadGoogleCloudStorageFilesJob(String, String, String) - Constructor for class com.google.appengine.tools.mapreduce.bigqueryjobs.BigQueryLoadGoogleCloudStorageFilesJob
-
- BigQueryLoadJobReference - Class in com.google.appengine.tools.mapreduce.bigqueryjobs
-
Result of the bigquery load files pipeline job.
- BigQueryLoadJobReference(String, JobReference) - Constructor for class com.google.appengine.tools.mapreduce.bigqueryjobs.BigQueryLoadJobReference
-
- BigQueryMarshaller<T> - Class in com.google.appengine.tools.mapreduce
-
An implementation of this class should serialize the objects of type T into newline separated
json as expected by the bigquery load jobs.
- BigQueryMarshaller() - Constructor for class com.google.appengine.tools.mapreduce.BigQueryMarshaller
-
- BigQueryMarshallerByType<T> - Class in com.google.appengine.tools.mapreduce.impl
-
Validates and generates TableSchema
of a bigquery table and marshals objects into json
for loading into that table using annotations and reflection on type T.
- BigQueryMarshallerByType(Class<T>, Map<Field, BigqueryFieldMarshaller>) - Constructor for class com.google.appengine.tools.mapreduce.impl.BigQueryMarshallerByType
-
- BigQueryMarshallerByType(Class<T>) - Constructor for class com.google.appengine.tools.mapreduce.impl.BigQueryMarshallerByType
-
- BigQueryStoreResult<R> - Class in com.google.appengine.tools.mapreduce.outputs
-
Result of bigQuery staging process.
- BigQueryStoreResult(R, TableSchema) - Constructor for class com.google.appengine.tools.mapreduce.outputs.BigQueryStoreResult
-
- BlobFileOutput - Class in com.google.appengine.tools.mapreduce.outputs
-
An
Output
that writes bytes to a set of blob files, one per shard.
- BlobFileOutput(String, String) - Constructor for class com.google.appengine.tools.mapreduce.outputs.BlobFileOutput
-
- BlobFileOutputWriter - Class in com.google.appengine.tools.mapreduce.outputs
-
An
OutputWriter
that writes bytes to a blob file that it creates.
- BlobFileOutputWriter(String, String) - Constructor for class com.google.appengine.tools.mapreduce.outputs.BlobFileOutputWriter
-
- BlobstoreInput - Class in com.google.appengine.tools.mapreduce.inputs
-
BlobstoreLineInput shards files in Blobstore on separator boundaries.
- BlobstoreInput(String, byte, int) - Constructor for class com.google.appengine.tools.mapreduce.inputs.BlobstoreInput
-
- BLOCK_SIZE - Static variable in class com.google.appengine.tools.mapreduce.impl.util.LevelDbConstants
-
The size of the blocks records are written in.
- BQ_SCOPE - Static variable in class com.google.appengine.tools.mapreduce.impl.BigQueryConstants
-
- build() - Method in class com.google.appengine.tools.mapreduce.DatastoreMutationPool.Params.Builder
-
- build() - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValue.Builder
-
- build() - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValues.Builder
-
- build() - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobSettings.Builder
-
- build() - Method in class com.google.appengine.tools.mapreduce.MapReduceSettings.Builder
-
- build() - Method in class com.google.appengine.tools.mapreduce.MapReduceSpecification.Builder
-
- build() - Method in class com.google.appengine.tools.mapreduce.MapSettings.Builder
-
- build() - Method in class com.google.appengine.tools.mapreduce.MapSpecification.Builder
-
- buildPartial() - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValue.Builder
-
- buildPartial() - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValues.Builder
-
- bytesLimit(int) - Method in class com.google.appengine.tools.mapreduce.DatastoreMutationPool.Params.Builder
-
- callWorker(I) - Method in class com.google.appengine.tools.mapreduce.impl.MapOnlyShardTask
-
- callWorker(I) - Method in class com.google.appengine.tools.mapreduce.impl.MapShardTask
-
- callWorker(KeyValue<K, Iterator<V>>) - Method in class com.google.appengine.tools.mapreduce.impl.ReduceShardTask
-
- callWorker(KeyValue<ByteBuffer, Iterator<ByteBuffer>>) - Method in class com.google.appengine.tools.mapreduce.impl.sort.MergeShardTask
-
- callWorker(KeyValue<ByteBuffer, ByteBuffer>) - Method in class com.google.appengine.tools.mapreduce.impl.sort.SortShardTask
-
- callWorker(I) - Method in class com.google.appengine.tools.mapreduce.impl.WorkerShardTask
-
- claim(long) - Method in class com.google.appengine.tools.mapreduce.impl.handlers.MemoryLimiter
-
This method attempts to claim ram to the provided request.
- claimedMemory - Variable in class com.google.appengine.tools.mapreduce.impl.WorkerShardTask
-
- cleanup(List<GcsFilename>, JobSetting...) - Static method in class com.google.appengine.tools.mapreduce.impl.pipeline.CleanupPipelineJob
-
- cleanup() - Method in interface com.google.appengine.tools.mapreduce.impl.shardedjob.IncrementalTask
-
Clean up and release any resources claimed in prepare.
- cleanup() - Method in class com.google.appengine.tools.mapreduce.impl.sort.SortShardTask
-
- cleanup() - Method in class com.google.appengine.tools.mapreduce.impl.WorkerShardTask
-
- cleanup() - Method in class com.google.appengine.tools.mapreduce.outputs.GoogleCloudStorageFileOutputWriter
-
- cleanup() - Method in class com.google.appengine.tools.mapreduce.OutputWriter
-
called after shards completes for any necessary cleanup.
- cleanupJob(String) - Method in interface com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobService
-
Deletes all data of a completed job with the given ID.
- CleanupPipelineJob - Class in com.google.appengine.tools.mapreduce.impl.pipeline
-
- clear() - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValue.Builder
-
- clear() - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValues.Builder
-
- clearKey() - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValue.Builder
-
required bytes key = 1 [ctype = CORD];
- clearKey() - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValues.Builder
-
required bytes key = 1 [ctype = CORD];
- clearValue() - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValue.Builder
-
required bytes value = 2 [ctype = CORD];
- clearValue() - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValues.Builder
-
repeated bytes value = 2 [ctype = CORD];
- clone() - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValue.Builder
-
- clone() - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValues.Builder
-
- clone(T) - Static method in class com.google.appengine.tools.mapreduce.impl.util.SerializationUtil
-
- close() - Method in class com.google.appengine.tools.mapreduce.InputReader
-
Deprecated.
Override endShard instead.
- close() - Method in class com.google.appengine.tools.mapreduce.OutputWriter
-
Deprecated.
Override endShard instead.
- com.google.appengine.tools.mapreduce - package com.google.appengine.tools.mapreduce
-
- com.google.appengine.tools.mapreduce.bigqueryjobs - package com.google.appengine.tools.mapreduce.bigqueryjobs
-
- com.google.appengine.tools.mapreduce.impl - package com.google.appengine.tools.mapreduce.impl
-
- com.google.appengine.tools.mapreduce.impl.handlers - package com.google.appengine.tools.mapreduce.impl.handlers
-
- com.google.appengine.tools.mapreduce.impl.pipeline - package com.google.appengine.tools.mapreduce.impl.pipeline
-
- com.google.appengine.tools.mapreduce.impl.proto - package com.google.appengine.tools.mapreduce.impl.proto
-
- com.google.appengine.tools.mapreduce.impl.shardedjob - package com.google.appengine.tools.mapreduce.impl.shardedjob
-
- com.google.appengine.tools.mapreduce.impl.shardedjob.pipeline - package com.google.appengine.tools.mapreduce.impl.shardedjob.pipeline
-
- com.google.appengine.tools.mapreduce.impl.sort - package com.google.appengine.tools.mapreduce.impl.sort
-
- com.google.appengine.tools.mapreduce.impl.util - package com.google.appengine.tools.mapreduce.impl.util
-
- com.google.appengine.tools.mapreduce.inputs - package com.google.appengine.tools.mapreduce.inputs
-
- com.google.appengine.tools.mapreduce.mappers - package com.google.appengine.tools.mapreduce.mappers
-
- com.google.appengine.tools.mapreduce.outputs - package com.google.appengine.tools.mapreduce.outputs
-
- com.google.appengine.tools.mapreduce.reducers - package com.google.appengine.tools.mapreduce.reducers
-
- com.google.appengine.tools.mapreduce.servlets - package com.google.appengine.tools.mapreduce.servlets
-
- compare(ByteBuffer, ByteBuffer) - Method in class com.google.appengine.tools.mapreduce.impl.sort.LexicographicalComparator
-
- compareBuffers(ByteBuffer, ByteBuffer) - Static method in class com.google.appengine.tools.mapreduce.impl.sort.LexicographicalComparator
-
- completed(Iterator<T>) - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobController
-
Called when the sharded job has completed successfully.
- completed(Iterator<WorkerShardTask<I, O, C>>) - Method in class com.google.appengine.tools.mapreduce.impl.WorkerController
-
- completeShard(String, String) - Method in interface com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobHandler
-
- completeShard(String, String) - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobRunner
-
- ConcatenatingInputReader<I> - Class in com.google.appengine.tools.mapreduce.inputs
-
Reads multiple inputs in sequence.
- ConcatenatingInputReader(List<? extends InputReader<I>>) - Constructor for class com.google.appengine.tools.mapreduce.inputs.ConcatenatingInputReader
-
- ConsecutiveLongInput - Class in com.google.appengine.tools.mapreduce.inputs
-
Produces all longs in a given interval.
- ConsecutiveLongInput(long, long, int) - Constructor for class com.google.appengine.tools.mapreduce.inputs.ConsecutiveLongInput
-
Produces longs from (inclusive) to limit
(exclusive).
- Context - Interface in com.google.appengine.tools.mapreduce
-
MapReduce context.
- CONTROLLER_PATH - Static variable in class com.google.appengine.tools.mapreduce.MapSettings
-
- CorruptDataException - Exception in com.google.appengine.tools.mapreduce
-
The exception generated if any of the data appears to be corrupt.
- CorruptDataException() - Constructor for exception com.google.appengine.tools.mapreduce.CorruptDataException
-
- CorruptDataException(String) - Constructor for exception com.google.appengine.tools.mapreduce.CorruptDataException
-
- CorruptDataException(String, Throwable) - Constructor for exception com.google.appengine.tools.mapreduce.CorruptDataException
-
- CorruptDataException(Throwable) - Constructor for exception com.google.appengine.tools.mapreduce.CorruptDataException
-
- Counter - Interface in com.google.appengine.tools.mapreduce
-
Counter is an integer variable that is aggregated across multiple shards.
- CounterNames - Class in com.google.appengine.tools.mapreduce
-
Built-in counter names.
- Counters - Interface in com.google.appengine.tools.mapreduce
-
Collection of all counters.
- CountersImpl - Class in com.google.appengine.tools.mapreduce.impl
-
- CountersImpl() - Constructor for class com.google.appengine.tools.mapreduce.impl.CountersImpl
-
- countLimit(int) - Method in class com.google.appengine.tools.mapreduce.DatastoreMutationPool.Params.Builder
-
- Crc32c - Class in com.google.appengine.tools.mapreduce.impl.util
-
This class generates a CRC32C checksum, defined by rfc3720 section B.4.
- Crc32c() - Constructor for class com.google.appengine.tools.mapreduce.impl.util.Crc32c
-
- CRC_MASK_DELTA - Static variable in class com.google.appengine.tools.mapreduce.impl.util.LevelDbConstants
-
CRC Mask.
- create(DatastoreService, DatastoreMutationPool.Params) - Static method in class com.google.appengine.tools.mapreduce.DatastoreMutationPool
-
- create() - Static method in class com.google.appengine.tools.mapreduce.DatastoreMutationPool
-
- create(int) - Static method in class com.google.appengine.tools.mapreduce.inputs.NoInput
-
- create() - Static method in class com.google.appengine.tools.mapreduce.reducers.KeyProjectionReducer
-
- create() - Static method in class com.google.appengine.tools.mapreduce.reducers.NoReducer
-
Deprecated.
- create() - Static method in class com.google.appengine.tools.mapreduce.reducers.ValueProjectionReducer
-
- createNextWriter(int) - Method in class com.google.appengine.tools.mapreduce.outputs.ItemSegmentingOutputWriter
-
- createNextWriter(int) - Method in class com.google.appengine.tools.mapreduce.outputs.SizeSegmentingOutputWriter
-
- createReadableByteChannel() - Method in class com.google.appengine.tools.mapreduce.inputs.GoogleCloudStorageLevelDbInputReader
-
- createReadableByteChannel() - Method in class com.google.appengine.tools.mapreduce.inputs.LevelDbInputReader
-
- createReader(Query) - Method in class com.google.appengine.tools.mapreduce.inputs.DatastoreInput
-
- createReader(Query) - Method in class com.google.appengine.tools.mapreduce.inputs.DatastoreKeyInput
-
- createReaders() - Method in class com.google.appengine.tools.mapreduce.impl.GoogleCloudStorageMergeInput
-
- createReaders() - Method in class com.google.appengine.tools.mapreduce.impl.GoogleCloudStorageReduceInput
-
- createReaders() - Method in class com.google.appengine.tools.mapreduce.impl.GoogleCloudStorageSortInput
-
- createReaders() - Method in class com.google.appengine.tools.mapreduce.Input
-
Returns a list of readers for this input.
- createReaders() - Method in class com.google.appengine.tools.mapreduce.inputs.BlobstoreInput
-
- createReaders() - Method in class com.google.appengine.tools.mapreduce.inputs.ConsecutiveLongInput
-
- createReaders() - Method in class com.google.appengine.tools.mapreduce.inputs.GoogleCloudStorageLevelDbInput
-
- createReaders() - Method in class com.google.appengine.tools.mapreduce.inputs.GoogleCloudStorageLineInput
-
- createReaders() - Method in class com.google.appengine.tools.mapreduce.inputs.InMemoryInput
-
- createReaders() - Method in class com.google.appengine.tools.mapreduce.inputs.LogInput
-
- createReaders() - Method in class com.google.appengine.tools.mapreduce.inputs.NoInput
-
- createReaders() - Method in class com.google.appengine.tools.mapreduce.inputs.RandomLongInput
-
- createReaders() - Method in class com.google.appengine.tools.mapreduce.inputs.UnmarshallingInput
-
- createShardsJob(int, int) - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.pipeline.AbstractShardedJob
-
- createShardsJob(int, int) - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.pipeline.DeleteShardedJob
-
- createShardsJob(int, int) - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.pipeline.FinalizeShardedJob
-
- createWriter(int) - Method in class com.google.appengine.tools.mapreduce.impl.GoogleCloudStorageMapOutputWriter
-
- createWriter(int) - Method in class com.google.appengine.tools.mapreduce.outputs.ShardingOutputWriter
-
Creates a new writer.
- createWriter(int) - Method in class com.google.appengine.tools.mapreduce.outputs.SizeSegmentingOutputWriter
-
- createWriter(int) - Method in class com.google.appengine.tools.mapreduce.outputs.SliceSegmentingOutputWriter
-
Creates a new writer.
- createWriters(int) - Method in class com.google.appengine.tools.mapreduce.impl.GoogleCloudStorageMapOutput
-
- createWriters(int) - Method in class com.google.appengine.tools.mapreduce.impl.GoogleCloudStorageMergeOutput
-
Returns a writer that writes the data the same way that the sort does, splitting the output
every time the key goes backwards in sequence.
- createWriters(int) - Method in class com.google.appengine.tools.mapreduce.impl.GoogleCloudStorageSortOutput
-
- createWriters(int) - Method in class com.google.appengine.tools.mapreduce.Output
-
Returns a list of writers, one for each shard, for this output.
- createWriters(int) - Method in class com.google.appengine.tools.mapreduce.outputs.BigQueryGoogleCloudStorageStoreOutput
-
- createWriters(int) - Method in class com.google.appengine.tools.mapreduce.outputs.BlobFileOutput
-
- createWriters(int) - Method in class com.google.appengine.tools.mapreduce.outputs.DatastoreOutput
-
- createWriters(int) - Method in class com.google.appengine.tools.mapreduce.outputs.GoogleCloudStorageFileOutput
-
- createWriters(int) - Method in class com.google.appengine.tools.mapreduce.outputs.GoogleCloudStorageLevelDbOutput
-
- createWriters(int) - Method in class com.google.appengine.tools.mapreduce.outputs.InMemoryOutput
-
- createWriters(int) - Method in class com.google.appengine.tools.mapreduce.outputs.LevelDbOutput
-
- createWriters(int) - Method in class com.google.appengine.tools.mapreduce.outputs.MarshallingOutput
-
- createWriters(int) - Method in class com.google.appengine.tools.mapreduce.outputs.NoOutput
-
- createWriters(int) - Method in class com.google.appengine.tools.mapreduce.outputs.SizeSegmentedGoogleCloudStorageFileOutput
-
Returns
OutputWriter
s that write files to GCS but segments the files based on the
maximum allowed file size.
- createWriters(int) - Method in class com.google.appengine.tools.mapreduce.outputs.StringOutput
-
- EARLIEST_LOG_TIME - Static variable in class com.google.appengine.tools.mapreduce.inputs.LogInput
-
- emit(O) - Method in class com.google.appengine.tools.mapreduce.impl.BaseShardContext
-
- emit(K, V) - Method in class com.google.appengine.tools.mapreduce.Mapper
-
Syntactic sugar for emit(KeyValue.of(key, value))
- emit(K, V) - Method in interface com.google.appengine.tools.mapreduce.MapperContext
-
Emits a key and a value to the output.
- emit(O) - Method in class com.google.appengine.tools.mapreduce.Reducer
-
Syntactic sugar for getContext().emit(value)
- emit(O) - Method in interface com.google.appengine.tools.mapreduce.WorkerContext
-
Emits a value to the output.
- endShard() - Method in class com.google.appengine.tools.mapreduce.InputReader
-
Called after endSlice if there will not be any subsequent calls to beginSlice or next.
- endShard() - Method in class com.google.appengine.tools.mapreduce.inputs.ConcatenatingInputReader
-
- endShard() - Method in class com.google.appengine.tools.mapreduce.inputs.ForwardingInputReader
-
- endShard() - Method in class com.google.appengine.tools.mapreduce.inputs.LevelDbInputReader
-
Calls close on the underlying stream.
- endShard() - Method in class com.google.appengine.tools.mapreduce.inputs.UnmarshallingInputReader
-
- endShard() - Method in class com.google.appengine.tools.mapreduce.outputs.BlobFileOutputWriter
-
- endShard() - Method in class com.google.appengine.tools.mapreduce.outputs.ForwardingOutputWriter
-
- endShard() - Method in class com.google.appengine.tools.mapreduce.outputs.GoogleCloudStorageFileOutputWriter
-
- endShard() - Method in class com.google.appengine.tools.mapreduce.outputs.InMemoryOutputWriter
-
- endShard() - Method in class com.google.appengine.tools.mapreduce.outputs.LevelDbOutputWriter
-
Closes the OutputChannel.
- endShard() - Method in class com.google.appengine.tools.mapreduce.outputs.ShardingOutputWriter
-
- endShard() - Method in class com.google.appengine.tools.mapreduce.OutputWriter
-
Called when no more output will be written to this writer.
- endShard() - Method in class com.google.appengine.tools.mapreduce.Worker
-
Notifies the worker that there is no more data to process in the current
shard, and prepares it for possible serialization.
- endSlice() - Method in class com.google.appengine.tools.mapreduce.impl.sort.SortWorker
-
- endSlice() - Method in class com.google.appengine.tools.mapreduce.InputReader
-
Prepares the InputReader
for serialization.
- endSlice() - Method in class com.google.appengine.tools.mapreduce.inputs.ConcatenatingInputReader
-
- endSlice() - Method in class com.google.appengine.tools.mapreduce.inputs.ForwardingInputReader
-
- endSlice() - Method in class com.google.appengine.tools.mapreduce.inputs.LogInputReader
-
- endSlice() - Method in class com.google.appengine.tools.mapreduce.inputs.UnmarshallingInputReader
-
- endSlice() - Method in class com.google.appengine.tools.mapreduce.outputs.BlobFileOutputWriter
-
- endSlice() - Method in class com.google.appengine.tools.mapreduce.outputs.DatastoreOutput.DatastoreOutputWriter
-
- endSlice() - Method in class com.google.appengine.tools.mapreduce.outputs.ForwardingOutputWriter
-
- endSlice() - Method in class com.google.appengine.tools.mapreduce.outputs.GoogleCloudStorageFileOutputWriter
-
- endSlice() - Method in class com.google.appengine.tools.mapreduce.outputs.GoogleCloudStorageLevelDbOutputWriter
-
- endSlice() - Method in class com.google.appengine.tools.mapreduce.outputs.InMemoryOutputWriter
-
- endSlice() - Method in class com.google.appengine.tools.mapreduce.outputs.LevelDbOutputWriter
-
- endSlice() - Method in class com.google.appengine.tools.mapreduce.outputs.ShardingOutputWriter
-
- endSlice() - Method in class com.google.appengine.tools.mapreduce.outputs.SliceSegmentingOutputWriter
-
closes the current writer.
- endSlice() - Method in class com.google.appengine.tools.mapreduce.OutputWriter
-
Prepares the writer for possible serialization.
- endSlice() - Method in class com.google.appengine.tools.mapreduce.Worker
-
Notifies the worker that there is no more data to process in the current
slice, and prepares it for possible serialization.
- ensureFinalized(AppEngineFile) - Static method in class com.google.appengine.tools.mapreduce.impl.util.FileUtil
-
- equals(Object) - Method in class com.google.appengine.tools.mapreduce.GoogleCloudStorageFileSet
-
- equals(Object) - Method in class com.google.appengine.tools.mapreduce.impl.FilesByShard
-
- equals(Object) - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.Status
-
- equals(Object) - Method in class com.google.appengine.tools.mapreduce.KeyValue
-
- estimateMemoryRequirement() - Method in class com.google.appengine.tools.mapreduce.impl.GoogleCloudStorageMapOutputWriter
-
- estimateMemoryRequirement() - Method in class com.google.appengine.tools.mapreduce.impl.MapOnlyShardTask
-
- estimateMemoryRequirement() - Method in class com.google.appengine.tools.mapreduce.impl.MapShardTask
-
- estimateMemoryRequirement() - Method in class com.google.appengine.tools.mapreduce.impl.ReduceShardTask
-
- estimateMemoryRequirement() - Method in class com.google.appengine.tools.mapreduce.impl.sort.MergeShardTask
-
- estimateMemoryRequirement() - Method in class com.google.appengine.tools.mapreduce.impl.sort.SortShardTask
-
- estimateMemoryRequirement() - Method in class com.google.appengine.tools.mapreduce.impl.sort.SortWorker
-
- estimateMemoryRequirement() - Method in class com.google.appengine.tools.mapreduce.impl.WorkerShardTask
-
- estimateMemoryRequirement() - Method in class com.google.appengine.tools.mapreduce.InputReader
-
Returns the estimated memory that will be used by this reader in bytes.
- estimateMemoryRequirement() - Method in class com.google.appengine.tools.mapreduce.inputs.ConcatenatingInputReader
-
- estimateMemoryRequirement() - Method in class com.google.appengine.tools.mapreduce.inputs.ForwardingInputReader
-
- estimateMemoryRequirement() - Method in class com.google.appengine.tools.mapreduce.inputs.GoogleCloudStorageLevelDbInputReader
-
- estimateMemoryRequirement() - Method in class com.google.appengine.tools.mapreduce.inputs.UnmarshallingInputReader
-
- estimateMemoryRequirement() - Method in class com.google.appengine.tools.mapreduce.outputs.DatastoreOutput.DatastoreOutputWriter
-
- estimateMemoryRequirement() - Method in class com.google.appengine.tools.mapreduce.outputs.ForwardingOutputWriter
-
- estimateMemoryRequirement() - Method in class com.google.appengine.tools.mapreduce.outputs.GoogleCloudStorageFileOutputWriter
-
- estimateMemoryRequirement() - Method in class com.google.appengine.tools.mapreduce.outputs.ItemSegmentingOutputWriter
-
- estimateMemoryRequirement() - Method in class com.google.appengine.tools.mapreduce.outputs.ShardingOutputWriter
-
- estimateMemoryRequirement() - Method in class com.google.appengine.tools.mapreduce.outputs.SliceSegmentingOutputWriter
-
- estimateMemoryRequirement() - Method in class com.google.appengine.tools.mapreduce.OutputWriter
-
Returns the estimated memory that will be used by this writer in bytes.
- estimateMemoryRequirement() - Method in class com.google.appengine.tools.mapreduce.Worker
-
Returns an estimate of the amount of memory needed for this worker in bytes.
- ExamineStatusAndReturnResult<R> - Class in com.google.appengine.tools.mapreduce.impl.pipeline
-
A pipeline job that examines ResultAndStatus
and returns MapReduceResult
when status is DONE or throw a MapReduceJobException
otherwise.
- ExamineStatusAndReturnResult(String) - Constructor for class com.google.appengine.tools.mapreduce.impl.pipeline.ExamineStatusAndReturnResult
-
- EXCEPTION_HANDLER - Static variable in class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobRunner
-
- GCS_FILE_NAME_FORMAT - Static variable in class com.google.appengine.tools.mapreduce.impl.BigQueryConstants
-
- GCS_IO_BLOCK_SIZE - Static variable in class com.google.appengine.tools.mapreduce.impl.MapReduceConstants
-
- GCS_RETRY_PARAMETERS - Static variable in class com.google.appengine.tools.mapreduce.impl.MapReduceConstants
-
- get(byte) - Static method in enum com.google.appengine.tools.mapreduce.impl.util.LevelDbConstants.RecordType
-
- getActiveTaskCount() - Method in interface com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobState
-
Returns the number of tasks or follow-up tasks that are currently active.
- getAvgElementSize() - Method in class com.google.appengine.tools.mapreduce.inputs.DatastoreInputReader
-
- getAvgElementSize() - Method in class com.google.appengine.tools.mapreduce.inputs.DatastoreKeyInputReader
-
- getBackend() - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobSettings
-
- getBigQueryType(Class<?>) - Static method in class com.google.appengine.tools.mapreduce.impl.util.BigQueryDataTypeUtil
-
- getBlobKey(AppEngineFile) - Static method in class com.google.appengine.tools.mapreduce.impl.util.FileUtil
-
- getBucket() - Method in class com.google.appengine.tools.mapreduce.impl.FilesByShard
-
- getBucketName() - Method in class com.google.appengine.tools.mapreduce.GoogleCloudStorageFileSet
-
- getByteBufferMarshaller() - Static method in class com.google.appengine.tools.mapreduce.Marshallers
-
Returns a Marshaller
for ByteBuffer
.
- getBytes(ByteBuffer) - Static method in class com.google.appengine.tools.mapreduce.impl.util.SerializationUtil
-
- getBytesLimit() - Method in class com.google.appengine.tools.mapreduce.DatastoreMutationPool.Params
-
- getBytesRead() - Method in class com.google.appengine.tools.mapreduce.inputs.LevelDbInputReader
-
- getChildJobParams() - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.pipeline.AbstractShardedJob
-
- getContext() - Method in interface com.google.appengine.tools.mapreduce.impl.IncrementalTaskWithContext
-
- getContext() - Method in class com.google.appengine.tools.mapreduce.impl.WorkerShardTask
-
- getContext() - Method in class com.google.appengine.tools.mapreduce.Input
-
Returns the current context, or null if none.
- getContext() - Method in class com.google.appengine.tools.mapreduce.InputReader
-
Returns the current context, or null if none.
- getContext() - Method in class com.google.appengine.tools.mapreduce.inputs.ForwardingInputReader
-
- getContext() - Method in class com.google.appengine.tools.mapreduce.Output
-
Returns the current context, or null if none.
- getContext() - Method in class com.google.appengine.tools.mapreduce.outputs.ForwardingOutputWriter
-
- getContext() - Method in class com.google.appengine.tools.mapreduce.outputs.ItemSegmentingOutputWriter
-
- getContext() - Method in class com.google.appengine.tools.mapreduce.OutputWriter
-
Returns the current context, or null if none.
- getContext() - Method in class com.google.appengine.tools.mapreduce.Worker
-
Returns the current context, or null if none.
- getControllerPath() - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobSettings
-
- getCounter(String) - Method in interface com.google.appengine.tools.mapreduce.Counters
-
- getCounter(String) - Method in class com.google.appengine.tools.mapreduce.impl.BaseShardContext
-
- getCounter(String) - Method in class com.google.appengine.tools.mapreduce.impl.CountersImpl
-
- getCounter(String) - Method in interface com.google.appengine.tools.mapreduce.ShardContext
-
Returns the
Counter
with the given name.
- getCounters() - Method in interface com.google.appengine.tools.mapreduce.Counters
-
- getCounters() - Method in class com.google.appengine.tools.mapreduce.impl.BaseShardContext
-
- getCounters() - Method in class com.google.appengine.tools.mapreduce.impl.CountersImpl
-
- getCounters() - Method in class com.google.appengine.tools.mapreduce.impl.IncrementalTaskContext
-
- getCounters() - Method in class com.google.appengine.tools.mapreduce.impl.MapReduceResultImpl
-
- getCounters() - Method in interface com.google.appengine.tools.mapreduce.MapReduceResult
-
Returns the counter values at the end of the job.
- getCounters() - Method in interface com.google.appengine.tools.mapreduce.ShardContext
-
Returns a
Counters
object for doing simple aggregate calculations.
- getCountLimit() - Method in class com.google.appengine.tools.mapreduce.DatastoreMutationPool.Params
-
- getDefaultInstance() - Static method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValue
-
- getDefaultInstance() - Static method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValues
-
- getDefaultInstanceForType() - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValue.Builder
-
- getDefaultInstanceForType() - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValue
-
- getDefaultInstanceForType() - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValues.Builder
-
- getDefaultInstanceForType() - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValues
-
- getDelegate() - Method in class com.google.appengine.tools.mapreduce.inputs.ForwardingInputReader
-
- getDelegate() - Method in class com.google.appengine.tools.mapreduce.outputs.ForwardingOutputWriter
-
- getDelegate() - Method in class com.google.appengine.tools.mapreduce.outputs.ItemSegmentingOutputWriter
-
- getDelegate() - Method in class com.google.appengine.tools.mapreduce.outputs.LevelDbOutputWriter
-
- getDelegate() - Method in class com.google.appengine.tools.mapreduce.outputs.MarshallingOutputWriter
-
- getDescriptor() - Static method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb
-
- getDescriptor() - Static method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValue.Builder
-
- getDescriptor() - Static method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValue
-
- getDescriptor() - Static method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValues.Builder
-
- getDescriptor() - Static method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValues
-
- getDescriptorForType() - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValue.Builder
-
- getDescriptorForType() - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValues.Builder
-
- getException() - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.Status
-
- getFailedStage() - Method in exception com.google.appengine.tools.mapreduce.MapReduceJobException
-
Returns a string representing the MapReduce stage that failed.
- getFieldDescription(Field) - Static method in class com.google.appengine.tools.mapreduce.impl.BigQueryFieldUtil
-
- getFieldMode(Field) - Static method in class com.google.appengine.tools.mapreduce.impl.BigQueryFieldUtil
-
- getFieldName(Field) - Static method in class com.google.appengine.tools.mapreduce.impl.BigQueryFieldUtil
-
- getFieldsToSerialize(Class<?>) - Static method in class com.google.appengine.tools.mapreduce.impl.BigQueryFieldUtil
-
Returns a set of all the non-transient, non-static fields without the annotation
BigQueryIgnore
.
- getFieldValue(Field, Object) - Method in interface com.google.appengine.tools.mapreduce.impl.BigqueryFieldMarshaller
-
- getFile(int) - Method in class com.google.appengine.tools.mapreduce.GoogleCloudStorageFileSet
-
- getFile() - Method in class com.google.appengine.tools.mapreduce.outputs.BlobFileOutputWriter
-
Returns the file or null if file was not finalized.
- getFile() - Method in class com.google.appengine.tools.mapreduce.outputs.GoogleCloudStorageFileOutputWriter
-
- getFileNames() - Method in class com.google.appengine.tools.mapreduce.GoogleCloudStorageFileSet
-
- getFiles() - Method in class com.google.appengine.tools.mapreduce.GoogleCloudStorageFileSet
-
- getFilesForShard(int) - Method in class com.google.appengine.tools.mapreduce.impl.FilesByShard
-
- getGenericJsonMarshaller(Class<T>) - Static method in class com.google.appengine.tools.mapreduce.Marshallers
-
Returns a Marshaller
for the given type.
- getInitialTask() - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardRetryState
-
- getInput(MapSpecification) - Static method in class com.google.appengine.tools.mapreduce.impl.InProcessUtil
-
- getInput(MapReduceSpecification) - Static method in class com.google.appengine.tools.mapreduce.impl.InProcessUtil
-
- getInputReader() - Method in class com.google.appengine.tools.mapreduce.impl.MapOnlyShardTask
-
- getInputReader() - Method in class com.google.appengine.tools.mapreduce.impl.MapShardTask
-
- getInputReader() - Method in class com.google.appengine.tools.mapreduce.impl.ReduceShardTask
-
- getInputReader() - Method in class com.google.appengine.tools.mapreduce.impl.sort.MergeShardTask
-
- getInputReader() - Method in class com.google.appengine.tools.mapreduce.impl.sort.SortShardTask
-
- getInputReader() - Method in class com.google.appengine.tools.mapreduce.impl.WorkerShardTask
-
- getIntegerMarshaller() - Static method in class com.google.appengine.tools.mapreduce.Marshallers
-
- getJobDisplayName() - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.pipeline.DeleteShardedJob
-
- getJobDisplayName() - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.pipeline.DeleteShardsInfos
-
- getJobDisplayName() - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.pipeline.FinalizeShardedJob
-
- getJobDisplayName() - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.pipeline.FinalizeShardsInfos
-
- getJobDisplayName() - Method in class com.google.appengine.tools.mapreduce.MapJob
-
- getJobDisplayName() - Method in class com.google.appengine.tools.mapreduce.MapReduceJob
-
- getJobId() - Method in interface com.google.appengine.tools.mapreduce.Context
-
Returns the Id for the job.
- getJobId() - Method in class com.google.appengine.tools.mapreduce.impl.BaseContext
-
- getJobId() - Method in class com.google.appengine.tools.mapreduce.impl.IncrementalTaskContext
-
- getJobId() - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.IncrementalTaskState
-
- getJobId() - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.pipeline.AbstractShardedJob
-
- getJobId() - Method in interface com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobState
-
Returns the ID of this job.
- getJobReference() - Method in class com.google.appengine.tools.mapreduce.bigqueryjobs.BigQueryLoadJobReference
-
- getJobState(String) - Method in interface com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobService
-
Returns the state of the job with the given ID.
- getKey() - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValue.Builder
-
required bytes key = 1 [ctype = CORD];
- getKey() - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValue
-
required bytes key = 1 [ctype = CORD];
- getKey() - Method in interface com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValueOrBuilder
-
required bytes key = 1 [ctype = CORD];
- getKey() - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValues.Builder
-
required bytes key = 1 [ctype = CORD];
- getKey() - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValues
-
required bytes key = 1 [ctype = CORD];
- getKey() - Method in interface com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValuesOrBuilder
-
required bytes key = 1 [ctype = CORD];
- getKey() - Method in class com.google.appengine.tools.mapreduce.KeyValue
-
- getKeyMarshaller(MapReduceSpecification) - Static method in class com.google.appengine.tools.mapreduce.impl.InProcessUtil
-
- getKeyValueMarshaller(Marshaller<K>, Marshaller<V>) - Static method in class com.google.appengine.tools.mapreduce.Marshallers
-
Returns a Marshaller
for key-value pairs based on keyMarshaller
and
valueMarshaller
.
- getKeyValuesMarshaller(Marshaller<K>, Marshaller<V>) - Static method in class com.google.appengine.tools.mapreduce.Marshallers
-
Returns a Marshaller
for key-values pairs based on keyMarshaller
and
valueMarshaller
.
- getLastWorkItemString() - Method in class com.google.appengine.tools.mapreduce.impl.IncrementalTaskContext
-
- getLockInfo() - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.IncrementalTaskState
-
- getLongMarshaller() - Static method in class com.google.appengine.tools.mapreduce.Marshallers
-
- getMapper(MapSpecification) - Static method in class com.google.appengine.tools.mapreduce.impl.InProcessUtil
-
- getMapper(MapReduceSpecification) - Static method in class com.google.appengine.tools.mapreduce.impl.InProcessUtil
-
- getMapReduceStatusUrl() - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobSettings
-
- getMarshaller() - Method in class com.google.appengine.tools.mapreduce.inputs.UnmarshallingInputReader
-
- getMaxShardRetries() - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobSettings
-
- getMaxSliceRetries() - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobSettings
-
- getModule() - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobSettings
-
- getMostRecentUpdateMillis() - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.IncrementalTaskState
-
- getMostRecentUpdateTimeMillis() - Method in interface com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobState
-
Returns the time this job's state was last updated.
- getName() - Method in interface com.google.appengine.tools.mapreduce.Counter
-
- getNumBlocksWritten() - Method in class com.google.appengine.tools.mapreduce.outputs.LevelDbOutputWriter
-
- getNumFiles() - Method in class com.google.appengine.tools.mapreduce.GoogleCloudStorageFileSet
-
- getNumReducers(MapReduceSpecification) - Static method in class com.google.appengine.tools.mapreduce.impl.InProcessUtil
-
- getNumShards() - Method in class com.google.appengine.tools.mapreduce.impl.HashingSharder
-
- getNumShards() - Method in interface com.google.appengine.tools.mapreduce.Sharder
-
- getOutput(MapSpecification) - Static method in class com.google.appengine.tools.mapreduce.impl.InProcessUtil
-
- getOutput(MapReduceSpecification) - Static method in class com.google.appengine.tools.mapreduce.impl.InProcessUtil
-
- getOutputResult() - Method in class com.google.appengine.tools.mapreduce.impl.MapReduceResultImpl
-
- getOutputResult() - Method in interface com.google.appengine.tools.mapreduce.MapReduceResult
-
- getOutputWriter() - Method in class com.google.appengine.tools.mapreduce.impl.MapOnlyShardTask
-
- getOutputWriter() - Method in class com.google.appengine.tools.mapreduce.impl.MapShardTask
-
- getOutputWriter() - Method in class com.google.appengine.tools.mapreduce.impl.ReduceShardTask
-
- getOutputWriter() - Method in class com.google.appengine.tools.mapreduce.impl.sort.MergeShardTask
-
- getOutputWriter() - Method in class com.google.appengine.tools.mapreduce.impl.sort.SortShardTask
-
- getOutputWriter() - Method in class com.google.appengine.tools.mapreduce.impl.WorkerShardTask
-
- getParameterType(ParameterizedType) - Static method in class com.google.appengine.tools.mapreduce.impl.BigQueryFieldUtil
-
- getParameterTypeOfRepeatedField(Field) - Static method in class com.google.appengine.tools.mapreduce.impl.BigQueryFieldUtil
-
Returns type of the parameter or component type for the repeated field depending on whether it
is a collection or an array.
- getParserForType() - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValue
-
- getParserForType() - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValues
-
- getPipelineStatusUrl() - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobSettings
-
- getProgress() - Method in class com.google.appengine.tools.mapreduce.InputReader
-
Returns the relative progress reading this input as a number from 0 to 1.
- getProgress() - Method in class com.google.appengine.tools.mapreduce.inputs.ConcatenatingInputReader
-
- getProgress() - Method in class com.google.appengine.tools.mapreduce.inputs.ForwardingInputReader
-
- getProgress() - Method in class com.google.appengine.tools.mapreduce.inputs.GoogleCloudStorageLevelDbInputReader
-
- getProgress() - Method in class com.google.appengine.tools.mapreduce.inputs.LogInputReader
-
Determine the approximate progress for this shard assuming the RequestLogs are uniformly
distributed across the entire time range.
- getProgress() - Method in class com.google.appengine.tools.mapreduce.inputs.UnmarshallingInputReader
-
- getQueueName() - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobSettings
-
- getReadHandle(AppEngineFile) - Static method in class com.google.appengine.tools.mapreduce.impl.util.FileUtil
-
- getReducer(MapReduceSpecification) - Static method in class com.google.appengine.tools.mapreduce.impl.InProcessUtil
-
- getResult() - Method in class com.google.appengine.tools.mapreduce.impl.pipeline.ResultAndStatus
-
- getResult() - Method in class com.google.appengine.tools.mapreduce.outputs.BigQueryStoreResult
-
- getResult() - Method in class com.google.appengine.tools.mapreduce.outputs.InMemoryOutputWriter
-
- getRetryCount() - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.IncrementalTaskState
-
- getRetryCount() - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardRetryState
-
- getRetryParams() - Method in class com.google.appengine.tools.mapreduce.DatastoreMutationPool.Params
-
- getSchema() - Method in class com.google.appengine.tools.mapreduce.BigQueryMarshaller
-
- getSchema() - Method in class com.google.appengine.tools.mapreduce.impl.BigQueryMarshallerByType
-
- getSchema() - Method in class com.google.appengine.tools.mapreduce.outputs.BigQueryStoreResult
-
- getSchemaType() - Method in interface com.google.appengine.tools.mapreduce.impl.BigqueryFieldMarshaller
-
- getSequenceNumber() - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.IncrementalTaskState
-
- getSerializationMarshaller() - Static method in class com.google.appengine.tools.mapreduce.Marshallers
-
Returns a Marshaller
that uses Java Serialization.
- getSettings() - Method in interface com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobState
-
Returns the execution settings of this job.
- getShardCount() - Method in class com.google.appengine.tools.mapreduce.impl.BaseShardContext
-
- getShardCount() - Method in class com.google.appengine.tools.mapreduce.impl.FilesByShard
-
- getShardCount() - Method in class com.google.appengine.tools.mapreduce.impl.IncrementalTaskContext
-
- getShardCount() - Method in interface com.google.appengine.tools.mapreduce.ShardContext
-
Returns the total number of shards.
- getShardedJobService() - Static method in class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobServiceFactory
-
- getShardedValueKeysFor(Transaction, Key, String) - Static method in class com.google.appengine.tools.mapreduce.impl.util.SerializationUtil
-
- getShardForKey(ByteBuffer) - Method in class com.google.appengine.tools.mapreduce.impl.HashingSharder
-
- getShardForKey(ByteBuffer) - Method in interface com.google.appengine.tools.mapreduce.Sharder
-
- getShardNumber() - Method in class com.google.appengine.tools.mapreduce.impl.BaseShardContext
-
- getShardNumber() - Method in class com.google.appengine.tools.mapreduce.impl.IncrementalTaskContext
-
- getShardNumber() - Method in interface com.google.appengine.tools.mapreduce.ShardContext
-
Returns the number of this mapper or reducer shard (zero-based).
- getShardsToWriterMap() - Method in class com.google.appengine.tools.mapreduce.impl.GoogleCloudStorageMapOutputWriter
-
- getShardsToWriterMap() - Method in class com.google.appengine.tools.mapreduce.outputs.ShardingOutputWriter
-
- getSliceTimeoutMillis() - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobSettings
-
- getStartTimeMillis() - Method in interface com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobState
-
Returns the time this job was started.
- getStatus() - Method in class com.google.appengine.tools.mapreduce.bigqueryjobs.BigQueryLoadJobReference
-
- getStatus() - Method in class com.google.appengine.tools.mapreduce.impl.pipeline.ResultAndStatus
-
- getStatus() - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.IncrementalTaskState
-
- getStatus() - Method in interface com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobState
-
Returns whether this job is running, finished, etc.
- getStatusCode() - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.Status
-
- getStringMarshaller() - Static method in class com.google.appengine.tools.mapreduce.Marshallers
-
Returns a Marshaller
for String
s.
- getTask() - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.IncrementalTaskState
-
- getTaskId() - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.IncrementalTaskState
-
- getTaskId(String, int) - Static method in class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobRunner
-
- getTaskId() - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardRetryState
-
- getTaskQueueTarget() - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobSettings
-
- getTotalTaskCount() - Method in interface com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobState
-
Returns the total number of tasks (not including follow-up tasks) that this
job consists of.
- getUnknownFields() - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValue
-
- getUnknownFields() - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValues
-
- getValue() - Method in enum com.google.appengine.tools.mapreduce.BigQueryFieldMode
-
- getValue() - Method in interface com.google.appengine.tools.mapreduce.Counter
-
- getValue() - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValue.Builder
-
required bytes value = 2 [ctype = CORD];
- getValue() - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValue
-
required bytes value = 2 [ctype = CORD];
- getValue() - Method in interface com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValueOrBuilder
-
required bytes value = 2 [ctype = CORD];
- getValue(int) - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValues.Builder
-
repeated bytes value = 2 [ctype = CORD];
- getValue(int) - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValues
-
repeated bytes value = 2 [ctype = CORD];
- getValue(int) - Method in interface com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValuesOrBuilder
-
repeated bytes value = 2 [ctype = CORD];
- getValue() - Method in class com.google.appengine.tools.mapreduce.impl.util.Crc32c
-
Returns the value of the checksum.
- getValue() - Method in class com.google.appengine.tools.mapreduce.impl.util.SerializableValue
-
- getValue() - Method in class com.google.appengine.tools.mapreduce.KeyValue
-
- getValueCount() - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValues.Builder
-
repeated bytes value = 2 [ctype = CORD];
- getValueCount() - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValues
-
repeated bytes value = 2 [ctype = CORD];
- getValueCount() - Method in interface com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValuesOrBuilder
-
repeated bytes value = 2 [ctype = CORD];
- getValueList() - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValues.Builder
-
repeated bytes value = 2 [ctype = CORD];
- getValueList() - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValues
-
repeated bytes value = 2 [ctype = CORD];
- getValueList() - Method in interface com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValuesOrBuilder
-
repeated bytes value = 2 [ctype = CORD];
- getValuesHeld() - Method in class com.google.appengine.tools.mapreduce.impl.sort.SortWorker
-
- getVersion() - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobSettings
-
- getVoidMarshaller() - Static method in class com.google.appengine.tools.mapreduce.Marshallers
-
Returns a Marshaller
for Void
.
- getWorker() - Method in class com.google.appengine.tools.mapreduce.impl.MapOnlyShardTask
-
- getWorker() - Method in class com.google.appengine.tools.mapreduce.impl.MapShardTask
-
- getWorker() - Method in class com.google.appengine.tools.mapreduce.impl.ReduceShardTask
-
- getWorker() - Method in class com.google.appengine.tools.mapreduce.impl.sort.MergeShardTask
-
- getWorker() - Method in class com.google.appengine.tools.mapreduce.impl.sort.SortShardTask
-
- getWorker() - Method in class com.google.appengine.tools.mapreduce.impl.WorkerShardTask
-
- getWorkerCallCount() - Method in class com.google.appengine.tools.mapreduce.impl.IncrementalTaskContext
-
- getWorkerPath() - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobSettings
-
- GoogleCloudStorageFileOutput - Class in com.google.appengine.tools.mapreduce.outputs
-
An
Output
that writes bytes to a set of Cloud Storage files, one per shard.
- GoogleCloudStorageFileOutput(String, String, String) - Constructor for class com.google.appengine.tools.mapreduce.outputs.GoogleCloudStorageFileOutput
-
Creates output files who's names follow the provided pattern in the specified bucket.
- GoogleCloudStorageFileOutput(String, String, String, boolean) - Constructor for class com.google.appengine.tools.mapreduce.outputs.GoogleCloudStorageFileOutput
-
Creates output files who's names follow the provided pattern in the specified bucket.
- GoogleCloudStorageFileOutputWriter - Class in com.google.appengine.tools.mapreduce.outputs
-
An
OutputWriter
that writes bytes to a GCS file that it creates.
- GoogleCloudStorageFileOutputWriter(GcsFilename, String) - Constructor for class com.google.appengine.tools.mapreduce.outputs.GoogleCloudStorageFileOutputWriter
-
- GoogleCloudStorageFileOutputWriter(GcsFilename, String, boolean) - Constructor for class com.google.appengine.tools.mapreduce.outputs.GoogleCloudStorageFileOutputWriter
-
- GoogleCloudStorageFileSet - Class in com.google.appengine.tools.mapreduce
-
An ordered list of files in GCS.
- GoogleCloudStorageFileSet(String, List<String>) - Constructor for class com.google.appengine.tools.mapreduce.GoogleCloudStorageFileSet
-
- GoogleCloudStorageLevelDbInput - Class in com.google.appengine.tools.mapreduce.inputs
-
GoogleCloudStorageLevelDbInput creates LevelDbInputReaders to read input written out by
LevelDbOutput
to files in
Google Cloud Storage.
- GoogleCloudStorageLevelDbInput(GoogleCloudStorageFileSet) - Constructor for class com.google.appengine.tools.mapreduce.inputs.GoogleCloudStorageLevelDbInput
-
- GoogleCloudStorageLevelDbInput(GoogleCloudStorageFileSet, int) - Constructor for class com.google.appengine.tools.mapreduce.inputs.GoogleCloudStorageLevelDbInput
-
- GoogleCloudStorageLevelDbInputReader - Class in com.google.appengine.tools.mapreduce.inputs
-
A simple wrapper of LevelDb wrapper for GCS to provide getProgress() and do lazy initialization.
- GoogleCloudStorageLevelDbInputReader(GcsFilename, int) - Constructor for class com.google.appengine.tools.mapreduce.inputs.GoogleCloudStorageLevelDbInputReader
-
- GoogleCloudStorageLevelDbOutput - Class in com.google.appengine.tools.mapreduce.outputs
-
- GoogleCloudStorageLevelDbOutput(String, String, String) - Constructor for class com.google.appengine.tools.mapreduce.outputs.GoogleCloudStorageLevelDbOutput
-
Creates LevelDb output files who's names follow the provided pattern in the specified bucket.
- GoogleCloudStorageLevelDbOutputWriter - Class in com.google.appengine.tools.mapreduce.outputs
-
- GoogleCloudStorageLevelDbOutputWriter(OutputWriter<ByteBuffer>) - Constructor for class com.google.appengine.tools.mapreduce.outputs.GoogleCloudStorageLevelDbOutputWriter
-
- GoogleCloudStorageLineInput - Class in com.google.appengine.tools.mapreduce.inputs
-
CloudStorageLineInput shards files in Cloud Storage on separator boundries.
- GoogleCloudStorageLineInput(GcsFilename, byte, int) - Constructor for class com.google.appengine.tools.mapreduce.inputs.GoogleCloudStorageLineInput
-
- GoogleCloudStorageLineInput(GcsFilename, byte, int, int) - Constructor for class com.google.appengine.tools.mapreduce.inputs.GoogleCloudStorageLineInput
-
- GoogleCloudStorageMapOutput<K,V> - Class in com.google.appengine.tools.mapreduce.impl
-
An
Output
that is used for the map stage.
- GoogleCloudStorageMapOutput(String, String, Marshaller<K>, Marshaller<V>, Sharder) - Constructor for class com.google.appengine.tools.mapreduce.impl.GoogleCloudStorageMapOutput
-
- GoogleCloudStorageMapOutputWriter<K,V> - Class in com.google.appengine.tools.mapreduce.impl
-
An
OutputWriter
that is used by the map stage and writes bytes to GCS,
later to be used by the sort/merge stages.
- GoogleCloudStorageMapOutputWriter(String, String, Marshaller<K>, Marshaller<V>, Sharder) - Constructor for class com.google.appengine.tools.mapreduce.impl.GoogleCloudStorageMapOutputWriter
-
- GoogleCloudStorageMergeInput - Class in com.google.appengine.tools.mapreduce.impl
-
Defines the way the data is read in by the merger.
- GoogleCloudStorageMergeInput(FilesByShard, int) - Constructor for class com.google.appengine.tools.mapreduce.impl.GoogleCloudStorageMergeInput
-
- GoogleCloudStorageMergeOutput - Class in com.google.appengine.tools.mapreduce.impl
-
Defines the way data is written out by the merging stage.
- GoogleCloudStorageMergeOutput(String, String, Integer) - Constructor for class com.google.appengine.tools.mapreduce.impl.GoogleCloudStorageMergeOutput
-
- GoogleCloudStorageReduceInput<K,V> - Class in com.google.appengine.tools.mapreduce.impl
-
Defines the way the data is read in by the reducer.
- GoogleCloudStorageReduceInput(FilesByShard, Marshaller<K>, Marshaller<V>) - Constructor for class com.google.appengine.tools.mapreduce.impl.GoogleCloudStorageReduceInput
-
- GoogleCloudStorageSortInput - Class in com.google.appengine.tools.mapreduce.impl
-
Defines the way the data is read in by the Sort phase.
- GoogleCloudStorageSortInput(FilesByShard) - Constructor for class com.google.appengine.tools.mapreduce.impl.GoogleCloudStorageSortInput
-
- GoogleCloudStorageSortOutput - Class in com.google.appengine.tools.mapreduce.impl
-
Defines the way data is written out by the sorter.
- GoogleCloudStorageSortOutput(String, String, Sharder) - Constructor for class com.google.appengine.tools.mapreduce.impl.GoogleCloudStorageSortOutput
-
- makeKey(String) - Static method in class com.google.appengine.tools.mapreduce.impl.shardedjob.IncrementalTaskState.Serializer
-
- makeKey(String) - Static method in class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardRetryState.Serializer
-
- map(KeyValue<K, V>) - Method in class com.google.appengine.tools.mapreduce.mappers.IdentityMapper
-
- map(T) - Method in class com.google.appengine.tools.mapreduce.mappers.KeyProjectionMapper
-
- MAP_OUTPUT_DIR_FORMAT - Static variable in class com.google.appengine.tools.mapreduce.impl.MapReduceConstants
-
- MAP_OUTPUT_MIME_TYPE - Static variable in class com.google.appengine.tools.mapreduce.impl.MapReduceConstants
-
- MapJob<I,O,R> - Class in com.google.appengine.tools.mapreduce
-
A Pipeline job that runs a map jobs.
- MapJob(MapSpecification<I, O, R>, MapSettings) - Constructor for class com.google.appengine.tools.mapreduce.MapJob
-
- MapOnlyMapper<I,O> - Class in com.google.appengine.tools.mapreduce
-
Map function for Map only jobs.
- MapOnlyMapper() - Constructor for class com.google.appengine.tools.mapreduce.MapOnlyMapper
-
- MapOnlyMapperContext<O> - Interface in com.google.appengine.tools.mapreduce
-
- MapOnlyShardTask<I,O> - Class in com.google.appengine.tools.mapreduce.impl
-
- MapOnlyShardTask(String, int, int, InputReader<I>, MapOnlyMapper<I, O>, OutputWriter<O>, long) - Constructor for class com.google.appengine.tools.mapreduce.impl.MapOnlyShardTask
-
- Mapper<I,K,V> - Class in com.google.appengine.tools.mapreduce
-
Map function for MapReduce computations.
- Mapper() - Constructor for class com.google.appengine.tools.mapreduce.Mapper
-
- MAPPER_CALLS - Static variable in class com.google.appengine.tools.mapreduce.CounterNames
-
Number of times map function was called.
- MAPPER_WALLTIME_MILLIS - Static variable in class com.google.appengine.tools.mapreduce.CounterNames
-
Total time in milliseconds spent in map function.
- MapperContext<K,V> - Interface in com.google.appengine.tools.mapreduce
-
A context for mapper execution.
- MapReduceConstants - Class in com.google.appengine.tools.mapreduce.impl
-
- MapReduceJob<I,K,V,O,R> - Class in com.google.appengine.tools.mapreduce
-
A Pipeline job that runs a MapReduce.
- MapReduceJob(MapReduceSpecification<I, K, V, O, R>, MapReduceSettings) - Constructor for class com.google.appengine.tools.mapreduce.MapReduceJob
-
- MapReduceJobException - Exception in com.google.appengine.tools.mapreduce
-
An exception that is thrown upon MapReduceJob failure.
- MapReduceJobException(String, Status) - Constructor for exception com.google.appengine.tools.mapreduce.MapReduceJobException
-
- MapReduceResult<R> - Interface in com.google.appengine.tools.mapreduce
-
- MapReduceResultImpl<R> - Class in com.google.appengine.tools.mapreduce.impl
-
- MapReduceResultImpl() - Constructor for class com.google.appengine.tools.mapreduce.impl.MapReduceResultImpl
-
- MapReduceResultImpl(R, Counters) - Constructor for class com.google.appengine.tools.mapreduce.impl.MapReduceResultImpl
-
- MapReduceServlet - Class in com.google.appengine.tools.mapreduce
-
Servlet for all MapReduce API related functions.
- MapReduceServlet() - Constructor for class com.google.appengine.tools.mapreduce.MapReduceServlet
-
- MapReduceServletImpl - Class in com.google.appengine.tools.mapreduce.impl.handlers
-
- MapReduceSettings - Class in com.google.appengine.tools.mapreduce
-
Settings that affect how a MapReduce is executed.
- MapReduceSettings.Builder - Class in com.google.appengine.tools.mapreduce
-
- MapReduceSettings.Builder() - Constructor for class com.google.appengine.tools.mapreduce.MapReduceSettings.Builder
-
- MapReduceSettings.Builder(MapReduceSettings) - Constructor for class com.google.appengine.tools.mapreduce.MapReduceSettings.Builder
-
- MapReduceSettings.Builder(MapSettings) - Constructor for class com.google.appengine.tools.mapreduce.MapReduceSettings.Builder
-
- MapReduceSpecification<I,K,V,O,R> - Class in com.google.appengine.tools.mapreduce
-
Specification for a MapReduce job.
- MapReduceSpecification.Builder<I,K,V,O,R> - Class in com.google.appengine.tools.mapreduce
-
- MapReduceSpecification.Builder() - Constructor for class com.google.appengine.tools.mapreduce.MapReduceSpecification.Builder
-
- MapReduceSpecification.Builder(Input<I>, Mapper<I, K, V>, Reducer<K, V, O>, Output<O, R>) - Constructor for class com.google.appengine.tools.mapreduce.MapReduceSpecification.Builder
-
- MapSettings - Class in com.google.appengine.tools.mapreduce
-
Settings that affect how a Map job is executed.
- MapSettings.Builder - Class in com.google.appengine.tools.mapreduce
-
- MapSettings.Builder() - Constructor for class com.google.appengine.tools.mapreduce.MapSettings.Builder
-
- MapSettings.Builder(MapSettings) - Constructor for class com.google.appengine.tools.mapreduce.MapSettings.Builder
-
- MapShardTask<I,K,V> - Class in com.google.appengine.tools.mapreduce.impl
-
- MapShardTask(String, int, int, InputReader<I>, Mapper<I, K, V>, OutputWriter<KeyValue<K, V>>, long) - Constructor for class com.google.appengine.tools.mapreduce.impl.MapShardTask
-
- MapSpecification<I,O,R> - Class in com.google.appengine.tools.mapreduce
-
Specification for a map-only job.
- MapSpecification.Builder<I,O,R> - Class in com.google.appengine.tools.mapreduce
-
- MapSpecification.Builder() - Constructor for class com.google.appengine.tools.mapreduce.MapSpecification.Builder
-
- MapSpecification.Builder(Input<I>, MapOnlyMapper<I, Void>) - Constructor for class com.google.appengine.tools.mapreduce.MapSpecification.Builder
-
A builder for map job using
NoOutput
as output.
- MapSpecification.Builder(Input<I>, MapOnlyMapper<I, O>, Output<O, R>) - Constructor for class com.google.appengine.tools.mapreduce.MapSpecification.Builder
-
- Marshaller<T> - Class in com.google.appengine.tools.mapreduce
-
Turns objects of type T
into bytes and back.
- Marshaller() - Constructor for class com.google.appengine.tools.mapreduce.Marshaller
-
- Marshallers - Class in com.google.appengine.tools.mapreduce
-
- MarshallingOutput<O,R> - Class in com.google.appengine.tools.mapreduce.outputs
-
An
Output
that marshalls records.
- MarshallingOutput(Output<ByteBuffer, R>, Marshaller<O>) - Constructor for class com.google.appengine.tools.mapreduce.outputs.MarshallingOutput
-
- MarshallingOutputWriter<O> - Class in com.google.appengine.tools.mapreduce.outputs
-
- MarshallingOutputWriter(OutputWriter<ByteBuffer>, Marshaller<? super O>) - Constructor for class com.google.appengine.tools.mapreduce.outputs.MarshallingOutputWriter
-
- maskCrc(long) - Static method in class com.google.appengine.tools.mapreduce.impl.util.LevelDbConstants
-
Masks the CRC.
- MAX_BIG_QUERY_GCS_FILE_SIZE - Static variable in class com.google.appengine.tools.mapreduce.impl.BigQueryConstants
-
- MAX_LAST_ITEM_STRING_SIZE - Static variable in class com.google.appengine.tools.mapreduce.impl.MapReduceConstants
-
Maximum display size of the lastItem in the UI.
- MAX_REDUCE_SHARDS - Static variable in class com.google.appengine.tools.mapreduce.impl.MapReduceConstants
-
- MAX_RETRIES - Static variable in class com.google.appengine.tools.mapreduce.impl.BigQueryConstants
-
- MAX_TIME_BEFORE_NEXT_POLL - Static variable in class com.google.appengine.tools.mapreduce.impl.BigQueryConstants
-
- MEMORY_REQUIRED - Static variable in class com.google.appengine.tools.mapreduce.outputs.GoogleCloudStorageFileOutputWriter
-
- MEMORY_REQUIRED_WITHOUT_SLICE_RETRY - Static variable in class com.google.appengine.tools.mapreduce.outputs.GoogleCloudStorageFileOutputWriter
-
- MemoryLimiter - Class in com.google.appengine.tools.mapreduce.impl.handlers
-
Limits the number of parallel requests according to their estimated memory usage.
- MemoryLimiter() - Constructor for class com.google.appengine.tools.mapreduce.impl.handlers.MemoryLimiter
-
- MERGE_CALLS - Static variable in class com.google.appengine.tools.mapreduce.CounterNames
-
Number of times merge function was called.
- MERGE_OUTPUT_DIR_FORMAT - Static variable in class com.google.appengine.tools.mapreduce.impl.MapReduceConstants
-
- MERGE_WALLTIME_MILLIS - Static variable in class com.google.appengine.tools.mapreduce.CounterNames
-
Total time in milliseconds spent in merge function.
- MergeContext - Class in com.google.appengine.tools.mapreduce.impl.sort
-
Provides a context for merging.
- MergeShardTask - Class in com.google.appengine.tools.mapreduce.impl.sort
-
Passes input to the output.
- MergeShardTask(String, int, int, InputReader<KeyValue<ByteBuffer, Iterator<ByteBuffer>>>, OutputWriter<KeyValue<ByteBuffer, List<ByteBuffer>>>, int) - Constructor for class com.google.appengine.tools.mapreduce.impl.sort.MergeShardTask
-
- MIME_TYPE - Static variable in class com.google.appengine.tools.mapreduce.impl.BigQueryConstants
-
- MIN_TIME_BEFORE_NEXT_POLL - Static variable in class com.google.appengine.tools.mapreduce.impl.BigQueryConstants
-
- self() - Method in class com.google.appengine.tools.mapreduce.MapReduceSettings.Builder
-
- self() - Method in class com.google.appengine.tools.mapreduce.MapReduceSpecification.Builder
-
- self() - Method in class com.google.appengine.tools.mapreduce.MapSettings.Builder
-
- self() - Method in class com.google.appengine.tools.mapreduce.MapSpecification.Builder
-
- SEQUENCE_NUMBER_PARAM - Static variable in interface com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobHandler
-
- SerializableValue<T> - Class in com.google.appengine.tools.mapreduce.impl.util
-
- SerializationUtil - Class in com.google.appengine.tools.mapreduce.impl.util
-
A serialization utility class.
- SerializationUtil.CompressionType - Enum in com.google.appengine.tools.mapreduce.impl.util
-
Type of compression to optionally use when serializing/deserializing objects.
- serializeToByteArray(Serializable) - Static method in class com.google.appengine.tools.mapreduce.impl.util.SerializationUtil
-
- serializeToByteArray(Serializable, boolean) - Static method in class com.google.appengine.tools.mapreduce.impl.util.SerializationUtil
-
- serializeToByteArray(Serializable, boolean, SerializationUtil.CompressionType) - Static method in class com.google.appengine.tools.mapreduce.impl.util.SerializationUtil
-
- serializeToDatastoreProperty(Transaction, Entity, String, Serializable) - Static method in class com.google.appengine.tools.mapreduce.impl.util.SerializationUtil
-
- serializeToDatastoreProperty(Transaction, Entity, String, Serializable, SerializationUtil.CompressionType) - Static method in class com.google.appengine.tools.mapreduce.impl.util.SerializationUtil
-
- setBackend(String) - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobSettings.Builder
-
- setBucketName(String) - Method in class com.google.appengine.tools.mapreduce.MapReduceSettings.Builder
-
Sets the GCS bucket that will be used for temporary files.
- setContext(ShardContext) - Method in class com.google.appengine.tools.mapreduce.InputReader
-
Used internally to sets the context to be used for the processing that follows.
- setContext(ShardContext) - Method in class com.google.appengine.tools.mapreduce.inputs.ForwardingInputReader
-
- setContext(Context) - Method in class com.google.appengine.tools.mapreduce.Output
-
Used internally to sets the context to be used for the processing that follows.
- setContext(ShardContext) - Method in class com.google.appengine.tools.mapreduce.outputs.ForwardingOutputWriter
-
- setContext(ShardContext) - Method in class com.google.appengine.tools.mapreduce.outputs.ItemSegmentingOutputWriter
-
- setContext(ShardContext) - Method in class com.google.appengine.tools.mapreduce.OutputWriter
-
Used internally to sets the context to be used for the processing that follows.
- setContext(C) - Method in class com.google.appengine.tools.mapreduce.Worker
-
Used internally to sets the context to be used for the processing that follows.
- setControllerPath(String) - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobSettings.Builder
-
- setFinalized() - Method in class com.google.appengine.tools.mapreduce.impl.WorkerShardTask
-
- setKey(ByteString) - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValue.Builder
-
required bytes key = 1 [ctype = CORD];
- setKey(ByteString) - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValues.Builder
-
required bytes key = 1 [ctype = CORD];
- setKeyMarshaller(Marshaller<K>) - Method in class com.google.appengine.tools.mapreduce.MapReduceSpecification.Builder
-
- setMapFanout(int) - Method in class com.google.appengine.tools.mapreduce.MapReduceSettings.Builder
-
The maximum number of files the map stage will write to at the same time.
- setMapper(Mapper<? extends I, K, V>) - Method in class com.google.appengine.tools.mapreduce.MapReduceSpecification.Builder
-
- setMapper(MapOnlyMapper<? extends I, O>) - Method in class com.google.appengine.tools.mapreduce.MapSpecification.Builder
-
- setMapper(Mapper<? extends I, Void, O>) - Method in class com.google.appengine.tools.mapreduce.MapSpecification.Builder
-
- setMapReduceStatusUrl(String) - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobSettings.Builder
-
- setMaxShardRetries(int) - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobSettings.Builder
-
- setMaxSliceRetries(int) - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobSettings.Builder
-
- setMaxSortMemory(Long) - Method in class com.google.appengine.tools.mapreduce.MapReduceSettings.Builder
-
The maximum memory the sort stage should allocate (in bytes).
- setMergeFanin(int) - Method in class com.google.appengine.tools.mapreduce.MapReduceSettings.Builder
-
Number of files the merge stage will read at the same time.
- setModule(String) - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobSettings.Builder
-
- setNumReducers(int) - Method in class com.google.appengine.tools.mapreduce.MapReduceSpecification.Builder
-
- setPipelineStatusUrl(String) - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobSettings.Builder
-
- setQueueName(String) - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobSettings.Builder
-
- setReducer(Reducer<K, V, ? extends O>) - Method in class com.google.appengine.tools.mapreduce.MapReduceSpecification.Builder
-
- setSeed(long) - Method in class com.google.appengine.tools.mapreduce.inputs.RandomLongInput
-
- setSliceTimeoutMillis(int) - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobSettings.Builder
-
- setSortBatchPerEmitBytes(int) - Method in class com.google.appengine.tools.mapreduce.MapReduceSettings.Builder
-
Size (in bytes) of items to batch together in the output of the sort.
- setSortReadTimeMillis(int) - Method in class com.google.appengine.tools.mapreduce.MapReduceSettings.Builder
-
The maximum length of time sort should spend reading input before it starts sorting it and
writing it out.
- setValue(ByteString) - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValue.Builder
-
required bytes value = 2 [ctype = CORD];
- setValue(int, ByteString) - Method in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValues.Builder
-
repeated bytes value = 2 [ctype = CORD];
- setValueMarshaller(Marshaller<V>) - Method in class com.google.appengine.tools.mapreduce.MapReduceSpecification.Builder
-
- setVersion(String) - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobSettings.Builder
-
- setWorkerPath(String) - Method in class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobSettings.Builder
-
- ShardContext - Interface in com.google.appengine.tools.mapreduce
-
Context for each shard.
- ShardedJob<T extends IncrementalTask> - Class in com.google.appengine.tools.mapreduce.impl.pipeline
-
ShardedJob pipeline.
- ShardedJob(String, List<? extends T>, ShardedJobController<T>, ShardedJobSettings) - Constructor for class com.google.appengine.tools.mapreduce.impl.pipeline.ShardedJob
-
- ShardedJobController<T extends IncrementalTask> - Class in com.google.appengine.tools.mapreduce.impl.shardedjob
-
Aggregates results from
IncrementalTask
s and receives notification
when the job completes.
- ShardedJobController() - Constructor for class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobController
-
- ShardedJobHandler - Interface in com.google.appengine.tools.mapreduce.impl.shardedjob
-
As part of its operation, the
ShardedJobService
will enqueue task
queue tasks that send requests to the URLs specified in
ShardedJobSettings
.
- ShardedJobRunner<T extends IncrementalTask> - Class in com.google.appengine.tools.mapreduce.impl.shardedjob
-
Contains all logic to manage and run sharded jobs.
- ShardedJobRunner() - Constructor for class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobRunner
-
- ShardedJobService - Interface in com.google.appengine.tools.mapreduce.impl.shardedjob
-
Allows interaction with sharded jobs.
- ShardedJobServiceFactory - Class in com.google.appengine.tools.mapreduce.impl.shardedjob
-
- ShardedJobSettings - Class in com.google.appengine.tools.mapreduce.impl.shardedjob
-
Execution settings for a sharded job.
- ShardedJobSettings.Builder - Class in com.google.appengine.tools.mapreduce.impl.shardedjob
-
ShardedJobSettings builder.
- ShardedJobSettings.Builder() - Constructor for class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobSettings.Builder
-
- ShardedJobState - Interface in com.google.appengine.tools.mapreduce.impl.shardedjob
-
Information about execution and progress of a sharded job.
- sharder - Variable in class com.google.appengine.tools.mapreduce.outputs.ShardingOutputWriter
-
- Sharder - Interface in com.google.appengine.tools.mapreduce
-
Used to determine which shard an item belongs to.
- ShardFailureException - Exception in com.google.appengine.tools.mapreduce.impl.shardedjob
-
An exception thrown when there should be no more attempts to continue processing the shard.
- ShardFailureException(String) - Constructor for exception com.google.appengine.tools.mapreduce.impl.shardedjob.ShardFailureException
-
- ShardFailureException(int, Throwable) - Constructor for exception com.google.appengine.tools.mapreduce.impl.shardedjob.ShardFailureException
-
- ShardFailureException(int, String, Throwable) - Constructor for exception com.google.appengine.tools.mapreduce.impl.shardedjob.ShardFailureException
-
- ShardingOutputWriter<K,V,WriterT extends OutputWriter<KeyValue<K,V>>> - Class in com.google.appengine.tools.mapreduce.outputs
-
Writes
KeyValue
s out to a number of output writers each corresponding to a different
shard A sharder and an Output object are provided in the constructor.
- ShardingOutputWriter(Marshaller<K>, Sharder) - Constructor for class com.google.appengine.tools.mapreduce.outputs.ShardingOutputWriter
-
- shardLogQuery - Variable in class com.google.appengine.tools.mapreduce.inputs.LogInputReader
-
- ShardRetryState<T extends IncrementalTask> - Class in com.google.appengine.tools.mapreduce.impl.shardedjob
-
Retry information for a shard.
- ShardRetryState.Serializer - Class in com.google.appengine.tools.mapreduce.impl.shardedjob
-
Utility class to serialize/deserialize ShardRetryState.
- ShardRetryState.Serializer() - Constructor for class com.google.appengine.tools.mapreduce.impl.shardedjob.ShardRetryState.Serializer
-
- shouldCheckpoint(long) - Method in class com.google.appengine.tools.mapreduce.impl.MapOnlyShardTask
-
- shouldCheckpoint(long) - Method in class com.google.appengine.tools.mapreduce.impl.MapShardTask
-
- shouldCheckpoint(long) - Method in class com.google.appengine.tools.mapreduce.impl.ReduceShardTask
-
- shouldCheckpoint(long) - Method in class com.google.appengine.tools.mapreduce.impl.sort.MergeShardTask
-
- shouldCheckpoint(long) - Method in class com.google.appengine.tools.mapreduce.impl.sort.SortShardTask
-
- shouldCheckpoint(long) - Method in class com.google.appengine.tools.mapreduce.impl.WorkerShardTask
-
- shouldSegment(O) - Method in class com.google.appengine.tools.mapreduce.outputs.ItemSegmentingOutputWriter
-
- shouldSegment(ByteBuffer) - Method in class com.google.appengine.tools.mapreduce.outputs.SizeSegmentingOutputWriter
-
- ShufflerServlet - Class in com.google.appengine.tools.mapreduce.servlets
-
This servlet provides a way for Python MapReduce Jobs to use the Java MapReduce as a shuffle.
- ShufflerServlet() - Constructor for class com.google.appengine.tools.mapreduce.servlets.ShufflerServlet
-
- SizeSegmentedGoogleCloudStorageFileOutput - Class in com.google.appengine.tools.mapreduce.outputs
-
An
Output
that writes files to GCS segmented by specified size limit.
- SizeSegmentedGoogleCloudStorageFileOutput(String, long, String, String) - Constructor for class com.google.appengine.tools.mapreduce.outputs.SizeSegmentedGoogleCloudStorageFileOutput
-
- SizeSegmentingOutputWriter - Class in com.google.appengine.tools.mapreduce.outputs
-
Segments the output base on the specified size limit.
- SizeSegmentingOutputWriter(long) - Constructor for class com.google.appengine.tools.mapreduce.outputs.SizeSegmentingOutputWriter
-
- SliceSegmentingOutputWriter<O,WriterT extends OutputWriter<O>> - Class in com.google.appengine.tools.mapreduce.outputs
-
Segments data by using a separate writer for each slice.
- SliceSegmentingOutputWriter() - Constructor for class com.google.appengine.tools.mapreduce.outputs.SliceSegmentingOutputWriter
-
- SORT_CALLS - Static variable in class com.google.appengine.tools.mapreduce.CounterNames
-
Number of times sort function was called.
- SORT_OUTPUT_DIR_FORMAT - Static variable in class com.google.appengine.tools.mapreduce.impl.MapReduceConstants
-
- SORT_WALLTIME_MILLIS - Static variable in class com.google.appengine.tools.mapreduce.CounterNames
-
Total time in milliseconds spent in sort function.
- SortContext - Class in com.google.appengine.tools.mapreduce.impl.sort
-
Provides a context for the in memory sort.
- SortShardTask - Class in com.google.appengine.tools.mapreduce.impl.sort
-
Keeps accepting inputs and passing them to a SortWorker until the worker's buffer is full.
- SortShardTask(String, int, int, InputReader<KeyValue<ByteBuffer, ByteBuffer>>, SortWorker, OutputWriter<KeyValue<ByteBuffer, List<ByteBuffer>>>, int) - Constructor for class com.google.appengine.tools.mapreduce.impl.sort.SortShardTask
-
- SortWorker - Class in com.google.appengine.tools.mapreduce.impl.sort
-
Sorts a set of keyValues by a lexicographical comparison of the bytes of the key.
- SortWorker(Long, int) - Constructor for class com.google.appengine.tools.mapreduce.impl.sort.SortWorker
-
- split(List<X>, int, boolean) - Static method in class com.google.appengine.tools.mapreduce.impl.util.SplitUtil
-
- splitQuery(Query, int) - Method in class com.google.appengine.tools.mapreduce.inputs.DatastoreShardStrategy
-
- splitShards(int) - Method in class com.google.appengine.tools.mapreduce.impl.FilesByShard
-
Splits the provided input if needed to ensure there are approximately targetNumShards
shards.
- SplitUtil - Class in com.google.appengine.tools.mapreduce.impl.util
-
Convenience methods related to splitting.
- SplitUtil() - Constructor for class com.google.appengine.tools.mapreduce.impl.util.SplitUtil
-
- start(MapSpecification<I, O, R>, MapSettings) - Static method in class com.google.appengine.tools.mapreduce.MapJob
-
Starts a
MapJob
with the given parameters in a new Pipeline.
- start(MapReduceSpecification<I, K, V, O, R>, MapReduceSettings) - Static method in class com.google.appengine.tools.mapreduce.MapReduceJob
-
Starts a
MapReduceJob
with the given parameters in a new Pipeline.
- startJob(String, List<? extends T>, ShardedJobController<T>, ShardedJobSettings) - Method in interface com.google.appengine.tools.mapreduce.impl.shardedjob.ShardedJobService
-
Starts a new sharded job with the given ID and parameters.
- Status - Class in com.google.appengine.tools.mapreduce.impl.shardedjob
-
Possible job statuses.
- Status(Status.StatusCode) - Constructor for class com.google.appengine.tools.mapreduce.impl.shardedjob.Status
-
- Status(Status.StatusCode, Exception) - Constructor for class com.google.appengine.tools.mapreduce.impl.shardedjob.Status
-
- Status.StatusCode - Enum in com.google.appengine.tools.mapreduce.impl.shardedjob
-
The possible status codes for Status
.
- StringOutput<O,R> - Class in com.google.appengine.tools.mapreduce.outputs
-
An output that accepts objects, invokes
Object.toString()
(or an arbitrary
other String-valued
Function
that is
Serializable
) on them,
adds an optional terminator, encodes the resulting String according to a
Charset
, and writes the result to an underlying
Output
.
- StringOutput(Function<O, String>, String, String, Output<ByteBuffer, R>) - Constructor for class com.google.appengine.tools.mapreduce.outputs.StringOutput
-
- StringOutput(String, String, Output<ByteBuffer, R>) - Constructor for class com.google.appengine.tools.mapreduce.outputs.StringOutput
-
- StringOutput(String, Output<ByteBuffer, R>) - Constructor for class com.google.appengine.tools.mapreduce.outputs.StringOutput
-
- validateCollection(Field) - Static method in class com.google.appengine.tools.mapreduce.impl.BigQueryFieldUtil
-
A field of type
Collection
must be parameterized for marshalling it into bigquery data
as a raw field can lead to ambiguous bigquery table definitions.
- validateNestedParameterizedType(Type) - Static method in class com.google.appengine.tools.mapreduce.impl.BigQueryFieldUtil
-
Parameterized types nested more than one level cannot be determined at runtime.
- validateNestedRepeatedType(Class<?>, Field) - Static method in class com.google.appengine.tools.mapreduce.impl.BigQueryFieldUtil
-
A field of type Collection cannot be marshalled into bigquery data format as
parameterized types nested more than one level cannot be determined at runtime.
- value() - Method in enum com.google.appengine.tools.mapreduce.impl.util.LevelDbConstants.RecordType
-
The byte value of the record type is written to the file as part of the
header.
- VALUE_FIELD_NUMBER - Static variable in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValue
-
- VALUE_FIELD_NUMBER - Static variable in class com.google.appengine.tools.mapreduce.impl.proto.KeyValuePb.KeyValues
-
- valueOf(String) - Static method in enum com.google.appengine.tools.mapreduce.BigQueryFieldMode
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum com.google.appengine.tools.mapreduce.impl.shardedjob.Status.StatusCode
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum com.google.appengine.tools.mapreduce.impl.util.LevelDbConstants.RecordType
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum com.google.appengine.tools.mapreduce.impl.util.SerializationUtil.CompressionType
-
Returns the enum constant of this type with the specified name.
- ValueProjectionReducer<K,V> - Class in com.google.appengine.tools.mapreduce.reducers
-
Reducer that emits the values that occur in its input, discarding the keys.
- ValueProjectionReducer() - Constructor for class com.google.appengine.tools.mapreduce.reducers.ValueProjectionReducer
-
- values() - Static method in enum com.google.appengine.tools.mapreduce.BigQueryFieldMode
-
Returns an array containing the constants of this enum type, in
the order they are declared.
- values() - Static method in enum com.google.appengine.tools.mapreduce.impl.shardedjob.Status.StatusCode
-
Returns an array containing the constants of this enum type, in
the order they are declared.
- values() - Static method in enum com.google.appengine.tools.mapreduce.impl.util.LevelDbConstants.RecordType
-
Returns an array containing the constants of this enum type, in
the order they are declared.
- values() - Static method in enum com.google.appengine.tools.mapreduce.impl.util.SerializationUtil.CompressionType
-
Returns an array containing the constants of this enum type, in
the order they are declared.