Modifier and Type | Method and Description |
---|---|
com.google.appengine.tools.pipeline.Value<BigQueryStoreResult<GoogleCloudStorageFileSet>> |
BigQueryLoadGoogleCloudStorageFilesJob.handleException(Throwable t) |
Modifier and Type | Method and Description |
---|---|
com.google.appengine.tools.pipeline.Value<List<BigQueryLoadJobReference>> |
BigQueryLoadGoogleCloudStorageFilesJob.run(BigQueryStoreResult<GoogleCloudStorageFileSet> bigQueryStoreResult)
Divides the files into bundles having size less than or equal to the maximum size allowed per
bigquery load
Job and then starts separate pipeline jobs for each of the bundles. |
Modifier and Type | Method and Description |
---|---|
GoogleCloudStorageFileSet |
FilesByShard.getFilesForShard(int shardNumber) |
Constructor and Description |
---|
GoogleCloudStorageLevelDbInput(GoogleCloudStorageFileSet files) |
GoogleCloudStorageLevelDbInput(GoogleCloudStorageFileSet files,
int bufferSize) |
Modifier and Type | Method and Description |
---|---|
GoogleCloudStorageFileSet |
SizeSegmentedGoogleCloudStorageFileOutput.finish(Collection<? extends OutputWriter<ByteBuffer>> writers)
Returns a list of all the filenames written by the output writers
|
GoogleCloudStorageFileSet |
GoogleCloudStorageLevelDbOutput.finish(Collection<? extends OutputWriter<ByteBuffer>> writers) |
GoogleCloudStorageFileSet |
GoogleCloudStorageFileOutput.finish(Collection<? extends OutputWriter<ByteBuffer>> writers)
Returns a list of GcsFilename that has one element for each reduce shard.
|
Modifier and Type | Method and Description |
---|---|
BigQueryStoreResult<GoogleCloudStorageFileSet> |
BigQueryGoogleCloudStorageStoreOutput.finish(Collection<? extends OutputWriter<O>> writers) |
Copyright © 2015 Google. All rights reserved.