| Modifier and Type | Field and Description |
|---|---|
protected Input<? extends I> |
input |
protected String |
jobName |
protected Output<? super O,? extends R> |
output |
| Constructor and Description |
|---|
MapReduceSpecification.Builder() |
MapReduceSpecification.Builder(Input<I> input,
Mapper<I,K,V> mapper,
Reducer<K,V,O> reducer,
Output<O,R> output) |
| Modifier and Type | Method and Description |
|---|---|
MapReduceSpecification<I,K,V,O,R> |
build() |
protected MapReduceSpecification.Builder<I,K,V,O,R> |
self() |
B |
setInput(Input<? extends I> input) |
B |
setJobName(String jobName) |
MapReduceSpecification.Builder<I,K,V,O,R> |
setKeyMarshaller(Marshaller<K> marshaller) |
MapReduceSpecification.Builder<I,K,V,O,R> |
setMapper(Mapper<? extends I,K,V> mapper) |
MapReduceSpecification.Builder<I,K,V,O,R> |
setNumReducers(int numReducers) |
B |
setOutput(Output<? super O,? extends R> output) |
MapReduceSpecification.Builder<I,K,V,O,R> |
setReducer(Reducer<K,V,? extends O> reducer) |
MapReduceSpecification.Builder<I,K,V,O,R> |
setValueMarshaller(Marshaller<V> marshaller) |
protected String jobName
protected Input<? extends I> input
protected Output<? super O,? extends R> output
public MapReduceSpecification.Builder<I,K,V,O,R> setMapper(Mapper<? extends I,K,V> mapper)
mapper - processes the input and optionally generates intermediate key-value pairs to be
processed by reducerpublic MapReduceSpecification.Builder<I,K,V,O,R> setKeyMarshaller(Marshaller<K> marshaller)
marshaller - turns intermediate keys into bytes and back. see Marshallers for
default implementations.public MapReduceSpecification.Builder<I,K,V,O,R> setValueMarshaller(Marshaller<V> marshaller)
marshaller - turns intermediate values into bytes and back. see Marshallers for
default implementations. defaults to Marshallers.getSerializationMarshaller().public MapReduceSpecification.Builder<I,K,V,O,R> setReducer(Reducer<K,V,? extends O> reducer)
reducer - processes the intermediate key-value pairs generated by the mapper and
optionally writes to output.public MapReduceSpecification.Builder<I,K,V,O,R> setNumReducers(int numReducers)
numReducers - specify the number of reducerspublic B setJobName(String jobName)
jobName - descriptive name for the job (human readable, does not have to be unique).public B setInput(Input<? extends I> input)
input - specifies what input the mapper should processpublic B setOutput(Output<? super O,? extends R> output)
output - specifies what to do with output values.Copyright © 2015 Google. All rights reserved.