Modifier and Type | Field and Description |
---|---|
protected Input<? extends I> |
input |
protected String |
jobName |
protected Output<? super O,? extends R> |
output |
Constructor and Description |
---|
MapReduceSpecification.Builder() |
MapReduceSpecification.Builder(Input<I> input,
Mapper<I,K,V> mapper,
Reducer<K,V,O> reducer,
Output<O,R> output) |
Modifier and Type | Method and Description |
---|---|
MapReduceSpecification<I,K,V,O,R> |
build() |
protected MapReduceSpecification.Builder<I,K,V,O,R> |
self() |
B |
setInput(Input<? extends I> input) |
B |
setJobName(String jobName) |
MapReduceSpecification.Builder<I,K,V,O,R> |
setKeyMarshaller(Marshaller<K> marshaller) |
MapReduceSpecification.Builder<I,K,V,O,R> |
setMapper(Mapper<? extends I,K,V> mapper) |
MapReduceSpecification.Builder<I,K,V,O,R> |
setNumReducers(int numReducers) |
B |
setOutput(Output<? super O,? extends R> output) |
MapReduceSpecification.Builder<I,K,V,O,R> |
setReducer(Reducer<K,V,? extends O> reducer) |
MapReduceSpecification.Builder<I,K,V,O,R> |
setValueMarshaller(Marshaller<V> marshaller) |
protected String jobName
protected Input<? extends I> input
protected Output<? super O,? extends R> output
public MapReduceSpecification.Builder<I,K,V,O,R> setMapper(Mapper<? extends I,K,V> mapper)
mapper
- processes the input and optionally generates intermediate key-value pairs to be
processed by reducer
public MapReduceSpecification.Builder<I,K,V,O,R> setKeyMarshaller(Marshaller<K> marshaller)
marshaller
- turns intermediate keys into bytes and back. see Marshallers
for
default implementations.public MapReduceSpecification.Builder<I,K,V,O,R> setValueMarshaller(Marshaller<V> marshaller)
marshaller
- turns intermediate values into bytes and back. see Marshallers
for
default implementations. defaults to Marshallers.getSerializationMarshaller()
.public MapReduceSpecification.Builder<I,K,V,O,R> setReducer(Reducer<K,V,? extends O> reducer)
reducer
- processes the intermediate key-value pairs generated by the mapper
and
optionally writes to output
.public MapReduceSpecification.Builder<I,K,V,O,R> setNumReducers(int numReducers)
numReducers
- specify the number of reducerspublic B setJobName(String jobName)
jobName
- descriptive name for the job (human readable, does not have to be unique).public B setInput(Input<? extends I> input)
input
- specifies what input the mapper should processpublic B setOutput(Output<? super O,? extends R> output)
output
- specifies what to do with output values.Copyright © 2015 Google. All rights reserved.