com.rpl.rama.module

Interface StreamSourceOptions.Impl

All Superinterfaces:

StreamSourceOptions

Enclosing interface:

StreamSourceOptions

public static interface StreamSourceOptions.Impl
extends StreamSourceOptions

Nested Class Summary

Nested classes/interfaces inherited from interface com.rpl.rama.module.StreamSourceOptions

StreamSourceOptions.Impl

Method Summary

Modifier and Type	Method and Description
StreamSourceOptions.Impl	ackReturnAgg(RamaAccumulatorAgg1 agg) Specifies aggregator to use for ack returns for processing off of this depot.
StreamSourceOptions.Impl	ackReturnAgg(RamaCombinerAgg agg) Specifies aggregator to use for ack returns for processing off of this depot.
StreamSourceOptions.Impl	ackReturnAgg(RamaFunction1<java.lang.Object,Agg> agg) Specifies aggregator to use for ack returns for processing off of this depot.
StreamSourceOptions.Impl	retryAllAfter() Retry failed records and all records after in the same depot partition
StreamSourceOptions.Impl	retryNone() Never retry a failed depot record
StreamSourceOptions.Impl	startFromBeginning() Start processing from beginning of depot partition.
StreamSourceOptions.Impl	startFromOffsetAfterTimestamp(long millis) Start processing each depot partition from a point in the past.
StreamSourceOptions.Impl	startFromOffsetAgo(long amt, OffsetAgo unit) Start processing each depot partition from a point in the past.

Methods inherited from interface com.rpl.rama.module.StreamSourceOptions

ackReturnAgg, ackReturnAgg, ackReturnAgg, create, retryAllAfter, retryNone, startFromBeginning, startFromOffsetAfterTimestamp, startFromOffsetAgo

Method Detail

retryAllAfter

StreamSourceOptions.Impl retryAllAfter()

Retry failed records and all records after in the same depot partition

See Also:

Stream topologies fault-tolerance documentation

retryNone

StreamSourceOptions.Impl retryNone()

Never retry a failed depot record

See Also:

Stream topologies fault-tolerance documentation

startFromBeginning

StreamSourceOptions.Impl startFromBeginning()

Start processing from beginning of depot partition. Only takes effect the first time the topology encounters this depot.

See Also:

Documentation on start options for stream topologies, Documentation on start options for microbatch topologies

startFromOffsetAgo

StreamSourceOptions.Impl startFromOffsetAgo(long amt,
                                            OffsetAgo unit)

Start processing each depot partition from a point in the past. Only takes effect the first time the topology encounters this depot.

Parameters:

amt - How far back to start in terms of specified unit

unit - Cardinality or time-based unit

See Also:

Documentation on start options for stream topologies, Documentation on start options for microbatch topologies

startFromOffsetAfterTimestamp

StreamSourceOptions.Impl startFromOffsetAfterTimestamp(long millis)

Start processing each depot partition from a point in the past. Only takes effect the first time the topology encounters this depot.

Parameters:

millis - Timestamp based on number of milliseconds since midnight, January 1, 1970 UTC

See Also:

Documentation on start options for stream topologies, Documentation on start options for microbatch topologies

ackReturnAgg

StreamSourceOptions.Impl ackReturnAgg(RamaAccumulatorAgg1 agg)

Specifies aggregator to use for ack returns for processing off of this depot. Aggregator can be custom accumulator, custom combiner, or built-in aggregator. Built-in aggregators are specified like .ackReturnAgg(Agg::sum).

Parameters:

agg - Aggregator to use

See Also:

Depot documentation

ackReturnAgg

StreamSourceOptions.Impl ackReturnAgg(RamaCombinerAgg agg)

Specifies aggregator to use for ack returns for processing off of this depot. Aggregator can be custom accumulator, custom combiner, or built-in aggregator. Built-in aggregators are specified like .ackReturnAgg(Agg::sum).

Parameters:

agg - Aggregator to use

See Also:

Depot documentation

ackReturnAgg

StreamSourceOptions.Impl ackReturnAgg(RamaFunction1<java.lang.Object,Agg> agg)

Specifies aggregator to use for ack returns for processing off of this depot. Aggregator can be custom accumulator, custom combiner, or built-in aggregator. Built-in aggregators are specified like .ackReturnAgg(Agg::sum).

Parameters:

agg - Aggregator to use

See Also:

Depot documentation