com.rpl.rama.module

Interface StreamSourceOptions

All Known Subinterfaces:

StreamSourceOptions.Impl

public interface StreamSourceOptions

Depot source options for stream topologies using builder pattern Stream topologies documentation

Nested Class Summary

Nested Classes

Modifier and Type	Interface and Description
static interface	StreamSourceOptions.Impl

Method Summary

Modifier and Type	Method and Description
static StreamSourceOptions.Impl	ackReturnAgg(RamaAccumulatorAgg1 agg) Specifies aggregator to use for ack returns for processing off of this depot.
static StreamSourceOptions.Impl	ackReturnAgg(RamaCombinerAgg agg) Specifies aggregator to use for ack returns for processing off of this depot.
static StreamSourceOptions.Impl	ackReturnAgg(RamaFunction1<java.lang.Object,Agg> agg) Specifies aggregator to use for ack returns for processing off of this depot.
static StreamSourceOptions.Impl	create() Creates an empty StreamSourceOptions.
static StreamSourceOptions.Impl	retryAllAfter() Retry failed records and all records after in the same depot partition
static StreamSourceOptions.Impl	retryNone() Never retry a failed depot record
static StreamSourceOptions.Impl	startFromBeginning() Start processing from beginning of depot partition.
static StreamSourceOptions.Impl	startFromOffsetAfterTimestamp(long millis) Start processing each depot partition from a point in the past.
static StreamSourceOptions.Impl	startFromOffsetAgo(long amt, OffsetAgo unit) Start processing each depot partition from a point in the past.

Method Detail

create

static StreamSourceOptions.Impl create()

Creates an empty StreamSourceOptions. StreamSourceOptions.startFromBeginning() is the same as StreamSourceOptions.create().startFromBeginning()

retryAllAfter

static StreamSourceOptions.Impl retryAllAfter()

Retry failed records and all records after in the same depot partition

See Also:

Stream topologies fault-tolerance documentation

retryNone

static StreamSourceOptions.Impl retryNone()

Never retry a failed depot record

See Also:

Stream topologies fault-tolerance documentation

startFromBeginning

static StreamSourceOptions.Impl startFromBeginning()

Start processing from beginning of depot partition. Only takes effect the first time the topology encounters this depot.

See Also:

Documentation on start options for stream topologies, Documentation on start options for microbatch topologies

startFromOffsetAgo

static StreamSourceOptions.Impl startFromOffsetAgo(long amt,
                                                   OffsetAgo unit)

Start processing each depot partition from a point in the past. Only takes effect the first time the topology encounters this depot.

Parameters:

amt - How far back to start in terms of specified unit

unit - Cardinality or time-based unit

See Also:

Documentation on start options for stream topologies, Documentation on start options for microbatch topologies

startFromOffsetAfterTimestamp

static StreamSourceOptions.Impl startFromOffsetAfterTimestamp(long millis)

Start processing each depot partition from a point in the past. Only takes effect the first time the topology encounters this depot.

Parameters:

millis - Timestamp based on number of milliseconds since midnight, January 1, 1970 UTC

See Also:

Documentation on start options for stream topologies, Documentation on start options for microbatch topologies

ackReturnAgg

static StreamSourceOptions.Impl ackReturnAgg(RamaAccumulatorAgg1 agg)

Specifies aggregator to use for ack returns for processing off of this depot. Aggregator can be custom accumulator, custom combiner, or built-in aggregator. Built-in aggregators are specified like .ackReturnAgg(Agg::sum).

Parameters:

agg - Aggregator to use

See Also:

Depot documentation

ackReturnAgg

static StreamSourceOptions.Impl ackReturnAgg(RamaCombinerAgg agg)

Specifies aggregator to use for ack returns for processing off of this depot. Aggregator can be custom accumulator, custom combiner, or built-in aggregator. Built-in aggregators are specified like .ackReturnAgg(Agg::sum).

Parameters:

agg - Aggregator to use

See Also:

Depot documentation

ackReturnAgg

static StreamSourceOptions.Impl ackReturnAgg(RamaFunction1<java.lang.Object,Agg> agg)

Specifies aggregator to use for ack returns for processing off of this depot. Aggregator can be custom accumulator, custom combiner, or built-in aggregator. Built-in aggregators are specified like .ackReturnAgg(Agg::sum).

Parameters:

agg - Aggregator to use

See Also:

Depot documentation