com.rpl.rama.module

Interface MicrobatchSourceOptions

All Known Subinterfaces:

MicrobatchSourceOptions.Impl

public interface MicrobatchSourceOptions

Depot source options for microbatch topologies using builder pattern Microbatch topologies documentation

Nested Class Summary

Nested Classes

Modifier and Type	Interface and Description
static interface	MicrobatchSourceOptions.Impl

Method Summary

Modifier and Type	Method and Description
static MicrobatchSourceOptions.Impl	create() Creates an empty MicrobatchSourceOptions.
static MicrobatchSourceOptions.Impl	startFromBeginning() Start processing from beginning of depot partition.
static MicrobatchSourceOptions.Impl	startFromOffsetAfterTimestamp(long millis) Start processing each depot partition from a point in the past.
static MicrobatchSourceOptions.Impl	startFromOffsetAgo(long amt, OffsetAgo unit) Start processing each depot partition from a point in the past.

Method Detail

create

static MicrobatchSourceOptions.Impl create()

Creates an empty MicrobatchSourceOptions. MicrobatchSourceOptions.startFromBeginning() is the same as MicrobatchSourceOptions.create().startFromBeginning()

startFromBeginning

static MicrobatchSourceOptions.Impl startFromBeginning()

Start processing from beginning of depot partition. Only takes effect the first time the topology encounters this depot.

See Also:

Documentation on start options for stream topologies, Documentation on start options for microbatch topologies

startFromOffsetAgo

static MicrobatchSourceOptions.Impl startFromOffsetAgo(long amt,
                                                       OffsetAgo unit)

Start processing each depot partition from a point in the past. Only takes effect the first time the topology encounters this depot.

Parameters:

amt - How far back to start in terms of specified unit

unit - Cardinality or time-based unit

See Also:

Documentation on start options for stream topologies, Documentation on start options for microbatch topologies

startFromOffsetAfterTimestamp

static MicrobatchSourceOptions.Impl startFromOffsetAfterTimestamp(long millis)

Start processing each depot partition from a point in the past. Only takes effect the first time the topology encounters this depot.

Parameters:

millis - Timestamp based on number of milliseconds since midnight, January 1, 1970 UTC

See Also:

Documentation on start options for stream topologies, Documentation on start options for microbatch topologies