org.apache.spark.streaming.kinesis

Class KinesisUtilsPythonHelper

java.lang.Object

org.apache.spark.streaming.kinesis.KinesisUtilsPythonHelper

public class KinesisUtilsPythonHelper
extends java.lang.Object

This is a helper class that wraps the methods in KinesisUtils into more Python-friendly class and function so that it can be easily instantiated and called from Python's KinesisUtils.

Constructor Summary

Constructors

Constructor and Description
KinesisUtilsPythonHelper()

Method Summary

Methods

Modifier and Type	Method and Description
JavaReceiverInputDStream<byte[]>	createStream(JavaStreamingContext jssc, java.lang.String kinesisAppName, java.lang.String streamName, java.lang.String endpointUrl, java.lang.String regionName, int initialPositionInStream, Duration checkpointInterval, StorageLevel storageLevel, java.lang.String awsAccessKeyId, java.lang.String awsSecretKey)
com.amazonaws.services.kinesis.clientlibrary.lib.worker.InitialPositionInStream	getInitialPositionInStream(int initialPositionInStream)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

KinesisUtilsPythonHelper

public KinesisUtilsPythonHelper()

Method Detail

getInitialPositionInStream

public com.amazonaws.services.kinesis.clientlibrary.lib.worker.InitialPositionInStream getInitialPositionInStream(int initialPositionInStream)

createStream

public JavaReceiverInputDStream<byte[]> createStream(JavaStreamingContext jssc,
                                            java.lang.String kinesisAppName,
                                            java.lang.String streamName,
                                            java.lang.String endpointUrl,
                                            java.lang.String regionName,
                                            int initialPositionInStream,
                                            Duration checkpointInterval,
                                            StorageLevel storageLevel,
                                            java.lang.String awsAccessKeyId,
                                            java.lang.String awsSecretKey)