Skip to content

tmcgrath/spark-2-streaming

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

WIP

Update of old Streaming examples to Spark 2 Add new ones too Spark Streaming tutorials

Kinesis example

Run SparkKinesisExample with arguments; i.e

com.supergloo.kinesis.SparkKinesisExample KinesisApp wm https://kinesis.us-east-1.amazonaws.com

Run/Debug Configuration Screenshot from IntelliJ Example

alt text

Running via spark-submit example

spark-submit --class com.supergloo.kinesis.SparkKinesisExample ./target/scala-2.11/spark-2-streaming-assembly-1.0.jar KinesisApp wm https://kinesis.us-east-1.amazonaws.com

In DSE 5.1.3 and above spark-submit example

dse --framework spark-2.0 spark-submit --class com.supergloo.kinesis.SparkKinesisExample ./target/scala-2.11/spark-2-streaming-assembly-1.0.jar KinesisApp wm https://kinesis.us-east-1.amazonaws.com

About

Spark Streaming Examples

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages