Streaming

Ignite streaming allows to process continuous never-ending streams of data in scalable and fault-tolerant fashion. The rates at which data can be injected into Ignite can be very high and easily exceed millions of events per second on a moderately sized cluster.

How it Works

1. Client nodes inject finite or continuous streams of data into Ignite caches using Ignite Data Streamers.
2. Data is automatically partitioned between Ignite data nodes, and each node gets equal amount of data.
3. Streamed data can be concurrently processed directly on the Ignite data nodes in colocated fashion.
4. Clients can also perform concurrent SQL queries on the streamed data.

Data Streamers

Data streamers are defined by IDataStreamer API and are built to inject large amounts of continuous streams of data into Ignite stream caches. Data streamers are built in a scalable and fault-tolerant fashion and provide at-least-once-guarantee semantics for all the data streamed into Ignite.

read more

Querying Data

You can use full set of Ignite data indexing capabilities, together with Ignite SQL, TEXT, and Predicate based cache queries, to query into the streaming data.

read more