How does Flink CEP manage the intermittent states ? where does it store them ? Is it just in-memory or is there a fast persistent storage backing the states ?
The documentation does not mention this anywhere.
1 Answers
2
votes
Like all stateful operations in Flink (e.g., windows, aggregations, SQL, timers, etc), Flink CEP uses Flink's managed state. Where the working state is held, and where it is durably persisted, depends on which state backend is being used. The RocksDB state backend allows for state larger than will fit into memory, and checkpoints are persisted in durable storage, such as HDFS, S3, or NFS.
