Pravega, a new storage abstraction data streams

Опубликовано 22 июля 2019, 18:41

Streaming Analytics has become an indispensable tool for any agile organization. While the rapid evolution of streaming tools has provided the ability to react to incoming data instantly, it has also introduced several engineering challenges. Data need to be duplicated to traditional storage systems for historical processing and archival, where a different set of tools are used for analyzing it. Pravega, an open source technology, aims to revolutionize this space by providing the first Streaming Storage solution that enables both Streaming and Batch Analytics using a single set of tools, all without unnecessary data replication. Designed from the ground up with exactly-once semantics, elastic stream scaling, and transactional support, Pravega hopes to revolutionize the streaming data platforms by providing stream as a data storage primitive.

See more at microsoft.com/en-us/research/v...