22.4 C
New York
Thursday, June 5, 2025

Real-time analytics with StarTree Cloud and Apache Pinot


Once I found the correct command (I was initially looking in the wrong place), it was fairly painless. I could also have run the Apache Pinot demo using Brew or launcher scripts.

The hybrid quick start example starts Apache Kafka, Apache ZooKeeper, Pinot controller, Pinot broker, and Pinot server, then creates an airlineStats schema, an airlineStats offline table, and an airlineStats real-time table that ingests messages from a Kafka topic. The data set had about 10K rows and almost 80 columns. The schema doesn’t seem to create any indexes. The screen shots below show some of the web pages.

Additional tutorials in the Apache Pinot getting started documentation show you how to create clusters, configure tables, ingest batch and streaming data, and configure indexes. You may also want to scan at least the titles of the Apache Pinot recipes, and try the Pizza Shop Demo, an analytic dashboard app.

StarTree Cloud 07
Apache Pinot Cluster Manager web page running locally in the hybrid stream and batch processing example app.

IDG

StarTree Cloud 08
Apache Pinot query console showing a simple SQL query and results in the hybrid example app. The query took 22ms to scan almost 11K documents. The flight time is in minutes, and includes taxi time at both ends. The large negative times apparently indicate cancelled flights.

IDG

StarTree Cloud 09
The Zookeeper Browser running in the Apache Pinot hybrid example app.

IDG

StarTree Cloud 10
The Swagger interface of the Pinot controller API.

IDG

Good, fast analytics

Overall, Apache Pinot and StarTree Cloud offer good, fast analytics capabilities, enabling real-time analytics for customers as well as internal users. Apache Pinot’s major distinguishing features over other columnar analytic databases are its plug-in indexes, star-tree index, and ability to combine batch data with real-time data.

Related Articles

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Latest Articles