Architecture

Zebclient Analytics Architecture

Ingestion layer

• Schedulers - Airflow, Kubeflow

• ELT tools - Airbyte

Storage layer (Analytical)

• ZebClient

Catalogue layer

• ZebClient filesystem - default Apache Parquet

• Data Warehouse - High Performance SQL Analaytical DB, Batch and Streaming data

Processing Layer

• Analytical database - StarRocks

• Big data processing - Kubeflow, Apache Spark

Consumption layer

• Interactive SQL querie - MySQL, Phyton

• BI tools Commersial or Opensource - verified BI tools

• LLM SQL - verified Ollama