Architecture

Zebclient Analytics Architecture

Ingestion layer

• Schedulers - Airflow, Kubeflow
• ELT tools - Airbyte

Storage layer (Analytical)

• ZebClient

Catalogue layer

• ZebClient filesystem - default Apache Parquet

• Data Warehouse - High Performance SQL Analaytical DB, Batch and Streaming data

Processing Layer

• Analytical database - StarRocks
• Big data processing - Kubeflow, Apache Spark

Consumption layer

• Interactive SQL querie - MySQL, Phyton

• BI tools Commersial or Opensource - verified BI tools
• LLM SQL - verified Ollama