Analytics Storage Stack — Query Engine, Table Format, Catalog

Analytics Storage Stack — Query Engine, Table Format, Catalog An architecture diagram generated by Archify. Analyst / BI Tool · SQL over big tables · Architecture component Analyst / BI Tool SQL over big tables Query Engine · parse, optimize, execute · Data Lakehouse — compute and storage scaled independently · Trino / Spark Query Engine parse, optimize, execute Trino / Spark Data Catalog · which tables exist · Data Lakehouse — compute and storage scaled independently · REST service Data Catalog which tables exist REST service Table Format · which files form a table · Data Lakehouse — compute and storage scaled independently · time travel, GC Table Format which files form a table time travel, GC Object Storage · immutable columnar files · Data Lakehouse — compute and storage scaled independently · Parquet / ORC Object Storage immutable columnar files Parquet / ORC SQL query resolve table metadata file list + schema read snapshot / commit references data files column blocks Data Lakehouse — compute and storage scaled independently Legend Backend Database Cloud External