Skip to content

XiangpengHao/parquet-viewer

Repository files navigation

Parquet Viewer

Online at: https://parquet-viewer.xiangpeng.systems

Features

  • Query parquet data with SQL (if you're resistance) ✅
  • Query parquet data with natural language through LLM (if you're enlightened) ✅
  • View Parquet metadata ✅
  • View Parquet files from anywhere -- local file, S3, or any URLs ✅
  • Everything runs in the browser, no server, no external dependencies, just a web page ✅

Demo

screenshot

Headless mode

Despite being a battery-included web app, it can also be used as a headless tool, especially helpful when working with LLM tools.

Like command args for CLI tools, you can pass url params to control the behavior of the app.

For example, this link tells parquet-viewer to

(1) load a file from a url,

(2) run a SQL query (or natural language if you like),

(3) export the results to a CSV file.

Most of the query params are reflected in the URL as you operate on the app, so you can simply share the URL with others to reproduce your findings.

Adding export=csv or export=parquet to the URL will export the query result to a CSV/Parquet file.

Development

It compiles Parquet, Arrow, Datafusion, OpenDAL to WebAssembly and uses it to explore Parquet files, more details.

Checkout the awesome Leptos framework.

trunk serve --open

trunk build --release

License

Licensed under either of

at your option.

Be aware that most of the code is generated by AI, resistance is futile.