Parquet-Py is a simple command-line interface & Python API designed to facilitate the interaction with Parquet files. It allows users to convert Parquet files into CSV, JSON, lists, and iterators for easy manipulation and access in Python applications.
Using Rust bindings under the hood, Parquet-Py provides a fast and efficient way to work with Parquet files, making it ideal for converting or processing large datasets.
- Convert Parquet to CSV: Convert your Parquet files into CSV format for easy viewing and processing in spreadsheet applications.
- Convert Parquet to JSON: Easily convert your Parquet files into a JSON string format for quick inspection or processing.
- Iterable Parquet Rows: Access Parquet file rows through an iterator, allowing for efficient row-by-row processing without loading the entire file into memory.
- Convert Parquet to Python List: Transform your Parquet files into Python lists, where each row is represented as a dictionary within the list.
pip install parquet-py
To convert a Parquet file into a CSV file, use the parq convert
command.
parq convert --input path/to/your/file.parquet --format csv --output example.csv
To convert a Parquet file into a JSON string, use the parq convert
command.
parq convert --input path/to/your/file.parquet --format json --output example.json
To iterate over the rows of a Parquet file, use the iter_rows
function. This allows for efficient row-by-row processing without loading the entire file into memory.
from parq import to_iter
# Path to your Parquet file
file_path = "path/to/your/file.parquet"
# Iterate over Parquet rows
for row in to_iter(file_path):
print(row)
To convert a Parquet file into a CSV string, use the to_csv_str
function.
from parq import to_csv_str
# Path to your Parquet file
file_path = "path/to/your/file.parquet"
# Convert to CSV string
csv_str = to_csv_str(file_path)
print(csv_str)
To convert a Parquet file into a JSON string, use the to_json_str
function.
from parq import to_json_str
# Path to your Parquet file
file_path = "path/to/your/file.parquet"
# Convert to JSON string
json_str = to_json_str(file_path)
print(json_str)
To convert a Parquet file into a Python list, where each row is represented as a dictionary within the list, use the to_list
function.
from parq import to_list
# Path to your Parquet file
file_path = "path/to/your/file.parquet"
# Convert to Python list
data_list = to_list(file_path)
print(len(data_list))