A few bug fixes
Pre-release
Pre-release
Improve comments to be LLM friendly, improve Spark compatibility (#511) * Improve comments to be LLM friendly * update * update * update * update * update * update * Switch method for Spark df to arrow * update * update * update * update * update