-
Notifications
You must be signed in to change notification settings - Fork 171
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Vicuna] Revert the formatting for Brevitas op #1626
Conversation
2cd1e5e
to
f0f4f83
Compare
-- This commit reverts the formatting for Brevitas op. -- It also excludes vicuna.py script from `black` formatter. Signed-off-by: Abhishek Varma <[email protected]>
f0f4f83
to
87c2997
Compare
rhs_bit_width: int, | ||
rhs_group_size: int, | ||
) -> List[int]: | ||
def brevitas〇matmul_rhs_group_quant〡shape(lhs: List[int], rhs: List[int], rhs_scale: List[int], rhs_zero_point: List[int], rhs_bit_width: int, rhs_group_size: int) -> List[int]: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@stellaraccident do you know how this changes the function signature.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
And @makslevental any thoughts
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think this is because of the way these functions are verified in Torch-MLIR. They match the functions' first line for verifying the signature (https://github.com/llvm/torch-mlir/blob/main/python/torch_mlir/dialects/torch/importer/jit_ir/build_tools/library_generator.py#L177), and after formatting the function definition goes to multiple lines and as a result, it would fail the verification.
@Abhishek-Varma but why revert the other files |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Why the changes the pyproject too?
Hi @powderluv I wasn't including the other files in this patch initially but the CI showed linting failures in those set of files - opt_params and model_wrappers.py. Also, pyproject was changed to exclude |
Opened #1627 to track this issue. so we can unblock the demos |
-- This commit reverts the formatting for Brevitas op.
-- It also excludes vicuna.py script from
black
formatter.Signed-off-by: Abhishek Varma [email protected]