Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

SparkNLP 1033: Introducing LLAVA #14450

Open
wants to merge 24 commits into
base: master
Choose a base branch
from
Open

SparkNLP 1033: Introducing LLAVA #14450

wants to merge 24 commits into from

Conversation

prabod
Copy link
Contributor

@prabod prabod commented Nov 8, 2024

This PR Integrates LLAVA family models into SparkNLP

Screenshots (if appropriate):

Types of changes

  • Code improvements with no or little impact
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

  • My code follows the code style of this project.
  • My change requires a change to the documentation.
  • I have updated the documentation accordingly.
  • I have read the CONTRIBUTING page.
  • I have added tests to cover my changes.
  • All new and existing tests passed.

danilojsl and others added 24 commits October 2, 2024 17:47
@danilojsl
[SPARKNLP-1068] Introducing BLIPForQuestionAnswering transformer
7adf658
@danilojsl
[SPARKNLP-1068] Adding BLIPForQuestionAnswering import notebook example
af0c319
@danilojsl
[SPARKNLP-1068] Fix fullAnnotateImage validation
c256e16
@danilojsl
[SPARKNLP-1068] Solves BLIPForQuestionAnsweringTest issue
7c46662
@danilojsl
[SPARKNLP-1068] Updates default BLIPForQuestionAnswering model name
1b4b29d
@danilojsl
[SPARKNLP-1068] [skip test] Adding documentation to BLIPForQuestionAn…
e121763 
…swering
@maziyarpanahi @prabod
Add a new llama_cpp engine (#14436)
c1e072e
@AbdullahMubeenAnwar @prabod
tasks-docs-integration (#14428)
f763fac 
* Update navigation.yml

Adding "- Tasks" page to SparkNLP Docs

* adding task files
@danilojsl @prabod
Introducing BertForMultipleChoice transformer (#14435)
0102a1b 
* [SPARKNLP-1084] Introducing BertForMultipleChoice

* [SPARKNLP-1084] Introducing BertForMultipleChoice transformer
@maziyarpanahi @prabod
fixing the missing import
fc23d43
@DevinTDHa @prabod
Fix pretrained models not being found on dbfs systems (#14438)
f792dea
@DevinTDHa @prabod
[SPARKNLP-1067] PromptAssembler (#14439)
ea28e97 
* [SPARKNLP-1067] PromptAssembler Prototype

* [SPARKNLP-1067] PromptAssembler Scala Side

* [SPARKNLP-1067] PromptAssembler Python Side

* [SPARKNLP-1067] Add example for PromptAssembler

* [SPARKNLP-1067] Add documentation for PromptAssembler

* [SPARKNLP-1067] Update llamacpp dependency

* Switch to slowtest for promptasssembler
@danilojsl @prabod
[SPARKNLP-1084] Adding notebooks for BertForMultipleChoice
126fb03
@maziyarpanahi @prabod
name llama_cpp to llamacpp engine
e7b269e
@maziyarpanahi @prabod
add a default engine to the AutoGGUFModel
55b490c
@maziyarpanahi @prabod
Bump to 5.5.1 and update CHANGELOG [run doc]
7f3704e
@actions-user @prabod
Update Scala and Python APIs
e2f669c
@maziyarpanahi @prabod
release conda 5.5.1 [skip test]
859ef81
@maziyarpanahi @prabod
Fix tasks path in navigation
42c7d36
@prabod
LLAVA Scala API and Tests
5f644bd 
Signed-off-by: Prabod Rathnayaka <[email protected]>
@prabod
LLAVA Test
c1e482e 
Signed-off-by: Prabod Rathnayaka <[email protected]>
@prabod
LLAVA python api
75bfc1e 
Signed-off-by: Prabod Rathnayaka <[email protected]>
@prabod
LLAVA notebook
43f6875 
Signed-off-by: Prabod Rathnayaka <[email protected]>
@prabod
Add custom model requirements
9d24569 
Signed-off-by: Prabod Rathnayaka <[email protected]>
@prabod prabod force-pushed the SPARKNLP-1033-Implement-LLaVA-and-LLaVA-NeXT branch from ab6b075 to 9d24569 Compare November 8, 2024 06:34
@prabod prabod marked this pull request as ready for review November 8, 2024 06:34
@prabod prabod requested a review from maziyarpanahi November 8, 2024 06:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@maziyarpanahi maziyarpanahi Awaiting requested review from maziyarpanahi

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
6 participants
@prabod @danilojsl @maziyarpanahi @AbdullahMubeenAnwar @DevinTDHa @actions-user