-
PodGPT Research: It is surprising to see that leveraging Podcasts into Large Language Models (LLMs) significantly boosts its ability to process medical information, making it an invaluable tool for education and research [1, 2].
-
Image Quality Assessment Research: Mimicking the long-dependency perception of Human Visual System, the Non-local Modeling enhances image quality assessment [1].
-
EEG Research: By cooperating with the functional topological relationship of electrodes, the decoding performance of raw EEG signals is improved [1, 2].
Source codes of all my works will be shared on GitHub, the trained models and datasets will be released on ๐ค Hugging Face, and some of my applied research on Vision and Language will be developed as Web or Android/iOS mobile apps.
Boston University: mostly Multimodal Foundation Models and Generative AI research
Topic 1: Large Language Models (LLMs):
- ๐ฅ ๐๐๐ง๐๐ก๐ฆ๐๐ซ๐ค ๐๐๐ญ๐๐ฌ๐๐ญ - GSM8K-Consistency Benchmark (available on ๐ค Hugging Face)
- ๐จ ๐๐จ๐จ๐ฅ๐ค๐ข๐ญ - PromptCraft: A Prompt Perturbation Toolkit and the released PyPI Package
- ๐งฐ ๐๐จ๐ฅ๐ฅ๐๐๐ญ๐ข๐จ๐ง๐ฌ - Quantized Large Language Models (available on ๐ค Hugging Face)
- ๐ ๐๐๐ฉ๐๐ซ ๐๐ฎ๐ซ๐ฏ๐๐ฒ - Awesome LLM Self-Consistency
- ๐ ๐๐๐ฉ๐๐ซ ๐๐ฎ๐ซ๐ฏ๐๐ฒ - Awesome Semantic Textual Similarity (STS)
Topic 2: Large Multimodal Models (LMMs/MM-LLMs): We will gradually deploy all our Multimodal Foundation Models on our PodGPT platform.
- ๐ ๐๐จ๐๐ญ๐ฐ๐๐ซ๐ - ๐๐จ๐๐๐๐ ๐๐ง๐ฅ๐ข๐ง๐ ๐๐ฅ๐๐ญ๐๐จ๐ซ๐ฆ and our preprint are available online!
- ๐ ๐๐๐ฉ๐๐ซ ๐๐ฎ๐ซ๐ฏ๐๐ฒ - Awesome Large Vision-Language Model (LVLM/MM-LLM)
- ๐ ๐๐๐ฉ๐๐ซ ๐๐ฎ๐ซ๐ฏ๐๐ฒ - Awesome Mixture of Experts (MoE)
Topic 3: Evidence-based Medicine (EBM):
- ๐ ๐๐๐ฉ๐๐ซ ๐๐ฎ๐ซ๐ฏ๐๐ฒ - Awesome Evidence-based Medicine
Topic 4: Medical Imaging with AI:
- ๐ผ๏ธ ๐๐ง๐ฅ๐ข๐ง๐ ๐๐๐๐ข๐๐๐ฅ ๐๐ฆ๐๐ ๐ข๐ง๐ ๐๐ข๐ฌ๐ฎ๐๐ฅ๐ข๐ณ๐๐ซ - Online Medical Imaging Visualizer (based on Papaya)
City University of Hong Kong: mostly Computer Vision research
- ๐๐จ๐ง-๐ฅ๐จ๐๐๐ฅ ๐๐จ๐๐๐ฅ๐ข๐ง๐ - Non-local Modeling for Image Quality Assessment
- ๐๐จ๐ง-๐ฅ๐จ๐๐๐ฅ ๐๐จ๐๐๐ฅ๐ข๐ง๐ - Context-aware Non-local Compensation for Image Quality Assessment
Northeast Electric Power University: mostly Deep Learning research
- ๐ฅ ๐๐ข๐๐ซ๐๐ซ๐ฒ - EEG Deep Learning Library
- ๐๐๐จ๐ฎ๐ญ ๐๐๐ ๐๐ง๐ ๐๐๐ - EEG Motor Imagery Signals Classification via CNN
- ๐๐จ๐ง๐๐ซ ๐๐ฆ๐๐ ๐ ๐๐๐ ๐ฆ๐๐ง๐ญ๐๐ญ๐ข๐จ๐ง - Sonar Image Segmentation via Entropy Method โ ๐ฃ๐ฎ๐๐ฒ๐ป๐
Others: