Skip to content
@mbzuai-oryx

ORYX

A Library for Large Vision-Language Models

Popular repositories

  1. Video-ChatGPT Video-ChatGPT Public

    [ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted fo…

    Python 1.1k 95

  2. LLaVA-pp LLaVA-pp Public

    🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)

    Python 781 55

  3. groundingLMM groundingLMM Public

    [CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.

    Python 726 37

  4. MobiLlama MobiLlama Public

    MobiLlama : Small Language Model tailored for edge devices

    Python 577 42

  5. XrayGPT XrayGPT Public

    [BIONLP@ACL 2024] XrayGPT: Chest Radiographs Summarization using Medical Vision-Language Models.

    Python 454 52

  6. GeoChat GeoChat Public

    [CVPR 2024 🔥] GeoChat, the first grounded Large Vision Language Model for Remote Sensing

    Python 390 29

Repositories

Showing 10 of 14 repositories
  • CVRR-Evaluation-Suite Public

    Official repository of paper titled "How Good is my Video LMM? Complex Video Reasoning and Robustness Evaluation Suite for Video-LMMs".

    mbzuai-oryx/CVRR-Evaluation-Suite’s past year of commit activity
    Python 39 CC-BY-4.0 2 0 0 Updated Aug 19, 2024
  • BiMediX Public

    Bilingual Medical Mixture of Experts LLM

    mbzuai-oryx/BiMediX’s past year of commit activity
    24 1 1 0 Updated Aug 15, 2024
  • BiMediX2 Public

    Bio-Medical EXpert LMM with English and Arabic Language Capabilities

    mbzuai-oryx/BiMediX2’s past year of commit activity
    0 0 0 0 Updated Aug 12, 2024
  • VideoGPT-plus Public

    Official Repository of paper VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding

    mbzuai-oryx/VideoGPT-plus’s past year of commit activity
    Python 176 CC-BY-4.0 11 14 1 Updated Aug 11, 2024
  • XrayGPT Public

    [BIONLP@ACL 2024] XrayGPT: Chest Radiographs Summarization using Medical Vision-Language Models.

    mbzuai-oryx/XrayGPT’s past year of commit activity
    Python 454 52 16 (1 issue needs help) 2 Updated Aug 8, 2024
  • GeoChat Public

    [CVPR 2024 🔥] GeoChat, the first grounded Large Vision Language Model for Remote Sensing

    mbzuai-oryx/GeoChat’s past year of commit activity
    Python 390 29 30 1 Updated Jul 25, 2024
  • LLaVA-pp Public

    🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)

    mbzuai-oryx/LLaVA-pp’s past year of commit activity
    Python 781 55 15 2 Updated Jul 10, 2024
  • Video-ChatGPT Public

    [ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.

    mbzuai-oryx/Video-ChatGPT’s past year of commit activity
    Python 1,129 CC-BY-4.0 95 17 0 Updated Jun 16, 2024
  • groundingLMM Public

    [CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.

    mbzuai-oryx/groundingLMM’s past year of commit activity
    Python 726 37 17 0 Updated Jun 2, 2024
  • PALO Public

    Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, Hindi, Bengali and Urdu.

    mbzuai-oryx/PALO’s past year of commit activity
    Python 76 Apache-2.0 5 4 0 Updated Mar 26, 2024
View all repositories

Top languages

Loading…

Most used topics

Loading…