Hugging Face's logo

Shashwath01
/
Idefic_medical_VQA_merged_4bit

Image-Text-to-Text
Transformers
Safetensors
idefics
Medical Visual Question Answering
VQA
IDEFIC
9B
4 Bit
LORA
Combining base with Adapter models
text-generation-inference
Inference Endpoints
4-bit precision
bitsandbytes
Model card Files Community
Idefic_medical_VQA_merged_4bit / README.md
Shashwath01's picture
Shashwath01
Update README.md
1b3cfb3 verified
preview code
|
raw
history blame contribute delete
2.03 kB
metadata
library_name: transformers
tags:
  - Medical Visual Question Answering
  - VQA
  - IDEFIC
  - 9B
  - 4 Bit
  - LORA
  - Combining base with Adapter models
license: apache-2.0

Contributed by:

  • Shashwath P
  • Shashank Ashok
  • Akilan Yohendiran

Total downloads all time - 2106

Model Card for Model ID

The following model is an experimental fine tuned model of the IDEFIC 9B version, for medical Visual Question Answering. It uses a dataset combined from SLAKE and VQARAD. Check the following repository for the notebooks of training,merging and inference. https://github.com/Shashwathp/Idefic_medical_vqa

Model Description

This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.

  • Developed by: [@Shashwath01,@Akill19,@Shashank91097 ]
  • Model type: [Multimodal, Visual Question Answering]
  • Language(s) (NLP): [English]
  • License: [Apache - 2.0]
  • Finetuned from model [optional]: [IDEFIC 9B]

Dataset

https://huggingface.co/datasets/Shashwath01/VQARAD_SLAKE

Model Sources

How to Get Started with the Model

Check the below link to get started with inferencing. https://github.com/Shashwathp/Idefic_medical_vqa/blob/main/inference.ipynb