ashmib
/

gemma-2b-travel-qa

Question Answering

Model card Files Files and versions Community

Edit model card

Finetuning Gemma-2b-it Models to answer European travel-related Q&A

This is a sample project where we fine-tuned the Gemma-2b-it model on Wikivoyage travel data on European cities to see if it answers the travel related Q&A better. This is also an ongoing WIP project.

Training Specs

Gemma-2b fine-tuned on 2 Nvidia A40 GPUs using HuggingFace SFTrainer
10 epochs
1e-5 learning rate

Data

Wikivoyage (English) data for 160 European cities.
Used Gemini 1.5 Pro and Flash to extract relevant questions from the data.

Code | Demo - TBD

Downloads last month: 10

Safetensors

Model size

3.03B params

Tensor type

BF16

·

Inference Examples

Question Answering

Unable to determine this model's library. Check the docs .

Model tree for ashmib/gemma-2b-travel-qa

Base model

google/gemma-2-2b

Finetuned

google/gemma-2-2b-it

Finetuned

(116)

this model

Dataset used to train ashmib/gemma-2b-travel-qa