From 83c3cb06ed415316b27362d799d5bceec124a554 Mon Sep 17 00:00:00 2001 From: junchen14 Date: Tue, 24 Oct 2023 21:34:08 +0300 Subject: [PATCH] udpate gqa --- dataset/README_MINIGPTv2_FINETUNE.md | 19 +++++++++++-------- 1 file changed, 11 insertions(+), 8 deletions(-) diff --git a/dataset/README_MINIGPTv2_FINETUNE.md b/dataset/README_MINIGPTv2_FINETUNE.md index a750c26..4056b1b 100644 --- a/dataset/README_MINIGPTv2_FINETUNE.md +++ b/dataset/README_MINIGPTv2_FINETUNE.md @@ -15,7 +15,7 @@ RefCOCOg | annotations AOK-VQA | annotations OCR-VQA | annotations -GQA | images    annotations +GQA | images    annotations Filtered Flickr-30k | annotations Multi-task conversation | annotations Filtered unnatural instruction | annotations @@ -180,21 +180,24 @@ Location_you_like │ ├── dataset.json ``` +Set **image_path** as the ocrvqa/images folder. +Similarly, set **ann_path** to the dataset.json +- [minigpt4/configs/datasets/ocrvqa/ocrvqa.yaml](../minigpt4/configs/datasets/ocrvqa/ocrvqa.yaml) + ### GQA -Download the GQA annotation files -download the images with loadDataset.py script +Download the GQA annotation files and images ``` Location_you_like ├── ${MINIGPTv2_DATASET} -│ ├── ocrvqa +│ ├── gqa │ ├── images -│ ├── dataset.json +│ ├── train_balanced_questions.json ``` -Set **image_path** as the OCR-VQA image folder. -Similarly, set **ann_path** to the lhe OCR-VQA dataset.json -- [minigpt4/configs/datasets/ocrvqa/ocrvqa.yaml](../minigpt4/configs/datasets/ocrvqa/ocrvqa.yaml) +Set **image_path** as the gqa/images folder. +Similarly, set **ann_path** to the train_balanced_questions.json +- [minigpt4/configs/datasets/gqa/balanced_val.yaml](../minigpt4/configs/datasets/gqa/balanced_val.yaml)