chris/MiniGPT-4
1
0
Fork 0
mirror of https://github.com/Vision-CAIR/MiniGPT-4.git synced 2025-04-17 11:10:46 +00:00
Code Issues Packages Projects Releases Wiki Activity

update readme for demo on gpu with 24G memory

Browse Source
This commit is contained in:
Deyao Zhu 2023-04-18 22:12:40 +03:00
parent dadc0d7e69
commit c37ef667ba
1 changed files with 6 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

8
README.md
View File

@ -33,8 +33,6 @@ More examples can be found in the [project page](https://minigpt-4.github.io).
![overview](figs/overview.png) ![overview](figs/overview.png)
## Getting Started ## Getting Started
### Installation ### Installation
@ -86,6 +84,12 @@ Try out our demo [demo.py](demo.py) on your local machine by running
python demo.py --cfg-path eval_configs/minigpt4_eval.yaml python demo.py --cfg-path eval_configs/minigpt4_eval.yaml
``` ```
Here, we load Vicuna as 8 bit by default to save some GPU memory usage.
Besides, the default beam search width is 1.
Under this setting, the demo cost about 23G GPU memory.
If you have a more powerful GPU with larger GPU memory, you can run the model
in 16 bit by setting low_resource to False in the config file
[minigpt4_eval.yaml](eval_configs/minigpt4_eval.yaml) and use a larger beam search width.
### Training ### Training