13 Commits

Author	SHA1	Message	Date
Deyao Zhu	062ad9bb30	remove files	2023-10-12 14:57:17 +03:00
Deyao Zhu	871918f758	fix the device bug with latest transformers	2023-08-29 16:12:22 +03:00
Deyao Zhu	fb8e2c656a	include llama2	2023-08-28 21:26:00 +03:00
Jun Chen	3bd99950f0	Update runner_base.py	2023-04-23 15:49:37 +03:00
Deyao Zhu	322ed189e6	add argument to set the demo device	2023-04-19 19:49:05 +03:00
Deyao Zhu	f5c28362d4	fix the issue with strange strikethrough output	2023-04-19 10:53:33 +03:00
Deyao Zhu	dadc0d7e69	adding length control and change the default hyperparameter of the conversation to avoid OOM in 3090.	2023-04-18 22:04:50 +03:00
Deyao Zhu	3c9d321b79	fix an import bug in image_text_pair_builder.py	2023-04-17 16:57:20 +03:00
Deyao Zhu	b76d5c5a50	add argument to switch 8bit	2023-04-17 16:54:00 +03:00
152334H	700f05d079	set num_beam default to 1 instead of completely removing it	2023-04-17 14:56:18 +08:00
152334H	6a8e6e49ff	load in 8bit and run ViT-L in cpu to reduce vram use	2023-04-17 13:52:09 +08:00
152334H	017fa43d03	disable beam search to reduce vram use	2023-04-17 13:51:39 +08:00
Deyao Zhu	f1a33af227	first commit	2023-04-17 01:04:16 +03:00