7 Commits

Author	SHA1	Message	Date
Deyao Zhu	0eba23ce3b	update v2 demo	2023-10-13 03:14:35 +03:00
Deyao Zhu	fb8e2c656a	include llama2	2023-08-28 21:26:00 +03:00
Deyao Zhu	f5c28362d4	fix the issue with strange strikethrough output	2023-04-19 10:53:33 +03:00
Deyao Zhu	dadc0d7e69	adding length control and change the default hyperparameter of the conversation to avoid OOM in 3090.	2023-04-18 22:04:50 +03:00
152334H	700f05d079	set num_beam default to 1 instead of completely removing it	2023-04-17 14:56:18 +08:00
152334H	017fa43d03	disable beam search to reduce vram use	2023-04-17 13:51:39 +08:00
Deyao Zhu	f1a33af227	first commit	2023-04-17 01:04:16 +03:00