9 Commits

Author	SHA1	Message	Date
Deyao Zhu	ada58a6f21	fix the compatibility issue when low-resource is false in the inference mode. Small refator in the conversation.py to remove repeated codes	2023-10-30 21:48:49 +03:00
Deyao Zhu	468b452a8a	fix the demo error when temperature = 2	2023-10-16 16:01:20 +03:00
Deyao Zhu	0eba23ce3b	update v2 demo	2023-10-13 03:14:35 +03:00
Deyao Zhu	fb8e2c656a	include llama2	2023-08-28 21:26:00 +03:00
Deyao Zhu	f5c28362d4	fix the issue with strange strikethrough output	2023-04-19 10:53:33 +03:00
Deyao Zhu	dadc0d7e69	adding length control and change the default hyperparameter of the conversation to avoid OOM in 3090.	2023-04-18 22:04:50 +03:00
152334H	700f05d079	set num_beam default to 1 instead of completely removing it	2023-04-17 14:56:18 +08:00
152334H	017fa43d03	disable beam search to reduce vram use	2023-04-17 13:51:39 +08:00
Deyao Zhu	f1a33af227	first commit	2023-04-17 01:04:16 +03:00