6 Commits

Author	SHA1	Message	Date
Deyao Zhu	dadc0d7e69	adding length control and change the default hyperparameter of the conversation to avoid OOM in 3090.	2023-04-18 22:04:50 +03:00
Zhwt	92126a0a32	fix wrong paper PDF link	2023-04-18 17:22:28 +08:00
ZhuDeyao	3e03c8327f	Merge pull request #5 from 152334H/int8 ... consumer gpu inference	2023-04-17 15:34:20 +03:00
XiaoqianShen	378508b83b	Update demo.py	2023-04-17 10:35:02 +03:00
152334H	700f05d079	set num_beam default to 1 instead of completely removing it	2023-04-17 14:56:18 +08:00
Deyao Zhu	f1a33af227	first commit	2023-04-17 01:04:16 +03:00