5 commits

Author	SHA1	Message	Date
rromb	e2a6bee13c	add further nerf-attention	2022-07-06 23:44:26 +02:00
rromb	0540e685e5	add options for scaling	2022-07-06 16:22:13 +02:00
rromb	71ebe40791	do not fix num_heads to one in legacy mode	2022-04-15 17:24:11 +02:00
rromb	a80ed7987e	add new models	2022-04-04 16:17:48 +02:00
ablattmann	e66308c7f2	add code	2021-12-21 03:23:41 +01:00