高速推論

書いてみる

関連タグ

#モデル (13,514)
#CS (3,142)
#GQA (1)
#LLM (5,334)
#MMLU (8)
#TriForce (1)

TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding

Ikemen Mas Kot
4か月前

Dynamic Memory Compression: Retrofitting LLMs for Accelerated Inference

Ikemen Mas Kot
4か月前