Fast and Portable Llama2 Inference on the Heterogeneous Edge

Fast and Portable Llama2 Inference on the Heterogeneous Edge.

Related Keywords

Elon Musk ,Nvidia Gpus ,Georgi Gerganov ,Chris Lattner ,Eric Hartford , ,Ubuntu Linux ,