Fast inference engine

Nitro is a high-efficiency C++ inference engine for edge computing, powering Jan. It is lightweight and embeddable, ideal for product integration.

Related Keywords

,Nitro ,Han ,Mast Inference ,Inference Server ,Ocal Ai ,Large Language Model ,Penai Compatible ,Open Source ,Lama ,