Run powerful LLMs on NPU with AnythingLLM | Snapdragon X Elite | Promo

In this video, we showcase that AnythingLLM now supports running models directly on the NPU for Microsoft CoPilot PCs with Snapdragon chips! Running LLMs and other models on NPU provides an incredible mix of speed and power-efficient compared to their CPU counter-part. Available in AnythingLLM v.1.7.2 coming soon for ARM64 Windows PCs https://anythingllm.com ---- This video was published for Qualcomm for CES 2205. It is not a deep dive into the NPU or the technology or meant to be a tutorial. It is a demonstration of AnythingLLM's native ability to use the NPU for inferencing on-device. --- …