Demoing a Large Language Model running locally on my laptop
Model: laser-dolphin-mixtral-2x7b-dpo.Q3_K_M
Front-End App: https:/github.com/oobabooga/text-generation-webui
Device: hp pavilion laptop 15-cs3xxx
Ram:12gb
CPU: i5-1035g1 cpu @1ghz
Download the model from:
https:/huggingface.co/TheBloke/laser-dolphin-mixtral-2x7b-dpo-GGUF/blob/main/laser-dolphin-mixtral-2x7b-dpo.Q3_K_M.GGUF
Download the latest release of the text-generation-webui. Extract it to your desired directory. You could also clone it from Github. Downloading this zip resolved an issue with gradio not being recognized by the start executable.
Now run the start_linux.sh, start…
Watch on YouTube ↗
(saves to browser)
Playlist
Playlist UUY0xk_A4qJTQWcV2_3sqvJw · Patrick Devaney · 5 of 19
1
2
3
4
▶
6
7
8
9
10
11
12
13
14
15
16
17
18
19
Penn Blockchain Hackathon Demo Oracle NFT Minter
Patrick Devaney
Demo Lionhacks NFT Based Content Authentication
Patrick Devaney
Arb Smart Contract and Front End Dapp
Patrick Devaney
Aleo: Zero Knowledge Dapps - Blockchain at FIU
Patrick Devaney
Demoing a Large Language Model running locally on my laptop
Patrick Devaney
WizardCoder-1B Demo: Powerful Responsive Coding LLM at Home
Patrick Devaney
laser dolphin mixtral 2x7b dpo Q3 K M
Patrick Devaney
deepseek coder6.7b and WizardLM 1B a side by side comparison
Patrick Devaney
wizardLM 1b solidity smart contract prompt
Patrick Devaney
mixtral 2x7b Quantized 2 K prompt on machine learning
Patrick Devaney
biomistral q2k q3km q8 comparison
Patrick Devaney
SQLV2 Q4 demo
Patrick Devaney
Initializing a Hyperledger Fabric Blockchain with Docker and Ubuntu
Patrick Devaney
Finetune LLaMa 7b on RTX 3090 GPU - Tutorial
Patrick Devaney
Local InstantMesh Tiger
Patrick Devaney
groq swarms demo
Patrick Devaney
Rustifying My Repo With Swarms
Patrick Devaney
AI Agents Improve Your Code Step-by-Step | Groq + Gradio Demo
Patrick Devaney
Code NYC Demo
Patrick Devaney
DeepCamp AI