Local AI just leveled up... Llama.cpp vs Ollama

Llama.cpp Web UI + GGUF Setup Walkthrough and Ollama comparisons.
Check out ChatLLM: https://chatllm.abacus.ai/ltf

My USB-C portable hub: https://amzn.to/4kw0hrf
👀 My favorite external drive (dependable): https://amzn.to/3Os9Wi3
👀 Thunderbolt 4 dock: https://amzn.to/3yVRicC

⚡ *Other gear I use:* https://www.amazon.com/shop/alexziskind

▶️ M2 MacBook Air | INSTANTLY connect 4K monitors - https://youtu.be/KLI65HnvNMg
▶️ Unity on Steroids M3 Max and RTX 4090m - https://youtu.be/COpEtHzdPG0
▶️ INSANE Machine Learning on Neural Engine - https://youtu.be/Y2FOUg_jo7k
▶️ Ultimate Web Developer MacBook - https://youtu.be/72fneIUHXyY
▶️ This is what spending more on a MacBook Pro gets you - https://youtu.be/iLHrYuQjKPU

▶️ Apple Silicon and Developers Playlist - https://youtube.com/playlist?list=PLPwbI_iIX3aR88msMh-cHoJiBqS6YMUUH

Developer productivity Playlist - https://www.youtube.com/playlist?list=PLPwbI_iIX3aQCRdFGM7j4TY_7STfv2aXX

— — — — — — — — —

❤️ SUBSCRIBE TO MY YOUTUBE CHANNEL 📺

Click here to subscribe: https://www.youtube.com/@AZisk?sub_confirmation=1

— — — — — — — — —

📱LET'S CONNECT ON SOCIAL MEDIA

ALEX ON TWITTER: https://twitter.com/digitalix

— — — — — — — — —

Join this channel to get access to perks:
https://www.youtube.com/channel/UCajiMK_CY9icRhLepS8_3ug/join


⏱️ Chapters
00:00 – Local LLMs, many stacks
01:05 – Building from source
04:15 – Picking a GGUF model
07:56 – New Llama.cpp Web UI
09:06 – Ollama UI & speed check
10:44 – Ollama’s concurrency limit
11:48 – Llama.cpp parallel chats

#llm #llamacpp #macbook