github-mirror/project-nomad
1
0
Fork 0
mirror of https://github.com/Crosstalk-Solutions/project-nomad.git synced 2026-10-17 05:14:19 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity Graph

Merge b794b103e8 into 54ee30a449

Browse Source
This commit is contained in:
Md Tasnimul Hoque 2026-10-09 18:14:30 +00:00 committed by GitHub
commit 932aac834b
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
admin/docs/faq.md
View File

@ -38,9 +38,7 @@ defensive one.
**The AI is the variable, and it is the model rather than NOMAD.** Ollama idles at
roughly 1.2GB, and a model needs about its download size resident while it answers,
so an 8B model at ~4.6GB wants about that much on top. **8GB is workable for a small
model, 16GB is comfortable, and 32GB is the recommendation if you want to run larger
ones.**
so an 8B model at ~4.6GB wants about that much on top. **8GB is workable for a small model, 16GB is comfortable, and 32GB is the recommendation if you want to run larger ones.**
Where that memory comes from depends on your hardware. With a discrete GPU the model
loads into VRAM and never touches system RAM, so VRAM is the number that limits which