The configuration requirements for deploying Deepseek locally on the PC side are that you can run without a graphics card and large memory
Configuration and model relationships
hardware type
memory capacity
Model recommendation
Mixed reasoning (available memory + minimum memory capacity)
supplementary note
CPU
8B Q4
4G
The CPU supports the AVX512 instruction set,
CPU inference speed can be 30% to 40% faster
GPU
4G
8B Q4
32B Q2
4G
8G
GPU
6G
8B Q4
32B Q2
4G
8G
GPU
8G
32B Q4
16G
GPU
12G
32B Q4
16G
GPU
16G
32B Q4
16G
GPU
24G
32B Q4
32B Q8
16G
32G
GPU
40G
70B Q4
35G
延伸阅读:
暂无内容!