paul arssov
Jan 26, 2024

--

If the system has 8gb it is not possible to create more dram memory. What is happening is that the system is creating virtual memory on the disk of the device. The system has most likely fast/large ssd. But this is slower than having the model loaded in actual dram memory.

--

--

paul arssov
paul arssov

Written by paul arssov

Creating the decentralized web — https://decentralizeweb.org, building a decentralized communication platform

No responses yet