I’m experimenting, and like I mentioned before, I’ve hit a pretty hard hardware wall. My current limit is my GPU: an RTX 4090 with 24GB VRAM. That’s fine for running tests on small models, up to around 8B parameters. But the moment you try to scale, things change completely. For what I’m doing...
This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
By continuing to use this site, you are consenting to our use of cookies.