304·
15 days agoWho cares?
- 0 Posts
- 6 Comments
Joined 3 years ago
Cake day: August 4th, 2023
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
“Comic Strips”
LLMs are limited by memory bandwidth much more then calculating power. You need HBM. Dedicated accelerators only lower power usage.
Don’t forget Mesa, the userspace part of graphics drivers. Also versions freely changeable.
Just tried it, it’s as great as it sounds!