4·
2 years agoJust beware that like AMD, Intel GPUs suffer a performance hit when using LLMs because of the CUDA specific optimizations in frameworks like llama.cpp
- 0 Posts
- 3 Comments
Joined 3 years ago
Cake day: August 10th, 2023
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
I’ve heard good things about Instander, but it may not satisfy all the requirements of an alternative frontend.
Do you have any tips (or examples) using quadlets? I tried using them but I couldn’t wrap my head around them.