Btw, Ollama is a software to run AI models. Deepseek is just a company. Or a model file or a service. But that’s not what OP is looking for. They want to run a model. And that needs software like Ollama.
hendrik
A software developer and Linux nerd, living in Germany. I’m usually a chill dude but my online persona doesn’t always reflect my true personality. Take what I say with a grain of salt, I usually try to be nice and give good advice, though.
I’m into Free Software, selfhosting, microcontrollers and electronics, freedom, privacy and the usual stuff. And a few select other random things, too.
- 0 Posts
- 3 Comments
Joined 8 months ago
Cake day: June 25th, 2024
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
0·3 days agoBtw, can anyone explain what piracy in 3D printing is about? Is this about some proprietary and costly replacement parts for a specific use? Or Patreon art/designs by independent creators? And what’s Materize? Some underground platform?
I’m also aware of LocalAI with automatic model swapping and OpenAI compatible API.
But unless I’m mistaken, they all use ggml behind the scenes? So you might want to look for something that uses vllm or exllama or something if you want a completely different backend.