• 5 Posts
  • 19 Comments
Joined 6 years ago
cake
Cake day: June 30th, 2020

help-circle








  • FrankLaskey@lemmy.mltoOpen Source@lemmy.mla foos GenAi tool for daily usage
    link
    fedilink
    English
    arrow-up
    2
    arrow-down
    1
    ·
    3 months ago

    I would check out Open WebUI which can be self-hosted via docker etc and configured with any OpenAI compatible endpoint so you can use a service like OpenRouter to run nearly any LLM remotely. Most of the open weights ones like Qwen 3 or Kimi K2 Thinking are great and cost pennies per inquiry and can be configured with Zero Data Retention (ZDR) so your data is not recorded. You could also use something like Ollama to run local LLMs if you want even more privacy and have the hardware (typically a modern Nvidia GPU with at least 16-24 GB of VRAM).









  • The US government’s position on this can be summed up as “massive unaccountable US tech firms having all of your data and manipulating public opinion via their black box algorithms is okay, but Chinese companies doing that is a national security concern”. I call BS. The degree to which China is actually a US adversary is being massively overstated by the US government as they see this as a threat to US geopolitical hegemony and America’s ability to propagandize its own citizens. I have spent some time on RedNote (Xiaohongshu) and all I have seen is friendly cross-cultural exchange and discussion between these supposed ‘adversaries’.