New Mozilla AI project. Put “trust” and “privacy” in the title and subtile but doesn’t support locally hosted model.

Exists as an add-on today. Model is Mistral 7B hosted by Mozilla in GCP. Claims won’t save data long term. Promises won’t use personal information to train models and not share queries with Mistral or any other services.

Am I going to use it? No. Not without local model supported.

Note: the mobile version of the page is broken (lack of many content). Best to view the desktop version for complete details.

    • kate@lemmy.uhhoh.comEnglish
      1·
      12 hours ago

      Consumer-ish. I can run it on my MacBook Pro, any 8GB VRAM nvidia card should be able to run it. Technically, any machine with 8GB system memory if you’re willing to run it really slowly

    • umami_wasabi@lemmy.mlOPEnglish
      1·
      1 day ago

      Yes. Depends on the actual hardware, parameters used, and model quantization, you can get 2~10 tok/s.