SuspciousCarrot78@lemmy.world to LocalLLaMA@sh.itjust.worksEnglish · edit-23 months agoMost AI tools try to replace your thinking. I built one that doesn'tcodeberg.orgexternal-linkmessage-square20linkfedilinkarrow-up172arrow-down18file-textcross-posted to: privacy@lemmy.mlprivacy@lemmy.ml
arrow-up164arrow-down1external-linkMost AI tools try to replace your thinking. I built one that doesn'tcodeberg.orgSuspciousCarrot78@lemmy.world to LocalLLaMA@sh.itjust.worksEnglish · edit-23 months agomessage-square20linkfedilinkfile-textcross-posted to: privacy@lemmy.mlprivacy@lemmy.ml
minus-squaremuzzle@lemmy.ziplinkfedilinkEnglisharrow-up2·4 months agoI am waiting for the day when you can run this kind of models directly on the phone.
minus-squareSuspciousCarrot78@lemmy.worldOPlinkfedilinkEnglisharrow-up4·edit-23 months ago[deleted by user]
minus-squaremuzzle@lemmy.ziplinkfedilinkEnglisharrow-up1·4 months agoUnfortunately i need to use android.
minus-squareNebLem@lemmy.worldlinkfedilinkEnglisharrow-up3·4 months agoTermux + CPU inference +llamacpp can get ~4B models running, even if slowly, on 5 year old flagship phones.
minus-squaremuzzle@lemmy.ziplinkfedilinkEnglisharrow-up2·4 months agoI’m experimenting with “tool neuron” and “off grid”
minus-squareNebLem@lemmy.worldlinkfedilinkEnglisharrow-up2·4 months agoNeat, cool to see these all-in-one native Android tools get so far.
I am waiting for the day when you can run this kind of models directly on the phone.
[deleted by user]
Unfortunately i need to use android.
Termux + CPU inference +llamacpp can get ~4B models running, even if slowly, on 5 year old flagship phones.
I’m experimenting with “tool neuron” and “off grid”
Neat, cool to see these all-in-one native Android tools get so far.