Topicsprivate ai3 items
Google’s HEIR compiler aims to make encrypted AI inference a practical option—running recommendation, fraud, intrusion, and hotword models on ciphertext so the server never needs the plaintext.
Inspired by blog.google · Google
VaultSort Guardian uses on-device AI to find sensitive files sitting where they should not—arguing that narrow, local, read-only AI that discovers exposure without uploading or rewriting anything is the kind of utility worth wanting.
Inspired by vaultsort.com · VaultSort
Petals distributes enormous language-model layers across volunteer peers so people can run Llama, Mixtral, Falcon, and BLOOM without hundreds of gigabytes of local GPU memory—arguing the idea is fascinating, but public swarms need much stronger privacy and trust before carrying anything sensitive.
Inspired by petals.dev · BigScience Workshop
