Google’s HEIR compiler aims to make encrypted AI inference a practical option—running recommendation, fraud, intrusion, and hotword models on ciphertext so the server never needs the plaintext.

Homomorphic Encryption Is Getting Practical Enough for AI

VaultSort Guardian uses on-device AI to find sensitive files sitting where they should not—arguing that narrow, local, read-only AI that discovers exposure without uploading or rewriting anything is the kind of utility worth wanting.

A Practical Use for Private, Local AI

Petals distributes enormous language-model layers across volunteer peers so people can run Llama, Mixtral, Falcon, and BLOOM without hundreds of gigabytes of local GPU memory—arguing the idea is fascinating, but public swarms need much stronger privacy and trust before carrying anything sensitive.

Topics · private ai

Notes and reading tagged private ai

Homomorphic Encryption Is Getting Practical Enough for AI

A Practical Use for Private, Local AI

A BitTorrent Swarm for Large Language Models

Related topics