HEIR is an open-source compiler in Google's Private Computing Toolkit that enables cryptographically-secure private AI inference using homomorphic encryption. This tool addresses the balance between privacy and security in AI applications.

Darkbloom is a decentralized inference network that utilizes idle Apple Silicon machines for private AI inference. It offers OpenAI-compatible APIs and can reduce costs by up to 70% compared to centralized alternatives while ensuring that operators cannot observe inference data.