When Private AI Needs to Remember
An assistant processes a conversation inside a trusted execution environment (TEE). The response comes back, the session ends, and the environment disappears. That is a useful model for private inference. It is a poor model for an assistant that is supposed to remember what you said tomorrow. That gap has been on my mind after reading three recent designs: Google’s plan for secure server-side memory, Meta’s Private Processing architecture for AI glasses, and Amazon’s Bee Private Compute paper. Each starts with a different product. All three have to deal with the same fact: a personal assistant needs context that lasts longer than one inference request. ...