This post is co-written with Justin Miles, Liv d’Aliberti, and Joe Kovba from Leidos. Leidos is a Fortune 500 science and technology solutions leader working to address some of the world’s toughest challenges in the defense, intelligence, homeland security, civil, and healthcare markets. In this post, we discuss how Leidos worked with AWS to develop an […]
Originally appeared here:
Large language model inference over confidential data using AWS Nitro Enclaves