MemVerge and Micron have an AI solution which aims to boost the performance of LLMs using CXL technology.
Originally appeared here:
Startup claims to boost LLM performance using standard memory instead of GPU HBM — but experts remain unconvinced by the numbers despite promising CXL technology