GRACE-HOPPER-Superchip

Retrieval-augmented generation (RAG) connects large language models (LLMs) with knowledge bases to improve model accuracy. RAG requires embeddings to be generated and vector searches to be executed at scale. The 72 power-efficient Arm-based Grace CPU cores accelerate preprocessing of the knowledge base data, and NVLink-C2C speeds up trans…