RAG latency becomes noticeable when retrieval and generation are both added to the path without much optimization. What seemed acceptable in a prototy…