May 15, 2024
All of the LLM based options seem nice at First, but if you build a Customer facing product, you do Not have the Freedom to use a LLM twice for a Single query. That is just way too Slow and also doubles, Tripels the Price of that query, which makes it useless.