How similar is similar enough? Semantic Caching for GenAI solutions
Now the general idea of your GenAI project is working. You get good results. People start using it. Everything’s fine. Now you look at the AWS bill. And you realize that Bedrock does not come for free. Bedrock caching also does not come for free and can be quite expensive, so sometimes semantic caching is a way to shrink your bill.