feat: add cache_control
filter to support prompt caching in Anthropic
#137
Job | Run time |
---|---|
39s | |
31s | |
2m 17s | |
2m 13s | |
28s | |
54s | |
7m 2s |
cache_control
filter to support prompt caching in Anthropic
#137
Job | Run time |
---|---|
39s | |
31s | |
2m 17s | |
2m 13s | |
28s | |
54s | |
7m 2s |