re latency: yes, latency can get quite high, for large contexts. minutes, 10s of minutes when you try to max out the context.
re latency: yes, latency can get quite high, for large contexts. minutes, 10s of minutes when you try to max out the context.