Ask HN：AWS Bedrock 上 OpenAI 推理速度缓慢
2 分•作者: timedude•8 天前
过去几天，在 AWS Bedrock 上使用 OpenAI 模型进行推理一直非常缓慢且不稳定，今天更是如此。首次获取 token 的延迟非常长，超过 5 分钟。这是怎么回事？
查看原文
Inference on AWS Bedrock for OpenAI models has been very slow and glitchy the last few days with today being the worst. Very long latency of over 5 minutes to first token. What's going on?