Vector Store API calls returning 504s, 503s, and generally being slow

Hi S_z,

Thank you for such a quick response. I’ll try reducing the page limit and add some back off. Persistence could be an option, but requires significantly more engineering effort and the vector stores are not large. They have, at most, 300 resources.

The idea that listing 300 resources in a vector store is simply too much for the system to handle is laughable. It would be a massive disappointment if this is enough to cause a trillion dollar company’s API to fail.

To clarify, nothing is happening in parallel, I am synchronously running three vector store setups. One of them is empty because it relies on full script completion. For the other two, I have used this code:

const vectorStore = await openai.vectorStores.retrieve(vectorStoreId);
console.dir(vectorStore.file_counts, { depth: null });

To get this output for one that regularly succeeds:

{ in_progress: 0, completed: 172, failed: 0, cancelled: 0, total: 172 }

And this for the other that regularly fails:

{ in_progress: 0, completed: 268, failed: 4, cancelled: 0, total: 272 }

The only obvious difference is the failed count being none zero. Could this be causing the issue?