Looking for curriculum plans for to take a model from initialization to check GPT 5 capability

Welcome to the forum!

This sounds interesting, but I think it would help if you clarified what model and training setup you are using. The title mentions GPT-5 capability, the tags include GPT-4, but the post sounds like you are training a small local language model.

Since advice can change a lot depending on the base model, model size, training method and dataset type, could you share a bit more about those?

I don’t want to pretend expertise without enough context, but narrowing that down would probably help others give more useful advice.