Overfitting issues in finetuning GPT 3.5 turbo

CAn you let me know that which type of training are you donig like r you taking samples and making batches or you are training in continuous manner means like you have a huge text corpus and you are sliding on that and taking Batch size x maxlen tokens and reshaping it?