Fine-Tuning an SLM for a Low-Resource Language

Hello, I am fine-tuning an SLM for an AI festival. I am aiming to make the model stronger in a specific language. Unfortunately, there are not many fine-tuning-ready datasets for the language I’m aiming for, and because of my hardware limitations and internet restrictions, I cannot continue pretraining the model. I wanted to ask two things: Can I use LoRA to simulate continued pretraining? And how can I build a QA dataset from raw Wikipedia dumps?