Opensource LLMs for Audio Understanding - British Accents

Hello I’m working on a dataset including audio, transcript, gender, and accent from 120 volunteers with different British accents. I firstly wanted to use ASR to check the ability of models. Then, use audio classification models for accent detection and also fine-tune models. But, I’m also looking for directions with some focus on LLMs. If there is a benchmark of opensource LLMs for audio understanding, then I would appreciate it or if you have any other suggestions for contribution on this dataset. Thanks!