How do I choose the right model for my use case?

Well you first need to know what hardware you will run your models on for local usage. Onec you know what your hardware will support then you can look into models that fit your use case.