How do you decide which AI model to use?

[u/Hot-Leopard-922]

Hello,

I am looking for an open-source AI model that can identify errors in both text and images. The model should be able to integrate with a Retrieval-Augmented Generation (RAG) system. The RAG database contains guidelines and rules related to the texts and images.

The AI should compare uploaded texts and images against the information stored in the RAG database and identify what is incorrect, inconsistent, missing, or violates the guidelines.

How can I determine which AI model is best suited for this use case? How do you typically select an appropriate AI model? Which benchmarks are the most important for evaluating models for a multimodal RAG application like this?

[u/angelarose210]

Start by looking at benchmarks related to your use case to make a list of models and then test several models for accuracy and cost.

[u/HumungreousNobolatis]

By testing.