← Back
Minigpt-4 logo
Chatbots

Minigpt-4

MiniGPT-4 is an open-source vision-language model aligning a visual encoder with advanced LLMs for multimodal understanding.

chatbot-multimodal
Website

Pricing plans

Activity on Konsenso

0 Visits (30d)
4 Outbound clicks (30d)
0 Likes

Active coupons

This tool has no active coupons right now.

What's included

MiniGPT-4 is an open-source multimodal artificial intelligence system that aligns an advanced vision encoder with a large language model to achieve deep visual and linguistic reasoning. Developed by researchers at KAUST, the architecture links a frozen BLIP-2 visual backbone with the Vicuna language model through a single linear projection layer. The model exhibits advanced vision-language capabilities, including generating rich image descriptions, explaining visual jokes and memes, analyzing diagrams, and writing webpage code directly from hand-drawn sketches. It can also produce culinary recipes from photos of ingredients and compose creative text conditioned on visual inputs. The platform is designed for artificial intelligence researchers, computer vision engineers, academic teams, and open-source developers. Its distribution model is open source and completely free to inspect, run, and modify under an open license.