The Grounding LMM (GLaMM) addresses shortcomings in existing models by enabling natural language responses integrated with object segmentation masks, facilitating visually grounded interactions.
GLaMM comprises five core components—Global Image Encoder, Region Encoder, LLM, Grounding Image Encoder, and Pixel Decoder—designed to support multiple levels of textual and visual interactions.
Collection
[
|
...
]