Sign In
Learn bits
Science & Tech.
Mahesh

12/04/24 06:04 AM IST

OpenAI’s GPT-4 Vision

In News
  • Chat-GPT can also create images from natural language prompts, thanks to the integration of DALL-E.
GPT-4 vision
  • GPT-4 with Vision, also referred to as GPT-4V, allows users to instruct GPT-4 to analyse image inputs.
  • Incorporating additional modalities (such as image inputs) into large language models (LLMs) is viewed by some as a key frontier in artificial intelligence research and development.
  • GPT-4 Vision has been considered OpenAI’s step forward towards making its chatbot multimodal — an AI model with a combination of image, text, and audio as inputs.
  • It allows users to upload an image as input and ask a question about it.
  • This task is known as visual question answering (VQA). GPT-4 Vision is a Large Multimodal Model or LMM, which is essentially a model that is capable of taking information in multiple modalities like text and images or text and audio and generating responses based on it.
  • It is not the first and only LMM.
  • There are many others such as CogVLM, LLaVA, Kosmos-2, etc. LMMs are also known as Multimodal Large Language Models (MLLMs).
Benefits
  • GPT-4 Vision has some groundbreaking capabilities such as processing visual content including photographs, screenshots, and documents.
  • The latest iteration allows it to perform a slew of tasks such as identifying objects within images, and interpreting and analysing data displayed in graphs, charts, and other visualisations.
  • GPT-4 Vision can also interpret handwritten and printed text contained within images.
  • This is a significant leap in AI as it, in a way, bridges the gap between visual understanding and textual analysis.
  • The model is capable of taking from a design on paper and creating code for a website.
  • Data interpretation is another key area where the model can work wonders as the model lets one unlock insights based on visuals and graphics.
Limitations
  • GPT-4 Vision also continues to reinforce social bias and worldviews, according to its maker.
  • The model has been trained to avoid identifying specific individuals in images which OpenAI calls ‘refusal’ behaviour by design.
  • The company has advised against its use for tasks that require precise scientific, medical, or sensitive content analysis due to its limitations and inconsistencies.
Source- Indian Express

More Related Current Affairs View All

10 Jan

Rural landowners in Delhi want repeal of Sections 33 and 81 of Delhi Land Reforms Act

'Both sections dealing with the use and sale of agricultural land have come under the spotlight ahead of the Delhi Assembly elections.' This can only be done by the Central gove

Read More

10 Jan

Pravasi Bharatiya Diwas

'Prime Minister Narendra Modi inaugurated the 18th edition of the Pravasi Bharatiya Diwas  in Bhubaneswar.' The event is held once every two years to “honour the cont

Read More

10 Jan

Deciphering the Indus script

'Recently, Tamil Nadu Chief Minister M.K. Stalin announced a $1-million prize for experts or organisations in the event of their success in deciphering the scripts of the Indus Val

Read More

India’s First Ai-Driven Magazine Generator

Generate Your Custom Current Affairs Magazine using our AI in just 3 steps