Sign In
Learn bits
Science & Tech.
Mahesh

12/04/24 06:04 AM IST

OpenAI’s GPT-4 Vision

In News
  • Chat-GPT can also create images from natural language prompts, thanks to the integration of DALL-E.
GPT-4 vision
  • GPT-4 with Vision, also referred to as GPT-4V, allows users to instruct GPT-4 to analyse image inputs.
  • Incorporating additional modalities (such as image inputs) into large language models (LLMs) is viewed by some as a key frontier in artificial intelligence research and development.
  • GPT-4 Vision has been considered OpenAI’s step forward towards making its chatbot multimodal — an AI model with a combination of image, text, and audio as inputs.
  • It allows users to upload an image as input and ask a question about it.
  • This task is known as visual question answering (VQA). GPT-4 Vision is a Large Multimodal Model or LMM, which is essentially a model that is capable of taking information in multiple modalities like text and images or text and audio and generating responses based on it.
  • It is not the first and only LMM.
  • There are many others such as CogVLM, LLaVA, Kosmos-2, etc. LMMs are also known as Multimodal Large Language Models (MLLMs).
Benefits
  • GPT-4 Vision has some groundbreaking capabilities such as processing visual content including photographs, screenshots, and documents.
  • The latest iteration allows it to perform a slew of tasks such as identifying objects within images, and interpreting and analysing data displayed in graphs, charts, and other visualisations.
  • GPT-4 Vision can also interpret handwritten and printed text contained within images.
  • This is a significant leap in AI as it, in a way, bridges the gap between visual understanding and textual analysis.
  • The model is capable of taking from a design on paper and creating code for a website.
  • Data interpretation is another key area where the model can work wonders as the model lets one unlock insights based on visuals and graphics.
Limitations
  • GPT-4 Vision also continues to reinforce social bias and worldviews, according to its maker.
  • The model has been trained to avoid identifying specific individuals in images which OpenAI calls ‘refusal’ behaviour by design.
  • The company has advised against its use for tasks that require precise scientific, medical, or sensitive content analysis due to its limitations and inconsistencies.
Source- Indian Express

More Related Current Affairs View All

20 Feb

The Maharashtra Protection of Interest of Depositors (in Financial Establishments) Act, 1999

'Investors who were defrauded in the Torres Ponzi scam may receive about Rs 40 crore over the next six months.' The Mumbai Police’s Economic Offences Wing (EOW) has begun

Read More

18 Feb

Aravali safari park project

'The Haryana government’s ambitious 3,858 hectare Aravali safari park project spread across Gurugram and Nuh — which was one of the poll promises of the ruling Bharatiy

Read More

17 Feb

President’s rule function

'Recently,  four days after Manipur Chief Minister N. Biren Singh’s resignation, the Union government announced that President’s rule has been implemented in the v

Read More

India’s First Ai-Driven Magazine Generator

Generate Your Custom Current Affairs Magazine using our AI in just 3 steps