Sign In
Learn bits
Science & Tech.
Mahesh

12/04/24 06:04 AM IST

OpenAI’s GPT-4 Vision

In News
  • Chat-GPT can also create images from natural language prompts, thanks to the integration of DALL-E.
GPT-4 vision
  • GPT-4 with Vision, also referred to as GPT-4V, allows users to instruct GPT-4 to analyse image inputs.
  • Incorporating additional modalities (such as image inputs) into large language models (LLMs) is viewed by some as a key frontier in artificial intelligence research and development.
  • GPT-4 Vision has been considered OpenAI’s step forward towards making its chatbot multimodal — an AI model with a combination of image, text, and audio as inputs.
  • It allows users to upload an image as input and ask a question about it.
  • This task is known as visual question answering (VQA). GPT-4 Vision is a Large Multimodal Model or LMM, which is essentially a model that is capable of taking information in multiple modalities like text and images or text and audio and generating responses based on it.
  • It is not the first and only LMM.
  • There are many others such as CogVLM, LLaVA, Kosmos-2, etc. LMMs are also known as Multimodal Large Language Models (MLLMs).
Benefits
  • GPT-4 Vision has some groundbreaking capabilities such as processing visual content including photographs, screenshots, and documents.
  • The latest iteration allows it to perform a slew of tasks such as identifying objects within images, and interpreting and analysing data displayed in graphs, charts, and other visualisations.
  • GPT-4 Vision can also interpret handwritten and printed text contained within images.
  • This is a significant leap in AI as it, in a way, bridges the gap between visual understanding and textual analysis.
  • The model is capable of taking from a design on paper and creating code for a website.
  • Data interpretation is another key area where the model can work wonders as the model lets one unlock insights based on visuals and graphics.
Limitations
  • GPT-4 Vision also continues to reinforce social bias and worldviews, according to its maker.
  • The model has been trained to avoid identifying specific individuals in images which OpenAI calls ‘refusal’ behaviour by design.
  • The company has advised against its use for tasks that require precise scientific, medical, or sensitive content analysis due to its limitations and inconsistencies.
Source- Indian Express

More Related Current Affairs View All

21 Sep

India Achieves Tier 1 Status in Global Cybersecurity Index 2024

' India has secured Tier 1 status in the Global Cybersecurity Index (GCI) 2024, published by the International Telecommunication Union (ITU).' The GCI is a comprehensive assessm

Read More

21 Sep

A new White Revolution

'Operation Flood, launched in 1970, ushered in the White Revolution and transformed the dairy sector in India.' Dairy cooperatives procured 660 lakh kg of milk per day in 2023-2

Read More

21 Sep

Changes in Canada’s international work permit system

'Canadian Prime Minister Justin Trudeau announced changes to the country’s international work permit system, aiming to reduce the number of immigrant workers in Canada.'

Read More

India’s First Ai-Driven Magazine Generator

Generate Your Custom Current Affairs Magazine using our AI in just 3 steps