Sign In
Learn bits
Science & Tech.
Mahesh

13/03/24 10:34 AM IST

Artificial neural network

In News
  • There are three main ways in which ‘machines’ can be classified depending on the way they learn: supervised learning, unsupervised learning, and reinforcement learning.
  • The way in which information flows inside the machine is governed by artificial neural networks (ANNs), the software that ‘animates’ the hardware.
Artificial Nueral networks
  • An ANN comprises computing units, or nodes, connected together in such a way that the whole network learns the way an animal brain does.
  • The nodes mimic neurons and the connections between nodes mimic synapses. Every ANN has two important components: activation functions and weights.
  • The activation function is an algorithm that runs at a node.
  • Its job is to accept the inputs from other nodes to which it is connected and compute an output. The inputs and outputs are in the form of real numbers.
  • The weight refers to the ‘importance’ an activation function gives to a particular input.
  • For example, say there are different nodes to estimate the fur colour, tail length, and dental profile in a given photo of a cat or a dog.
  • All these nodes provide their outputs as inputs to a node responsible for separating ‘cat’ from ‘dog’. This way, the nodes can be ‘taught’ to adjust their outcomes by adjusting the relative weights they assign to different inputs.
  • A node is the ‘site’ of a mathematical function. Put another way, the ANN is like an algorithm that passes information from one activation function to the next in a specific order.
  • The functions modify the information they receive in different ways.
Types of ANNs
  • Transformers are a specialised type of ANN. They are easy to train in parallel, unlike the ANN architectures that preceded it. This is how, for example, ChatGPT could be trained on the entire web.
  • The ANN is broken up into two parts: the encoder and the decoder. Say an ANN is required to recognise the presence of a cat in a photograph.
  • The encoder accepts the photograph, breaks it up into small pieces (say, 10 x 10 pixels), and encodes the visual information as numerical data (e.g. 0s and 1s). The decoder accepts this data and processes the numbers to reconstruct the information content in the photograph.
  • The transformer architecture, originally developed at Google and released in 2017, is designed to maximise the amount of attention an ANN devotes to different parts of the input data. It has better performance as a result.
  • The advent of transformers revolutionised machines’ ability to translate long, complicated sentences.
GPU
  • The GPU is the physical processor that ‘runs’ the ANN. It was originally developed to render graphics for video games.
  • It was better at this task than other processors at the time because it was designed to run computing tasks in parallel. It has been widely adopted since as the basic computing unit for ANNs for the same feature.
Source- The Hindu

More Related Current Affairs View All

21 Sep

India Achieves Tier 1 Status in Global Cybersecurity Index 2024

' India has secured Tier 1 status in the Global Cybersecurity Index (GCI) 2024, published by the International Telecommunication Union (ITU).' The GCI is a comprehensive assessm

Read More

21 Sep

A new White Revolution

'Operation Flood, launched in 1970, ushered in the White Revolution and transformed the dairy sector in India.' Dairy cooperatives procured 660 lakh kg of milk per day in 2023-2

Read More

21 Sep

Changes in Canada’s international work permit system

'Canadian Prime Minister Justin Trudeau announced changes to the country’s international work permit system, aiming to reduce the number of immigrant workers in Canada.'

Read More

India’s First Ai-Driven Magazine Generator

Generate Your Custom Current Affairs Magazine using our AI in just 3 steps