Artificial Intelligence

gpt3-ai-model

How GPT-3 is Revolutionizing Artificial Intelligence

GPT-3 has been created by OpenAI, a research business co-founded by Elon Musk, and has been described as the most important and useful advance in AI for years.

Advanced AI: Deep Reinforcement Learning

But there’s some confusion over exactly what it does (and indeed doesn’t do), so here I will try and break it down into simple terms for any non-techy readers interested in understanding the fundamental principles behind it. I’ll also cover some of the problems it raises, as well as why some people think its significance has been overinflated somewhat by hype.

What is GPT-3?
Starting with the very basics, GPT-3 stands for Generative Pre-trained Transformer 3 – it’s the third version of the tool to be released.

In short, this means that it generates text using algorithms that are pre-trained – they’ve already been fed all of the data they need to carry out their task. Specifically, they’ve been fed around 570gb of text information gathered by crawling the internet (a publicly available dataset known as CommonCrawl) along with other texts selected by OpenAI, including the text of Wikipedia.

If you ask it a question, you would expect the most useful response would be an answer. If you ask it to carry out a task such as creating a summary or writing a poem, you will get a summary or a poem.

More technically, it has also been described as the largest artificial neural network every created – I will cover that further down.

nlp-nural-language-processor

What can GPT-3 do?
GPT-3 can create anything that has a language structure – which means it can answer questions, write essays, summarize long texts, translate languages, take memos, and even create computer code.

In fact, in one demo available online, it is shown creating an app that looks and functions similarly to the Instagram application, using a plugin for the software tool Figma, which is widely used for app design.

This is, of course, pretty revolutionary, and if it proves to be usable and useful in the long-term, it could have huge implications for the way software and apps are developed in the future.

As the code itself isn’t available to the public yet (more on that later), access is only available to selected developers through an API maintained by OpenAI. Since the API was made available in June this year, examples have emerged of poetry, prose, news reports, and creative fiction.

This article is particularly interesting – where you can see GPT-3 making a – quite persuasive – attempt at convincing us humans that it doesn’t mean any harm. Although its robotic honesty means it is forced to admit that “I know that I will not be able to avoid destroying humankind,” if evil people make it do so!

How does GPT-3 work?
In terms of where it fits within the general categories of AI applications, GPT-3 is a language prediction model. This means that it is an algorithmic structure designed to take one piece of language (an input) and transform it into what it predicts is the most useful following piece of language for the user.

It can do this thanks to the training analysis it has carried out on the vast body of text used to “pre-train” it. Unlike other algorithms that, in their raw state, have not been trained, OpenAI has already expended the huge amount of compute resources necessary for GPT-3 to understand how languages work and are structured. The compute time necessary to achieve this is said to have cost OpenAI $4.6 million.

To learn how to build language constructs, such as sentences, it employs semantic analytics – studying not just the words and their meanings, but also gathering an understanding of how the usage of words differs depending on other words also used in the text.

It’s also a form of machine learning termed unsupervised learning because the training data does not include any information on what is a “right” or “wrong” response, as is the case with supervised learning. All of the information it needs to calculate the probability that it’s output will be what the user needs is gathered from the training texts themselves.

This is done by studying the usage of words and sentences, then taking them apart and attempting to rebuild them itself.

For example, during training, the algorithms may encounter the phrase “the house has a red door.” It is then given the phrase again, but with a word missing – such as “the house has a red X.”

It then scans all of the text in its training data – hundreds of billions of words, arranged into meaningful language – and determines what word it should use to recreate the original phrase.

gps-tracker-course

To start with, it will probably get it wrong – potentially millions of times. But eventually, it will come up with the right word. By checking its original input data, it will know it has the correct output, and “weight” is assigned to the algorithm process that provided the correct answer. This means that it gradually “learns” what methods are most likely to come up with the correct response in the future.

The scale of this dynamic “weighting” process is what makes GPT-3 the largest artificial neural network ever created. It has been pointed out that in some ways, what it does is nothing that new, as transformer models of language prediction have been around for many years. However, the number of weights the algorithm dynamically holds in its memory and uses to process each query is 175 billion – ten times more than its closest rival, produced by Nvidia. Read More at: (source:https://www.forbes.com/sites/bernardmarr/2020/10/05/what-is-gpt-3-and-why-is-it-revolutionizing-artificial-intelligence/#783916b7481a)

RAISE-2020-Summit

The Responsible AI for Social Empowerment (RAISE 2020) virtual summit

RAISE 2020 (Responsible AI for Social Empowerment) Artificial Intelligence Summit: Key Facts

 

Advanced AI: Deep Reinforcement Learning

PM Modi to inaugurate the Global Virtual Summit on Artificial Intelligence on October 5, 2020. The summit is organized by the Government of India in partnership with academia and industry. The summit aims to transform education, health, and agricultural areas.

In the history of human civilization, Artificial Intelligence is considered to be the next giant technological leap similar to electricity and the internet. With AI possessing the power to radically transform the economic and social fabric of the world we live in, it’s time to ask, how can we use AI responsibly for the good of humanity and for inclusive socio-economic development? The Responsible AI for Social Empowerment (RAISE 2020) virtual summit will be a Global Artificial Intelligence summit

RAISE is Responsible AI for Social Empowerment, 2020.

Highlights of the Summit: In June 2020, India joined the Global Partnership on Artificial Intelligence along with US, Australia, UK, France, Germany, and Canada.
Global Partnership on Artificial Intelligence: India is a founding member of GPAI. It supports human centric and responsible development and use of AI. In June 2020, the initiative was hosted by OECD (Organization for Economic Cooperation and Development) in Paris.

Google-AI-ML

The initiative will bridge the gap between theory and practice of Artificial Intelligence. This is to be done by supporting research and applied activities related to AI. The GPAI will bring together international organizations and partners from civil societies, academia and society to promote responsible evolution of AI.

Artificial Intelligence: AI is a branch of Computer Science that is concerned in making computers behave like humans. The technology provides ability to the machines to perform tasks such as perceiving, thinking, learning and problem solving.

Past
In June 2020, India joined the Global Partnership on Artificial Intelligence along with US, Australia, UK, France, Germany, and Canada.

Key Features of the Summit

The summit is held to exchange ideas of Artificial Intelligence for inclusion, social empowerment, transformation in key areas such as agriculture, health care, education, and smart mobility.
It calls for global participation in government representatives, academia, and opinion-makers.
The summit aims to encourage discussion on public infrastructure, transform society and build responsible Artificial Intelligence for social empowerment.
More than 38,700 stakeholders have registered for the summit from 125 countries
The summit will add 957 billion USD to the Indian economy by 2035.
The summit will discuss on education and awareness for responsible AI impact of data and AI in smart cities, leveraging AI for pandemic preparedness, role of data governance in enabling AI, building a future-ready Agricultural Supply Chain, and the role of data for responsible AI.
Global Partnership on Artificial Intelligence
India is a founding member of GPAI. It supports human-centric and responsible development and use of AI. In June 2020, the initiative was hosted by OECD (Organization for Economic Cooperation and Development) in Paris.

Alexa-course

The initiative will bridge the gap between theory and practice of Artificial Intelligence. This is to be done by supporting research and applied activities related to AI. The GPAI will bring together international organizations and partners from civil societies, academia, and society to promote the responsible evolution of AI.

About Artificial Intelligence Course

This course will introduce you to the potential of machine learning and help you reflect on how you can use it responsibly to enhance your journalism. Machine learning (ML) already powers many products we use every day. However, it is not always apparent to us that ML is behind them.