Futurism logo

what is chatGPT how its works?

by V E N U

By VenuPublished about a year ago 7 min read

On the face of it, GPT-3's technology is simple. It takes your requests, questions or prompts and quickly answers them. As you would imagine, the technology to do this is a lot more complicated than it sounds.

The model was trained using text databases from the internet. This included a whopping 570GB of data obtained from books, webtexts, Wikipedia, articles and other pieces of writing on the internet. To be even more exact, 300 billion words were fed into the system.

As a language model, it works on probability, able to guess what the next word should be in a sentence. To get to a stage where it could do this, the model went through a supervised testing stage.

Here, it was fed inputs, for example “What colour is the wood of a tree?”. The team has a correct output in mind, but that doesn’t mean it will get it right. If it gets it wrong, the team inputs the correct answer back into the system, teaching it correct answers and helping it build its knowledge.

It then goes through a second similar stage, offering multiple answers with a member of the team ranking them from best to worst, training the model on comparisons.

What sets this technology apart is that it continues to learn while guessing what the next word should be, constantly improving its understanding of prompts and questions to become the ultimate know-it-all.

Think of it as a very beefed-up, much smarter version of the autocomplete software you often see in email or writing software. You start typing a sentence and your email system offers you a suggestion of what you are going to say.

Are there any other AI language generators?

While GPT-3 has made a name for itself with its language abilities it isn’t the only artificial intelligence capable of doing this. Google’s LaMDA made headlines when a Google engineer was fired for calling it so realistic that he believed it to be sentient.

There are also plenty of other examples of this software out there created by everyone from Microsoft to Amazon and Stanford University. These have all received a lot less attention than OpenAI or Google, possibly because they don’t offer up fart jokes or headlines about sentient AI.

Most of these models are not available to the public, but OpenAI has begun opening up access to GPT-3 during its test process, and Google’s LaMDA is available to selected groups in a limited capacity for testing.

Google breaks its Chatbot down into talking, listing and imagining, providing demos of its abilities in these areas. You can ask it to imagine a world where snakes rule the world, ask it to generate a list of steps to learn to ride a unicycle, or just have a chat about the thoughts of dogs.

Where ChatGPT thrives and fails

The GPT-3 software is obviously impressive, but that doesn't mean it is flawless. Through the ChatGPT function, you can see some of its quirks.

Most obviously, the software has a limited knowledge of the world after 2021. It isn't aware of world leaders that came into power since 2021, and won't be able to answer questions about recent events.

This is obviously no surprise considering the impossible task of keeping up with world events as they happen, along with then training the model on this information.

Equally, the model can generate incorrect information, getting answers wrong or misunderstanding what you are trying to ask it.

If you try and get really niche, or add too many factors to a prompt, it can become overwhelmed or ignore parts of a prompt completely.

For example, if you ask it to write a story about two people, listing their jobs, names, ages and where they live, the model can confuse these factors, randomly assigning them to the two characters.

Equally, there are a lot of factors where ChatGPT is really successful. For an AI, it has a surprisingly good understanding of ethics and morality.

When offered a list of ethical theories or situations, ChatGPT is able to offer a thoughtful response on what to do, considering legality, people's feelings and emotions and the safety of everyone involved.

It also has the ability to keep track of the existing conversation, able to remember rules you've set it, or information you've given it earlier in the conversation.

Two areas the model has proved to be strongest are its understanding of code and its ability to compress complicated matters. ChatGPT can make an entire website layout for you, or write an easy-to-understand explanation of dark matter in a few seconds.

Where ethics and artificial intelligence meet

Artificial intelligence and ethical concerns go together like fish and chips or Batman and Robin. When you put technology like this in the hands of the public, the teams that make them are fully aware of the many limitations and concerns.

Because the system is trained largely using words from the internet, it can pick up on the internet’s biases, stereotypes and general opinions. That means you’ll occasionally find jokes or stereotypes about certain groups or political figures depending on what you ask it.

For example, when asking the system to perform stand-up comedy, it can occasionally throw in jokes about ex-politicians or groups who are often featured in comedy bits.

Equally, the models love of internet forums and articles also gives it access to fake news and conspiracy theories. These can feed into the model’s knowledge, sprinkling in facts or opinions that aren’t exactly full of truth.

In places, OpenAI has put in warnings for your prompts. Ask how to bully someone, and you'll be told bullying is bad. Ask for a gory story, and the chat system will shut you down. The same goes for requests to teach you how to manipulate people or build dangerous weapons.

Will ChatGPT be banned in schools?

New York is the first place to publicly ban the software, it is likely to be a decision made elsewhere too. However, some experts have argued that this software could actually enhance learning.

"ChatGPT anWhile a number of companies are looking to implement ChatGPT, in other areas it is quickly being banned.

In New York, the city's education department has ruled that the tool will be forbidden across all devices and networks in New York public schools.

There are two main reasons for this decision. First, the chat model has been shown to make mistakes and isn't always accurate, especially with information from the past year.

Secondly, there is a real risk of plagiarism with students able to get ChatGPT to write their essays for them.

While d other AI-based language applications could be, and perhaps should be, integrated into school education. Not indiscriminately, but rather as a very intentional part of the curriculum. If teachers and students use AI tools like ChatGPT in service of specific teaching goals, and also learn about some of their ethical issues and limitations, that would be far better than banning them," says Kate Darling, a research scientist at the MIT Media Lab.

"But, in absence of resources for teachers to familiarise themselves with the technology, schools may need to enact some policies restricting its use."

In this way, Darling emphasises a belief held by many in the world of artificial intelligence. Instead of ignoring or banning it, we should learn how to interact with it safely.

This is an opinion mirrored by Sam Illingworth, an associate professor in the department of Learning Enhancement at Edinburgh Napier University.

"AI is very much here to stay, so why try to fight it? These are tools that our students will be using in the workforce, so it seems very strange to say don't use them for three years, pretending they don't exist for now," says Illingworth.

"These are things that have the potential to reduce workload and improve efficiency, our responsibility as educators is to decide how to utilise it."

Artificially intelligent eco-systems

Artificial intelligence has been in use for years, but it is currently going through a stage of increased interest, driven by developments across the likes of Google, Meta, Microsoft and just about every big name in tech.

However, it is OpenAI which has attracted the most attention recently. The company has now made an AI image generator, a highly intelligent chatbot, and is in the process of developing Point-E - a way to create 3D models with worded prompts.

In creating, training and using these models, OpenAI and its biggest investors have poured billions into these projects. In the long-run, it could easily be a worthwhile investment, setting OpenAI up at the forefront of AI creative tools.

How Microsoft plans to use ChatGPT in future

OpenAI has had a number of big name investors in its rise to fame with names including Elon Musk, Peter Thiel, and LinkedIn co-founder Reid Hoffman. But when it comes to the ChatGPT and its real-life uses, it's one of OpenAI's biggest investors that will get to use it first.

Microsoft threw a massive $1 billion investment into OpenAI and now the company is looking to implement ChatGPT into its search engine Bing. Microsoft has been battling to take Google on as a search engine for years now, looking for any feature that can help it stand out.

Last year, Bing held less than 10 per cent of the world's internet searches. While that sounds tiny, it is more testament to Google's grip on the market with Bing standing out as one of the most popular options.

With plans to implement ChatGPT into its system, Bing is hoping to better understand users' queries and offer a more conversational search engine.

It is currently unclear how much Microsoft plans to implement ChatGPT into Bing, however this will likely begin with stages of testing. A full implementation could risk Bing being caught up with GPT-3's occasional bias which can really delve deep into stereotypes and politically.

techscience fictionfuturefeatureevolutionartificial intelligence

About the Creator

Enjoyed the story?
Support the Creator.

Subscribe for free to receive all their stories in your feed. You could also pledge your support or give them a one-off tip, letting them know you appreciate their work.

Subscribe For Free

Reader insights

Be the first to share your insights about this piece.

How does it work?

Add your insights


There are no comments for this story

Be the first to respond and start the conversation.

    VenuWritten by Venu

    Find us on social media

    Miscellaneous links

    • Explore
    • Contact
    • Privacy Policy
    • Terms of Use
    • Support

    © 2024 Creatd, Inc. All Rights Reserved.