Social Media is abuzz with the capabilities of ChatGPT released by OpenAI last week. In fact, the usage of ChatGPT became so popular that OpenAI had to increase the capacity allocated to this service. Praise for ChatGPT has ranged from users mentioning that ChatGPT could replace Google Search to people wondering how could academic essays ever be graded anymore after the advent of services like ChatGPT. Many people have compared academic articles written by them many years ago to the output from ChatGPT and have found the output from ChatGPT superior.
So what’s ChatGPT?
Natural Language Models such as GPT-3 which we had written about in a previous post write sentences by filling in the best possible tokens based on an originating paragraph of text. You can think of them as engines that fill in the blanks with the most appropriate set of words. However, GPT-3 has been shown to have two main limitations: i) It lacks memory, and so you cannot ask it to give alternate explanations to questi…