In recent years, artificial intelligence (AI) researchers have been developing and refining large language models (LLMs) that exhibit remarkable capabilities across a variety of domains and tasks. The latest model developed by OpenAI, GPT-4, was trained using an unprecedented scale of compute and data. In this paper, Microsoft researchers report on their investigation of an early version of GPT-4 when it was still in active development by OpenAI. They contend that this early version of GPT-4 is part of a new cohort of LLMs that exhibit more general intelligence than previous AI models. The researchers demonstrate that beyond its mastery of language, GPT-4 can solve novel and difficult tasks that span mathematics, coding, vision, medicine, law, psychology and more without needing any special prompting. Moreover, in all these tasks, GPT-4's performance is strikingly close to human-level performance and often vastly surpasses prior models such as ChatGPT. Given the breadth and depth of GPT-4's capabilities, the researchers believe it could reasonably be viewed as an early yet incomplete version of an artificial general intelligence (AGI) system. However, the researchers also put special emphasis on discovering the limitations of GPT-4 and discuss the challenges ahead for advancing towards deeper and more comprehensive versions of AGI. They note that current metrics fail to capture semantic similarities within statements which results in metrics such as ROUGE determining the GPT-4 generated answer to be a mismatch despite containing relevant information. Furthermore, they explore examples where the model lacks planning abilities in text generation under constraints such as generating rhymes or prescribing specific words or letters in each sentence. Despite these limitations, the researchers reflect on societal influences from this technological leap and future research directions towards AGI systems beyond next-word prediction paradigms.

• - Artificial intelligence (AI) researchers have been developing and refining large language models (LLMs) that exhibit remarkable capabilities across a variety of domains and tasks.
• - OpenAI's latest model, GPT-4, was trained using an unprecedented scale of compute and data.
• - Microsoft researchers investigated an early version of GPT-4 when it was still in active development by OpenAI.
• - This early version of GPT-4 is part of a new cohort of LLMs that exhibit more general intelligence than previous AI models.
• - Beyond its mastery of language, GPT-4 can solve novel and difficult tasks that span mathematics, coding, vision, medicine, law, psychology and more without needing any special prompting.
• - In all these tasks, GPT-4's performance is strikingly close to human-level performance and often vastly surpasses prior models such as ChatGPT.
• - The researchers believe it could reasonably be viewed as an early yet incomplete version of an artificial general intelligence (AGI) system.
• - Current metrics fail to capture semantic similarities within statements which results in metrics such as ROUGE determining the GPT-4 generated answer to be a mismatch despite containing relevant information.
• - The model lacks planning abilities in text generation under constraints such as generating rhymes or prescribing specific words or letters in each sentence.
• - Future research directions towards AGI systems beyond next-word prediction paradigms are discussed.

1. Scientists have been working on making computers that can understand and use language really well. 2. A new computer program called GPT-4 is really good at understanding language and can also do other things like math, medicine, and law. 3. It's almost as good as humans at these tasks! 4. Some people think this program could be the start of a type of computer that can do many different things like a human (called artificial general intelligence). 5. There are still some things the program can't do, like make up rhymes or choose specific words.

Exploring GPT-4: An Early Version of Artificial General Intelligence

"In recent years, artificial intelligence (AI) researchers have been developing and refining large language models (LLMs) that exhibit remarkable capabilities across a variety of domains and tasks. The latest model developed by OpenAI, GPT-4, was trained using an unprecedented scale of compute and data. "

Microsoft researchers recently reported on their investigation of an early version of GPT-4 when it was still in active development by OpenAI. They contend that this early version is part of a new cohort of LLMs that exhibit more general intelligence than previous AI models. The researchers demonstrate that beyond its mastery of language, GPT-4 can solve novel and difficult tasks that span mathematics, coding, vision, medicine, law, psychology and more without needing any special prompting.

Moreover, in all these tasks the performance is strikingly close to human level performance and often vastly surpasses prior models such as ChatGPT. Given the breadth and depth of GPT-4's capabilities the researchers believe it could reasonably be viewed as an early yet incomplete version of an artificial general intelligence (AGI) system.

Limitations Of Current Metrics

The Microsoft research team put special emphasis on discovering the limitations with current metrics which fail to capture semantic similarities within statements.