Azure DataCenter
Timespan
explore our new search
What is ChatGPT?
M365 All about AI
Mar 7, 2023 7:00 AM

What is ChatGPT?

by HubSite 365 about John Savill's [MVP]

Principal Cloud Solutions Architect

External YouTube Channel
Administrator

M365 All about AIM365 Hot News

Looking at what machine learning is, what neural networks are, what GPT is and then how that all plays into ChatGPT!

Looking at what machine learning is, what neural networks are, what GPT is and then how that all plays into ChatGPT! Looking for content on a particular topic? Search the channel. If I have something it will be there!

In this Video

  • 0:00 - Introduction
  • 4:29 - History and training
  • 8:55 - Machine learning
  • 12:47 - Prediction
  • 14:32 - More complex predictions
  • 17:30 - Making any shape with enough curves combined
  • 24:30 - How to get different curves from one curve
  • 28:23 - Weights and bias
  • 33:33 - Activation functions
  • 40:02 - Back propagation and gradient descent
  • 50:48 - Visualization of layers working together
  • 53:30 - What is GPT
  • 57:39 - Attention
  • 1:00:00 - Tokens
  • 1:02:33 - GPT-2
  • 1:07:22 - GPT-3
  • 1:09:10 - zero, one and few shot
  • 1:10:19 - What was it trained on
  • 1:13:45 - ChatGPT
  • 1:18:40 - Closing thoughts

▬▬▬▬▬▬ K E Y L I N K S 🔗 ▬▬▬▬▬▬

► Whiteboard:

[https://github.com/johnthebrit/RandomStuff/raw/master/Whiteboards/WhatisChatGPT.png]

► ChatGPT site at OpenAI:

🔗 chat.openai.com/chat [https://chat.openai.com/chat]

► Great example video of number recognition:

🔗 youtu.be/Tsvxx-GGlTg [https://youtu.be/Tsvxx-GGlTg]

► OpenAI tokenizer:

🔗 platform.openai.com/tokenizer [https://platform.openai.com/tokenizer]

► GPT 2 paper:

🔗 cdn.openai.com/better-language-models/l

[https://cdn.openai.com/better-language-models/language_models_are_unsupervised_multitask_learners.pdf]

► GPT-3 paper:

🔗 arxiv.org/pdf/2005.14165.pdf [https://arxiv.org/pdf/2005.14165.pdf]

► ChatGPT overview:

🔗 openai.com/blog/chatgpt [https://openai.com/blog/chatgpt]