Artificial Intelligence (AI) refers to the ability of computer systems to mimic human intelligence and also to the development of such systems.
Expert Systems use rules and logic to anticipate a wide range of possible scenarios.
Machine Learning uses probability and statistics to recognize patterns and generalize. Neural Networks are computing systems modeled like the neural connections in the human brain.
Foundational Models are deep neural networks trained with a large data set using machine learning techniques that mimic human trial and error.
Large Language Models (LLMs) are foundational models focused on language.
GPT stands for Generative Pre- trained Transformers. Foundational models and LLMs all use GPT architecture; it is not unique to OpenAI or ChatGPT.
Diffusion Models are a type of foundational model used to create images and video. Tools like DALL- E, Stable Diffusion, Midjourney are trained by adding noise to the training data which the model learns to remove.
Natural Language Processing (NLP) is a field of AI and linguistics that aims to enable machines to understand, interpret AI Basics and create human language. They are essential for search engines and analyzing your social media content. LLMs use NLP to train deep neural networks but LLMs are also used in NLP applications.
Parameters are internal variables in a neural network that can be tuned or adjusted to change the output.
Tokens are the representations of words, parts of words, characters, or punctuation in code and are a focus of NLP.
Transformers (or “self-attention”) provide every token with a weight that allows tokens to be compared to any other token simultaneously.
An Application Programming Interface (API) is a set of tools for building software applications that can interact with a foundation model. Most of the AI tools and products we are using are not LLMs themselves but are powered by under lying LLMs.
Fine-tuning is the process of customizing pre- trained foundational models (using an API) to do specific tasks. There is an ambiguity here, but for most people it is prob ably close enough to think of ChatGPT as fine- tuned or powered by GPT, and not its own LLM (Google’s Bard has a similar relationship to Gemini).
Generative Artificial Intelligence (GAI) is any type of AI that uses deep learning models to generate or create new content. LLMs and Diffusion Models are both examples of GAI.
Artificial General Intelligence (AGI) is the computer science holy grail that someday an AI will be able to think, make decisions and even feel like humans can. It’s basically a person.
Bowen, JoseĢ Antonio, and C. Edward Watson. Teaching with AI : A Practical Guide to a New Era of Human Learning. Johns Hopkins University Press, 2024
