George RowlandsDigital GardenDigital GardenContactContact (opens in a new tab)
GitHubGitHub (opens in a new tab)
  • My Digital Garden
      • Analysis of Algorithms
      • What is NP-Hard?
      • Collections
      • Bags
      • Sets
      • Linked Lists
      • Queues
      • Stacks
      • Hash Tables
        • Introduction to DP
        • Subset Sum Problem
        • Knapsack Problem
        • Longest Common Subsequence
        • Longest Increasing Subsequence
        • Coins in a Line
        • General Definition
        • Multirelational Graphs
        • Storing Graphs
        • Graph Traversal
        • Network Reduction
        • Centrality
        • Communities
        • Connectivity
        • Statistics with Graphs
        • Link Prediction
        • Topological Sort/Ordering
        • Shortest Path
        • Eulerian path
        • Node Embeddings
        • Diffusion
        • General Definition
        • Binary Trees
        • Binary Search Trees
        • AVL Trees
        • B-Trees
        • Heaps
        • Stable Sorting Algorithms
        • Bubble Sort
        • Selection Sort
        • Insertion Sort
        • Merge Sort
        • Quick Sort
        • Heap Sort
        • Radix Sort
        • Counting Sort
        • Searching
      • Recursion
      • Introduction to Concurrent Programming
      • Threads
      • Locking
      • Condition Variables
      • Interrupts
      • JMM - Java Memory Model
      • Safe Object Sharing
      • Lock-Free Programming
      • Synchronizers
      • The Executor Framework
      • Concurrent Programming in Scala
      • STM - Software Transactional Memory
      • Actor Model
      • Computer Systems
      • Working with Numbers
      • Memory Hierarchy
        • What is RISC-V?
        • Arithmetic and Logical Operations
        • Control Transfer Operations
        • Data Transfer Operations
        • Procedure Calls
        • Pseudo Instructions
      • General Knowledge
      • Networking
      • The Internet
      • RESTful APIs
      • Websockets
      • Messaging
      • Actor Model
      • Distributed Algorithms
      • OOP Design Principles
      • Command
      • Composite
      • Decorator
      • DAOs and Repositories
      • Factory
      • Iterators
      • Observer
      • Prototype
      • Singleton
      • State
      • Strategy
      • Template Method
      • Formal Languages
      • Computational Problems
      • Deterministic Finite Automaton
      • Nondeterministic Finite Automaton
      • Regular Expressions & Languages
      • Context-Free Grammars & Languages
      • Pushdown Automaton
      • Turing Machine
      • Kolomogorov Complexity
      • Cloud Practitioner
      • Introduction to C
      • Variables and Data Types
      • Pointers
      • Control Flow
      • Functions
      • Arrays
      • Strings
      • Structures
      • Standard File I/O
        • Introduction to System Programming
        • POSIX File I/O
        • Processes and Signals
        • Threads and Synchronization with C
        • IPC with Pipes
        • POSIX Interprocess Communication
        • Sockets
        • Time Measuring
      • Variables and Data Types
      • Classes
      • Enums and Enum Classes
      • Pointers
      • Containers
      • Strings
      • Structures
      • Overloading
      • Unions
      • Copy and Move Semantic
      • Inheritance
      • Stream I/O
      • Templates
      • STL - Standard Template Library
      • Functional Programming in C++
      • Building Blocks of C#
      • The Essentials
      • Collections and Generics
      • Filo I/O
      • Inheritance
      • Delegates and Events
      • Advanced Usage
      • Lambdas and LINQ
      • Concurrency
      • Parallelism
      • Interoperability
      • Reflection
      • Resource Management
      • Git Basics
      • Common Problems
      • Records
        • Dependency Injection and Beans
      • The Basics
      • Objects, Classes and Prototypes
      • Binding and This
      • Arrays and Iterables
      • Modules
      • The DOM
      • Async and Promises
      • Meta Programming
      • Tools for JavaScript
        • TypeScript and its Types
        • Functions
        • Classes and Interfaces
      • React
      • From Java to Kotlin
      • Makefiles
      • CMake
      • Fluent in Python
      • Modules & Packages
    • Coursera Machine Learning
    • Coursera Deep Learning
    • Main Ideas of Machine Learning
    • K-Nearest Neighbors
    • Cross-Validation
    • Linear Classification & Regression
    • Ridge Regression
    • Lasso Regression
    • Logistic Regression
    • Naive Bayes
    • Support Vector Machines
    • K-Means Clustering
    • Decision Trees
    • Random Forests
    • Power Law
    • TF-IDF
    • Mining Data Streams
    • Finding Similar Items
    • Gradient Descent
    • Backpropagation
    • MLP - Multi Layer Perceptron
    • Correlation
    • Cross-Correlation
    • Autocorrelation
    • Convolution
    • Word Embeddings
    • Link Analysis
    • PageRank
    • Graph Neural Networks
      • The Attention Mechanism
      • Recurrent Neural Networks
      • Long Short-Term Memory
      • Transformers
      • BERT
      • RoBERTa
      • GPT
      • GPT-2
      • Mamba
      • xLSTM
      • LoRA
      • Logic Theory
      • Set Theory
      • Intervals
      • Infinity & Countability
        • Relations
        • Equivalence Relations
        • Functions
        • Recurrence Relations
        • Partial Orders
      • Algebraic Structures
      • Homomorphisms
      • Combinatorics
      • Writing Proofs
      • Functions
      • Differentiation
      • Newton's Method
      • Analysis
        • Sequences
        • Sum Operator
        • Product Operator
        • What is a Series?
        • Convergence of Series
        • Power Series
        • Taylor Series
        • Fourier Series
        • Integrals Explained
        • Definite Integrals
        • Antiderivatives
        • Integration Rules
        • List of Integrals
        • Integration by Substitution
        • Integration by Parts
        • Integration by Partial Fraction Decomposition
        • Numerical Integration
        • Improper Integrals
        • Double Integrals
      • Polynomials
      • Linear Equations
      • Gaussian Elimination
      • Matrices
      • Vectors
      • Matrix Rank
      • Linear Transformations
      • Determinants
      • Matrix Inverse
      • LU Decomposition
      • Vector and Matrix Spaces
      • Cramer's Rule
      • QR Decomposition
      • Eigenvalues and Eigenvectors
      • SVD - Singular Value Decomposition
      • Moore-Penrose Pseudoinverse
      • Quadratic Forms
      • Definiteness of a Matrix
      • PCA - Principal Component Analysis
      • Hadamard Product
      • Cross Product
      • Broadcasting
      • Combinatorics
      • Probability
      • Discrete Random Variables
      • Continuous Random Variables
      • Independent Random Variables
      • Markov Chains
      • Queueing theory
      • Standard Deviation, Variance and Covariance
      • Random Stuff
      • Complex Numbers Explained
      • Cheatsheet
    • Trigonometry
      • Absolute Value
      • Factorial
      • Binomial Coefficient
    • LaTeX Guidelines
    • Scientific Notation
Edit this page on GitHub ✍🏻
Digital Garden
Machine Learning
Large Language Models
The Attention Mechanism

The Attention Mechanism

Graph Neural NetworksRecurrent Neural Networks

  • Socials

  • Linkedin↗
  • GitHub↗
  • StackOverflow↗
Buy Me A Coffee