Core AI
12 methods · 14,883 papers
General
Core AI methods for learning, reasoning, and intelligent decision-making.
Language
Methods for understanding, generating, and translating natural language.
Computer Vision
Techniques for understanding images, videos, and visual content.
Audio & Speech
Methods for speech recognition, synthesis, and audio understanding.
Video
Methods for video understanding, generation, and temporal analysis.
Multimodal
Models combining text, images, audio, and video inputs.
Robotics
AI methods for robot perception, planning, and interaction.
Embodied AI
Intelligent agents learning through real-world interactions.
3D & Spatial
Methods for 3D perception, mapping, and spatial reasoning.
Graph Learning
Learning from graph-structured data and relationships.
Time Series
Forecasting and modeling patterns in sequential time-series data.
Scientific AI
AI methods advancing scientific research and discovery.
Neural Architectures
10 methods · 24,685 papers
Transformer
Attention-based neural architecture for sequence modeling and generation.
Mamba
State space architecture designed for efficient long-context sequence modeling.
State Space Models
State-space models for capturing long-range dependencies.
Convolutional Networks
Neural networks specialized for extracting spatial features from data.
Recurrent Networks
Neural architectures designed for sequential and time-dependent data.
Graph Neural Networks
Models that learn representations from graph-structured data.
Mixture of Experts
Architecture that routes inputs to specialized expert networks.
Autoencoders
Neural models that learn compact representations by reconstructing inputs.
Generative Adversarial Networks
Generative models using generator-discriminator competition.
Diffusion Architectures
Generative architectures that create data through iterative denoising.
Neural Components
10 methods · 16,197 papers
Attention
Mechanisms that focus on the most relevant parts of input data.
Embeddings
Dense vector embeddings capturing semantic meaning.
Positional Encoding
Methods that encode sequence order for transformer-based models.
Feedforward Networks
Fully connected neural layers for feature transformation and learning.
Activation Functions
Functions introducing non-linearity to improve model learning capacity.
Normalization
Techniques that stabilize training and improve model convergence.
Residual Connections
Connections that improve gradient flow in deep neural networks.
Pooling
Methods for reducing feature dimensions while preserving key information.
Convolution
Neural operations that extract local patterns from structured data.
Tokenization
Methods for splitting text into tokens for language model processing.
Training
12 methods · 7,347 papers
Pre-training
Training models on large datasets to learn general-purpose representations.
Fine-tuning
Adapting pre-trained models for specific downstream tasks.
Instruction Tuning
Training models to better understand and follow user instructions.
Continued Pretraining
Extending pre-training using additional domain-specific datasets.
Self-Supervised Learning
Learning meaningful representations without manually labeled data.
Semi-Supervised Learning
Combining labeled and unlabeled data to improve model performance.
Transfer Learning
Reusing knowledge learned from one task to solve another.
Curriculum Learning
Training models progressively from simpler tasks to harder ones.
Multi-task Learning
Learning multiple related tasks within a shared model architecture.
Continual Learning
Methods enabling models to learn continuously without forgetting.
Distillation
Transferring knowledge from larger models into smaller, efficient models.
Teacher Forcing
Training sequence models using target outputs as guidance.
Alignment
6 methods · 11,947 papers
RLHF
Aligning models with human preferences through reinforcement learning.
DPO
Preference optimization without reinforcement learning.
Preference Optimization
Optimizing model behavior using human or synthetic preferences.
Reward Modeling
Learning reward functions for optimizing machine learning models.
Constitutional AI
Aligning AI behavior using predefined principles and rules.
AI Feedback
Improving models using feedback generated by other AI systems.
Prompting & Reasoning
6 methods · 4,951 papers
Prompting
Guiding model behavior through carefully designed prompts and instructions.
Chain of Thought
Reasoning step by step to solve complex problems effectively.
Reasoning
Methods for logical inference, analysis, and decision-making.
Planning
Breaking complex goals into structured actions and intermediate steps.
Search
Finding relevant information efficiently across large search spaces.
Reflection
Improving responses through self-evaluation and iterative refinement.
Agents
7 methods · 1,772 papers
Tool Use
Using external tools and APIs to complete complex tasks.
ReAct
Combining reasoning and actions to solve multi-step problems.
Function Calling
Invoking external functions and APIs during model execution.
Agent Memory
Maintaining context and recalling information across interactions.
Multi-Agent Systems
Coordinating multiple intelligent agents to achieve shared goals.
Workflow Orchestration
Managing multi-step AI workflows and task execution pipelines.
Model Context Protocol (MCP)
Standardized communication between AI models, tools, and services.
Retrieval
7 methods · 6,414 papers
Retrieval-Augmented Generation
Combines retrieval with language generation.
Dense Retrieval
Retrieving documents using semantic vector representations.
Sparse Retrieval
Keyword-based retrieval using sparse text representations.
Hybrid Retrieval
Combining dense and sparse retrieval for improved search quality.
Reranking
Reordering retrieved results based on relevance and quality.
Vector Search
Searching data using vector embeddings and similarity matching.
Knowledge Graphs
Structured graphs representing entities and relationships.
Adaptation
6 methods · 6,620 papers
LoRA
Low-rank adaptation for efficient fine-tuning of large models.
QLoRA
Quantized LoRA for memory-efficient model fine-tuning.
PEFT
Parameter-efficient methods for adapting large language models.
Prompt Tuning
Learning task-specific prompts without updating all model weights.
Prefix Tuning
Optimizing trainable prefix representations for downstream tasks.
Adapter Tuning
Fine-tuning lightweight adapter layers while freezing base models.
Optimization
4 methods · 223 papers
Optimizers
Algorithms that update model parameters for efficient and stable learning.
Learning Rate Scheduling
Techniques that adjust learning rates throughout the training process.
Initialization
Methods for setting initial model parameters before training begins.
Gradient Methods
Gradient-based optimization for updating machine learning models.
Regularization
4 methods · 612 papers
Dropout
Randomly disabling neurons during training to reduce model overfitting.
Weight Regularization
Constraining model weights to improve generalization and robustness.
Label Smoothing
Softening target labels to improve model confidence and accuracy.
Data Augmentation
Expanding training datasets with transformed or synthetic examples.
Efficiency
9 methods · 13,085 papers
Quantization
Reducing numerical precision for faster and more efficient inference.
Pruning
Removes unnecessary parameters while preserving performance.
Sparsity
Using sparse representations to reduce computation.
Speculative Decoding
Accelerating text generation through predictive decoding strategies.
KV Cache
Caching attention states to speed up autoregressive model inference.
PagedAttention
Memory-efficient attention for serving large language models efficiently.
FlashAttention-2
Highly optimized attention algorithm for faster transformer execution.
Model Compression
Reducing model size while preserving accuracy and performance.
Inference Optimization
Techniques that improve model inference speed and resource efficiency.
Reinforcement Learning
5 methods · 363 papers
Value-based RL
Learning action values to maximize long-term rewards through experience.
Policy Optimization
Optimizing decision-making policies for reinforcement learning agents.
Model-based RL
Learning environment dynamics for better planning and decisions.
Offline RL
Training reinforcement learning agents using fixed offline datasets.
Online RL
Learning through real-time interactions with environments.
Representation Learning
4 methods · 1,485 papers
Contrastive Learning
Learning representations by comparing similar and dissimilar samples.
Metric Learning
Learning distance metrics that capture semantic similarity between samples.
Embedding Learning
Creating dense feature representations for downstream tasks.
Feature Learning
Automatically discovering useful features directly from raw input data.
Diffusion
4 methods · 2,392 papers
Diffusion Models
Generative models that create data through iterative denoising processes.
Flow Matching
Learning continuous transformations for efficient generative modeling tasks.
Score-based Models
Generative models that learn score functions over data distributions.
Consistency Models
Fast generative models designed for high-quality one-step sampling.
Vision
7 methods · 990 papers
Object Detection
Detecting and localizing objects within images and video scenes.
Segmentation
Partitioning images into regions for detailed understanding
Image Generation
Generating realistic images from text, noise, or other visual inputs.
Image Classification
Classifying images into predefined categories using deep learning models.
Pose Estimation
Estimating human or object poses from images and videos.
Tracking
Following objects consistently across multiple frames in video sequences.
3D Vision
Understanding 3D scenes, geometry, and spatial relationships.
Language
7 methods · 5,761 papers
Tokenization
Splitting text into tokens for efficient language model processing.
Language Modeling
Learning language patterns for text prediction and generation tasks.
Machine Translation
Translating text accurately between different natural languages.
Text Generation
Generating coherent and contextually relevant natural language text.
Summarization
Producing concise summaries while preserving essential information.
Question Answering
Answering questions using context, documents, or structured knowledge.
Information Extraction
Extracting structured facts and entities from unstructured text.
Audio
5 methods · 104 papers
Speech Recognition
Converting spoken language into accurate text using AI models.
Speech Synthesis
Generating realistic and natural-sounding speech from text inputs.
Speaker Recognition
Identifying and verifying speakers from voice characteristics.
Audio Generation
Generating speech, sound effects, and other synthetic audio content.
Music Generation
Creating original music compositions using generative AI models.
Video
4 methods · 186 papers
Video Understanding
Analyzing video content to recognize events, actions, and scene dynamics.
Video Generation
Generating realistic videos from text, images, or learned visual representations.
Video Segmentation
Segmenting objects and regions consistently across video frames.
Video Retrieval
Finding relevant videos using semantic search and similarity.
Robotics
4 methods · 436 papers
Motion Planning
Planning safe and efficient robot movements in complex environments.
Manipulation
Controlling robotic interaction through grasping and manipulation.
Navigation
Navigating autonomous robots in dynamic environments.
Policy Learning
Learning robot control policies from experience, demonstrations, or rewards.
3D
4 methods · 315 papers
NeRF
Neural rendering method for reconstructing realistic three-dimensional scenes.
Gaussian Splatting
Fast technique for high-quality rendering of complex 3D scenes.
SLAM
Simultaneous localization and mapping for robotic perception and navigation.
Point Clouds
Representing 3D environments using spatial point collections.
Mathematics
5 methods · 591 papers
Optimization Theory
Mathematical principles for optimization in machine learning.
Probability
Modeling uncertainty and randomness with probabilistic frameworks.
Statistics
Analyzing data distributions, patterns, and relationships through statistical methods.
Loss Functions
Functions that measure prediction errors during model optimization.
Linear Algebra
Foundation for vectors, matrices, and neural network computations.
Evaluation
5 methods · 587 papers
Metrics
Measuring model accuracy, quality, and performance using evaluation metrics.
Human Evaluation
Assessing AI outputs through human judgment and expert review.
LLM-as-a-Judge
Using language models to evaluate responses and compare output quality.
Preference Evaluation
Comparing model outputs using human or AI preference judgments.
Benchmarking
Evaluating models against standardized datasets and benchmark tasks.
Interpretability
4 methods · 187 papers
Mechanistic Interpretability
Studying internal model mechanisms to understand learned behaviors.
Attribution
Identifying which inputs contribute most to model predictions.
Probing
Using diagnostic probes to analyze learned representations.
Explainability
Making AI decisions more transparent and understandable for users.
Safety
6 methods · 840 papers
Hallucination
Reducing inaccurate or fabricated content generated by AI systems.
Watermarking
Embedding identifiable markers into AI-generated content for verification.
Alignment Safety
Ensuring AI systems behave safely and follow intended objectives.
Jailbreak Defense
Protecting models against prompt injection and jailbreak attacks.
Robustness
Improving model reliability under noisy, adversarial, or changing conditions.
Privacy
Protecting sensitive data throughout model training and deployment.
Systems
5 methods · 2,621 papers
Distributed Training
Scaling model training across multiple machines and computing devices.
Parallelism
Executing model computations to improve training efficiency.
Serving
Deploying AI models for reliable, large-scale production inference.
Inference Systems
Systems optimized for fast and scalable model inference workloads.
Memory Optimization
Reducing memory usage while maintaining efficient model performance.
Hardware
4 methods · 128 papers
GPUs
Graphics processors optimized for large-scale AI training and inference.
TPUs
Google-designed accelerators for machine learning workloads.
NPUs
Dedicated neural processors for efficient on-device AI computation.
Accelerators
Specialized hardware designed to speed up AI model execution.
Research Concepts
7 methods · 605 papers
Scaling Laws
Studying how model performance improves with increased scale and data.
Emergence
Unexpected capabilities that appear as AI models become larger.
In-Context Learning
Learning new tasks from examples provided directly within prompts.
Test-Time Compute
Using extra computation during inference to improve performance.
Context Engineering
Optimizing prompts and context to improve model responses consistently.
World Models
Learning internal environment representations for planning.
Foundation Models
Large pre-trained models adaptable to diverse downstream AI applications.
