Dyt (tanh norm) Causal Decoder Adapter tuning Prefix Decoder Encoder- Decoder Teacher forcing RMSNorm deepseek Post- LN Prompt tuning KV caching Supervised Fine- Tuning (SFT) Multi Query Attention - MQA Llama Hallucinations Multi-Head Latent Attention (MLA) Incremental Decoding RLAIF Alignment Chain- of- Thought Training difficulties ICL Knowledge recency GPT Loss Spikes GLaM GLU Gemini Swish DeepNorm Pre- LN DPO Prefix tuning SwiGLU Instruction Tuning RLHF Low-Rank Adaptation (LoRA) Grouped Query Attention - GQA Paged Attention Dyt (tanh norm) Causal Decoder Adapter tuning Prefix Decoder Encoder- Decoder Teacher forcing RMSNorm deepseek Post- LN Prompt tuning KV caching Supervised Fine- Tuning (SFT) Multi Query Attention - MQA Llama Hallucinations Multi-Head Latent Attention (MLA) Incremental Decoding RLAIF Alignment Chain- of- Thought Training difficulties ICL Knowledge recency GPT Loss Spikes GLaM GLU Gemini Swish DeepNorm Pre- LN DPO Prefix tuning SwiGLU Instruction Tuning RLHF Low-Rank Adaptation (LoRA) Grouped Query Attention - GQA Paged Attention
(Print)
Dyt (tanh norm)
Causal Decoder
Adapter tuning
Prefix Decoder
Encoder-Decoder
Teacher forcing
RMSNorm
deepseek
Post-LN
Prompt tuning
KV caching
Supervised Fine-Tuning (SFT)
Multi Query Attention - MQA
Llama
Hallucinations
Multi-Head Latent Attention (MLA)
Incremental Decoding
RLAIF
Alignment
Chain-of-Thought
Training difficulties
ICL
Knowledge recency
GPT
Loss Spikes
GLaM
GLU
Gemini
Swish
DeepNorm
Pre-LN
DPO
Prefix tuning
SwiGLU
Instruction Tuning
RLHF
Low-Rank Adaptation (LoRA)
Grouped Query Attention - GQA
Paged Attention
