Ludwig - ai/language_models

LudwigAbap

Resources › ai › language_models

Bookmarks

bookmark huggingface.co · 1h 13m The Smol Training Playbook: The Secrets to Building World-Class LLMs training
bookmark magazine.sebastianraschka.com · 29 min From DeepSeek V3 to V3.2: Architecture, Sparse Attention, and RL Updates attention mechanisms llm

bookmark xenaproject.wordpress.com · 8 min Formal or not formal? That is the question in AI for theorem proving. usage proof assistants
bookmark lilianweng.github.io · 10 min Why We Think inference llm

bookmark madore.org · 49 min Les LLM vont-ils tuer les mathématiques ? evaluation proof assistants
bookmark geohot.github.io · 4 min The Real Singularity is the Friends We Made Along the Way theory
bookmark scottaaronson.blog · 6 min Dispatches from the possibly last days of human relevance usage

bookmark alexzhang13.github.io · 6 min The Mismanaged Geniuses Hypothesis agents context
bookmark caj.al · 7 min Mathematics, AI, and Formalization: The State of Play agents proof assistants
bookmark davidbessis.substack.com · 53 min The fall of the theorem economy evaluation proof assistants

bookmark blog.janestreet.com · 10 min Using group theory to explore the space of positional encodings for attention attention mechanisms group theory

video youtube.com · 24:17 How Attention Residuals Rewire Modern LLMs attention mechanisms efficiency

bookmark tristan.st · 2 min In search of falsehood agents proof assistants
bookmark leodemoura.github.io · 5 min Teaching AI to Make Proof Automation Work agents proof assistants

video youtube.com · 2:10:59 AI math capabilities could be jagged for a long time – Daniel Litt evaluation usage

video youtube.com · 34:31 Beyond Softmax: The Future of Attention Mechanisms attention mechanisms

bookmark lilianweng.github.io · 37 min The Transformer Family Version 2.0 variants

bookmark galacodes.hashnode.dev · 15 min Speculative Decoding: From Theory to Implementation efficiency inference
bookmark goodfire.ai · 10 min Understanding Memorization via Loss Curvature theory

bookmark sankalp.bearblog.dev · 21 min How prompt caching works - Paged Attention and Automatic Prefix Caching plus practical tips attention mechanisms

bookmark andrewkchan.dev · 37 min Fast LLM Inference From Scratch inference cuda

bookmark blog.ezyang.com · 15 min The Parallelism Mesh Zoo efficiency training cuda

bookmark hanlab.mit.edu · 9 min How Attention Sinks Keep Language Models Stable attention mechanisms
bookmark guangxuanx.com · 9 min Statistics behind Block Sparse Attention attention mechanisms statistics

bookmark tylercosgrove.com · 4 min Do LLMs Have Good Music Taste? interpretability evaluation aesthetics

bookmark lesswrong.com · 6 min LLM in-context learning as (approximating) Solomonoff induction theory information theory epistemology

video youtube.com · 39:58 AI Predictions With ex-Applied AI engineer at Stripe! attention mechanisms
video youtube.com · 46:22 It's Not About Scale, It's About Abstraction attention mechanisms mind

video youtube.com · 25:13 Street Fighting Transformers attention mechanisms
video youtube.com · 22:42 How might LLMs store facts | Deep Learning Chapter 7 interpretability attention mechanisms
video youtube.com · 41:35 Re-thinking Transformers: Searching for Efficient Linear Layers over a Continuous Space of... attention mechanisms
video youtube.com · 1:07:02 LSTM: The Comeback Story? fundamentals attention mechanisms
video youtube.com · 18:09 How DeepSeek Rewrote the Transformer [MLA] attention mechanisms
video youtube.com · 27:03 What is the Transformers’ Context Window in Deep Learning? (and how to make it LONG) attention mechanisms
video youtube.com · 1 min DeepMind’s AlphaEvolve AI: History In The Making! agents
video youtube.com · 1:03:00 What is a Transformer? (Transformer Walkthrough Part 1/2) attention mechanisms
video youtube.com · 53:06 Fireside Chat With Ilya Sutskever and Jensen Huang AI Today and Vision of the Future March 2023 attention mechanisms
video youtube.com · 34:01 Matt Squire - Diving into Transformer Model Internals | PyData London 25 attention mechanisms
video youtube.com · 1 min I Visualised Attention in Transformers interpretability attention mechanisms
video youtube.com · 47:51 Energy-Based Transformers are Scalable Learners and Thinkers (Paper Review) attention mechanisms
video youtube.com · 21:01 The Attention Mechanism in Large Language Models attention mechanisms
video youtube.com · 58:01 Large Language Models in Five Formulas attention mechanisms
video youtube.com · 1:11:40 Stanford CS25: V2 I Introduction to Transformers w/ Andrej Karpathy attention mechanisms
video youtube.com · 17:06 LoRA explained (and a bit about precision and quantization) compression attention mechanisms
video youtube.com · 1 min How to Build an LLM from Scratch | An Overview attention mechanisms
video youtube.com · 10:50 Transformer Neural Network: Visually Explained implementations attention mechanisms
video youtube.com · 1 min Sitan Chen - Provably learning a multi-head attention layer - IPAM at UCLA attention mechanisms
video youtube.com · 1 min Tutorial | LLMs in 5 Formulas (360°) attention mechanisms
video youtube.com · 1:56:20 Let's build GPT: from scratch, in code, spelled out. attention mechanisms
video youtube.com · 13:40 What's next for AI agentic workflows ft. Andrew Ng of AI Fund attention mechanisms
video youtube.com · 1 min If we don’t get AGI by GPT-7 (~$1T), will we just never get it? – Sholto Douglas & Trenton Bricken attention mechanisms

bookmark goombalab.github.io · 28 min H-Nets - the Past attention mechanisms
bookmark goombalab.github.io · 17 min H-Nets - the Future attention mechanisms

bookmark nrehiew.github.io · 16 min The State of Generative Models attention mechanisms

bookmark semianalysis.com · 13 min DeepSeek Debrief: >128 Days Later – SemiAnalysis model reports gpus

bookmark pytorch.org · 19 min FlexAttention: The Flexibility of PyTorch with the Performance of FlashAttention attention mechanisms

bookmark elanapearl.github.io · 51 min The Illustrated AlphaFold attention mechanisms

bookmark gleech.org · 10 min How I don't use LLMs usage productivity

bookmark anthropic.com · 17 min How we built our multi-agent research system agents distributed systems

bookmark medium.com · 9 min DeepSeek-V3 Explained 1: Multi-head Latent Attention attention mechanisms

bookmark huggingface.co · 13 min You could have designed state of the art positional encoding attention mechanisms
bookmark supaiku.com · 11 min attention is logarithmic, actually attention mechanisms
bookmark blog.briankitano.com · 11 min Llama from scratch (or how to implement a paper without crying) training

bookmark arxiv.org · 1 min Are Transformers universal approximators of sequence-to-sequence functions? theory
bookmark huggingface.co · 1 min a Hugging Face Space by nanotron training distributed systems

bookmark arxiv.org · 50 min Training Large Language Models to Reason in a Continuous Latent Space theory

bookmark arxiv.org · 1 min Training Large Language Models to Reason in a Continuous Latent Space attention mechanisms
bookmark transformer-circuits.pub · 3h 34m On the Biology of a Large Language Model interpretability efficiency
bookmark arxiv.org · 1 min Do Llamas Work in English? On the Latent Language of Multilingual Transformers interpretability efficiency
bookmark natolambert.substack.com · 3 min "Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?" evaluation llm

bookmark snimu.github.io · 4 min Multi-layer language heads: the output latent is for text (and nothing else) attention mechanisms
bookmark stanford-cs336.github.io · 4 min CS336: Language Modeling from Scratch attention mechanisms

bookmark stochasm.blog · 17 min Contextualization Machines context

bookmark writings.stephenwolfram.com · 1h 33m What Is ChatGPT Doing … and Why Does It Work? attention mechanisms

bookmark ludwigabap.com · 2h 37m paper agents cuda

bookmark lesswrong.com · 11 min Recent AI model progress feels mostly like interpretability efficiency

bookmark google.com · 1 min diffusion transformers diffusion attention mechanisms

bookmark transformer-circuits.pub · 3h 43m Circuit Tracing: Revealing Computational Graphs in Language Models interpretability efficiency

bookmark ethansmith2000.com · 13 min Softmax Attention is a Fluke attention mechanisms

bookmark goyalpramod.github.io · 38 min Transformers Laid Out attention mechanisms

bookmark physics.allen-zhu.com · 4 min Physics of language models interpretability efficiency

bookmark mrinalxdev.github.io · 2 min Attention from Beginners Point of View attention mechanisms
bookmark k-a.in · 10 min Why Attention Is All You NeedWhy Attention Is All You Need interpretability attention mechanisms

bookmark ludwigabap.com · 29 min Attention in SRAM on Tenstorrent Grayskull attention mechanisms efficiency

bookmark microsoft.com · 1h 44m þÿThe Impact of Generative AI on Critical Thinking: Self-Reported Reductions in Cognitive Effort and Confidence Effects From a Survey of Knowledge Workers usage decision making

bookmark developer.nvidia.com · 10 min Mastering LLM Techniques: Evaluation efficiency
bookmark resources.nvidia.com · 1 min Mastering LLM Inference Techniques: Inference Optimization efficiency
bookmark developer.nvidia.com · 3 min Automating GPU Kernel Generation with DeepSeek-R1 and Inference Time Scaling efficiency gpus

bookmark arxiv.org · 2h 19m The What, Why, and How of Context Length Extension Techniques in Large Language Models -- A Detailed Survey context

bookmark arxiv.org · 35 min Transformer Memory as a Differentiable Search Index usage

bookmark drive.google.com · 8 min Unveiling_DeepSeek.pdf model reports

bookmark medium.com · 9 min DeepSeek-V3 Explained: A Deep Dive into the Next-Generation AI Model model reports

bookmark arxiv.org · 1 min Foundations of Large Language Models efficiency

bookmark ludwigabap.com · 1h 51m DeepSeek-V3 Technical Report model reports training

bookmark github.com · 1 min DeepSeek-V3/DeepSeek_V3.pdf at main · deepseek-ai/DeepSeek-V3 efficiency

bookmark chinatalk.media · 25 min Deepseek: The Quiet Giant Leading China’s AI Race efficiency

bookmark dl.fbaipublicfiles.com · 1h 3m BLT__Patches_Scale_Better_Than_Tokens computer vision attention mechanisms
bookmark arxiv.org · 2h 29m Gemini: A Family of Highly Capable Multimodal Models computer vision efficiency
bookmark storage.googleapis.com · 2h 43m Mastering Board Games by External and Internal Planning with Language Models game ai efficiency

bookmark blog.steelph0enix.dev · 1h 9m llama.cpp guide - Running LLMs locally, on any hardware, from scratch efficiency inference

bookmark thegregyang.com · 7 min Greg Yang fundamentals attention mechanisms

bookmark blog.dottxt.co · 11 min Coalescence: making LLM inference 5x faster efficiency

bookmark oasis-model.github.io · 4 min Oasis: A Universe in a Transformer attention mechanisms procedural generation

bookmark huggingface.co · 1 min Humans in 4D: Reconstructing and Tracking Humans with Transformers computer vision attention mechanisms

bookmark arxiv.org · 1h 2m Cramming: Training a Language Model on a Single GPU in One Day interpretability efficiency
bookmark arxiv.org · 18 min The MiniPile Challenge for Data-Efficient Language Models training

bookmark scontent.fbeg1-1.fna.fbcdn.net · 1h 0m 448997590_1496256481254967_2304975057370160015_n efficiency optimization

bookmark arxiv.org · 1 min MLKV: Multi-Layer Key-Value Heads for Memory Efficient Transformer Decoding attention mechanisms

bookmark tinkerd.net · 13 min Multi-Query & Grouped-Query Attention interpretability inference caching

bookmark mathblog.vercel.app · 6 min Exploring architectures- Transformers II attention mechanisms

bookmark nlp.seas.harvard.edu · 32 min The Annotated Transformer attention mechanisms

bookmark arxiv.org · 40 min Auto-Regressive Next-Token Predictors are Universal Learners theory

bookmark openreview.net · 1 min Unnamed Document multimodal
bookmark lesswrong.com · 7 min New Scaling Laws for Large Language Models efficiency
bookmark arxiv.org · 12 min How Good Are Low-bit Quantized LLaMA3 Models? An Empirical Study compression efficiency
bookmark mobiusml.github.io · 7 min 1-bit Model compression efficiency

bookmark artfintel.com · 8 min Where do LLMs spend their FLOPS? efficiency

bookmark arxiv.org · 1 min Sparse Autoencoders Find Highly Interpretable Features in Language Models interpretability efficiency

bookmark arxiv.org · 26 min OpenELM: An Efficient Language Model Family with Open-source Training and Inference Framework efficiency

bookmark ieeexplore.ieee.org · 1 min Transformers Meet Small Datasets attention mechanisms

bookmark arxiv.org · 1h 35m Generative Agents: Interactive Simulacra of Human Behavior game ai efficiency

bookmark arxiv.org · 16 min The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits compression efficiency

bookmark huggingface.co · 1 min The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits compression efficiency

bookmark storage.googleapis.com · 1h 59m gemini_v1_5_report model reports

bookmark arxiv.org · 37 min 2309.10668 compression theory

bookmark arxiv.org · 1 min K-Level Reasoning with Large Language Models efficiency

bookmark arxiv.org · 1 min Measuring Faithfulness in Chain-of-Thought Reasoning interpretability efficiency

bookmark arxiv.org · 1 min Self-Rewarding Language Models training llm

bookmark arxiv.org · 39 min MemGPT: Towards LLMs as Operating Systems efficiency

bookmark towardsdatascience.com · 1 min Visual Guides to understand the basics of Large Language Models attention mechanisms
bookmark magazine.sebastianraschka.com · 26 min Understanding and Coding Self-Attention, Multi-Head Attention, Cross-Attention, and Causal-Attention in LLMs attention mechanisms

bookmark arxiv.org · 2h 42m Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training ethics efficiency

bookmark chats-lab.github.io · 6 min This project is about how to systematically persuade LLMs to jailbreak them. interpretability efficiency
bookmark github.com · 4 min mlx-examples/lora at main · ml-explore/mlx-examples · GitHub training
bookmark arxiv.org · 1 min Mixtral of Experts attention mechanisms
bookmark huggingface.co · 1 min Paper page - Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models training llm
bookmark arxiv.org · 45 min From LLM to Conversational Agent: A Memory Enhanced Architecture with Fine-Tuning of Large Language Models efficiency

bookmark arxiv.org · 1h 20m WikiChat: Stopping the Hallucination of Large Language Model Chatbots by Few-Shot Grounding on Wikipedia efficiency

bookmark arxiv.org · 2h 22m Discovering Language Model Behaviors with Model-Written Evaluations ethics efficiency

bookmark lilianweng.github.io · 17 min Attention? Attention! attention mechanisms
bookmark jaykmody.com · 9 min An Intuition for Attention attention mechanisms
bookmark blog.matdmiller.com · 1 min Transformers From Scratch implementations attention mechanisms

bookmark jalammar.github.io · 3 min How GPT3 Works - Visualizations and Animations attention mechanisms

bookmark colab.research.google.com · 1 min Tensor2Tensor Intro attention mechanisms
bookmark nlp.seas.harvard.edu · 16 min The Annotated Transformer attention mechanisms
bookmark jalammar.github.io · 19 min The Illustrated Transformer attention mechanisms
bookmark jalammar.github.io · 7 min Visualizing A Neural Machine Translation Model (Mechanics of Seq2seq Models With Attention) attention mechanisms
bookmark osanseviero.github.io · 1 min The Random Transformer attention mechanisms
bookmark web.stanford.edu · 6 min CS25: Transformers United V3 attention mechanisms

bookmark huggingface.co · 7 min Spaces using openai/whisper-large-v2 232 attention mechanisms signal processing
bookmark haticeozbolat17.medium.com · 4 min Text Summarization: How to Calculate BertScore evaluation embeddings
bookmark whatdhack.medium.com · 29 min Some Core Principles of Large Language Model (LLM) Tuning training llm
bookmark arxiv.org · 48 min MotionGPT: Human Motion as a Foreign Language computer vision multimodal

Subcategories