AI Disruption

Home
Chat
Chip
Meta
Paper
Yi AI
Qwen
Agent
Robot
OpenAI
YouTube
AI Code
AI Video
AI Weekly
Elon Musk
AI Writing
AI Painting
AI Business
AI Open Source
Machine Learning
Chinese Outbound
Foundation Model
Archive
About

Machine Learning

AI Large Model Data Labeling: Does It Outperform Humans?
Streamline data labeling with LLMs like GPT-4. Learn how to improve accuracy, efficiency, and scalability in machine learning projects using LLMs.
 • 
Meng Li
The Untold Story: Small Models Behind Every Successful Large AI Model
Explore the crucial role of small models in AI, from powering large models to optimizing performance. Discover why small models are key to big AI…
 • 
Meng Li
How Multi-Head Attention Transforms AI: The Crucial Details(AI Painting Creation Intro Course 7)
Explore how Transformers and Multi-Head Attention enhance AI models like GPT, with insights into Self-Attention, LSTM, and efficient sequence…
 • 
Meng Li
Will the interviewer give a chance if I don't have experience with large models?
Insights from large model interviews: Why experience isn't everything, and what truly matters in AI research candidates—foundation, curiosity, and…
 • 
Meng Li
The First Pure Attention-Free Large Model Surpasses Open-Source Giant Llama 3.1
Falcon Mamba 7B: A new open-source model challenging Transformer, handling infinite sequences on a single GPU. Now outperforming Llama 3.1.
 • 
Meng Li
Surprising Truths About GPU Memory for Large Models: How Much Do You Really Need?
Learn how to accurately estimate GPU memory for training large models like Llama-6B, including memory changes with fp32, fp16, and int8 precision.
 • 
Meng Li
Why Are Most Large Models Now Decoder-Only?
Discover why most large language models (LLMs) are decoder-only. Explore their efficiency, performance, and the future of AI architectures in this deep…
 • 
Meng Li
Streamline Your AI Development: The 3 Essential Stages
Master AI model development with 3 key stages: pretraining, fine-tuning, and advanced alignment. Boost performance by leveraging domain-specific data…
 • 
Meng Li
Mamba vs. Transformer: The New AI Model Challenging the Status Quo
Discover Mamba: The AI Model Challenging Transformers with Efficiency and Innovation. Explore its strengths, weaknesses, and potential in real-world…
 • 
Meng Li
Discover the Secrets Behind AI's Long Context Capabilities
Explore the importance of context length in AI models, its impact on memory, computation, and practical applications. Learn cutting-edge methods for…
 • 
Meng Li
Unlocking Neural Network Secrets: The Rising Role of Sparse Autoencoders
Discover the rising role of Sparse Autoencoders (SAE) in making powerful machine learning models understandable. Learn how SAE breaks down neural…
 • 
Meng Li
Optimizing Models for Low-Configuration Devices
Learn how to optimize AI models using pruning, quantization, and distillation techniques to run efficiently on low-configuration devices.
 • 
Meng Li
© 2024 Meng Li
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great culture