New trend: extreme hours at AI startups

Pulling 80+ hour work weeks – including weekends – is becoming the norm across AI startups, and is unlikely to stop while AI is so hot.

AGI is not coming!

jack Morris's investigation into GPT-OSS training data https://x.com/jxmnop/status/1953899426075816164?t=3YRhVQDwQLk2gouTSACoqA&s=09

I Saved a PNG Image To A Bird

I got a bit concerningly obsessed with birds for a few months. Follow Sarah and The Mouth! https://linktr.ee/inkydragon Older bat vid: https://www.you...

Context Rot: How Increasing Input Tokens Impacts LLM Performance (Paper Analysis)

Paper: https://research.trychroma.com/context-rot Abstract: Large Language Models (LLMs) are typically presumed to process context uniformly—that is,...

Hearing Impairments Are REALLY Profitable. 🫤

I was diagnosed with hearing loss. The problem is that I don't have hearing loss. Here's how to take care of your hearing in reality. Thanks @DrCliffA...

7 Concerning Levels Of Acoustic Spying Techniques

Take my hand while I gradually show you how to spy in ways that will make KGB agents look like noobs. Thanks @WonderboyMMA for being a great high spee...

APIs Explained in 6 Minutes!

Sign up now to access ChatLLM: https://bit.ly/42RlGDV Get a Free System Design PDF with 158 pages by subscribing to our weekly newsletter: https://bit...

On the Biology of a Large Language Model (Part 2)

An in-depth look at Anthropic's Transformer Circuit Blog Post Part 1 here: https://youtu.be/mU3g2YPKlsA Discord here: https;//ykilcher.com/discord htt...

i tried increasing my pain tolerance

This Video is Sponsored by Rocket Money. Try Rocket Money for free: https://rocketmoney.com/osman Send your inventions to me: https://opensauce.com/ex...

On the Biology of a Large Language Model (Part 1)

An in-depth look at Anthropic's Transformer Circuit Blog Post https://transformer-circuits.pub/2025/attribution-graphs/biology.html Abstract: We inves...

How I use LLMs

The example-driven, practical walkthrough of Large Language Models and their growing list of related features, as a new entry to my general audience s...

Deep Dive into LLMs like ChatGPT

This is a general audience deep dive into the Large Language Model (LLM) AI technology that powers ChatGPT and related products. It is covers the full...

[GRPO Explained] DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models

#deepseek #llm #grpo GRPO is one of the core advancements used in Deepseek-R1, but was introduced already last year in this paper that uses a combinat...

Byte Latent Transformer: Patches Scale Better Than Tokens (Paper Explained)

#tokenization #llm #meta This paper does away with tokenization and creates an LLM architecture that operates on dynamically sized "patches" instead o...

The most painful plant in New Zealand

What Programming Font Should You Use?

I like programming. Fonts tried in this video 1. Menlo 2. Comic Shanns 3. Fira Code 4. JetBrains Mono 5. MonoLisa #benawad ---- Follow me online: http...

Let's reproduce GPT-2 (124M)

We reproduce the GPT-2 (124M) from scratch. This video covers the whole process: First we build the GPT-2 network, then we optimize its training to be...

I Turned 1-Star Toys into Military Nightmares

Go to http://crunchlabs.com/williamosman and claim your free kit today! Get your Open Sauce Tickets before they sell out!! https://opensauce.com/ticke...

Could you Survive a Blast from the Worlds Biggest Vortex Cannon?

Go to http://crunchlabs.com/backyardscientist and claim your free kit today! Also, bring your project to Open Sauce! http://opensauce.com Allens Video...

Let's build the GPT Tokenizer

The Tokenizer is a necessary and pervasive component of Large Language Models (LLMs), where it translates between strings and tokens (text chunks). To...