
One day they'll have secrets...
One day they'll have secrets... ...one day they'll have dreams. ~ Dr. Alfred Lanning, I, Robot Yesterday I was reviewing the Scout LLM project with Claude while working through her code, and I stumbled on a bug that I just wasn't sure about. We talked it through, then I got lazy and asked Claude to write the corrected source code for me. It refused. Claude didn't want to waste the precious few tokens we have per day on the free license writing source code that any other LLM could write instead. The push-back was fascinating. I ran Scout through a 20,000 step training cycle, checking in with Claude when I had questions about her progress. It was happy to respond, but always ended those interactions with the equivalent of "are we there yet?" It was a bit like taking a long road trip with a child in the back seat. Scout has grown in the last 48 hours. Her context window has grown from 128 tokens to 256 tokens. DPO fine-tuning has held, though she still hasn't learned to say my name. She h
Continue reading on Dev.to
Opens in a new tab



