SAM 3 vs SAM for aerial segmentation: understanding the architecture behind the magic

You've probably used apps that can automatically select a person in a photo. Now imagine doing that for an entire city from a satellite image That's aerial segmentation . The newest tool for this job is SAM 3 , and it works very differently from the original SAM. Let's peek under the hood and understand SAM 3 vs SAM for aerial segmentation in a way that makes sense. What is the "Perception Encoder" and why does it matter for satellite images? The Perception Encoder is SAM 3's special "brain" for seeing. Unlike the original SAM which only understood images, this brain was trained on 5.4 billion image‑text pairs – meaning it learned to connect words like "round building" with what round buildings actually look like from above. For aerial segmentation, this means it can find things you describe, even if it's never seen that exact satellite photo before. Think of it like this : Original SAM = someone who only learned to trace shapes SAM 3 = someone who read a giant encyclopedia of pictures