How to Build a Meeting Summary Generator with Whisper and Claude

I got tired of taking meeting notes. So I built a system that records meetings, transcribes them with OpenAI Whisper, and generates structured summaries with Claude — complete with action items, decisions, and follow-ups. Here is the complete technical walkthrough. System Architecture Audio Input -> Whisper Transcription -> Claude Summary Engine -> Output Router ├── Slack channel post ├── Notion page creation ├── Email to attendees └── JSON for CRM Step 1: Audio Capture and Transcription First, we capture audio and run it through Whisper for transcription. I use the local Whisper model for privacy — no audio leaves your machine. import whisper import subprocess import tempfile from pathlib import Path from dataclasses import dataclass @dataclass class TranscriptSegment : start : float end : float text : str speaker : str | None = None @dataclass class Transcript : segments : list [ TranscriptSegment ] full_text : str duration_seconds : float language : str class AudioTranscriber : def