Scraping VC Portfolios to Track Investment Thesis Shifts

Why Track VC Portfolios Venture capital firms signal their investment thesis through their portfolios. When a16z makes three AI infrastructure investments in a month, it reveals where smart money is flowing. Lets build a scraper that tracks VC portfolio changes over time and detects thesis shifts. What We Monitor New portfolio additions and removals Investment stage patterns (seed, Series A, growth) Sector concentration shifts Co-investment patterns between firms Setup pip install requests beautifulsoup4 pandas VC firm websites use modern JavaScript frameworks. ScraperAPI renders these pages fully before extraction. Scraping VC Portfolio Pages import requests from bs4 import BeautifulSoup import pandas as pd from datetime import datetime import json import os import time SCRAPER_API_KEY = " YOUR_KEY " VC_FIRMS = { " a16z " : " https://a16z.com/portfolio/ " , " sequoia " : " https://www.sequoiacap.com/our-companies/ " , " greylock " : " https://greylock.com/portfolio/ " , " benchmark "