
Scraping Kickstarter and Indiegogo for Crowdfunding Trends
Crowdfunding platforms are a window into consumer demand and innovation trends. By scraping Kickstarter and Indiegogo, you can spot what's resonating with backers before these products hit the mainstream market. What We'll Track Campaign funding amounts and backer counts Category trends (tech, design, games, etc.) Success rates and funding velocity Geographic distribution of projects Setup pip install requests beautifulsoup4 pandas matplotlib Kickstarter Scraper import requests from bs4 import BeautifulSoup import json import time SCRAPER_API_KEY = " YOUR_KEY " def scrape_kickstarter_category ( category , page = 1 ): """ Scrape Kickstarter projects from a category page. """ url = ( f " https://www.kickstarter.com/discover/advanced " f " ?category_id= { category } &sort=newest&page= { page } " ) api_url = ( f " http://api.scraperapi.com?api_key= { SCRAPER_API_KEY } " f " &url= { url } &render=true " ) response = requests . get ( api_url , timeout = 60 ) soup = BeautifulSoup ( response .
Continue reading on Dev.to Tutorial
Opens in a new tab



![[MM’s] Boot Notes — The Day Zero Blueprint — Test Smarter on Day One](/_next/image?url=https%3A%2F%2Fcdn-images-1.medium.com%2Fmax%2F1368%2F1*AvVpFzkFJBm-xns4niPLAA.png&w=1200&q=75)