
Stop Parsing HTML — 7 Websites That Give You JSON If You Ask Nicely
Most web scraping tutorials start with BeautifulSoup or Cheerio. But many popular websites already return structured JSON — you just need to know how to ask. 1. Reddit Append .json to any URL: https://www.reddit.com/r/webdev.json https://www.reddit.com/r/python/top.json?t=week 2. YouTube (Innertube API) fetch ( " https://www.youtube.com/youtubei/v1/search " , { method : " POST " , body : JSON . stringify ({ context : { client : { clientName : " WEB " , clientVersion : " 2.20240101 " } }, query : " python tutorial " }) }); 3. Hacker News (Algolia) https://hn.algolia.com/api/v1/search?query=python&tags=story 4. Wikipedia https://en.wikipedia.org/w/api.php?action=query&list=search&srsearch=machine+learning&format=json 5. GitHub https://api.github.com/search/repositories?q=web+scraping&sort=stars 6. npm Registry https://registry.npmjs.org/-/v1/search?text=scraping&size=10 7. Stack Overflow https://api.stackexchange.com/2.3/search?order=desc&sort=votes&intitle=web+scraping&site=stackoverflo
Continue reading on Dev.to Beginners
Opens in a new tab



