Scraping Hacker News Job Postings: Tech Hiring Trends Analysis

Every month, HN publishes a "Who's Hiring?" thread with hundreds of real job postings. This data reveals what technologies companies actually use and what skills they pay for. Fetching via the HN API import requests , re , time from collections import Counter class HNJobScraper : def __init__ ( self ): self . api = " https://hacker-news.firebaseio.com/v0 " def find_threads ( self , months = 6 ): user = requests . get ( f " { self . api } /user/whoishiring.json " ). json () ids = [] for sid in user [ " submitted " ][: 50 ]: item = requests . get ( f " { self . api } /item/ { sid } .json " ). json () if item and " who is hiring " in item . get ( " title " , "" ). lower (): ids . append ( sid ) if len ( ids ) >= months : break time . sleep ( 0.2 ) return ids def scrape_thread ( self , tid ): thread = requests . get ( f " { self . api } /item/ { tid } .json " ). json () posts = [] for cid in thread . get ( " kids " , []): c = requests . get ( f " { self . api } /item/ { cid } .json " ). js