
I built a tool to find your H1B Wage Level by ZIP code (OpenH1B.org)
Building a fast H1B search engine with DuckDB Hey devs, I'm excited to share a project I've been working on recently - a fast and clean H1B search engine called OpenH1B.org . As someone who's dealt with slow government databases and ad-heavy sites, I wanted to create a better alternative for finding honest H1B data. To make this project a reality, I used a combination of Python and DuckDB, a columnar database that allows for fast querying and indexing of large datasets. Here's a high-level overview of the tech stack and architecture: Data Ingestion : I used Python scripts to process over 546,000 certified H1B records. Data Storage : I used DuckDB and Parquet for fast analytical processing, with SQLite for transactional metadata. Performance : Optimized for 200+ QPS on a 4-core ARM VPS . Frontend : I used a minimal HTML/CSS/JS frontend to keep it lighweight and fast. Some key features of the project include: Wage Levels by ZIP : Users can search by ZIP code to find the official DOL Wage
Continue reading on Dev.to Python
Opens in a new tab




