
Meet Vessel: The "Scrapy" of the Ruby World
The Missing Piece In the Ruby scraping ecosystem, we have excellent low-level tools. Nokogiri: Great for parsing HTML. Ferrum: Great for controlling a headless Chrome browser via CDP. HTTP: Great for making requests. But what if you need to build a Crawler ? A crawler isn't just a script that visits one page. It’s a system that visits a page, extracts data, finds the "Next Page" link, adds it to a queue, manages concurrency, and exports the data. For years, Python developers laughed at us because they had Scrapy . Rubyists had Kimurai , but it has largely gone unmaintained. Enter Vessel . Built by the same team behind Ferrum, Vessel is the modern, high-level web crawling framework Ruby has been waiting for. Why Vessel is a Game Changer Vessel is built on top of Ferrum . This means: It handles JavaScript natively: It drives a real Chrome browser. React, Vue, and Angular sites are no problem. It manages the Pool: You don't have to manually spawn threads or manage browser contexts. Vessel
Continue reading on Dev.to Webdev
Opens in a new tab



