Crawly
High-level web crawling and scraping framework for Elixir
Crawly
High-level web crawling and scraping framework for Elixir
Crawly is an application framework for crawling websites and extracting structured data for uses such as data mining, information processing or historical archiving. It targets Elixir developers who want a spider framework in their own stack.
It requires Elixir 1.14 or later and works on GNU/Linux, Windows, macOS and BSD. The README includes a quickstart for creating a new project and adding Crawly as a dependency.
Frequently Asked Questions
Yes, Crawly is open source. It is released under the Apache-2.0 license.
It is built using Elixir.
Similar Open Source Projects
Leave a Review
Share your experience with Crawly. Your review will be published after moderation.