Browse agent skills

Crawl elements selector which match specific DOM event

A library for checking basic SEO signals of a website

lihkg-crawler is a ai & automation skill indexed by Skillful.sh. Package: lihkg-crawler. GitHub stars: 2.

No description available

CAP Plugin — Midnight Blockchain Indexer with OData V4 API

Unofficial National Bibliographic Information Network collection crawler

SiteBot is an event driven website crawler.

A terminal-based dungeon crawler game with ASCII graphics

PIXNET posts crawler for node.js

Google Maps Place crawler

A web spider of hangzhou

A powerful command-line tool for crawling websites and generating CSV reports

Automated crawling and messaging for LinkedIn

No description available

Plugin for bauer-crawler to scrape content.

A prerender middleware for express. This middleware serves cached prerendered pages for crawlers or if no cached page exists for a requested page it will cache a page using PhantomJS and respond with that newly cached page.

Forked from https://github.com/github/lightcrawler

a video downloader that crawls the web

A Typescript library to fetch data from GitHub projects and write them to JSON files for the HocDoc parser.

Plugin for bauer-crawler to convert PDF into text.

Scrapy Framework implemented by nodejs.

A Mercator crawler with url-frontier, url-set, meta-data fetcher, etc. inspired by the Stanford Information Retrieval book

Config based news crawler using Google Puppeteer

Pull athlete information straight from the Parkrun website

a module to interact with the crawler tables stored in hbase

auto-web-crawler is a ai & automation skill indexed by Skillful.sh. Package: auto-web-crawler. GitHub stars: 4.

A painless Node.js web crawler that simply works

Web Crawler in Node.js to spider dynamically whole websites.

https://user-images.githubusercontent.com/74648201/216847852-66d3cab4-4f1e-4125-a54f-95e96f1b95e7.mp4

Crawl your CSS/SCSS or HTML files for img URL's and store the crawled image URL's in a local JSON file.