crawler

BigPhish - An all-in-one solution to identify and monitor phishing kit deployment

Findpapers is an application that helps researchers who are looking for references for their work

Discover apps by different mehtods. Mass download app packages and metadata.

Bilingual TED-TALK, Crawler, Crawling

A Python crawler to gather information about augmented reality applications. (For a research project.)

A Python app for scanning large data sets of URLs for a given signature and storing the results to an ElasticSearch index. Useful applications for CERTs and security researchers, maybe others.

Python tools for ethical hacking

A Python module for collecting and providing popular user agent strings, with a requests session which rotates user agents.

A web-spider implemented with Scrapy, to crawl GoogleNews

A Python 2 terminal program that crawls a website for all URL links and takes full-page screenshots.

Crawler which can crawl and download videos from YouTube and Vimeo

This is a e-gental downloader based on python3. #crawler

This script is created for scraping Data from MCGM web-site

RyanAir crawler