PastebinScrapy – Flask application for scraping latest scrapes from Pastebin

This is a Web Scraping application built on Flask. This web application utilizes Pastebin Scraping API and scrapes IOCs including IP addresses, domains, hashes, and emails from the latest pastes of Pastebin. It uses Elasticsearch as the database to store the pastes and Kibana is used for visualizing data from Elasticsearch.

Prerequisites

• Python
• Flask
• Requests
• Elasticsearch 5.6
• BeautifulSoup
• Kibana

Usage

• Enter your Pastebing Scraping API key and Flask secret key in the code
• Run the PastebinScrapy.py file
• Open 127.0.0.1:5000 in any browser
• Open 127.0.0.1:5601 in any browser to see the Kibana dashboard

Screenshots