Awesome OSINT

Emma White
Posted by Emma White September 1, 2022

superior_hosting_service

onint

A curated list of amazingly awesome open source intelligence tools and resources. Open-source intelligence (OSINT) is intelligence collected from publicly available sources. In the intelligence community (IC), the term “open” refers to overt, publicly available sources (as opposed to covert or clandestine sources)

General Search

The main search engines used by users.

  • Advangle
  • Aol
  • Ask
  • Bing
  • DuckDuckGo – an Internet search engine that emphasizes protecting searchers’ privacy.
  • Gigablast – provides large-scale, high-performance, real-time information retrieval technology and services for partner sites.
  • Goodsearch – a search engine for shopping deals online.
  • Google Search – Most popular search engine.
  • Instya
  • Impersonal.me
  • Lycos
  • Search.com
  • SurfCanyon – a real-time contextual search technology that observes user behavior in order to disambiguate intent “on the fly,” and then automatically bring forward to page one relevant results that might otherwise have remain buried.
  • Wolfram Alpha – Wolfram Alpha is a computational knowledge engine (answer engine) developed by Wolfram Alpha. It will compute expert-level answers using Wolfram’s breakthrough algorithms, knowledgebase and AI technology.
  • Yahoo! Search

Main National Search Engines

Localized search engines by country.

Meta Search

Lesser known and used search engines.

Specialty Search Engines

Search engines for specific information or topics.

Visual Search and Clustering Search Engines

Search engines that scrape multiple sites (Google, Yahoo, Bing, Goo, etc) at the same time and return results.

  • Carrot2 – Organizes your search results into topics.
  • Yippy – Search using multiple sources at once

Similar Sites Search

Find websites that are similar. Good for business competition research.

Document and Slides Search

Search for data located on PDFs, Word documents, presentation slides, and more.

File Search

Search for all kind of files.

Pastebins

Find information that has been uploaded to Pastebin & alternative pastebin-type sites

Code Search

Search by website source code

Major Social Networks

Real-Time Search, Social Media Search, and General Social Media Tools

Social Media Tools

Twitter

Facebook

Instagram

Pinterest

Reddit

Tools to help discover more about a reddit user or subreddit.

  • Imgur – The most popular image hosting website used by redditors.
  • Mostly Harmless – Mostly Harmless looks up the page you are currently viewing to see if it has been submitted to reddit.
  • Reddit Archive – Historical archives of reddit posts.
  • Reddit Suite – Enhances your reddit experience.
  • Reddit User Analyser – reddit user account analyzer.
  • Subreddits – Discover new subreddits.
  • Reddit Comment Search – Analyze a reddit users by comment history.
  • Universal Scammer List – This acts as the website-portion for the subreddit /r/universalscammerlist. That subreddit, in conjuction with this website and a reddit bot, manages a list of malicious reddit accounts and minimizes the damage they can deal. This list is referred to as the “USL” for short.
  • Reddit Comment Lookup – Search for reddit comments by reddit username.

VKontakte

Perform various OSINT on Russian social media site VKontakte.

Tumblr

LinkedIn

  • FTL – Browser plugin that finds emails of people’s profiles in LinkedIn.

Telegram

  • Telegago – A Google Advanced Search specifically for finding public and private Telegram Channels and Chatrooms.
  • Telegram Nearby Map – Webapp based on OpenStreetMap and the official Telegram library to find the position of nearby users.

Blog Search

Forums and Discussion Boards Search

Username Check

People Investigations

  • 411 (US) – Search by person, phone number, address, and business. Limited free info, premium data upsell.
  • 192 (UK) – Search by person, business, address. Limited free info, premium data upsell.
  • Ancestry – Premium data, free trial with credit card.
  • Black Book Online – Free. Nationwide directory of public record lookups.
  • Canada411 – Search by person, phone number, and business. Free.
  • Classmates – High-school focused people search. Free acounts allow creating a profile and viewing other members. Premium account required to contact other members.
  • CrunchBase – Business information database, with a focus on investment, acquisition, and executive data. Ancillary focus on market research and connecting founders and investors.
  • facesearch – Handy proxy to search Google face-only image search results.
  • Family Search – Popular genealogy site. Free, but registration requried. Funded by The Church Of Jesus Christ of Latter-day Saints.
  • Federal Bureau of Prisons – Inmate Locator (US) – Search federal inmates incarcerated from 1982 to the present.
  • Fold3 (US Military Records) – Search military records. Search filters limited with free access. Premium access requires subscription.
  • Genealogy Bank – Premium data, free trial with credit card.
  • Genealogy Links – Genealogy directory with over 50K links.
  • Homemetry – Reverse address search and allows searching for properties for sale/rent.
  • Judyrecords – Free. Nationwide search of 400 million+ United States court cases.
  • Kompass – Business directory and search.
  • OpenSanctions – Information on sanctions and public office holders.
  • The National Archives (UK) – Search UK national archives.
  • Reunion – People search. Limited free info, premium data upsell.
  • SearchBug – People search. Limited free info, premium data upsell.
  • Spokeo – People search. Limited free info, premium data upsell.
  • UniCourt – Limited free searches, premium data upsell. Nationwide search of 100 million+ United States court cases.
  • White Pages (US) – People search. Limited free info, premium data upsell.
  • ZabaSearch
  • JailBase
  • Mugshots

E-mail Search / E-mail Check

  • DeHashed – DeHashed helps prevent ATO with our extensive data set & breach notification solution. Match employee and consumer logins against the world’s largest repository of aggregated publicly available assets leaked from third-party breaches. Secure passwords before criminals can abuse stolen information, and protect your enterprise.
  • LeakCheck – Data Breach Search Engine with 7.5B+ entries collected from more than 3000 databases. Search by e-mail, username, keyword, password or corporate domain name.
  • Email Address Validator
  • Email Format
  • EmailHippo
  • Email Permutator
  • h8mail – Password Breach Hunting and Email OSINT, locally or using premium services. Supports chasing down related email.
  • Holehe
  • Have I Been Pwned – Search across multiple data breaches to see if your email address has been compromised.
  • Hunter – Hunter lets you find email addresses in seconds and connect with the people that matter for your business.
  • MailTester
  • Peepmail
  • Pipl
  • Reacher – Real-time email verification API, written in Rust, 100% open-source.
  • ReverseGenie
  • ThatsThem
  • Toofr
  • Verify Email
  • VoilaNorbert – Find anyone’s contact information for lead research or talent acquisition.
  • Ghunt – Investigate Google emails and documents.

Phone Number Research

Expert Search

Company Research

Job Search Resources

Q&A Sites

Domain and IP Research

Keywords Discovery and Research

Web History and Website Capture

Language Tools

Image Search

Image Analysis

Stock Images

Video Search and Other Video Tools

Radio and Podcasts Tools

Academic Resources and Grey Literature

Books and Reading

Geospatial Research and Mapping Tools

News

News Digest and Discovery Tools

Fact Checking

Data and Statistics

Web Monitoring

Bookmarking

Startpages

Browsers

Offline Browsing

VPN Services

Note-taking

Annotation Tools

Writing and Office Tools

Slide Show and Presentation Tools

Digital Publishing

Newsletter Tools

Digital Storytelling

Infographics and Data Visualization

Image and Photo Editing

Productivity Tools

E-mail Management

Document and Reference Management

PDF Management

OCR Tools

Cloud Storage and File Sharing

Web Automation

Dashboard Tools

Wikis

Collaboration and Project Management

Communication Tools

Calendars and Scheduling

Mind Mapping, Concept Mapping and Idea Generation Tools

Social Network Analysis

Privacy and Encryption Tools

DNS

  • Amass – The amass tool searches Internet data sources, performs brute force subdomain enumeration, searches web archives, and uses machine learning to generate additional subdomain name guesses. DNS name resolution is performed across many public servers so the authoritative server will see the traffic coming from different locations. Written in Go.
  • findsubdomains – Automatically scans different sources to collect as many subdomains as can. Validate all the data through various tools and services to provide correct results without waiting.

Martime

  • VesselFinder – a FREE AIS vessel tracking web site. VesselFinder displays real time ship positions and marine traffic detected by global AIS network.

Other Tools

  • Barcode Reader – Decode barcodes in C#, VB, Java, C\C++, Delphi, PHP and other languages.
  • Belati – Belati – The Traditional Swiss Army Knife For OSINT. Belati is tool for Collecting Public Data & Public Document from Website and other service for OSINT purpose.
  • BeVigil-CLI – A unified command line interface and python library for using BeVigil OSINT API to search for assets such as subdomains, URLs, applications indexed from mobile applications.
  • CrowdSec – An open source, free, and collaborative IPS/IDS software written in Go, able to analyze visitor behavior & provide an adapted response to all kinds of attacks.
  • Datasploit – Tool to perform various OSINT techniques on usernames, emails addresses, and domains.
  • DuckDuckGo URL scraper – A simple DuckDuckGo URL scraper.
  • Greynoise – “Anti-Threat Intelligence” Greynoise characterizes the background noise of the internet, so the user can focus on what is actually important.
  • The Harvester – Gather emails, subdomains, hosts, employee names, open ports and banners from different public sources like search engines, PGP key servers and SHODAN computer database.
  • Intrigue Core – Framework for attack surface discovery.
  • LinkScope – LinkScope is an open source intelligence (OSINT) graphical link analysis tool and automation platform for gathering and connecting information for investigative tasks.
  • Maltego – Maltego is an open source intelligence (OSINT) and graphical link analysis tool for gathering and connecting information for investigative tasks.
  • Hunchly – Hunchly is a web capture tool designed specifically for online investigations.
  • OpenRefine – Free & open source power tool for working with messy data and improving it.
  • Orbit – Draws relationships between crypto wallets with recursive crawling of transaction history.
  • OSINT Framework – Web based framework for OSINT.
  • OsintStalker – Python script for Facebook and geolocation OSINT.
  • Outwit – Find, grab and organize all kinds of data and media from online sources.
  • eScraper – Grab product descriptions, prices, image urls and other data effortlessly
  • Photon – Crawler designed for OSINT
  • Pown Recon – Target reconnaissance framework powered by graph theory.
  • QuickCode – Python and R data analysis environment.
  • SecApps Recon – Information gathering and target reconnaissance tool and UI.
  • sn0int – Semi-automatic OSINT framework and package manager.
  • SpiderFoot – SpiderFoot is an open source intelligence (OSINT) automation platform with over 200 modules for threat intelligence, attack surface monitoring, security assessments and asset discovery.
  • Zen – Find email addresses of Github users
  • OSINT.SH – Information Gathering Toolset.
  • FOCA – Tool to find metadata and hidden information in the documents.
  • Sub3 Suite – A research-grade suite of tools for intelligence gathering & target mapping with both active and passive(100+ modules) intelligence gathering capabilities.

Threat Intelligence

  • GitGuardian – Public GitHub Monitoring – Monitor public GitHub repositories in real time. Detect secrets and sensitive information to prevent hackers from using GitHub as a backdoor to your business.
  • REScure Threat Intel Feed – REScure is an independent threat intelligence project which we undertook to enhance our understanding of distributed systems, their integration, the nature of threat intelligence and how to efficiently collect, store, consume, distribute it.
  • OTX AlienVault – Open Threat Exchange is the neighborhood watch of the global intelligence community. It enables private companies, independent security researchers, and government agencies to openly collaborate and share the latest information about emerging threats, attack methods, and malicious actors, promoting greater security across the entire community.
  • OnionScan – Free and open source tool for investigating the Dark Web. Its main goal is to help researchers and investigators monitor and track Dark Web sites.

OSINT Videos

OSINT Blogs

Other Resources

Project Management Tools

Project management tools, Scrum tools, and Project Boards.

  • ClickUp – Heavy-weight Task Management
  • Scrumfast – Light-weight, Free Project Management Tool
  • Trello – Free Team Project Board

The OSINT is a github repository by jivoi

Source from
Awesome AWS Security
Tags: