Awesome OSINT

superior_hosting_service

onint

A curated list of amazingly awesome open source intelligence tools and resources. Open-source intelligence (OSINT) is intelligence collected from publicly available sources. In the intelligence community (IC), the term “open” refers to overt, publicly available sources (as opposed to covert or clandestine sources)


General Search

The main search engines used by users.

  • Advangle
  • Aol
  • Ask
  • Bing
  • DuckDuckGo – an Internet search engine that emphasizes protecting searchers’ privacy.
  • Gigablast – provides large-scale, high-performance, real-time information retrieval technology and services for partner sites.
  • Goodsearch – a search engine for shopping deals online.
  • Google Search – Most popular search engine.
  • Instya
  • Impersonal.me
  • Lycos
  • Search.com
  • SurfCanyon – a real-time contextual search technology that observes user behavior in order to disambiguate intent “on the fly,” and then automatically bring forward to page one relevant results that might otherwise have remain buried.
  • Wolfram Alpha – Wolfram Alpha is a computational knowledge engine (answer engine) developed by Wolfram Alpha. It will compute expert-level answers using Wolfram’s breakthrough algorithms, knowledgebase and AI technology.
  • Yahoo! Search

Main National Search Engines


Localized search engines by country.

Meta Search


Lesser known and used search engines.

Specialty Search Engines


Search engines for specific information or topics.

Visual Search and Clustering Search Engines


Search engines that scrape multiple sites (Google, Yahoo, Bing, Goo, etc) at the same time and return results.

  • Carrot2 – Organizes your search results into topics.
  • Yippy – Search using multiple sources at once

Similar Sites Search


Find websites that are similar. Good for business competition research.

Document and Slides Search


Search for data located on PDFs, Word documents, presentation slides, and more.

File Search


Search for all kind of files.

Pastebins


Find information that has been uploaded to Pastebin & alternative pastebin-type sites

Code Search


Search by website source code

Major Social Networks


Real-Time Search, Social Media Search, and General Social Media Tools


Social Media Tools


Twitter

Facebook

Instagram

Pinterest

Reddit

Tools to help discover more about a reddit user or subreddit.

  • Imgur – The most popular image hosting website used by redditors.
  • Mostly Harmless – Mostly Harmless looks up the page you are currently viewing to see if it has been submitted to reddit.
  • Reddit Archive – Historical archives of reddit posts.
  • Reddit Suite – Enhances your reddit experience.
  • Reddit User Analyser – reddit user account analyzer.
  • Subreddits – Discover new subreddits.
  • Reddit Comment Search – Analyze a reddit users by comment history.
  • Universal Scammer List – This acts as the website-portion for the subreddit /r/universalscammerlist. That subreddit, in conjuction with this website and a reddit bot, manages a list of malicious reddit accounts and minimizes the damage they can deal. This list is referred to as the “USL” for short.
  • Reddit Comment Lookup – Search for reddit comments by reddit username.

VKontakte

Perform various OSINT on Russian social media site VKontakte.

Tumblr

LinkedIn

  • FTL – Browser plugin that finds emails of people’s profiles in LinkedIn.

Telegram

  • Telegago – A Google Advanced Search specifically for finding public and private Telegram Channels and Chatrooms.
  • Telegram Nearby Map – Webapp based on OpenStreetMap and the official Telegram library to find the position of nearby users.

Blog Search


Forums and Discussion Boards Search


Username Check


People Investigations


  • 411 (US) – Search by person, phone number, address, and business. Limited free info, premium data upsell.
  • 192 (UK) – Search by person, business, address. Limited free info, premium data upsell.
  • Ancestry – Premium data, free trial with credit card.
  • Black Book Online – Free. Nationwide directory of public record lookups.
  • Canada411 – Search by person, phone number, and business. Free.
  • Classmates – High-school focused people search. Free acounts allow creating a profile and viewing other members. Premium account required to contact other members.
  • CrunchBase – Business information database, with a focus on investment, acquisition, and executive data. Ancillary focus on market research and connecting founders and investors.
  • facesearch – Handy proxy to search Google face-only image search results.
  • Family Search – Popular genealogy site. Free, but registration requried. Funded by The Church Of Jesus Christ of Latter-day Saints.
  • Federal Bureau of Prisons – Inmate Locator (US) – Search federal inmates incarcerated from 1982 to the present.
  • Fold3 (US Military Records) – Search military records. Search filters limited with free access. Premium access requires subscription.
  • Genealogy Bank – Premium data, free trial with credit card.
  • Genealogy Links – Genealogy directory with over 50K links.
  • Homemetry – Reverse address search and allows searching for properties for sale/rent.
  • Judyrecords – Free. Nationwide search of 400 million+ United States court cases.
  • Kompass – Business directory and search.
  • OpenSanctions – Information on sanctions and public office holders.
  • The National Archives (UK) – Search UK national archives.
  • Reunion – People search. Limited free info, premium data upsell.
  • SearchBug – People search. Limited free info, premium data upsell.
  • Spokeo – People search. Limited free info, premium data upsell.
  • UniCourt – Limited free searches, premium data upsell. Nationwide search of 100 million+ United States court cases.
  • White Pages (US) – People search. Limited free info, premium data upsell.
  • ZabaSearch
  • JailBase
  • Mugshots

E-mail Search / E-mail Check


  • DeHashed – DeHashed helps prevent ATO with our extensive data set & breach notification solution. Match employee and consumer logins against the world’s largest repository of aggregated publicly available assets leaked from third-party breaches. Secure passwords before criminals can abuse stolen information, and protect your enterprise.
  • LeakCheck – Data Breach Search Engine with 7.5B+ entries collected from more than 3000 databases. Search by e-mail, username, keyword, password or corporate domain name.
  • Email Address Validator
  • Email Format
  • EmailHippo
  • Email Permutator
  • h8mail – Password Breach Hunting and Email OSINT, locally or using premium services. Supports chasing down related email.
  • Holehe
  • Have I Been Pwned – Search across multiple data breaches to see if your email address has been compromised.
  • Hunter – Hunter lets you find email addresses in seconds and connect with the people that matter for your business.
  • MailTester
  • Peepmail
  • Pipl
  • Reacher – Real-time email verification API, written in Rust, 100% open-source.
  • ReverseGenie
  • ThatsThem
  • Toofr
  • Verify Email
  • VoilaNorbert – Find anyone’s contact information for lead research or talent acquisition.
  • Ghunt – Investigate Google emails and documents.

Phone Number Research


Expert Search


Company Research


Job Search Resources


Q&A Sites


Domain and IP Research


Keywords Discovery and Research


Web History and Website Capture


Language Tools


Image Search


Image Analysis


Stock Images


Video Search and Other Video Tools


Radio and Podcasts Tools


Academic Resources and Grey Literature


Books and Reading


Geospatial Research and Mapping Tools


News


News Digest and Discovery Tools


Fact Checking


Data and Statistics


Web Monitoring


Bookmarking


Startpages


Browsers


Offline Browsing


VPN Services


Note-taking


Annotation Tools


Writing and Office Tools


Slide Show and Presentation Tools


Digital Publishing


Newsletter Tools


Digital Storytelling


Infographics and Data Visualization


Image and Photo Editing


Productivity Tools


E-mail Management


Document and Reference Management


PDF Management


OCR Tools


Cloud Storage and File Sharing


Web Automation


Dashboard Tools


Wikis


Collaboration and Project Management


Communication Tools


Calendars and Scheduling


Mind Mapping, Concept Mapping and Idea Generation Tools


Social Network Analysis


Privacy and Encryption Tools


DNS


  • Amass – The amass tool searches Internet data sources, performs brute force subdomain enumeration, searches web archives, and uses machine learning to generate additional subdomain name guesses. DNS name resolution is performed across many public servers so the authoritative server will see the traffic coming from different locations. Written in Go.
  • findsubdomains – Automatically scans different sources to collect as many subdomains as can. Validate all the data through various tools and services to provide correct results without waiting.

Martime


  • VesselFinder – a FREE AIS vessel tracking web site. VesselFinder displays real time ship positions and marine traffic detected by global AIS network.

Other Tools


  • Barcode Reader – Decode barcodes in C#, VB, Java, C\C++, Delphi, PHP and other languages.
  • Belati – Belati – The Traditional Swiss Army Knife For OSINT. Belati is tool for Collecting Public Data & Public Document from Website and other service for OSINT purpose.
  • BeVigil-CLI – A unified command line interface and python library for using BeVigil OSINT API to search for assets such as subdomains, URLs, applications indexed from mobile applications.
  • CrowdSec – An open source, free, and collaborative IPS/IDS software written in Go, able to analyze visitor behavior & provide an adapted response to all kinds of attacks.
  • Datasploit – Tool to perform various OSINT techniques on usernames, emails addresses, and domains.
  • DuckDuckGo URL scraper – A simple DuckDuckGo URL scraper.
  • Greynoise – “Anti-Threat Intelligence” Greynoise characterizes the background noise of the internet, so the user can focus on what is actually important.
  • The Harvester – Gather emails, subdomains, hosts, employee names, open ports and banners from different public sources like search engines, PGP key servers and SHODAN computer database.
  • Intrigue Core – Framework for attack surface discovery.
  • LinkScope – LinkScope is an open source intelligence (OSINT) graphical link analysis tool and automation platform for gathering and connecting information for investigative tasks.
  • Maltego – Maltego is an open source intelligence (OSINT) and graphical link analysis tool for gathering and connecting information for investigative tasks.
  • Hunchly – Hunchly is a web capture tool designed specifically for online investigations.
  • OpenRefine – Free & open source power tool for working with messy data and improving it.
  • Orbit – Draws relationships between crypto wallets with recursive crawling of transaction history.
  • OSINT Framework – Web based framework for OSINT.
  • OsintStalker – Python script for Facebook and geolocation OSINT.
  • Outwit – Find, grab and organize all kinds of data and media from online sources.
  • eScraper – Grab product descriptions, prices, image urls and other data effortlessly
  • Photon – Crawler designed for OSINT
  • Pown Recon – Target reconnaissance framework powered by graph theory.
  • QuickCode – Python and R data analysis environment.
  • SecApps Recon – Information gathering and target reconnaissance tool and UI.
  • sn0int – Semi-automatic OSINT framework and package manager.
  • SpiderFoot – SpiderFoot is an open source intelligence (OSINT) automation platform with over 200 modules for threat intelligence, attack surface monitoring, security assessments and asset discovery.
  • Zen – Find email addresses of Github users
  • OSINT.SH – Information Gathering Toolset.
  • FOCA – Tool to find metadata and hidden information in the documents.
  • Sub3 Suite – A research-grade suite of tools for intelligence gathering & target mapping with both active and passive(100+ modules) intelligence gathering capabilities.

Threat Intelligence


  • GitGuardian – Public GitHub Monitoring – Monitor public GitHub repositories in real time. Detect secrets and sensitive information to prevent hackers from using GitHub as a backdoor to your business.
  • REScure Threat Intel Feed – REScure is an independent threat intelligence project which we undertook to enhance our understanding of distributed systems, their integration, the nature of threat intelligence and how to efficiently collect, store, consume, distribute it.
  • OTX AlienVault – Open Threat Exchange is the neighborhood watch of the global intelligence community. It enables private companies, independent security researchers, and government agencies to openly collaborate and share the latest information about emerging threats, attack methods, and malicious actors, promoting greater security across the entire community.
  • OnionScan – Free and open source tool for investigating the Dark Web. Its main goal is to help researchers and investigators monitor and track Dark Web sites.

OSINT Videos


OSINT Blogs


Other Resources


Project Management Tools


Project management tools, Scrum tools, and Project Boards.

  • ClickUp – Heavy-weight Task Management
  • Scrumfast – Light-weight, Free Project Management Tool
  • Trello – Free Team Project Board

The OSINT is a github repository by jivoi