Cybersecurity Threat Detection and Hunting

superior_hosting_service

cyberthreat

An ongoing & curated collection of awesome software best practices and remediation techniques, libraries and frameworks, E-books and videos, Technical guidelines and important resources about Threat Detection & Hunting.


Threat Detection and Hunting

Tools

  • MITRE ATT&CK Navigator(source code) – The ATT&CK Navigator is designed to provide basic navigation and annotation of ATT&CK matrices, something that people are already doing today in tools like Excel.
  • HELK – A Hunting ELK (Elasticsearch, Logstash, Kibana) with advanced analytic capabilities.
  • osquery-configuration – A repository for using osquery for incident detection and response.
  • DetectionLab – Vagrant & Packer scripts to build a lab environment complete with security tooling and logging best practices.
  • Sysmon-DFIR – Sources, configuration and how to detect evil things utilizing Microsoft Sysmon.
  • sysmon-config – Sysmon configuration file template with default high-quality event tracing.
  • sysmon-modular – A repository of sysmon configuration modules. It also includes a mapping of Sysmon configurations to MITRE ATT&CK techniques.
  • Revoke-Obfuscation – PowerShell Obfuscation Detection Framework.
  • Invoke-ATTACKAPI – A PowerShell script to interact with the MITRE ATT&CK Framework via its own API.
  • Unfetter – A reference implementation provides a framework for collecting events (process creation, network connections, Window Event Logs, etc.) from a client machine and performing CAR analytics to detect potential adversary activity.
  • Flare – An analytical framework for network traffic and behavioral analytics.
  • RedHunt-OS – A Virtual Machine for Adversary Emulation and Threat Hunting. RedHunt aims to be a one stop shop for all your threat emulation and threat hunting needs by integrating attacker’s arsenal as well as defender’s toolkit to actively identify the threats in your environment.
  • Oriana – Lateral movement and threat hunting tool for Windows environments built on Django comes Docker ready.
  • Bro-Osquery – Bro integration with osquery
  • Brosquery – A module for osquery to load Bro logs into tables
  • DeepBlueCLI – A PowerShell Module for Hunt Teaming via Windows Event Logs
  • Uncoder – An online translator for SIEM saved searches, filters, queries, API requests, correlation and Sigma rules
  • Sigma – Generic Signature Format for SIEM Systems
  • CimSweep – A suite of CIM/WMI-based tools that enable the ability to perform incident response and hunting operations remotely across all versions of Windows
  • Dispatch – An open-source crisis management orchestration framework
  • EQL – Event Query Language
    • EQLLib – The Event Query Language Analytics Library (eqllib) is a library of event based analytics, written in EQL to detect adversary behaviors identified in MITRE ATT&CK™.
  • BZAR (Bro/Zeek ATT&CK-based Analytics and Reporting) – A set of Zeek scripts to detect ATT&CK techniques
  • Security Onion – An open-source Linux distribution for threat hunting, security monitoring, and log management. It includes ELK, Snort, Suricata, Zeek, Wazuh, Sguil, and many other security tools
  • Varna – A quick & cheap AWS CloudTrail Monitoring with Event Query Language (EQL)
  • BinaryAlert – Serverless, real-time & retroactive malware detection
  • hollows_hunter – Scans all running processes, recognizes and dumps a variety of potentially malicious implants (replaced/implanted PEs, shellcodes, hooks, in-memory patches).
  • ThreatHunting – A Splunk app mapped to MITRE ATT&CK to guide your threat hunts
  • Sentinel Attack – A repository of Azure Sentinel alerts and hunting queries leveraging sysmon and the MITRE ATT&CK framework
  • Brim – A desktop application to efficiently search large packet captures and Zeek logs
  • YARA – The pattern matching swiss knife
  • Intel Owl – An Open Source Intelligence, or OSINT solution to get threat intelligence data about a specific file, an IP or a domain from a single API at scale.
  • Capa – An open-source tool to identify capabilities in executable files.

Alerting Engine

  • ElastAlert – A framework for alerting on anomalies, spikes, or other patterns of interest from data in Elasticsearch
  • StreamAlert – A serverless, realtime data analysis framework which empowers you to ingest, analyze, and alert on data from any environment, using datasources and alerting logic you define

Endpoint Monitoring

  • osquery (github) – SQL powered operating system instrumentation, monitoring, and analytics
  • Kolide Fleet – A flexible control server for osquery fleets
  • Zeek Agent – An endpoint monitoring agent that provides host activity to Zeek
  • Velociraptor – Endpoint visibility and collection tool
  • Sysdig – A tool for deep Linux system visibility, with native support for containers. Think about sysdig as strace + tcpdump + htop + iftop + lsof + …awesome sauce
  • go-audit – An alternative to the Linux auditd daemon
  • Sysmon – A Windows system service and device driver that monitors and logs system activity to the Windows event log
  • OSSEC – An open-source Host-based Intrusion Detection System (HIDS)
  • WAZUH – An open-source security platform

Network Monitoring

  • Zeek (formerly Bro) – A network security monitoring tool
  • ntopng – A web-based network traffic monitoring tool
  • Suricata – A network threat detection engine
  • Snort (github) – A network intrusion detection tool
  • Joy – A package for capturing and analyzing network flow data and intraflow data, for network research, forensics, and security monitoring
  • Netcap – A framework for secure and scalable network traffic analysis
  • Moloch – A large scale and open source full packet capture and search tool
  • Stenographer – A full-packet-capture tool

Fingerprinting Tools

  • JA3 – A method for profiling SSL/TLS Clients and Servers
  • HASSH – Profiling Method for SSH Clients and Servers
  • RDFP – Zeek Remote desktop fingerprinting script based on FATT (Fingerprint All The Things)
  • FATT – A pyshark based script for extracting network metadata and fingerprints from pcap files and live network traffic
  • FingerprinTLS – A TLS fingerprinting method
  • Mercury – Network fingerprinting and packet metadata capture
  • GQUIC Protocol Analyzer for Zeek
  • Recog – A framework for identifying products, services, operating systems, and hardware by matching fingerprints against data returned from various network probes
  • Hfinger – Fingerprinting HTTP requests
  • JARM – An active Transport Layer Security (TLS) server fingerprinting tool.

Dataset

Resources

Frameworks

  • MITRE ATT&CK – A curated knowledge base and model for cyber adversary behavior, reflecting the various phases of an adversary’s lifecycle and the platforms they are known to target.
  • MITRE CAR – The Cyber Analytics Repository (CAR) is a knowledge base of analytics developed by MITRE based on the Adversary Tactics, Techniques, and Common Knowledge (ATT&CK™) adversary model.
  • Alerting and Detection Strategies Framework – A framework for developing alerting and detection strategies.
  • A Simple Hunting Maturity Model – The Hunting Maturity Model describes five levels of organizational hunting capability, ranging from HMM0 (the least capability) to HMM4 (the most).
  • The Pyramic of Pain – The relationship between the types of indicators you might use to detect an adversary’s activities and how much pain it will cause them when you are able to deny those indicators to them.
  • A Framework for Cyber Threat Hunting
  • The PARIS Model – A model for threat hunting.
  • Cyber Kill Chain – It is part of the Intelligence Driven Defense® model for identification and prevention of cyber intrusions activity. The model identifies what the adversaries must complete in order to achieve their objective.
  • The DML Model – The Detection Maturity Level (DML) model is a capability maturity model for referencing ones maturity in detecting cyber attacks.
  • NIST Cybersecurity Framework
  • OSSEM (Open Source Security Events Metadata) – A community-led project that focuses on the documentation and standardization of security event logs from diverse data sources and operating systems
  • MITRE Shield – A knowledge base of active defense techniques and tactics (Active Defense Matrix)

DNS

Command and Control

DoH

Osquery

Windows

Sysmon

PowerShell

Fingerprinting

Research Papers

Blogs

Videos

Trainings

Twitter

Threat Simulation


A curated list of awesome adversary simulation resources

Tools

  • MITRE CALDERA – An automated adversary emulation system that performs post-compromise adversarial behavior within Windows Enterprise networks.
  • APTSimulator – A Windows Batch script that uses a set of tools and output files to make a system look as if it was compromised.
  • Atomic Red Team – Small and highly portable detection tests mapped to the Mitre ATT&CK Framework.
  • Network Flight Simulator – flightsim is a lightweight utility used to generate malicious network traffic and help security teams to evaluate security controls and network visibility.
  • Metta – A security preparedness tool to do adversarial simulation.
  • Red Team Automation (RTA) – RTA provides a framework of scripts designed to allow blue teams to test their detection capabilities against malicious tradecraft, modeled after MITRE ATT&CK.
  • SharpShooter – Payload Generation Framework.
  • CACTUSTORCH – Payload Generation for Adversary Simulations.
  • DumpsterFire – A modular, menu-driven, cross-platform tool for building repeatable, time-delayed, distributed security events.
  • Empire(website) – A PowerShell and Python post-exploitation agent.
  • PowerSploit – A PowerShell Post-Exploitation Framework.
  • RedHunt-OS – A Virtual Machine for Adversary Emulation and Threat Hunting. RedHunt aims to be a one stop shop for all your threat emulation and threat hunting needs by integrating attacker’s arsenal as well as defender’s toolkit to actively identify the threats in your environment.
  • Infection Monkey – An open source Breach and Attack Simulation (BAS) tool that assesses the resiliency of private and public cloud environments to post-breach attacks and lateral movement.
  • Splunk Attack Range – A tool that allows you to create vulnerable instrumented local or cloud environments to simulate attacks against and collect the data into Splunk.

Resources

The Cybersecurity Threat Detection is a github repository by Paul Veillard