Skip to content

DR4CBOI/OniExtractor

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 

Repository files navigation

OniExtractor

A Dark Web OSINT tool for discovering and validating .onion links from various sources.

Disclaimer

This tool is intended for security research and educational purposes. Users are responsible for compliance with all applicable laws. Only use on systems you own or have explicit permission to test.

Features

  • Extract .onion links from URLs, files, or text
  • Automatic link categorization (7 categories)
  • SQLite database with historical tracking
  • Multi-threaded link validation (alive/dead checking)
  • Link search functionality
  • 15 rotating User-Agents
  • Comprehensive error handling

Categories

Links are automatically categorized as:

  • Marketplace
  • Forum
  • Service
  • Social
  • Blog
  • Directory
  • Other

Requirements

pip install requests beautifulsoup4

Tor must be running on 127.0.0.1:9050.

Installation

  1. Install Tor:

    # Debian/Ubuntu
    sudo apt install tor
    sudo systemctl start tor
    
    # macOS
    brew install tor
    tor
  2. Install dependencies:

    pip install requests beautifulsoup4

Usage

torsocks python oniextractor.py

Options

  1. Extract from URL
  2. Extract from file
  3. Extract from text input
  4. Check if links are alive (batch validation)
  5. Show alive links from database
  6. Search links

Configuration

  • Use database (yes/no)
  • Number of workers for batch checking (default: 5)
  • Category filter for search

Output Structure

onion_links/
├── onion_links.json    # Full data with categories
├── onion_links.txt     # Plain link list
└── links.db            # SQLite database

Database Schema

links table:

  • link, category, first_seen, last_seen
  • source, status, title, description

link_checks table:

  • link_id, timestamp, status_code
  • response_time, is_alive

Link Validation

Multi-threaded alive/dead checking:

  • Configurable worker threads
  • Response time tracking
  • Status code logging
  • Database status updates

Search

Search by:

  • Keyword in link
  • Category filter
  • Status (alive/dead)

Export Formats

  • JSON: Complete data with metadata and timestamps
  • TXT: Simple sorted list of links

About Project

Version : 1.0

License: MIT License - See LICENSE file

Developer: DR4CBOI

Contact: dr4cboi@protonmail.com

About

A Dark Web OSINT tool for discovering and validating .onion links from various sources.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages