Bot Data Scraper Cog

The Bot Data Scraper cog extracts and stores moderation data from other bots’ messages for unified case management.

Features

Data Extraction

  • Message Parsing: Extract case information from embeds
  • Bot Recognition: Identify different bot formats
  • Historical Scraping: Process past messages
  • Incremental Updates: Track last processed message

Database Storage

  • Unified Format: Store all cases in consistent format
  • Duplicate Prevention: Avoid storing duplicate cases
  • Data Validation: Ensure data integrity
  • Backup Support: Include in database backups

Supported Bots

  • Sisyphus: Full case data extraction
  • Circle: Moderation log parsing
  • Custom Bots: Extensible for other bots
  • Format Detection: Automatic format recognition

Commands

Command Description Permissions
/scraper status View scraping status Administrator
/scraper fix Fix database inconsistencies Administrator

Configuration

  • Enabled Bots: Which bots to scrape
  • Channel Monitoring: Which channels to monitor
  • Update Frequency: How often to check for new messages

Best Practices

  1. Permission Verification: Ensure read access to channels
  2. Data Accuracy: Verify scraped data matches source
  3. Performance Monitoring: Watch for rate limiting
  4. Regular Maintenance: Clean up old tracking data