Adobe Digest

Automated security bulletin aggregator for Adobe Commerce, AEM, and related products

Adobe Digest is an automated system that scrapes, aggregates, and publishes security bulletins and research articles related to Adobe Commerce (Magento), Adobe Experience Manager (AEM), and related technologies. The content is automatically posted to adobedigest.com via Micro.blog.

Features

🔍 Automated Scraping: Monitors multiple sources for new security content
📰 Multi-Source Aggregation: Adobe HelpX bulletins, Sansec research, Akamai blog
🤖 Smart Filtering: Content filtering for relevant Adobe Commerce/AEM topics
📝 Micro.blog Integration: Automatic posting via Micropub API
⏰ Scheduled Updates: Runs every 6 hours via GitHub Actions
🔄 Deduplication: Tracks posted content to avoid duplicates
📊 Hugo Static Site: Fast, modern website built with Hugo
📡 RSS Feeds: Multiple feeds for all bulletins and per-product updates
🔔 Browser Notifications: Real-time alerts for new security bulletins via browser notifications

Staying Updated

Get security bulletin updates through your preferred channel:

Browser Notifications

Enable browser notifications on adobedigest.com to receive instant alerts when new security bulletins are posted. Works with Chrome, Firefox, Safari, and Edge.

See Browser Notifications Documentation for details.

RSS Feeds

Subscribe to stay updated on Adobe security bulletins:

All Bulletins - Complete firehose of all security bulletins and advisories
Per-Product Feeds - Individual RSS feeds for specific Adobe products
JSON Feed - JSON Feed format for developers

Data Sources

Adobe Security Bulletins (via Adobe HelpX)
- Adobe Commerce (Magento)
- Adobe Experience Manager
- Adobe AEM Forms
Adobe Commerce Release Notes
- Official release notes for Adobe Commerce versions
- Feature updates, security patches, and platform changes
Magento Open Source Release Notes
- Official release notes for Magento Open Source versions
- Community edition updates and releases
Sansec.io Security Research
- Magento/Adobe Commerce security research
- Threat intelligence and malware analysis
Akamai Security Blog (filtered)
- Posts mentioning Adobe Commerce, AEM, or related vulnerabilities
- SessionReaper, CosmicString, and other Adobe-related threats
NIST National Vulnerability Database (NVD)
- CVE vulnerability updates for Adobe Commerce, Magento, and AEM
- Tracks newly published and recently modified CVEs
- Checks for updates daily across 30-day rolling window
- Includes CVSS severity scores and reference links

Architecture

┌─────────────────┐
│ GitHub Actions  │  Runs every 6 hours
│  (Scraper)      │  
└────────┬────────┘
         │
         ├──> Scrape Adobe HelpX
         ├──> Scrape Adobe Commerce Releases
         ├──> Scrape Magento Open Source Releases
         ├──> Scrape Sansec.io 
         ├──> Scrape Akamai Blog (filtered)
         ├──> Scrape NIST NVD CVEs (filtered)
         │
         v
┌─────────────────┐
│  Post to        │  Via Micropub API
│  Micro.blog     │  
└────────┬────────┘
         │
         v
┌─────────────────┐
│  adobedigest.com│  Hugo static site
│  (Micro.blog)   │  Custom theme
└─────────────────┘

Local Development

Prerequisites

Python 3.11+
Hugo 0.152+
Node.js (for justfile tasks)

Setup

# Clone the repository
git clone https://github.com/doughatcher/adobe-digest.git
cd adobe-digest

# Create Python virtual environment
python3 -m venv .venv
source .venv/bin/activate

# Install dependencies
cd scraper
pip install -r requirements.txt

Running the Scraper Locally

cd scraper
python3 scraper.py

This will:

Read sources from data/sources.yaml
Scrape new content
Create markdown files in content/YYYY/MM/DD/
Update scraped_posts.json tracking file

Testing Micro.blog Posting

# Set environment variables
export MICROBLOG_TOKEN="your-token"
export MICROBLOG_MP_DESTINATION="https://adobedigest.micro.blog/"

# Post up to 5 new items
cd scraper
python3 post_to_microblog.py 5

Building the Site

# Build with Hugo
hugo

# Serve locally
hugo server

Configuration

Adding New Sources

Edit data/sources.yaml:

sources:
  - type: adobe-helpx
    name: source-identifier
    display_name: "Display Name"
    url: https://helpx.adobe.com/security/security-bulletin.html
    section_id: product-section
  
  - type: adobe-release-notes
    name: source-identifier
    display_name: "Display Name"
    url: https://experienceleague.adobe.com/en/docs/commerce-operations/release/versions
    product: adobe-commerce  # or magento-open-source
    categories:
      - releases
    
  - type: atom-feed
    name: source-identifier
    display_name: "Display Name"
    url: https://example.com/feed.xml
    limit: 20
    includes:
      - keyword1
      - keyword2
    categories:
      - category1
  
  - type: nist-nvd
    name: source-identifier
    display_name: "Display Name"
    keywords:
      - Adobe Commerce
      - Magento
    lookback_days: 30
    categories:
      - cve
      - vulnerability

GitHub Secrets and Variables

Required for GitHub Actions:

Secrets (Settings → Secrets and variables → Actions → Secrets):

GMAIL_APP_PASSWORD: Gmail App Password (see DEPLOYMENT.md for setup)
MICROBLOG_TOKEN: Your Micro.blog API token
MICROBLOG_MP_DESTINATION: Your blog URL (e.g., https://adobedigest.micro.blog/)

Variables (Settings → Secrets and variables → Actions → Variables):

GMAIL_EMAIL: Gmail address for receiving sign-in emails
MICROBLOG_EMAIL: Micro.blog account email
MICROBLOG_SITE_ID: Your site's numeric ID
MICROBLOG_THEME_ID: Your theme's numeric ID

See DEPLOYMENT.md for detailed setup instructions.

Workflows

Scrape and Post (`scrape-and-post.yml`)

Schedule: Every 6 hours
Manual: Via workflow_dispatch
Actions: Scrape sources → Post to Micro.blog → Commit tracking file

Deploy to Micro.blog (`deploy-microblog.yml`)

Trigger: Push to main (theme files only)
Manual: Via workflow_dispatch
Actions: Email auth → Reload theme → Rebuild site → Monitor logs
Features: Session caching (7-day TTL), automatic re-authentication

Test (`test.yml`)

Trigger: Push to main, PRs
Actions: Validate YAML, test scraper, verify Hugo build

Deployment

Automated Deployment

Theme changes automatically trigger deployment to Micro.blog when you push to main:

Changes to layouts/, static/, theme.toml, or config.json
Uses email-based authentication with session caching
Monitors build logs for completion

Manual Deployment

# Full deployment with authentication
just microblog-deploy-all

# Quick deployment (reuses existing session)
just microblog-deploy

# Individual operations
just microblog-auth       # Authenticate and save session
just microblog-reload     # Reload theme only
just microblog-rebuild    # Trigger rebuild only

See DEPLOYMENT.md for complete documentation.

Project Structure

adobe-digest/
├── .github/
│   └── workflows/          # GitHub Actions workflows
├── content/                # Hugo content (generated by scraper)
│   ├── 2024/
│   ├── 2025/
│   └── bulletins/
├── data/
│   └── sources.yaml        # Scraper source configuration
├── layouts/                # Hugo templates
│   ├── index.html          # Homepage
│   └── _default/
├── scraper/                # Python scraping system
│   ├── scraper.py          # Main scraper
│   ├── post_to_microblog.py # Micropub poster
│   ├── scraped_posts.json  # Tracking file
│   └── scrapers/           # Individual scrapers
│       ├── adobe_helpx.py
│       ├── adobe_releases.py
│       ├── atom_feed.py
│       ├── sansec_io.py
│       └── nist_nvd.py
└── static/                 # Static assets

Documentation

NIST NVD Integration - How CVE tracking from NIST works
Deployment Guide - Deployment and hosting information
Micro.blog Multi-Blog Setup - Multi-blog configuration

Credits

Theme: Forked from Dougie theme
Hosting: Micro.blog
Sources: Adobe, Sansec.io, Akamai

License

MIT License - See LICENSE for details

Links

Website: adobedigest.com
Micro.blog: @adobedigest
Repository: github.com/doughatcher/adobe-digest

Automated security intelligence for Adobe Commerce and AEM

Name		Name	Last commit message	Last commit date
Latest commit History 211 Commits
.devcontainer		.devcontainer
.github		.github
.husky		.husky
content		content
data		data
docs		docs
layouts		layouts
scraper		scraper
static		static
.env.example		.env.example
.gitignore		.gitignore
DEDUPLICATION_ANALYSIS.md		DEDUPLICATION_ANALYSIS.md
DEPLOYMENT.md		DEPLOYMENT.md
DUPLICATE_CLEANUP.md		DUPLICATE_CLEANUP.md
DYNAMIC_RSS_FEEDS.md		DYNAMIC_RSS_FEEDS.md
LICENSE		LICENSE
MICROBLOG.md		MICROBLOG.md
README.md		README.md
config.json		config.json
generate-favicon.html		generate-favicon.html
justfile		justfile
package-lock.json		package-lock.json
package.json		package.json
plugin.json		plugin.json
theme.toml		theme.toml

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Repository files navigation

Adobe Digest

Features

Staying Updated

Browser Notifications

RSS Feeds

Data Sources

Architecture

Local Development

Prerequisites

Setup

Running the Scraper Locally

Testing Micro.blog Posting

Building the Site

Configuration

Adding New Sources

GitHub Secrets and Variables

Workflows

Scrape and Post (`scrape-and-post.yml`)

Deploy to Micro.blog (`deploy-microblog.yml`)

Test (`test.yml`)

Deployment

Automated Deployment

Manual Deployment

Project Structure

Documentation

Credits

License

Links

About

Uh oh!

Uh oh!

Contributors 3

Uh oh!

Languages

License

doughatcher/adobe-digest

Folders and files

Latest commit

History

Repository files navigation

Adobe Digest

Features

Staying Updated

Browser Notifications

RSS Feeds

Data Sources

Architecture

Local Development

Prerequisites

Setup

Running the Scraper Locally

Testing Micro.blog Posting

Building the Site

Configuration

Adding New Sources

GitHub Secrets and Variables

Workflows

Scrape and Post (scrape-and-post.yml)

Deploy to Micro.blog (deploy-microblog.yml)

Test (test.yml)

Deployment

Automated Deployment

Manual Deployment

Project Structure

Documentation

Credits

License

Links

About

Resources

License

Uh oh!

Stars

Watchers

Forks

Uh oh!

Contributors 3

Uh oh!

Languages

Scrape and Post (`scrape-and-post.yml`)

Deploy to Micro.blog (`deploy-microblog.yml`)

Test (`test.yml`)