Sign in

The DejanBot crawler checks monitored URLs on scheduled cadences by fetching the live HTML and verifying link presence, status codes, rel attributes, and exact anchor text matching against original placements, surfacing changes through the platform notification bell and event logs.

sequenceDiagram
    autonumber
    participant S as Scheduler
    participant DB as DejanBot Engine
    participant T as Publisher Page
    participant DBStore as Link Monitor DB
    participant UI as Alert System

    S->>DB: Trigger Crawl Job
    DB->>T: HTTP GET Request
    T-->>DB: Status Code and HTML
    DB->>DB: Parse DOM and Validate Anchor
    alt Link Missing or Modified
        DB->>DBStore: Record Failure Status
        DB->>UI: Dispatch Alert
    else Link and Anchor Valid
        DB->>DBStore: Update Verified Timestamp
    end

Referenced by