Monitoring — AML Screening

HTML crawl settings

Depth

Max pages

Follow pagination (Next button through all pages)

Crawl all pages found (follow every link on each page)

Only follow links on the same domain

Exclude URLs containing (optional)

One pattern per line. Any discovered URL containing a pattern is skipped. The starting URL is never excluded.

Examples: /admin/ skips any admin page · .pdf skips PDF links · ?page= skips paginated variants

Filter fields Off: ingest all fields. On: choose which fields to store.

CSV settings

Title column (column name) *

ID column for deduplication (optional)

Content columns (comma-separated) *

Filter fields Off: ingest all fields. On: choose which fields to store.

Delimiter

Batch size

First row is a header

XML settings

Record selector (dot-path) *

Title field (dot-path within record) *

ID field (optional)

Content fields (comma-separated dot-paths) *

Filter fields Off: ingest all fields. On: choose which fields to store.

Batch size

JSON settings

Records path *

Title field *

ID field (optional)

Content fields (comma-separated) *

Filter fields Off: ingest all fields. On: choose which fields to store.

Batch size

PDF settings

Page handling

Max pages to extract

API settings

Records path in response *

Title field *

ID field (optional)

Content fields (comma-separated) *

Filter fields Off: ingest all fields. On: choose which fields to store.

Authentication

Auth type

Pagination

Pagination type

Page size

Max pages

Limit param (optional)

Batch size

OAuth2 settings

Profile

Token endpoint URL *

Client ID *

Scope(s) *

SPARQL settings

SPARQL SELECT query *

Override endpoint URL (optional)

Title variable *

ID variable (optional)

Content variables (comma-separated) *

Filter fields Off: ingest all fields. On: choose which fields to store.

Batch size

Mailbox settings

Email address i Reading a mailbox needs a one-time Microsoft 365 setup: an app registration with Mail.Read permission, approved by an administrator. Without it, the mailbox will connect but fetch nothing.
Learn more

Lookback window

Retention period

Lookback controls how far back we start reading. Retention controls how long ingested mail stays searchable before it's automatically removed. They are independent settings. First sync reads mail back to the lookback window start; after that only new mail since the last sync is fetched. Widening lookback later clears the sync marker so the next pull back-fills; already-ingested mail is kept (duplicates skipped by message ID).

Entra tenant ID

Client ID

Client secret credential

Store the Graph app secret under Credentials first, then select it here.

HTML crawl settings

Depth

Max pages

Follow pagination (Next button through all pages)

Crawl all pages found (follow every link on each page)

Only follow links on the same domain

Exclude URLs containing (optional)

One pattern per line. Any discovered URL containing a pattern is skipped. The starting URL is never excluded.

Examples: /admin/ skips any admin page · .pdf skips PDF links · ?page= skips paginated variants

Filter fields Off: ingest all fields. On: choose which fields to store.

CSV settings

Title column *

ID column (optional)

Content columns (comma-separated) *

Filter fields Off: ingest all fields. On: choose which fields to store.

Delimiter

Batch size

First row is a header

XML settings

Record selector (dot-path) *

Title field (dot-path) *

ID field (optional)

Content fields (comma-separated) *

Filter fields Off: ingest all fields. On: choose which fields to store.

Batch size

JSON settings

Records path *

Title field *

ID field (optional)

Content fields (comma-separated) *

Filter fields Off: ingest all fields. On: choose which fields to store.

Batch size

PDF settings

Page handling

Max pages to extract

API settings

Records path in response *

Title field *

ID field (optional)

Content fields (comma-separated) *

Filter fields Off: ingest all fields. On: choose which fields to store.

Authentication

Auth type

Pagination

Pagination type

Page size

Max pages

Limit param (optional)

Batch size

SPARQL settings

SPARQL SELECT query *

Override endpoint URL (optional)

Title variable *

ID variable (optional)

Content variables (comma-separated) *

Filter fields Off: ingest all fields. On: choose which fields to store.

Batch size

Mailbox settings

Lookback window

Retention period

Lookback controls how far back we start reading. Retention controls how long ingested mail stays searchable before it's automatically removed. Changing retention does not reset lookback, watermark, or active/cadence. Widening lookback clears the sync marker so the next pull back-fills; already-ingested mail is kept (duplicates skipped by message ID).

Sources

URL Monitors