Backlog over time
Due clocks per stream, sampled every 5 minutes.
MONITOR
Is the crawler keeping up?
Liveness, throughput and the direction of the backlog — read together.
Supervisor
Pool slots in use and background actors. Rate is clocks/min; if a cycle crawls without writing clocks, page pace from its log is shown too.
Freshness by stream
Click a stream to break it down by store. Pace is observations per hour against what the learned intervals need.
Recent runs
Store × stream cycles launched by the orchestrator pool.
Portfolio notes
OPERATE
Launch and follow work
Queue cycles, crawls, sweeps and browser sessions, then follow them as the workers pick them up.
Launch
Same commands as the CLI, through the worker queue.
Process the next due batch of one channel × stream.
EQUIVALENT COMMAND
Preview is read-only: it fetches nothing and moves no clock.
Activity
Jobs and browser sessions, newest first. Click a row to follow it — the detail keeps your place while it updates.
| created | kind | target | status | duration | result |
|---|
SUPERVISOR
Orchestrator
The store × stream pool: what it runs now, what comes next, and what it has done. Freshness per store lives in the Overview.
Pool
Running slots first, then the waiting queue in the order the pool will claim it. Rate is clocks refreshed in the last minute; score = late share × average lateness × envelope priority.
Control
Runs ecom orchestrate run on this host, under the same lease as the CLI.
EQUIVALENT COMMAND
PRODUCT + STOCK covers the normal portfolio. Use STOCK=2 to leave seats for PRODUCT. SHIPPING needs postal codes. Workers = 0 is legacy per-group mode.
Timeline
One bar per cycle, coloured by stream. Failed cycles are red; click a bar to open its output.
Cycles by store
What the pool did with each store × stream in the window.
Background actors
History drain, projection, jobs, harvest and reviews — each with its last result.
Envelope priorities
The multiplier each envelope adds to the score, and how many active pairs use it. Edit in stores.yaml.
Recent cycles
Newest first. Click a row for the cycle's output.
COVERAGE
Channels × streams
Where there are clocks, delays or ingestion gaps.
Expand a channel to compare clocks, envelope and last observation per stream.
CHECK
Last 10 results
Most recent observations the controller recorded for a domain × stream.
PORTFOLIO
Subscriptions and entities
Manage what the cycle tracks and the priority of each page.
| page / variant | weight | PRODUCT | STOCK | expires |
|---|
Each row is a subscribed URL. Expand it to see variants and individual clocks.
Maintenanceexpire · sync · purge — same guards as the CLI
Expire lapsed leases
Retires only what is past its term.
Sync canonical list
Adds what is missing and retires what left.
Purge retired
Deletes permanently after the given period.
No maintenance run in this session.
CONFIGURATION
Channel registry
Transport, streams, policy and discovery commands. Click a channel for portfolio health.
Read-only. Policy lives in stores.yaml; channel facts live in code. Health reads the final layer via offer-catalog-api.
AGENT
Self Commerce
Explore a domain before implementing it in the crawler. Add the store, run the pipeline, and see which stages already left artifacts. Nothing here is written into the catalog.
Runs
Explore, analyze, build and sweep jobs for this agent. Cancel stops a queued run immediately. A running browser stops within a few seconds. Click a row for the worker log.
| created | stage | domain | target | status | duration | result |
|---|
Domains
A filled chip means that stage already has artifacts. A plain chip has not run. Counts are categories found, listing pages saved, and product facts exported.
| domain | pipeline | found |
|---|
STORE
—
Launch sweep
One collection, or smoke-test the first page.
Pipeline
Run a stage again any time. Explore opens a visible browser. If that page is HTTP 403, the run waits up to 3 minutes for someone to clear it and for the page to change.
Discovery
Categories and brands from the last explore.
Categories
—
| name | url |
|---|
Brands
—
| name | url |
|---|
Artifacts
Listing pages and exported product facts on disk.
EXPLORE
Open Swagger ↗CLI & API
Capability map, ready-made commands and the interactive docs.
One operation, two doors
The UI uses the same routes and guards as the CLI. Use the interface day to day and copy commands when you need to automate or run workers.
API BASE