Monitors are defined in monitors.config.js. Edit that file and redeploy to add, change, or remove one.

History is kept in memory and resets when the app restarts or redeploys. Alerting itself is unaffected.