The automation (e.g. daily) for (re)calculation should include such use cases by default.
Maybe a dedicated timespan calculation so that no further configuration is required (maybe filter on status) aside from specifying the start date.
In addition, add a capability to exclude cases based on dimensions (status, last stage) in order to remove closed cases from an alert list.