Data Quality
Feature Drift
Fennel monitors the live probability distribution of all extracted features. It does so by measuring the mean and the standard deviation of the extracted feature values.
Changes in the probability distribution of a feature are usually indicative of one of the three scenarios:
- Organic drift over time
- Major changes to feature definitions
- Newly introduced bugs
Either way, it's useful to be able to track the feature distribution. These distributions can be seen on Fennel console.
Info
Feature distributions are tracked only for features having a type of either int
or float
.
These distributions are also hosted on the Prometheus endpoint. Thus you can point your monitoring systems (like Grafana) towards these graphs and do your own anomaly detection and/or alerting on top if needed.