Observability
Lineage
Fennel console contains an interactive visualization of the full lineage graph spanning all Fennel entities - data sources, datasets, features, extractors etc. This lineage information is inferred automatically from the program structure without any manual annotation.
This visualization can be used to discover datasets/features of interest. It can also be used to understand the relationships between existing entities - which can further help debug issues and/or build deeper intuition about the dataflow.
Fennel also exposes all the lineage information behind a REST API in case you want to combine this with broader data lineage graphs outside of Fennel and host it in your own dashboards.