Skip to content

Roadmap

emeli-dral edited this page Oct 26, 2021 · 7 revisions

2021

Reports

  • Dataset Profiling
  • [backlog] Historical Drift
  • advanced configurations

Algorithms & Stats

  • Regression Performance: segments of underperformance
  • Anderson-Darling test for Data and Target Drift
  • Barnard's exact test for Data and Target Drift
  • Target Drift Analysis: add Kendall and Spearman correlation
  • [backlog] "Small Dataset" option for reports
  • [backlog] "Big Dataset" option for reports

Examples & Tutorials

  • Update all the examples & tutorials with readme
  • Update the structure of examples folder

Monitoring

  • metrics calculation logic for Production Data Stream
  • Grafana: Data Drift Dashboard
  • Grafana: Numerical Target Drift Dashboard
  • Grafana: Regression Performance Dashboard
  • Grafana: Categorical Target Drift Dashboard
  • Grafana: Classification Performance Dashboard
  • Grafana: Probabilistic Classification Performance Dashboard

Evidently Community

  • evidently_community repo for custom reports
  • evidently_community contributor Guide
  • tests for evidently_community project

Environments

  • interactive reports in pylab
  • interactive reports in google colaboratory notebooks
  • interactive reports in kaggle notebooks

User Interface

  • reduce HTML reports size (at least twice, better more)
  • UI configuration (color-schema change, etc)
  • color-blind mode for reports
  • fix UI building issues

[backlog] Run App

  • run evidently dashboards from terminal in a "service" mode
  • host it somewhere

Testing, CI/CD

  • python unit tests for analyzers
  • python unit tests for widgets
  • python unit tests for dashboard
  • automation of running selected examples as a test
  • package deployment

Documentation & Repo

  • Developer's guide
  • Contributor's guide
  • Release notes
  • Good first issues, issue templates
Clone this wiki locally