[Kubeflow 1.10] Define Kubeflow 1.10 Roadmap for Model Registry

[tarilabs]

🚧 this roadmap is being discussed in the biweekly Model Registry meeting and might be subject to change 🏗️ join us in the meeting or on Model Registry Slack channel for your feedback!
As suggested by KF Release team, as the KF 1.10 will kick-start, anything which won't be attainable for the 1.10 plan, will carry-over to a "Roadmap for KF 1.Next" roadmap (thanks @rimolive for the suggestion!)

• Kubeflow Model Registry UI (ref: @ederign)
  The first version of the Kubeflow Model Registry web app will include features like model registration and listing, detailed model views with metadata, version listings, and the ability to archive models on multiple model registries.
  (see here for details)
• Improve the project, CNCF maturity, etc.
  • Multi-arch images - for the Go REST server specifically
  • Monitor CVE reports as provided by KF/manifest team #327
  • Introduce dependency license monitoring #323
• MLMD-related enhancements
  examples:
  • multi-tenancy Support for Multi-Tenancy #120
  • single instance with KFP(?)
    etc.
• "shift-left" testing - incorporating CI testing we have Midstream, to Upstream (ref: @tonyxrmdavidson)
• Integration/Import from other Registries - e.g.: integration of MLFlow (ref: MLFLOW MR & HuggingFace & KFMR logical model comparison #94)
• Improve integration with other KF components
  • e.g.: harden CSI blueprint (@lampajr)
  • integration blueprints with Katib/HPO:
    example
  • keep tabs with Feast integrations ( Evaluate adding support for ML Metadata or alternative feast-dev/feast#4258 @franciscojavierarceo )
  • integration/blueprint with Training Operator (see here)
  • and other blueprints (for example)
• Integration Storage solutions for Model Registry, with OCI being the preferred option (ref: @tarilabs)
• Carry-over from 1.9:
  • brief docs on Manifest quickstart, pointers to "read more on how you can further kustomize"
  • confirm if any special requirements for Istio/Cert-manager

---

References for KF 1.10 from Release team or other:

• dependency matrix [Kubeflow 1.10] Create Dependencies version list community#767

[franciscojavierarceo]

Linking the ticket in the Feast repo feast-dev/feast#4258

[ederign]

@tarilabs, we are happy to provide an update regarding the Kubeflow Model Registry web app for the 1.10 scope.

---

Kubeflow Model Registry UI

The first version of the Kubeflow Model Registry web app will include features like model registration and listing, detailed model views with metadata, version listings, and the ability to archive models on multiple model registries.

---

We still need to investigate and discuss how to integrate our work with the central dashboard regarding iframe integration, security (logged user), auth, and topology deployment. We will keep everyone posted as you progress on those.

[tarilabs]

Thank you for sharing awesome news with the community @ederign and team

[lucferbux]

Hi there @tarilabs I'm gonna add UI's roadmap into this issue so we have a first draft to interact with, if you want we can open a follow up issue for that topic. So far, this is the roadmap of the UI integration:

Phase 1 - PoC ✅

Goals

• Get the first PoC for Model Registry
• Define the first architecture for an Upstream Project
• Get the first dev mode for the feature
• Make it work in mock mode
• Implement the feature with the current screens:
  • Registered models view
  • Archived registered models
  • Model Registration form
  • Model version view
  • Archived model versions
  • Model Registration (versions) form
  • Model version detail

Target Dates

Sep 30, 2024

Phase 2 - Modular Architecture Refinement

Goals

• Implement notification center
• Improve onboarding in the repo
• Enhance deployments
• Refactor shared libraries/components/utils
• UI/BFF project overhaul
• Networking improvements
• BFF route handling enhancements
• Testing overhaul

Target Dates

Dec 30, 2024

Phase 3 - Kubeflow Integration

Goals

• Investigate all the requirements for integration - Nov 29, 2024
  • Login & auth
  • K8s Library integration in the cluster
  • KF Dashboard Integration
  • Data Handling
  • CI/CD
• Integration with the dashboard Jan 16, 2025
  • BFF auth handling with DEX for login
  • Manifest enhancements for kubeflow deployment
  • Manifest promotion to root of Model Registry repo
  • Refactor of the k8s library implementation for production
  • Integration with the k8s central dashboard repo
  • Material UI theme
• Create a roadmap for the missing features - After 1.10 release
  • Model deployed in the cluster
  • Model registry settings
  • Model registry deployment

Target Dates

1.10 Release

[milosjava]

@lucferbux this is really helpful, thanks!

[tarilabs]

there was a suggestion from Valentina in biweekly to update this roadmap and roll-over items which likely not land for 1.10.