Service Description:
This service enables the consumer to subscribe/unsubscribe for ML model accuracy (i.e. Analytics accuracy for an ML model as described in
clause 6.2E.3.3) information monitored. The service can additionally provide Analytics feedback information for the analytics generated by an NWDAF (i.e. NWDAF containing AnLF). The service also enables the NWDAF containing AnLF registers the use and monitoring capability for an ML model into the model provider NWDAF, i.e. NWDAF containing MTLF.
Service operation name:
Nnwdaf_MLModelMonitor_Subscribe
Description:
Subscribes to NWDAF for ML model accuracy (i.e. Analytics accuracy for an ML model as described in
clause 6.2E.3.3) information and Analytics feedback information for the analytics generated by the NWDAF with specific parameters.
Inputs, Required:
(set of) Unique ML Model identifier(s), Notification Target Address (+ Notification Correlation ID).
Inputs, Optional:
Subscription Correlation ID (in the case of modification of the ML model monitor subscription), Accuracy metrics to indicate the metrics to calculate the accuracy information, ML model accuracy information period to indicate the reporting periodicity in which the information can be reported, Accuracy reporting threshold to indicate the reporting condition above which the accuracy information needs to be reported.
Outputs Required:
When the subscription is accepted: Subscription Correlation ID (required for management of this subscription), Expiry time (required if the subscription can be expired based on the operator's policy).
Outputs, Optional:
None.
Service operation name:
Nnwdaf_MLModelMonitor_Unsubscribe
Description:
The NF consumer unsubscribes to the NWDAF for ML model accuracy (i.e. Analytics accuracy for an ML model as described in
clause 6.2E.3.3) information and Analytics feedback information for the analytics generated by the NWDAF.
Inputs, Required:
Subscription Correlation ID.
Outputs, Required:
Operation execution result indication.
Outputs, Optional:
None.
Service operation name:
Nnwdaf_MLModelMonitor_Notify.
Description:
NWDAF notifies the ML model accuracy (i.e. Analytics accuracy for an ML model as described in
clause 6.2E.3.3) information and Analytics feedback information for the analytics generated by the NWDAF to the consumer instance which has subscribed to the specific NWDAF service.
Inputs, Required:
Notification Correlation Information, at least one of the following:
-
the tuple (Unique ML model identifier, ML model accuracy information): the ML model accuracy information may include a deviation value which indicates the deviation of the predictions generated using the ML model(s) from the ground truth data, Network data indicated by DataSetTag with ADRF ID when the deviation occurs (which can be used by the NWDAF containing MTLF for possible ML model retraining), Accuracy metrics as requested in Subscribe service operation; and
-
Analytics feedback information: indicates that the consumer NF of the analytics generated by the provisioned ML model has taken an action(s) influenced by the analytics, and includes the following parameter(s):
-
Corresponding Analytics ID(s) which has been used for taking an action(s);
-
Corresponding ML Model identifier(s) which has been used for generating Analytics;
-
Indication whether the action will affect on ground truth data (if available);
-
Time stamp(s) when the action(s) are taken.
Inputs, Optional:
Validity period.
Outputs, Required:
Operation execution result indication.
Outputs, Optional:
None.
Service operation name:
Nnwdaf_MLModelMonitor_Register
Description:
The consumer registers the use and monitoring capability for an ML model at an NWDAF containing MTLF.
Inputs, Required:
Consumer NF ID, Unique ML Model identifier.
Inputs, Optional:
Endpoint address of the Nnwdaf_MLModelMonitor_Subscribe service operation.
Outputs, Required:
ML model monitoring registration ID.
Outputs, Optional:
None.
Service operation name:
Nnwdaf_MLModelMonitor_Deregister
Description:
The consumer deregisters, from an NWDAF containing MTLF, a previous MLModelMonitor registration, e.g. when the consumer is no longer using or monitoring the accuracy of the analytics generated using the ML model.
Inputs, Required:
ML model monitoring registration ID.
Inputs, Optional:
None.
Outputs, Required:
None.
Outputs, Optional:
None.