Mean latency

​

Definition

The mean latency test ensures that the mean latency for the data is within a given range.

​

Taxonomy

• Category: Performance.
• Task types: LLM, tabular classification, tabular regression, text classification.
• Availability: monitoring.

​

Why it matters

• The latency of a model directly impacts the user experience. Setting up tests to monitor the latency ensures that the latency is kept within a given range.

​

Related

• Max latency test.