LiteRtLmRuntimeMetrics constructor

const LiteRtLmRuntimeMetrics({
  1. required int inputTokens,
  2. required int outputTokens,
  3. required double? timeToFirstTokenSeconds,
  4. required double? initSeconds,
  5. required double? prefillTokensPerSecond,
  6. required double? decodeTokensPerSecond,
  7. required int wallMilliseconds,
})

Creates runtime metrics.

Implementation

const LiteRtLmRuntimeMetrics({
  required this.inputTokens,
  required this.outputTokens,
  required this.timeToFirstTokenSeconds,
  required this.initSeconds,
  required this.prefillTokensPerSecond,
  required this.decodeTokensPerSecond,
  required this.wallMilliseconds,
});