LiteRtLmRuntimeMetrics class

Runtime metrics shape shared with the native LiteRT-LM implementation.

Implementers

Constructors

LiteRtLmRuntimeMetrics({required int inputTokens, required int outputTokens, required double? timeToFirstTokenSeconds, required double? initSeconds, required double? prefillTokensPerSecond, required double? decodeTokensPerSecond, required int wallMilliseconds})
Creates runtime metrics.
const

Properties

decodeTokensPerSecond → double?
Decode throughput in tokens per second.
final
hashCode → int
The hash code for this object.
no setterinherited
initSeconds → double?
Engine initialization time in seconds, when reported by LiteRT-LM.
final
inputTokens → int
Number of prompt/input tokens.
final
outputTokens → int
Number of generated/output tokens.
final
prefillTokensPerSecond → double?
Prompt prefill throughput in tokens per second.
final
runtimeType → Type
A representation of the runtime type of the object.
no setterinherited
timeToFirstTokenSeconds → double?
Time to first token in seconds, when reported by LiteRT-LM.
final
wallMilliseconds → int
Wall-clock runtime measured by Dart.
final

Methods

noSuchMethod(Invocation invocation) → dynamic
Invoked when a nonexistent method or property is accessed.
inherited
toJson() → Map<String, Object?>
Converts metrics to JSON-compatible values.
toString() → String
A string representation of this object.
inherited

Operators

operator ==(Object other) → bool
The equality operator.
inherited