decodeTokensPerSecond property

double? decodeTokensPerSecond
final

Decode throughput in tokens per second.

Implementation

final double? decodeTokensPerSecond;