prefillTokensPerSecond property

double? prefillTokensPerSecond
final

Prompt prefill throughput in tokens per second.

Implementation

final double? prefillTokensPerSecond;