promptBatchSize property

int promptBatchSize
final

Prompt evaluation batch size.

Implementation

final int promptBatchSize;