threads property
CPU threads for generation and for prompt processing; null (or 0) lets the runtime choose.
Implementation
final int? threads;
CPU threads for generation and for prompt processing; null (or 0) lets the runtime choose.
final int? threads;