flashAttention property

bool flashAttention
final

Flash attention; the quantized KV cache types need it.

Implementation

final bool flashAttention;