Feature(MInference): add triton-based decoding in case flash_attn is not available - #35

Feature(MInference): add triton-based decoding in case flash_attn is not available#35

Huiqiang Jiang (iofu728) merged 2 commits into

mainmicrosoft/MInference:mainfrom

decoding-devmicrosoft/MInference:decoding-devCopy head branch name to clipboard