Skip to content

Hotfix(MInference): fix the import warnings, fix the apply_rotary_pos… - #30

Merged
Huiqiang Jiang (iofu728) merged 1 commit into
mainfrom
hjiang/fix_apply_rotary_pos_emb_single
Jul 12, 2024
Merged

Huiqiang Jiang (iofu728) merged 1 commit into
mainfrom
hjiang/fix_apply_rotary_pos_emb_single

Conversation

@iofu728

@iofu728 Huiqiang Jiang (iofu728) commented Jul 12, 2024 •

Copy link
Copy Markdown
Contributor

What does this PR do?

Feature

Bug fixed

Before submitting

  • This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
  • Was this discussed/approved via a Github issue? Please add a link
    to it if that's the case.
  • Did you make sure to update the documentation with your changes?
  • Did you write any new necessary tests?

Who can review?

Huiqiang Jiang (@iofu728)

…_emb_single, fix phi-3 vs kernel

Feature(MInference): remove pycuda, support multi-gpu
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working documentation Improvements or additions to documentation feature feature

Projects

None yet

1 participant