Skip to content

Pull requests: HabanaAI/vllm-fork

New pull request New
37 Open 573 Closed
37 Open 573 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Added lora manager tests
#670 opened Jan 8, 2025 by rsshaik1 • Draft
Fix for random sampler recompilations for incomplete batches
#663 opened Dec 30, 2024 by mfylcek Loading…
[SW-197036] - use torch._scaled_mm with hpu
#660 opened Dec 22, 2024 by nirda7 Loading…
2
Draft: Delayed prompts
#659 opened Dec 20, 2024 by kamil-kaczor • Draft
Chunked Prefill
#656 opened Dec 20, 2024 by hlahkar • Draft
Fix: selecting correct backend for MultiHeadAttention habana Issues or PRs submitted by Habana Labs
#645 opened Dec 18, 2024 by adobrzyniewicz-habana Loading…
2
Fix model OOM issue in llama-405 and mixtral - 2nd attempt habana Issues or PRs submitted by Habana Labs
#644 opened Dec 18, 2024 by afierka-intel Loading…
@afierka-intel
Selective merged prefill
#643 opened Dec 18, 2024 by xuechendi Loading…
4
Add exponential bucketing integration
#642 opened Dec 17, 2024 by kzawora-intel • Draft
Multimodality fix for llava habana Issues or PRs submitted by Habana Labs
#641 opened Dec 17, 2024 by adobrzyniewicz-habana Loading…
Add inc fp8 qunatization documentation
#635 opened Dec 16, 2024 by nirda7 Loading…
49
Device Type HPU support for torch.generator() API
#628 opened Dec 13, 2024 by nageshdn Loading…
1
1
[WIP] Add HPU support to vLLM v1 - cont.
#609 opened Dec 10, 2024 by kzawora-intel Loading…
21 of 23 tasks
Add in Dockerfile.hpu.ubi
#602 opened Dec 9, 2024 by Xaenalt Loading…
13
Add real BS & seq_len to profiling
#601 opened Dec 9, 2024 by kamil-kaczor Loading…
Documentation update for 1.19
#597 opened Dec 5, 2024 by PatrykWo Loading…
20
[DONNOT MERGE] [POC] Ray Compiled graphs
#593 opened Dec 5, 2024 by michalkuligowski • Draft
Multi models support for upstream
#590 opened Dec 4, 2024 by xuechendi Loading…
1
Remove assert for alibi in case of FusedSDPA.
#587 opened Dec 4, 2024 by itaraban Loading…
1
Update documentation
#555 opened Nov 26, 2024 by michalkuligowski • Draft
5
[SW-201504] Trigger Internal Tests
#538 opened Nov 24, 2024 by RonBenMosheHabana Loading…
Bump aiohttp from 3.10.10 to 3.10.11 dependencies Pull requests that update a dependency file
#536 opened Nov 21, 2024 by dependabot bot Loading…
3
Clean-up LoRA flow
#518 opened Nov 18, 2024 by SanjuCSudhakaran • Draft
Update .dockerignore - DO NOT MERGE - CI tetsing
#514 opened Nov 17, 2024 by RonBenMoshe Loading…
2
1.19 documentation update
#507 opened Nov 15, 2024 by kzawora-intel • Draft
ProTip! Filter pull requests by the default branch with base:habana_main.