Skip to content

Pull requests: triton-inference-server/server

New pull request New
56 Open 3,537 Closed
56 Open 3,537 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Milestones
Filter by milestone
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Added new flag for GPU peer access API control
#7261 opened May 23, 2024 by indrajit96 Loading…
Update expected error message
#7258 opened May 22, 2024 by kthui Loading…
Add response sender test for new behavior
#7257 opened May 22, 2024 by kthui Loading…
Add response sender test base
#7254 opened May 21, 2024 by kthui Loading…
1
Add testing for decoupled model use case
#7246 opened May 20, 2024 by krishung5 Loading…
5
Ci updates
#7241 opened May 17, 2024 by nvda-mesharma Loading…
Jetpack 5.1.2 Patch 2
#7217 opened May 14, 2024 by fpetrini15 • Draft
7
Bump vllm to v0.4.2 module: backends Issues related to the backends
#7198 opened May 9, 2024 by kebe7jun Loading…
@tanmayv25
5
add test for shape validation
#7195 opened May 8, 2024 by jbkyang-nvi Loading…
@yinggeh
15
Remove unnecessary wait in case of failed stub creation
#7192 opened May 7, 2024 by indrajit96 Loading…
9
Add testing for L0_iterative_tutorial
#7176 opened May 1, 2024 by Tabrizian Loading…
9
Fix GenAI-Perf incorrect installation
#7175 opened May 1, 2024 by matthewkotila • Draft
added error message when env TRITON_MODEL_REPO not set
#7147 opened Apr 22, 2024 by JonasGoebel Loading…
Change TensorRT-LLM
#7143 opened Apr 20, 2024 by mc-nv • Draft
1
Update L0_trace for DLIS-6462
#7134 opened Apr 18, 2024 by indrajit96 Loading…
6
Enhance OTEL testing to capture and verify Cancellation Requests and Non-Decoupled model inference.
#7132 opened Apr 18, 2024 by indrajit96 Loading…
18
update openvino to 2024.0.0
#7089 opened Apr 9, 2024 by dtrawins Loading…
@krishung5
1
Have ability to split the build in CI
#7076 opened Apr 5, 2024 by mc-nv Loading…
10
[Windows] Support CPU shared memory (Client/Frontend)
#7048 opened Mar 27, 2024 by fpetrini15 Loading…
68
added support to intel gpu in a custom build
#7047 opened Mar 27, 2024 by dtrawins Loading…
8
Update quickstart.md
#7033 opened Mar 26, 2024 by inf3rnus Loading…
debugging guide: fix verbose logging option
#6927 opened Feb 29, 2024 by catwell Loading…
Adding a readiness matrix of the various first party Backends
#6912 opened Feb 23, 2024 by zeryx Loading…
10
Update pytorch version for tests
#6907 opened Feb 23, 2024 by jbkyang-nvi Loading…
[DO NOT MERGE] add command line parser option to add model configuration prefixes
#6884 opened Feb 14, 2024 by jbkyang-nvi • Draft
ProTip! no:milestone will show everything without a milestone.