A TensorRT Toolbox for Optimized Large Language Model Inference

References

• https://github.com/NVIDIA/TensorRT-LLM
• https://nvidia.github.io/TensorRT-LLM/latest/