Package#
Docker Image#
Inference#
CardType |
image |
tag |
|---|---|---|
CUDA-SM9x |
rtp-llm-registry.cn-hangzhou.cr.aliyuncs.com/rtp-llm/rtp-llm |
0.2.0_0.2.0_2025_11_26_10_16_dd9cb964d_sm9x_opensource |
CUDA-SM8x |
rtp-llm-registry.cn-hangzhou.cr.aliyuncs.com/rtp-llm/rtp-llm |
0.2.0_0.2.0_2025_11_26_10_16_dd9cb964d_sm8x_opensource |
CUDA-SM7x |
rtp-llm-registry.cn-hangzhou.cr.aliyuncs.com/rtp-llm/rtp-llm |
0.2.0_0.2.0_2025_11_26_10_16_dd9cb964d_sm7x_opensource |
Frontend |
rtp-llm-registry.cn-hangzhou.cr.aliyuncs.com/rtp-llm/rtp-llm |
0.2.0_0.2.0_2025_11_26_10_16_dd9cb964d_frontend-opensource |
AMD |
rtp-llm-registry.cn-hangzhou.cr.aliyuncs.com/rtp-llm/rtp-llm |
0.2.0_0.2.0_2025_11_26_10_16_dd9cb964d_rocm_opensource |
Wheel#
CardType |
wheel |
|---|---|
CUDA-SM9x |
https://rtp-opensource.oss-cn-hangzhou.aliyuncs.com/package/daily/2025_11_26/rtp_llm-0.2.0-0.2.0-2025_11_26_10_16_dd9cb964d-sm9x-cp310-cp310-manylinux1_x86_64.whl |
CUDA-SM8x |
https://rtp-opensource.oss-cn-hangzhou.aliyuncs.com/package/daily/2025_11_26/rtp_llm-0.2.0-0.2.0-2025_11_26_10_16_dd9cb964d-sm8x-cp310-cp310-manylinux1_x86_64.whl |
CUDA-SM7x |
https://rtp-opensource.oss-cn-hangzhou.aliyuncs.com/package/daily/2025_11_26/rtp_llm-0.2.0-0.2.0-2025_11_26_10_16_dd9cb964d-sm7x-cp310-cp310-manylinux1_x86_64.whl |
Frontend |
https://rtp-opensource.oss-cn-hangzhou.aliyuncs.com/package/daily/2025_11_26/rtp_llm-0.2.0-0.2.0-2025_11_26_10_16_dd9cb964d-frontend-cp310-cp310-manylinux1_x86_64.whl |
AMD |
https://rtp-opensource.oss-cn-hangzhou.aliyuncs.com/package/daily/2025_11_26/rtp_llm-0.2.0-0.2.0-2025_11_26_10_16_dd9cb964d-rocm-cp310-cp310-manylinux1_x86_64.whl |
Images of Master is comming soon