Skip to content

Commit

Permalink
Update README.md 20250205_aiter
Browse files Browse the repository at this point in the history
  • Loading branch information
arakowsk-amd authored Feb 6, 2025
1 parent f65ecc9 commit d57b480
Showing 1 changed file with 6 additions and 2 deletions.
8 changes: 6 additions & 2 deletions docs/dev-docker/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,14 +12,18 @@ The pre-built image includes:

- ROCm™ 6.3.1
- vLLM 0.6.6
- PyTorch 2.6dev (nightly)
- PyTorch 2.7dev (nightly)

## Pull latest Docker Image

Pull the most recent validated docker image with `docker pull rocm/vllm-dev:main`

## What is New

20250205_aiter:
- [AITER](https://github.com/ROCm/aiter) support
- Performance improvement for custom paged attention
- Reduced memory overhead bug fix
20250124:
- Fix accuracy issue with 405B FP8 Triton FA
- Fixed accuracy issue with TP8
Expand Down Expand Up @@ -475,7 +479,7 @@ To reproduce the release docker:
```bash
git clone https://github.com/ROCm/vllm.git
cd vllm
git checkout 8e87b08c2a284c1a20eb3d8e0fbdc84918bf27dc
git checkout 9dc3394c9ee4da250be28d7bd08babf098d51081
docker build -f Dockerfile.rocm -t <your_tag> --build-arg BUILD_HIPBLASLT=1 --build-arg USE_CYTHON=1 .
```

Expand Down

0 comments on commit d57b480

Please sign in to comment.