llama-mtp (1.0.1)

Published 2026-09-02 10:03:47 +02:00 by mat

Pull the image from the command line:

docker pull git.mialemrobicnic.pl/mat/llama-mtp:1.0.1

Digest

sha256:d78784b1a1889ddb2bb0c04bd26232fe4b4d02740fcd37fade99febb04b63f95

For more information on the Container registry, see the documentation.

Image Layers

KIWI 10.3.0

RUN /bin/sh -c tee /etc/yum.repos.d/rocm.repo <<REPO [amdrocm-stable] name=ROCm 10.0.0 baseurl=https://stable.repo.amd.com/rocm/core/packages/rhel10/x86_64 enabled=1 priority=50 gpgcheck=1 gpgkey=https://stable.repo.amd.com/rocm/gpg/packages.gpg REPO # buildkit

RUN /bin/sh -c microdnf -y --nodocs --setopt=install_weak_deps=0 install bash ca-certificates libatomic libstdc++ libgcc libgomp libibverbs sudo amdrocm10.0-gfx1201 radeontop procps-ng && microdnf clean all && rm -rf /var/cache/dnf/* && ln -s core-10.0 /opt/rocm/core && ln -s core-10.0/bin /opt/rocm/bin && ln -s core-10.0/include /opt/rocm/include && ln -s core-10.0/lib /opt/rocm/lib && ln -s core-10.0/libexec /opt/rocm/libexec && ln -s core-10.0/lib/llvm /opt/rocm/llvm && ln -s core-10.0/share /opt/rocm/share && ln -s core-10.0/lib/llvm/amdgcn /opt/rocm/amdgcn # buildkit

ENV ROCM_PATH=/opt/rocm HIP_PATH=/opt/rocm PATH=/opt/rocm/bin:/opt/rocm/core/bin:/opt/rocm/core/lib/llvm/bin:/usr/local/bin:/usr/bin LD_LIBRARY_PATH=/opt/rocm/core/lib/rocm_sysdeps/lib:/opt/rocm/core/lib

COPY /usr/local/ /usr/local/ # buildkit

COPY /opt/llama.cpp/build/bin/ggml-rpc-* /usr/local/bin/ # buildkit

RUN /bin/sh -c echo "/usr/local/lib" > /etc/ld.so.conf.d/local.conf && echo "/usr/local/lib64" >> /etc/ld.so.conf.d/local.conf && echo "/opt/rocm/core/lib" > /etc/ld.so.conf.d/rocm.conf && echo "/opt/rocm/core/lib/rocm_sysdeps/lib" >> /etc/ld.so.conf.d/rocm.conf && ldconfig && find /usr/local/lib /usr/local/lib64 -maxdepth 1 -type f -name 'libllama*.so*' -exec cp -n {} /usr/lib64/ \; && ldconfig # buildkit

COPY gguf-vram-estimator.py /usr/local/bin/gguf-vram-estimator.py # buildkit

RUN /bin/sh -c chmod +x /usr/local/bin/gguf-vram-estimator.py # buildkit

CMD ["/bin/bash"]

ARG UNSLOTH_TAG=b10715-mix-86bd2d3

RUN |1 UNSLOTH_TAG=b10715-mix-86bd2d3 /bin/sh -c set -euxo pipefail && dnf install -y --setopt=install_weak_deps=False tar && dnf clean all && mkdir -p /opt/unsloth-llama && curl -fSL "https://github.com/unslothai/llama.cpp/releases/download/${UNSLOTH_TAG}/app-${UNSLOTH_TAG}-linux-x64-rocm-gfx120X.tar.gz" -o /tmp/unsloth-llama.tar.gz && tar xzf /tmp/unsloth-llama.tar.gz -C /opt/unsloth-llama && rm -f /tmp/unsloth-llama.tar.gz && ln -sf /opt/unsloth-llama/llama-server /usr/local/bin/llama-server && ln -sf /opt/unsloth-llama/llama-cli /usr/local/bin/llama-cli # buildkit

ENV LD_LIBRARY_PATH=/opt/unsloth-llama:/opt/rocm/core/lib/rocm_sysdeps/lib:/opt/rocm/core/lib

ENV PATH=/opt/unsloth-llama:/opt/rocm/bin:/opt/rocm/core/bin:/usr/local/bin:/usr/bin

Key	Value
io.buildah.version	1.43.2
org.opencontainers.image.licenses	MIT
org.opencontainers.image.title	fedora-minimal
org.opencontainers.image.url	https://fedoraproject.org/
org.opencontainers.image.vendor	Fedora Project
org.opencontainers.image.version	44

Details

Container

2026-09-02 10:03:47 +02:00

OCI / Docker

linux/amd64

MIT

Project Site

2.2 GiB

Versions (1) View all

1.0.1

2026-09-02

llama-mtp (1.0.1)

Installation

Image Layers

Labels