dscc-admin-ch/vllm
Watch
2
mirror of https://github.com/dscc-admin-ch/vllm.git synced 2026-08-26 10:24:31 +00:00
Code Releases Activity
Read-only mirror of https://github.com/dscc-admin-ch/vllm — Data Science Competence Center DSCC. Issues & pull requests at the source.
80 commits 14 branches 12 tags 157 KiB
  • Jupyter Notebook 90.7%
  • Go Template 4.3%
  • Shell 2.8%
  • Dockerfile 2.2%
Find a file
Exact
Repository files (latest commit first)
Filename Latest commit message Latest commit date
Jono711 75b2d18263
 Merge pull request #54 from dscc-admin-ch/release/v0.0.12 
Release/v0.0.12
2025-06-25 11:38:32 +02:00
.github/workflows Changed source and target directory to avoid erasing other charts deployed on dscc-admin-ch/helm-charts 2024-10-18 13:36:44 +00:00
deployment Merge branch 'main' into release/v0.0.12 2025-06-25 11:38:11 +02:00
notebooks updated demo for MDI presentation 2025-04-28 06:41:09 +00:00
THIRD_PARTY_LICENSES Update License 2024-12-04 13:10:45 +00:00
LICENSE Update License 2024-12-04 13:10:45 +00:00
README.md Updated README 2024-10-17 09:23:51 +00:00

README.md

A LLM-serving library based on vLLM

Description

This project proposes helm charts deployment for llm use and serving. It is based on the library and docker package vLLM.

This project is currently a work in progress (WIP) and might be subject to changes and bugs.

This project aims to be deployed on Onyxia but should be general enough that it can be adapted to to other kubernetes-based platforms.