Project

General

Profile

Actions

Task #14628

closed
NR IA

Access for GPU Servers

Task #14628: Access for GPU Servers

Added by Nino Richter about 2 months ago. Updated about 2 months ago.

Status:
Closed
Priority:
Major
Start date:
06.03.2026
Due date:
% Done:

0%

Estimated time:
SecReporter:
Originally created on:
09.09.2024
Originally updated on:
06.11.2024
Original due date:

Description

I need access to the GPU servers for my Master's thesis (Implementing a RAG chatbot for the CIT)

IA Updated by Ignacio Alejandro about 2 months ago Actions #1

Hi [~ge93xab],

Great, I'll set that up. I need to know if you need administrative access too to the Ollama service installed in the GPU, you're working with Stephan Krusche and Nick Schneider, right? If you're not sure if you need administrative access, check relevant information on the GPUs here: [https://confluence.ase.in.tum.de/display/IKS/LLMs+@+LS1] . There you can find which endpoints require administrative access.

 
Ollama API access is regulated through [HTTP Basic Auth|https://docs.nginx.com/nginx/admin-guide/security-controls/configuring-http-basic-authentication/]. For this, you’d need to generate an MD5 hash of a password and a user. Then, you can send me those and I’ll configure it. In order to create an MD5 hash from a password, you can use the [htpasswd|https://httpd.apache.org/docs/2.4/programs/htpasswd.html] utility
htpasswd -n {USERNAME}
 
and then entering the password. The output to the terminal will include the hash + salt I’d need to write into the GPU configuration.

Let me know if you have any questions!

NR Updated by Nino Richter about 2 months ago Actions #2

Hi, thank you. Yes, I am. I think I would only need user credentials at first. I have contacted you on Slack. 

Actions

Also available in: PDF Atom