Hi [~ge93xab],
Great, I'll set that up. I need to know if you need administrative access too to the Ollama service installed in the GPU, you're working with Stephan Krusche and Nick Schneider, right? If you're not sure if you need administrative access, check relevant information on the GPUs here: [https://confluence.ase.in.tum.de/display/IKS/LLMs+@+LS1] . There you can find which endpoints require administrative access.
Ollama API access is regulated through [HTTP Basic Auth|https://docs.nginx.com/nginx/admin-guide/security-controls/configuring-http-basic-authentication/]. For this, you’d need to generate an MD5 hash of a password and a user. Then, you can send me those and I’ll configure it. In order to create an MD5 hash from a password, you can use the [htpasswd|https://httpd.apache.org/docs/2.4/programs/htpasswd.html] utility
htpasswd -n {USERNAME}
and then entering the password. The output to the terminal will include the hash + salt I’d need to write into the GPU configuration.
Let me know if you have any questions!