Aalto nextG
Aalto nextG is an infrastructure supporting research on future mobile networks. It is operated by the technical support service in the Department of Information and Communications Engineering, School of Electrical Engineering.
Local LLM Gateway
Local LLM Gateway aims to provide an easy-to-use way to provide a large variety of large language models to the Aalto Community through a unified API. It ensures a secure and efficient use of models on premises with shared resources between multiple models. You can access the service at https://llm-gateway.k8s.aalto.fi.
Features
Local LLM Gateway aims to provide a variety of large language models available on Hugging Face to the Aalto community. In addition, the service can be integrated into any AI powered assistant that is compatible with OpenAI API specifications in a unified and easy to use manner.
To begin using, you have to generate API keys on the service website to gain access to the models. There are currently four models available for the service:
- Qwen/Qwen3-30B-A3B-Instruct-2507-FP8
- openai/gpt-oss-120b
- Qwen/Qwen3-VL-30B-A3B-Instruct-FP8
- Qwen/Qwen3-VL-30B-A3B-Thinking-FP8
Coverage
The service is available within the Aalto network. For usage outside of Aalto network, please establish a remote connection to an Aalto network.
Use cases
Local LLM Gateway is suitable for everyday academic activities such as learning, teaching, and researching. It is ideal for students, teachers, and researchers who want to have easy access to large language models to use in their academic activities.
As a general rule, special categories of personal data should not be processed. If the legal basis of your research allows, and if the data you are working with is public, also special categories of personal data can be processed. If you need to process special categories of personal data that are not public, please discuss this as part of your ethical review application, before using the service.
Target groups
The main target audiences for Local LLM Gateway are Aalto-affiliated, such as students, teachers, researchers, and employees. Additionally, the service is completely free of charge. Students need to be given access to the service by teachers.
Restrictions and risks
The use of the Local LLM Gateway for commercial purposes is prohibited. Access rights are limited ºÚÁÏÍø network only. Data encryption is done according to the Kubernetes cluster specification. Interaction data are not stored, and session data is stored only for fast session retrieval.
It is important to note that you are not allowed to process secret data. If you need to process personal data, we recommend having a consultation with an expert researchdata@aalto.fi.
How to start using the service
To use the service, using your Aalto accounr. You can view the available models and their descriptions in the Models tab. In the Keys tab, you can generate API keys (maximum number of keys is 10) and track your usage and balance.
Support
To begin utilising Local LLM Gateway, you must have a connection to the Aalto network. To do this, you have to be on the campus’s premises or have . If you have any questions, reach out to the IT Service Desk at servicedesk@aalto.fi with a description of your use case.
More information
IT Service Desk contact information and service hours
Contact IT End User Support for help or information on Aalto University IT. You can visit the service desk during opening hours or ask for help by email, telephone or chat.