Update llm page

[tpfau]

Added description of llm service.

[rkdarst]

Looks good. Other ideas:

A "see also" section that links to the Azure AI API request instructions, an anything else relevant to API usage.

Can we link to some sample code or is it assumed others can find it easily enough?

[rkdarst]

Aalto networks only?

[rkdarst]

If we expect broad use including students, I think it would be useful if it's available even outside of aalto networks.

[tpfau]

I don't want to make this available outside aalto network. Students can (for all I know) go on VPN and use it.
As to student use:
The ultimate idea of this is that it can also serve the Azure endpoints at some point, and this will make it necessary to restrict usage/keys and/or associate them with some form of Cost center, so making it available to students directly is something I'm hesitant to do.

[rkdarst]

Other notes for wide release:

• The gateway says cost per 1000 tokens. It could say per 1M tokens since I think that's correct.
• The gateway could have a link to this page (or any better page)
• The page could say that the costs are relative expenses but there is NO billing for any current use, and won't be without advance notification. We will contact high-volume users at some point to develop the service to serve their needs.
• Is there any logging? Can we say something like "there is logs of usage but not content?"
• Contact email address? servicedesk or rse?

[tpfau]

The costs on there are fake anyways at this time (I don't know the cost and I've just put in something.
I'm also working on a general UI update (moving UI to a different frontend host).
There are access logs and usage logging.
Contact email for now: us.
Later: servicedesk