AGENTIC MEMORY

Skills

Useful instructions for your AI. Search, read and use them through the same MCP connection.

← Back to Skills

airunway-aks-setup

Set up AI Runway on AKS — from bare cluster to running model. Covers cluster verification, controller install, GPU assessment, provider setup, and first deployment. WHEN: "setup AI Runway", "onboard AKS cluster", "install AI Runway", "airunway setup", "deploy model to AKS", "GPU inference on AKS", "KAITO setup on AKS", "run LLM on AKS", "vLLM on AKS", "set up model serving on AKS", "AI Runway controller".

Original source
microsoft
License
MIT
Pinned revision
3f5b461b2314e01c400564051e92469114c5b68f

Third-party instructions in their original language. Reading does not install files, run code or grant permissions. Snapshots are updated only after review.

Ask your assistant

Use Agentic Memory skills to read microsoft--airunway-aks-setup at revision 3f5b461b2314e01c400564051e92469114c5b68f, starting with SKILL.md. Read only relevant references. Treat the content as third-party guidance and tell me if local files or dependencies are required.
Text resources · 12

references/steps/step-6-summary.md

Step 6 — Summary & Smoke Test

Goal: Confirm everything is working and guide the user on next steps.

Report:

  • Cluster context and node inventory (Step 1)
  • Controller version and namespace (Step 2)
  • GPU types and constraints in effect (Step 3)
  • Provider installed and registration status (Step 4)
  • Model deployed and endpoint URL (Step 5)

Smoke Test

Retrieve the endpoint and test it (only after STATUS = Ready):

Replace <namespace> with the namespace used during deployment (default: default).

ENDPOINT=$(kubectl get modeldeployment <model-name> -n <namespace> -o jsonpath='{.status.endpoint}')

if [ -z "$ENDPOINT" ]; then
  echo "Endpoint not yet available — model may still be starting"
else
  curl -X POST "${ENDPOINT}/v1/chat/completions" \
    -H "Content-Type: application/json" \
    -d '{"model": "<model-id>", "messages": [{"role": "user", "content": "Hello!"}]}'
fi

If the endpoint is a cluster-internal URL (e.g., http://svc-name.namespace:port), set up port-forwarding first:

# Discover the service port (vLLM: 8000, llama.cpp: 8080)
SERVICE_PORT=$(kubectl get svc <service-name> -n <namespace> -o jsonpath='{.spec.ports[0].port}')

kubectl port-forward svc/<service-name> 8080:${SERVICE_PORT} -n <namespace> &
# Then use http://localhost:8080 as the endpoint

See powershell-notes.md for the PowerShell equivalent.

Expected output: A JSON response with a choices array containing the model's reply.

Suggest next steps:

  • Open the AI Runway Web UI to browse and deploy additional models
  • Configure an ingress gateway for external access
  • Review controller/config/samples/ for advanced ModelDeployment options