Adjust timeouts in ATRIA

Adjust timeouts in aura-gateway-api

The instructions to adjust timeouts in aura-gateway-api and Nginx are detailed below:

• Open the ConfigMap aura-gateway-api
  kubectl edit configmap aura-gateway-api -n <namespace>
  (Change <namespace> by the specific one)

• In config key, search and update the AURA_REQUEST_TIMEOUT field:

  AURA_REQUEST_TIMEOUT: 490000
  

• Save and close the ConfigMap

• Open the ConfigMap aura-services
  kubectl edit vs aura-services -n <namespace>
  (Change <namespace> by the specific one)

• In aura-gateway-api key, search and update read_timeout and send_timeout field:

  read_timeout: 495s
  send_timeout: 495s
  

• Save and close the ConfigMap

Adjust timeouts in atria-model-gateway

The instructions to adjust timeouts in atria-model-gateway are detailed below:

• Open the ConfigMap atria-model-gw
  kubectl edit cm atria-model-gw-config -n <namespace> (Change <namespace> by the specific one)

• Now, modify the following timeout in the corresponding models:

  rag-server:
      timeout:
          timeout: 485
          read: 60
  gpt-35-turbo:
      timeout:
          timeout: 240
          read: 60
  gpt-4:
      timeout:
          timeout: 240
          read: 60
  

• Save and close the ConfigMap