Skip to content

Commit 7197286

Browse files
lvliang-intellvliang-intel
authored
Fix ChatQnA manifest default port issue (opea-project#1033)
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
1 parent 960805a commit 7197286

18 files changed

Lines changed: 20 additions & 50 deletions

File tree

‎AudioQnA/kubernetes/intel/README.md‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -7,14 +7,14 @@
77
88
## Deploy On Xeon
99
```
10-
cd GenAIExamples/AudioQnA/kubernetes/intel/cpu/xeon/manifests
10+
cd GenAIExamples/AudioQnA/kubernetes/intel/cpu/xeon/manifest
1111
export HUGGINGFACEHUB_API_TOKEN="YourOwnToken"
1212
sed -i "s/insert-your-huggingface-token-here/${HUGGINGFACEHUB_API_TOKEN}/g" audioqna.yaml
1313
kubectl apply -f audioqna.yaml
1414
```
1515
## Deploy On Gaudi
1616
```
17-
cd GenAIExamples/AudioQnA/kubernetes/intel/hpu/gaudi/manifests
17+
cd GenAIExamples/AudioQnA/kubernetes/intel/hpu/gaudi/manifest
1818
export HUGGINGFACEHUB_API_TOKEN="YourOwnToken"
1919
sed -i "s/insert-your-huggingface-token-here/${HUGGINGFACEHUB_API_TOKEN}/g" audioqna.yaml
2020
kubectl apply -f audioqna.yaml

‎ChatQnA/kubernetes/intel/cpu/xeon/manifest/chatqna-guardrails.yaml‎

Lines changed: 0 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -1252,18 +1252,12 @@ spec:
12521252
env:
12531253
- name: LLM_SERVER_HOST_IP
12541254
value: chatqna-tgi
1255-
- name: LLM_SERVER_PORT
1256-
value: "2080"
12571255
- name: RERANK_SERVER_HOST_IP
12581256
value: chatqna-teirerank
1259-
- name: RERANK_SERVER_PORT
1260-
value: "2082"
12611257
- name: RETRIEVER_SERVICE_HOST_IP
12621258
value: chatqna-retriever-usvc
12631259
- name: EMBEDDING_SERVER_HOST_IP
12641260
value: chatqna-tei
1265-
- name: EMBEDDING_SERVER_PORT
1266-
value: "2081"
12671261
- name: GUARDRAIL_SERVICE_HOST_IP
12681262
value: chatqna-guardrails-usvc
12691263
- name: GUARDRAIL_SERVICE_PORT

‎ChatQnA/kubernetes/intel/cpu/xeon/manifest/chatqna.yaml‎

Lines changed: 0 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -994,18 +994,12 @@ spec:
994994
env:
995995
- name: LLM_SERVER_HOST_IP
996996
value: chatqna-tgi
997-
- name: LLM_SERVER_PORT
998-
value: "2080"
999997
- name: RERANK_SERVER_HOST_IP
1000998
value: chatqna-teirerank
1001-
- name: RERANK_SERVER_PORT
1002-
value: "2082"
1003999
- name: RETRIEVER_SERVICE_HOST_IP
10041000
value: chatqna-retriever-usvc
10051001
- name: EMBEDDING_SERVER_HOST_IP
10061002
value: chatqna-tei
1007-
- name: EMBEDDING_SERVER_PORT
1008-
value: "2081"
10091003
securityContext:
10101004
allowPrivilegeEscalation: false
10111005
capabilities:

‎ChatQnA/kubernetes/intel/cpu/xeon/manifest/chatqna_bf16.yaml‎

Lines changed: 0 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -997,18 +997,12 @@ spec:
997997
env:
998998
- name: LLM_SERVER_HOST_IP
999999
value: chatqna-tgi
1000-
- name: LLM_SERVER_PORT
1001-
value: "2080"
10021000
- name: RERANK_SERVER_HOST_IP
10031001
value: chatqna-teirerank
1004-
- name: RERANK_SERVER_PORT
1005-
value: "2082"
10061002
- name: RETRIEVER_SERVICE_HOST_IP
10071003
value: chatqna-retriever-usvc
10081004
- name: EMBEDDING_SERVER_HOST_IP
10091005
value: chatqna-tei
1010-
- name: EMBEDDING_SERVER_PORT
1011-
value: "2081"
10121006
securityContext:
10131007
allowPrivilegeEscalation: false
10141008
capabilities:

‎ChatQnA/kubernetes/intel/hpu/gaudi/manifest/chatqna-guardrails.yaml‎

Lines changed: 0 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -1257,18 +1257,12 @@ spec:
12571257
env:
12581258
- name: LLM_SERVER_HOST_IP
12591259
value: chatqna-tgi
1260-
- name: LLM_SERVER_PORT
1261-
value: "2080"
12621260
- name: RERANK_SERVER_HOST_IP
12631261
value: chatqna-teirerank
1264-
- name: RERANK_SERVER_PORT
1265-
value: "2082"
12661262
- name: RETRIEVER_SERVICE_HOST_IP
12671263
value: chatqna-retriever-usvc
12681264
- name: EMBEDDING_SERVER_HOST_IP
12691265
value: chatqna-tei
1270-
- name: EMBEDDING_SERVER_PORT
1271-
value: "2081"
12721266
- name: GUARDRAIL_SERVICE_HOST_IP
12731267
value: chatqna-guardrails-usvc
12741268
- name: GUARDRAIL_SERVICE_PORT

‎ChatQnA/kubernetes/intel/hpu/gaudi/manifest/chatqna.yaml‎

Lines changed: 0 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -997,18 +997,12 @@ spec:
997997
env:
998998
- name: LLM_SERVER_HOST_IP
999999
value: chatqna-tgi
1000-
- name: LLM_SERVER_PORT
1001-
value: "2080"
10021000
- name: RERANK_SERVER_HOST_IP
10031001
value: chatqna-teirerank
1004-
- name: RERANK_SERVER_PORT
1005-
value: "2082"
10061002
- name: RETRIEVER_SERVICE_HOST_IP
10071003
value: chatqna-retriever-usvc
10081004
- name: EMBEDDING_SERVER_HOST_IP
10091005
value: chatqna-tei
1010-
- name: EMBEDDING_SERVER_PORT
1011-
value: "2081"
10121006
securityContext:
10131007
allowPrivilegeEscalation: false
10141008
capabilities:

‎ChatQnA/tests/test_manifest_on_gaudi.sh‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -161,7 +161,7 @@ case "$1" in
161161
if [ $ret -ne 0 ]; then
162162
exit $ret
163163
fi
164-
pushd ChatQnA/kubernetes/intel/hpu/gaudi/manifests
164+
pushd ChatQnA/kubernetes/intel/hpu/gaudi/manifest
165165
set +e
166166
install_and_validate_chatqna_guardrail
167167
popd

‎ChatQnA/tests/test_manifest_on_xeon.sh‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -161,7 +161,7 @@ case "$1" in
161161
if [ $ret -ne 0 ]; then
162162
exit $ret
163163
fi
164-
pushd ChatQnA/kubernetes/intel/cpu/xeon/manifests
164+
pushd ChatQnA/kubernetes/intel/cpu/xeon/manifest
165165
set +e
166166
install_and_validate_chatqna_guardrail
167167
popd

‎CodeGen/kubernetes/intel/README.md‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -12,7 +12,7 @@
1212
## Deploy On Xeon
1313

1414
```
15-
cd GenAIExamples/CodeGen/kubernetes/intel/cpu/xeon/manifests
15+
cd GenAIExamples/CodeGen/kubernetes/intel/cpu/xeon/manifest
1616
export HUGGINGFACEHUB_API_TOKEN="YourOwnToken"
1717
export MODEL_ID="Qwen/Qwen2.5-Coder-7B-Instruct"
1818
sed -i "s/insert-your-huggingface-token-here/${HUGGINGFACEHUB_API_TOKEN}/g" codegen.yaml
@@ -23,7 +23,7 @@ kubectl apply -f codegen.yaml
2323
## Deploy On Gaudi
2424

2525
```
26-
cd GenAIExamples/CodeGen/kubernetes/intel/hpu/gaudi/manifests
26+
cd GenAIExamples/CodeGen/kubernetes/intel/hpu/gaudi/manifest
2727
export HUGGINGFACEHUB_API_TOKEN="YourOwnToken"
2828
sed -i "s/insert-your-huggingface-token-here/${HUGGINGFACEHUB_API_TOKEN}/g" codegen.yaml
2929
kubectl apply -f codegen.yaml

‎CodeGen/kubernetes/intel/cpu/xeon/manifest/README_react_ui.md‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -17,7 +17,7 @@ Before deploying the react-codegen.yaml file, ensure that you have the following
1717
```
1818
# You may set the HUGGINGFACEHUB_API_TOKEN via method:
1919
export HUGGINGFACEHUB_API_TOKEN="YourOwnToken"
20-
cd GenAIExamples/CodeGen/kubernetes/intel/cpu/xeon/manifests/ui/
20+
cd GenAIExamples/CodeGen/kubernetes/intel/cpu/xeon/manifest/ui/
2121
sed -i "s/insert-your-huggingface-token-here/${HUGGINGFACEHUB_API_TOKEN}/g" react-codegen.yaml
2222
```
2323
b. Set the proxies based on your network configuration

0 commit comments

Comments
 (0)