{"id":16833,"date":"2023-08-02T10:42:36","date_gmt":"2023-08-02T03:42:36","guid":{"rendered":"https:\/\/www.thegioimaychu.vn\/blog\/?p=16833"},"modified":"2023-08-03T21:42:40","modified_gmt":"2023-08-03T14:42:40","slug":"cach-trien-khai-chatbot-gpt-tren-k8s-voi-giao-dien-gradio","status":"publish","type":"post","link":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/cach-trien-khai-chatbot-gpt-tren-k8s-voi-giao-dien-gradio-p16833\/","title":{"rendered":"C\u00e1ch tri\u1ec3n khai chatbot GPT tr\u00ean K8s v\u1edbi giao di\u1ec7n Gradio"},"content":{"rendered":"<style>.iblink{color:#975!important;}.iblink:hover{color:orange!important;}<\/style><p>C\u00e1c m\u00f4 h\u00ecnh ng\u00f4n ng\u1eef l\u1edbn (LLM) \u0111ang chen s\u00e2u v\u00e0o cu\u1ed9c s\u1ed1ng c\u1ee7a ch\u00fang ta.\u00a0\u00dd t\u00f4i kh\u00f4ng ph\u1ea3i l\u00e0 theo ngh\u0129a \u0111en (\u00edt nh\u1ea5t l\u00e0 trong th\u1eddi \u0111i\u1ec3m hi\u1ec7n t\u1ea1i), m\u00e0 \u0111\u00fang h\u01a1n l\u00e0 c\u00f3 v\u1ebb nh\u01b0\u00a0<a href=\"https:\/\/medium.com\/geekculture\/list-of-open-sourced-fine-tuned-large-language-models-llm-8d95a2e0dc76\">m\u1ed7i ng\u00e0y \u0111\u1ec1u c\u00f3 v\u00f4 s\u1ed1 m\u00f4 h\u00ecnh<\/a>\u00a0v\u00e0 \u1ee9ng d\u1ee5ng m\u1edbi xu\u1ea5t hi\u1ec7n. S\u1ef1 kh\u1edfi \u0111\u1ea7u t\u01b0\u1edfng ch\u1eebng ch\u1ec9 l\u00e0 d\u1ecbch v\u1ee5 \u0111\u1ed9c quy\u1ec1n \u0111\u01b0\u1ee3c qu\u1ea3ng c\u00e1o r\u1ea7m r\u1ed9 c\u1ee7a OpenAI gi\u1edd \u0111\u00e2y \u0111\u00e3 th\u1ef1c s\u1ef1 b\u00f9ng n\u1ed5, ch\u00fang tr\u1edf th\u00e0nh n\u1ec1n t\u1ea3ng m\u00e3 ngu\u1ed3n m\u1edf sau khi b\u1ea3n ph\u00e1t h\u00e0nh\u00a0LLaMA c\u1ee7a Meta\u00a0v\u00e0 c\u00e1c m\u00f4 h\u00ecnh ngu\u1ed3n m\u1edf m\u1edbi nh\u1ea5t \u0111\u01b0\u1ee3c c\u00f4ng b\u1ed1.<\/p>\n<p>N\u1ebfu b\u1ea1n gi\u1ed1ng t\u00f4i, c\u00f3 th\u1ec3 b\u1ea1n c\u0169ng c\u1ea3m th\u1ea5y m\u00ecnh mu\u1ed1n s\u1eed d\u1ee5ng LLM ngu\u1ed3n m\u1edf. V\u1edbi c\u00e1 nh\u00e2n t\u00f4i, m\u1ed9t ph\u1ea7n c\u00f4ng vi\u1ec7c h\u00e0ng ng\u00e0y l\u00e0 ph\u00e2n t\u00edch v\u00e0 \u0111\u00e1nh gi\u00e1 c\u00e1c m\u00f4 h\u00ecnh kh\u00e1c nhau. V\u00ec v\u1eady t\u00f4i mu\u1ed1n t\u00ecm m\u1ed9t c\u00e1ch hi\u1ec7u qu\u1ea3 \u0111\u1ec3 tri\u1ec3n khai LLM v\u00e0 giao di\u1ec7n c\u1ee7a n\u00f3 \u0111\u1ec3 c\u00f3 th\u1ec3 khai th\u00e1c h\u1ebft c\u00e1c kh\u1ea3 n\u0103ng.<\/p>\n<p>Tr\u01b0\u1edbc khi \u0111i s\u00e2u v\u00e0o chi ti\u1ebft vi\u1ec7c tri\u1ec3n khai, d\u01b0\u1edbi \u0111\u00e2y l\u00e0 nh\u1eefng y\u00eau c\u1ea7u ch\u00ednh m\u00e0 t\u00f4i \u0111\u01b0a ra:<\/p>\n<ul>\n<li>D\u1ec5 truy c\u1eadp: Vi\u1ec7c truy c\u1eadp m\u00f4 h\u00ecnh ph\u1ea3i \u0111\u01b0\u1ee3c th\u1ef1c hi\u1ec7n th\u00f4ng qua giao di\u1ec7n ng\u01b0\u1eddi d\u00f9ng web (web UI)<\/li>\n<li>T\u00ednh b\u1ec1n v\u1eefng: Thi\u1ebft l\u1eadp c\u00f3 th\u1ec3 \u0111\u01b0\u1ee3c kh\u1edfi \u0111\u1ed9ng l\u1ea1i sau khi reboot laptop\/cloud instance c\u1ee7a m\u00ecnh<\/li>\n<li>Kh\u1ea3 n\u0103ng m\u1edf r\u1ed9ng: T\u00f4i mu\u1ed1n c\u00f3 th\u1ec3 m\u1edf r\u1ed9ng th\u00f4ng l\u01b0\u1ee3ng c\u1ee7a gi\u1ea3i ph\u00e1p b\u1eb1ng c\u00e1ch b\u1ed5 sung th\u00eam s\u1ee9c m\u1ea1nh t\u00ednh to\u00e1n \u0111\u1ec3 ch\u1ea1y m\u00f4 h\u00ecnh<\/li>\n<li>T\u00ednh kh\u1ea3 d\u1ee5ng: M\u1eb7c d\u00f9 kh\u00f4ng ph\u1ea3i l\u00e0 y\u00eau c\u1ea7u b\u1eaft bu\u1ed9c, nh\u01b0ng t\u00f4i mu\u1ed1n c\u00f3 th\u1ec3 cung c\u1ea5p c\u00e1c \u0111\u1ea3m b\u1ea3o d\u1ecbch v\u1ee5 t\u1ed1i thi\u1ec3u b\u1eb1ng c\u00e1ch b\u1ea3o v\u1ec7 thi\u1ebft l\u1eadp kh\u1ecfi l\u1ed7i node<\/li>\n<li>T\u00ednh ho\u00e0n h\u1ea3o: L\u00fd t\u01b0\u1edfng nh\u1ea5t l\u00e0 t\u00f4i mu\u1ed1n g\u00f5 m\u1ed9t l\u1ec7nh duy nh\u1ea5t \u0111\u1ec3 t\u1ef1 \u0111\u1ed9ng ch\u1ea1y m\u1ecdi th\u1ee9.<\/li>\n<\/ul>\n<p>Nh\u1eefng g\u00ec t\u00f4i ngh\u0129 ra ph\u1ee5c v\u1ee5 t\u1ed1t cho t\u00f4i.\u00a0Tuy nhi\u00ean, t\u00f4i cho r\u1eb1ng n\u00f3 c\u0169ng c\u00f3 th\u1ec3 gi\u00fap \u00edch cho b\u1ea5t k\u1ef3 ai mu\u1ed1n thi\u1ebft l\u1eadp m\u1ed9t d\u1ecbch v\u1ee5 t\u01b0\u01a1ng t\u1ef1 cho m\u1ee5c \u0111\u00edch s\u1eed d\u1ee5ng c\u00e1 nh\u00e2n ho\u1eb7c th\u1eadm ch\u00ed v\u1edbi c\u00e1c t\u1ed5 ch\u1ee9c.\u00a0N\u1ebfu b\u1ea1n l\u00e0 m\u1ed9t trong s\u1ed1 \u0111\u00f3, h\u00e3y \u0111\u1ecdc ti\u1ebfp.<\/p>\n<p>Gi\u1ea3i ph\u00e1p c\u1ee7a t\u00f4i d\u1ef1a v\u00e0o Kubernetes \u0111\u1ec3 x\u1eed l\u00fd t\u1ea5t c\u1ea3 c\u00e1c c\u00f4ng vi\u1ec7c n\u1eb7ng nh\u1ecdc c\u1ee7a c\u01a1 s\u1edf h\u1ea1 t\u1ea7ng, bao g\u1ed3m t\u00ednh \u1ed5n \u0111\u1ecbnh c\u1ee7a tr\u1ea1ng th\u00e1i, t\u00ednh kh\u1ea3 d\u1ee5ng v\u00e0 kh\u1ea3 n\u0103ng m\u1edf r\u1ed9ng.\u00a0Ngo\u00e0i ra, ph\u01b0\u01a1ng ph\u00e1p n\u00e0y mang l\u1ea1i cho t\u00f4i s\u1ef1 linh ho\u1ea1t ho\u00e0n to\u00e0n trong vi\u1ec7c tri\u1ec3n khai local, l\u00ean cloud ho\u1eb7c d\u1ecbch v\u1ee5 K8s \u0111\u01b0\u1ee3c qu\u1ea3n l\u00fd (managed).<\/p>\n<p>\u0110\u1ed1i v\u1edbi m\u1ee5c \u0111\u00edch minh ho\u1ea1, \u1ee9ng d\u1ee5ng s\u1eed d\u1ee5ng\u00a0<a href=\"https:\/\/huggingface.co\/gpt2\">GPT-2 t\u1eeb Hugging Face<\/a>, nh\u01b0ng b\u1ea1n c\u00f3 th\u1ec3 ch\u1ecdn b\u1ea5t k\u1ef3 model n\u00e0o kh\u00e1c thay cho n\u00f3.\u00a0T\u00f4i \u0111\u00e3 ch\u1ecdn LLM n\u00e0y v\u00ec c\u00e1c model l\u1edbn h\u01a1n c\u1ea7n nhi\u1ec1u t\u00e0i nguy\u00ean h\u01a1n v\u00e0 c\u00f3 th\u1ec3 kh\u00f4ng ho\u1ea1t \u0111\u1ed9ng t\u1ed1t tr\u00ean laptop t\u1ea7m trung.<\/p>\n<p>Cu\u1ed1i c\u00f9ng, giao di\u1ec7n ng\u01b0\u1eddi d\u00f9ng c\u1ee7a \u1ee9ng d\u1ee5ng \u0111\u01b0\u1ee3c tri\u1ec3n khai v\u1edbi\u00a0<a href=\"https:\/\/github.com\/gradio-app\/gradio\/\">Gradio<\/a>.\u00a0Gradio t\u1ef1 \u0111\u1ed9ng t\u1ea1o m\u1ed9t giao di\u1ec7n web \u0111\u1ea7y \u0111\u1ee7 ch\u1ee9c n\u0103ng \u0111\u01a1n gi\u1ea3n, ph\u00f9 h\u1ee3p v\u1edbi model ngu\u1ed3n m\u1edf \u0111\u00e3 ch\u1ecdn.<\/p>\n<h3>\u0110i\u1ec1u ki\u1ec7n ti\u00ean quy\u1ebft<\/h3>\n<p>\u0110\u1ec3 b\u1eaft \u0111\u1ea7u, b\u1ea1n c\u1ea7n c\u00f3 kh\u1ea3 n\u0103ng t\u1ea1o c\u00e1c container image.\u00a0T\u00f4i \u0111ang s\u1eed d\u1ee5ng Docker cho vi\u1ec7c \u0111\u00f3 nh\u01b0ng b\u1ea1n c\u00f3 th\u1ec3 s\u1eed d\u1ee5ng b\u1ea5t k\u1ef3 gi\u1ea3i ph\u00e1p thay th\u1ebf n\u00e0o.\u00a0B\u1ea1n c\u00f3 th\u1ec3 t\u00ecm th\u1ea5y h\u01b0\u1edbng d\u1eabn t\u1ea3i xu\u1ed1ng v\u00e0 c\u00e0i \u0111\u1eb7t Docker <a href=\"https:\/\/docs.docker.com\/engine\/install\/\">t\u1ea1i \u0111\u00e2y<\/a>.<\/p>\n<p>Ti\u1ebfp theo, b\u1ea1n s\u1ebd c\u1ea7n quy\u1ec1n truy c\u1eadp v\u00e0o cluster K8s th\u00f4ng qua l\u1ec7nh &#8216;kubeconfig&#8217; v\u00e0 c\u00f3 vai tr\u00f2 &#8216;cluster-admin&#8217;.\u00a0T\u00f4i th\u00edch s\u1eed d\u1ee5ng\u00a0<a href=\"https:\/\/kind.sigs.k8s.io\/\">kind<\/a>\u00a0\u0111\u1ec3 t\u1ea1o v\u00e0 qu\u1ea3n l\u00fd cluster dockerized local c\u1ee7a m\u00ecnh, nh\u01b0ng \u0111\u00f3 ch\u1ec9 l\u00e0 t\u00f4i.\u00a0B\u1ea1n ch\u1eafc ch\u1eafn c\u00f3 th\u1ec3 s\u1eed d\u1ee5ng c\u00f4ng c\u1ee5 m\u00e0 b\u1ea1n \u0111\u00e3 quen d\u00f9ng, nh\u01b0ng n\u1ebfu b\u1ea1n mu\u1ed1n th\u1eed, ch\u1ec9 c\u1ea7n l\u00e0m theo h\u01b0\u1edbng d\u1eabn b\u1eaft \u0111\u1ea7u nhanh v\u1ec1 c\u00e0i \u0111\u1eb7t <a href=\"https:\/\/kind.sigs.k8s.io\/docs\/user\/quick-start\/#installation\">t\u1ea1i \u0111\u00e2y<\/a>.<\/p>\n<h3>\u200dT\u1ea1o Cluster<\/h3>\n<p>T\u1ea1i th\u1eddi \u0111i\u1ec3m n\u00e0y, ch\u00fang ta c\u00f3 th\u1ec3 t\u1ea1o cluster t\u1ed1i thi\u1ec3u c\u1ee7a m\u00ecnh, bao g\u1ed3m control plane v\u00e0 c\u00e1c node worker.\u00a0\u0110\u1ec3 l\u00e0m \u0111i\u1ec1u \u0111\u00f3, tr\u01b0\u1edbc ti\u00ean, h\u00e3y t\u1ea1o file &#8216;cluster.yaml&#8217; v\u1edbi n\u1ed9i dung sau:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" width=\"611\" height=\"181\" class=\"alignnone wp-image-16838 size-full\" src=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-2.png\" srcset=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-2.png 611w, https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-2-300x89.png 300w, https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-2-40x12.png 40w\" sizes=\"auto, (max-width: 611px) 100vw, 611px\" \/><\/p>\n<p>Sau \u0111\u00f3, t\u1ea1o v\u00e0 xu\u1ea5t cluster <strong>kind<\/strong> b\u1eb1ng c\u00e1c l\u1ec7nh n\u00e0y t\u1eeb shell promt:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" width=\"611\" height=\"103\" class=\"alignnone wp-image-16837 size-full\" src=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-1.png\" srcset=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-1.png 611w, https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-1-300x51.png 300w, https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-1-40x7.png 40w\" sizes=\"auto, (max-width: 611px) 100vw, 611px\" \/><\/p>\n<h3>\u200dContainer \u1ee9ng d\u1ee5ng<\/h3>\n<p>H\u00e3y t\u1ea1o m\u1ed9t \u1ee9ng d\u1ee5ng Python \u0111\u01b0\u1ee3c \u0111\u00f3ng g\u00f3i (containerized) &#8211; cung c\u1ea5p giao di\u1ec7n v\u00e0 ch\u1ea1y m\u00f4 h\u00ecnh GPT-2.\u00a0\u0110\u1ea7u ti\u00ean, t\u1ea1o m\u1ed9t file c\u00f3 t\u00ean &#8216;app.py&#8217; v\u1edbi n\u1ed9i dung sau:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" width=\"611\" height=\"235\" class=\"alignnone wp-image-16836 size-full\" src=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface.png\" srcset=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface.png 611w, https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-300x115.png 300w, https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-40x15.png 40w\" sizes=\"auto, (max-width: 611px) 100vw, 611px\" \/><\/p>\n<p>V\u00e0 sau \u0111\u00f3 l\u00e0 file &#8216;requirements.txt&#8217;:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" width=\"612\" height=\"131\" class=\"alignnone wp-image-16839 size-full\" src=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-3.png\" srcset=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-3.png 612w, https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-3-300x64.png 300w, https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-3-40x9.png 40w\" sizes=\"auto, (max-width: 612px) 100vw, 612px\" \/><\/p>\n<p>Ti\u1ebfp theo, x\u00e1c \u0111\u1ecbnh container image c\u1ee7a \u1ee9ng d\u1ee5ng b\u1eb1ng c\u00e1ch th\u00eam file &#8216;Dockerfile&#8217; m\u1edbi v\u1edbi n\u1ed9i dung sau:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" width=\"703\" height=\"210\" class=\"alignnone wp-image-16840 size-full\" src=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-4.png\" srcset=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-4.png 703w, https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-4-300x90.png 300w, https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-4-40x12.png 40w\" sizes=\"auto, (max-width: 703px) 100vw, 703px\" \/><\/p>\n<p>B\u00e2y gi\u1edd, t\u1ea1o image b\u1eb1ng c\u00e1ch d\u00e1n l\u1ec7nh n\u00e0y v\u00e0o prompt v\u00e0 ch\u1ea1y n\u00f3:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" width=\"610\" height=\"78\" class=\"alignnone wp-image-16841 size-full\" src=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-5.png\" srcset=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-5.png 610w, https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-5-300x38.png 300w, https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-5-40x5.png 40w\" sizes=\"auto, (max-width: 610px) 100vw, 610px\" \/><\/p>\n<p>Cu\u1ed1i c\u00f9ng, t\u1ea3i image v\u00e0o c\u00e1c node c\u1ee7a cluster:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" width=\"611\" height=\"78\" class=\"alignnone wp-image-16842 size-full\" src=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-6.png\" srcset=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-6.png 611w, https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-6-300x38.png 300w, https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-6-40x5.png 40w\" sizes=\"auto, (max-width: 611px) 100vw, 611px\" \/><\/p>\n<h3>Tri\u1ec3n khai \u1ee9ng d\u1ee5ng v\u00e0 d\u1ecbch v\u1ee5<\/h3>\n<p>B\u1eaft \u0111\u1ea7u b\u1eb1ng c\u00e1ch x\u00e1c \u0111\u1ecbnh tri\u1ec3n khai c\u1ee7a \u1ee9ng d\u1ee5ng th\u00f4ng qua vi\u1ec7c t\u1ea1o file &#8216;deployment.yaml&#8217;:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" width=\"575\" height=\"518\" class=\"alignnone wp-image-16843 size-full\" src=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-7.png\" srcset=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-7.png 575w, https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-7-300x270.png 300w, https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-7-40x36.png 40w\" sizes=\"auto, (max-width: 575px) 100vw, 575px\" \/><\/p>\n<p>V\u00e0 \u00e1p d\u1ee5ng n\u00f3 cho cluster K8s:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" width=\"621\" height=\"65\" class=\"alignnone wp-image-16844 size-full\" src=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-8.png\" srcset=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-8.png 621w, https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-8-300x31.png 300w, https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-8-40x4.png 40w\" sizes=\"auto, (max-width: 621px) 100vw, 621px\" \/><\/p>\n<p>B\u00e2y gi\u1edd, x\u00e1c \u0111\u1ecbnh d\u1ecbch v\u1ee5 b\u1eb1ng c\u00e1ch t\u1ea1o file &#8216;service.yaml&#8217;:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" width=\"620\" height=\"302\" class=\"alignnone wp-image-16845 size-full\" src=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-9.png\" srcset=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-9.png 620w, https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-9-300x146.png 300w, https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-9-40x19.png 40w\" sizes=\"auto, (max-width: 620px) 100vw, 620px\" \/><\/p>\n<p>V\u00e0 m\u1ed9t l\u1ea7n n\u1eefa, \u00e1p d\u1ee5ng n\u00f3 cho cluster:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" width=\"621\" height=\"64\" class=\"alignnone wp-image-16846 size-full\" src=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-10.png\" srcset=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-10.png 621w, https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-10-300x31.png 300w, https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-10-40x4.png 40w\" sizes=\"auto, (max-width: 621px) 100vw, 621px\" \/><\/p>\n<p>V\u00ec qu\u00e1 tr\u00ecnh n\u00e0y c\u00f3 th\u1ec3 m\u1ea5t v\u00e0i ph\u00fat \u0111\u1ec3 ho\u00e0n th\u00e0nh, b\u1ea1n c\u00f3 th\u1ec3 theo d\u00f5i ti\u1ebfn tr\u00ecnh b\u1eb1ng l\u1ec7nh sau:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" width=\"622\" height=\"64\" class=\"alignnone wp-image-16847 size-full\" src=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-11.png\" srcset=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-11.png 622w, https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-11-300x31.png 300w, https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-11-40x4.png 40w\" sizes=\"auto, (max-width: 622px) 100vw, 622px\" \/><\/p>\n<p>Cu\u1ed1i c\u00f9ng, nh\u01b0ng kh\u00f4ng k\u00e9m ph\u1ea7n quan tr\u1ecdng, b\u1ea1n c\u1ea7n b\u1eadt port forwarding cho d\u1ecbch v\u1ee5 \u0111\u1ec3 c\u00f3 th\u1ec3 truy c\u1eadp d\u1ecbch v\u1ee5 n\u00e0y t\u1eeb tr\u00ecnh duy\u1ec7t:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" width=\"622\" height=\"65\" class=\"alignnone wp-image-16848 size-full\" src=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-12.png\" srcset=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-12.png 622w, https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-12-300x31.png 300w, https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-cach-trien-khai-chatbot-gpt-tren-k8s-voi-gradio-interface-12-40x4.png 40w\" sizes=\"auto, (max-width: 622px) 100vw, 622px\" \/><\/p>\n<p>\u0110\u00f3 l\u00e0 t\u1ea5t c\u1ea3 nh\u1eefng g\u00ec c\u1ea7n l\u00e0m \u0111\u1ec3 c\u00f3 n\u00f3.\u00a0B\u00e2y gi\u1edd, b\u1ea1n c\u00f3 th\u1ec3 tr\u1ecf tr\u00ecnh duy\u1ec7t c\u1ee7a m\u00ecnh t\u1edbi\u00a0<a href=\"http:\/\/localhost:7860\/\">http:\/\/localhost:7860\/<\/a>\u00a0v\u00e0 b\u1eaft \u0111\u1ea7u s\u1eed d\u1ee5ng GPT-2 LLM:<\/p>\n<p><img decoding=\"async\" src=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/tgmc-blog-64c9c005b57c1.gif\" alt=\"\" \/><\/p>\n<p>T\u1ea5t nhi\u00ean, b\u1ea1n c\u00f3 th\u1ec3 t\u00f9y ch\u1ec9nh b\u1ea3n d\u1ef1ng \u0111\u1ec3 s\u1eed d\u1ee5ng c\u00e1c m\u00f4 h\u00ecnh m\u00e3 ngu\u1ed3n m\u1edf kh\u00e1c, ch\u1eb3ng h\u1ea1n nh\u01b0\u00a0<a href=\"https:\/\/huggingface.co\/huggyllama\/llama-65b\">LLaMA<\/a>\u00a0c\u1ee7a\u00a0<a href=\"https:\/\/ai.meta.com\/blog\/large-language-model-llama-meta-ai\/\">Meta<\/a>\u00a0ho\u1eb7c\u00a0<a href=\"https:\/\/huggingface.co\/tiiuae\/falcon-40b-instruct\">Falcon<\/a>\u00a0c\u1ee7a <a href=\"https:\/\/www.tii.ae\/\">TII<\/a>.<\/p>\n<p><em>Theo <\/em>Run:ai<\/p>\n<div>____<br \/><b>B\u00e0i vi\u1ebft li\u00ean quan<\/b><\/div>\n<ul>\n<li><a href=\"https:\/\/thegioimaychu.vn\/blog\/?post_type=post&#038;p=19669\">T\u1ea1o chatbot tr\u00ean d\u1eef li\u1ec7u c\u1ee7a ri\u00eang b\u1ea1n v\u1edbi NVIDIA ChatRTX<\/a><\/li>\n<li><a href=\"https:\/\/thegioimaychu.vn\/blog\/?post_type=post&#038;p=18558\">Google ra m\u1eaft Gemini &#8211; m\u00f4 h\u00ecnh AI &#8216;m\u1ea1nh h\u01a1n GPT-4&#8217;<\/a><\/li>\n<li><a href=\"https:\/\/thegioimaychu.vn\/blog\/?post_type=post&#038;p=17069\">T\u1ea1i sao Kubernetes ch\u00ednh l\u00e0 n\u1ec1n t\u1ea3ng d\u00e0nh cho Generative AI?<\/a><\/li>\n<li><a href=\"https:\/\/thegioimaychu.vn\/blog\/?post_type=post&#038;p=15771\">GPT-3 vs BERT: So s\u00e1nh c\u00e1c m\u00f4 h\u00ecnh ng\u00f4n ng\u1eef l\u1edbn<\/a><\/li>\n<li><a href=\"https:\/\/thegioimaychu.vn\/blog\/?post_type=post&#038;p=15320\">M\u00f4 h\u00ecnh ng\u00f4n ng\u1eef l\u1edbn (LLMs): Th\u00f4ng minh v\u00e0 hi\u1ec7u qu\u1ea3 h\u01a1n v\u1edbi NVIDIA NeMo<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>C&aacute;c m&ocirc; h&igrave;nh ng&ocirc;n ng&#7919; l&#7899;n (LLM) &#273;ang chen s&acirc;u v&agrave;o cu&#7897;c s&#7889;ng c&#7911;a ch&uacute;ng ta.&nbsp;&Yacute; t&ocirc;i kh&ocirc;ng ph&#7843;i l&agrave; theo ngh&#297;a &#273;en (&iacute;t nh&#7845;t l&agrave; trong th&#7901;i &#273;i&#7875;m hi&#7879;n t&#7841;i), m&agrave; &#273;&uacute;ng h&#417;n l&agrave; c&oacute; v&#7867; nh&#432;&nbsp;m&#7895;i ng&agrave;y &#273;&#7873;u c&oacute; v&ocirc; s&#7889; m&ocirc; h&igrave;nh&nbsp;v&agrave; &#7913;ng d&#7909;ng m&#7899;i xu&#7845;t hi&#7879;n. S&#7921; kh&#7903;i &#273;&#7847;u t&#432;&#7903;ng ch&#7915;ng&#8230;<\/p>\n","protected":false},"author":29,"featured_media":16850,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":""},"categories":[3],"tags":[522,83,1062,1124],"class_list":["post-16833","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai-hpc","tag-chatbot","tag-container","tag-gpt","tag-k8s"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.3 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>C\u00e1ch tri\u1ec3n khai chatbot GPT tr\u00ean K8s v\u1edbi giao di\u1ec7n Gradio - Blog | TheGioiMayChu<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/cach-trien-khai-chatbot-gpt-tren-k8s-voi-giao-dien-gradio-p16833\/\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:title\" content=\"C\u00e1ch tri\u1ec3n khai chatbot GPT tr\u00ean K8s v\u1edbi giao di\u1ec7n Gradio - Blog | TheGioiMayChu\" \/>\n<meta name=\"twitter:description\" content=\"C&aacute;c m&ocirc; h&igrave;nh ng&ocirc;n ng&#7919; l&#7899;n (LLM) &#273;ang chen s&acirc;u v&agrave;o cu&#7897;c s&#7889;ng c&#7911;a ch&uacute;ng ta.&nbsp;&Yacute; t&ocirc;i kh&ocirc;ng ph&#7843;i l&agrave; theo ngh&#297;a &#273;en (&iacute;t nh&#7845;t l&agrave; trong th&#7901;i &#273;i&#7875;m hi&#7879;n t&#7841;i), m&agrave; &#273;&uacute;ng h&#417;n l&agrave; c&oacute; v&#7867; nh&#432;&nbsp;m&#7895;i ng&agrave;y &#273;&#7873;u c&oacute; v&ocirc; s&#7889; m&ocirc; h&igrave;nh&nbsp;v&agrave; &#7913;ng d&#7909;ng m&#7899;i xu&#7845;t hi&#7879;n. S&#7921; kh&#7903;i &#273;&#7847;u t&#432;&#7903;ng ch&#7915;ng...\" \/>\n<meta name=\"twitter:image\" content=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-gpt-chatbot.jpg\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"TGMC Blog\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"7 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/cach-trien-khai-chatbot-gpt-tren-k8s-voi-giao-dien-gradio-p16833\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/cach-trien-khai-chatbot-gpt-tren-k8s-voi-giao-dien-gradio-p16833\\\/\"},\"author\":{\"name\":\"TGMC Blog\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#\\\/schema\\\/person\\\/777f41403962330933a4fbcc80bec570\"},\"headline\":\"C\u00e1ch tri\u1ec3n khai chatbot GPT tr\u00ean K8s v\u1edbi giao di\u1ec7n Gradio\",\"datePublished\":\"2023-08-02T03:42:36+00:00\",\"dateModified\":\"2023-08-03T14:42:40+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/cach-trien-khai-chatbot-gpt-tren-k8s-voi-giao-dien-gradio-p16833\\\/\"},\"wordCount\":1459,\"publisher\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/cach-trien-khai-chatbot-gpt-tren-k8s-voi-giao-dien-gradio-p16833\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/wp-content\\\/uploads\\\/2023\\\/08\\\/TheGioiMayChu-Blog-Image-gpt-chatbot.jpg\",\"keywords\":[\"chatbot\",\"container\",\"GPT\",\"K8S\"],\"articleSection\":[\"AI - HPC\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/cach-trien-khai-chatbot-gpt-tren-k8s-voi-giao-dien-gradio-p16833\\\/\",\"url\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/cach-trien-khai-chatbot-gpt-tren-k8s-voi-giao-dien-gradio-p16833\\\/\",\"name\":\"C\u00e1ch tri\u1ec3n khai chatbot GPT tr\u00ean K8s v\u1edbi giao di\u1ec7n Gradio - Blog | TheGioiMayChu\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/cach-trien-khai-chatbot-gpt-tren-k8s-voi-giao-dien-gradio-p16833\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/cach-trien-khai-chatbot-gpt-tren-k8s-voi-giao-dien-gradio-p16833\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/wp-content\\\/uploads\\\/2023\\\/08\\\/TheGioiMayChu-Blog-Image-gpt-chatbot.jpg\",\"datePublished\":\"2023-08-02T03:42:36+00:00\",\"dateModified\":\"2023-08-03T14:42:40+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/cach-trien-khai-chatbot-gpt-tren-k8s-voi-giao-dien-gradio-p16833\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/cach-trien-khai-chatbot-gpt-tren-k8s-voi-giao-dien-gradio-p16833\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/cach-trien-khai-chatbot-gpt-tren-k8s-voi-giao-dien-gradio-p16833\\\/#primaryimage\",\"url\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/wp-content\\\/uploads\\\/2023\\\/08\\\/TheGioiMayChu-Blog-Image-gpt-chatbot.jpg\",\"contentUrl\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/wp-content\\\/uploads\\\/2023\\\/08\\\/TheGioiMayChu-Blog-Image-gpt-chatbot.jpg\",\"width\":2560,\"height\":1205},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/cach-trien-khai-chatbot-gpt-tren-k8s-voi-giao-dien-gradio-p16833\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Trang ch\u1ee7\",\"item\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"AI - HPC\",\"item\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/.\\\/ai-hpc\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"C\u00e1ch tri\u1ec3n khai chatbot GPT tr\u00ean K8s v\u1edbi giao di\u1ec7n Gradio\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#website\",\"url\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/\",\"name\":\"Blog | TheGioiMayChu\",\"description\":\"C\u1eadp nh\u1eadt xu h\u01b0\u1edbng c\u00f4ng ngh\u1ec7 m\u00e1y ch\u1ee7\",\"publisher\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#organization\",\"name\":\"Blog | TheGioiMayChu\",\"url\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/wp-content\\\/uploads\\\/2018\\\/08\\\/cropped-ntcnlog-logo-2.png\",\"contentUrl\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/wp-content\\\/uploads\\\/2018\\\/08\\\/cropped-ntcnlog-logo-2.png\",\"width\":500,\"height\":73,\"caption\":\"Blog | TheGioiMayChu\"},\"image\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/thegioimaychu\\\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#\\\/schema\\\/person\\\/777f41403962330933a4fbcc80bec570\",\"name\":\"TGMC Blog\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/ff179df3aeac078da5e07e40f2e014e99ab4120e2276b687bbe7e6964d99655e?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/ff179df3aeac078da5e07e40f2e014e99ab4120e2276b687bbe7e6964d99655e?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/ff179df3aeac078da5e07e40f2e014e99ab4120e2276b687bbe7e6964d99655e?s=96&d=mm&r=g\",\"caption\":\"TGMC Blog\"},\"url\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/author\\\/tgmc\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"C\u00e1ch tri\u1ec3n khai chatbot GPT tr\u00ean K8s v\u1edbi giao di\u1ec7n Gradio - Blog | TheGioiMayChu","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/cach-trien-khai-chatbot-gpt-tren-k8s-voi-giao-dien-gradio-p16833\/","twitter_card":"summary_large_image","twitter_title":"C\u00e1ch tri\u1ec3n khai chatbot GPT tr\u00ean K8s v\u1edbi giao di\u1ec7n Gradio - Blog | TheGioiMayChu","twitter_description":"C&aacute;c m&ocirc; h&igrave;nh ng&ocirc;n ng&#7919; l&#7899;n (LLM) &#273;ang chen s&acirc;u v&agrave;o cu&#7897;c s&#7889;ng c&#7911;a ch&uacute;ng ta.&nbsp;&Yacute; t&ocirc;i kh&ocirc;ng ph&#7843;i l&agrave; theo ngh&#297;a &#273;en (&iacute;t nh&#7845;t l&agrave; trong th&#7901;i &#273;i&#7875;m hi&#7879;n t&#7841;i), m&agrave; &#273;&uacute;ng h&#417;n l&agrave; c&oacute; v&#7867; nh&#432;&nbsp;m&#7895;i ng&agrave;y &#273;&#7873;u c&oacute; v&ocirc; s&#7889; m&ocirc; h&igrave;nh&nbsp;v&agrave; &#7913;ng d&#7909;ng m&#7899;i xu&#7845;t hi&#7879;n. S&#7921; kh&#7903;i &#273;&#7847;u t&#432;&#7903;ng ch&#7915;ng...","twitter_image":"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-gpt-chatbot.jpg","twitter_misc":{"Written by":"TGMC Blog","Est. reading time":"7 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/cach-trien-khai-chatbot-gpt-tren-k8s-voi-giao-dien-gradio-p16833\/#article","isPartOf":{"@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/cach-trien-khai-chatbot-gpt-tren-k8s-voi-giao-dien-gradio-p16833\/"},"author":{"name":"TGMC Blog","@id":"https:\/\/thegioimaychu.vn\/blog\/#\/schema\/person\/777f41403962330933a4fbcc80bec570"},"headline":"C\u00e1ch tri\u1ec3n khai chatbot GPT tr\u00ean K8s v\u1edbi giao di\u1ec7n Gradio","datePublished":"2023-08-02T03:42:36+00:00","dateModified":"2023-08-03T14:42:40+00:00","mainEntityOfPage":{"@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/cach-trien-khai-chatbot-gpt-tren-k8s-voi-giao-dien-gradio-p16833\/"},"wordCount":1459,"publisher":{"@id":"https:\/\/thegioimaychu.vn\/blog\/#organization"},"image":{"@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/cach-trien-khai-chatbot-gpt-tren-k8s-voi-giao-dien-gradio-p16833\/#primaryimage"},"thumbnailUrl":"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-gpt-chatbot.jpg","keywords":["chatbot","container","GPT","K8S"],"articleSection":["AI - HPC"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/cach-trien-khai-chatbot-gpt-tren-k8s-voi-giao-dien-gradio-p16833\/","url":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/cach-trien-khai-chatbot-gpt-tren-k8s-voi-giao-dien-gradio-p16833\/","name":"C\u00e1ch tri\u1ec3n khai chatbot GPT tr\u00ean K8s v\u1edbi giao di\u1ec7n Gradio - Blog | TheGioiMayChu","isPartOf":{"@id":"https:\/\/thegioimaychu.vn\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/cach-trien-khai-chatbot-gpt-tren-k8s-voi-giao-dien-gradio-p16833\/#primaryimage"},"image":{"@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/cach-trien-khai-chatbot-gpt-tren-k8s-voi-giao-dien-gradio-p16833\/#primaryimage"},"thumbnailUrl":"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-gpt-chatbot.jpg","datePublished":"2023-08-02T03:42:36+00:00","dateModified":"2023-08-03T14:42:40+00:00","breadcrumb":{"@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/cach-trien-khai-chatbot-gpt-tren-k8s-voi-giao-dien-gradio-p16833\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/cach-trien-khai-chatbot-gpt-tren-k8s-voi-giao-dien-gradio-p16833\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/cach-trien-khai-chatbot-gpt-tren-k8s-voi-giao-dien-gradio-p16833\/#primaryimage","url":"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-gpt-chatbot.jpg","contentUrl":"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/08\/TheGioiMayChu-Blog-Image-gpt-chatbot.jpg","width":2560,"height":1205},{"@type":"BreadcrumbList","@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/cach-trien-khai-chatbot-gpt-tren-k8s-voi-giao-dien-gradio-p16833\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Trang ch\u1ee7","item":"https:\/\/thegioimaychu.vn\/blog\/"},{"@type":"ListItem","position":2,"name":"AI - HPC","item":"https:\/\/thegioimaychu.vn\/blog\/.\/ai-hpc\/"},{"@type":"ListItem","position":3,"name":"C\u00e1ch tri\u1ec3n khai chatbot GPT tr\u00ean K8s v\u1edbi giao di\u1ec7n Gradio"}]},{"@type":"WebSite","@id":"https:\/\/thegioimaychu.vn\/blog\/#website","url":"https:\/\/thegioimaychu.vn\/blog\/","name":"Blog | TheGioiMayChu","description":"C\u1eadp nh\u1eadt xu h\u01b0\u1edbng c\u00f4ng ngh\u1ec7 m\u00e1y ch\u1ee7","publisher":{"@id":"https:\/\/thegioimaychu.vn\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/thegioimaychu.vn\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/thegioimaychu.vn\/blog\/#organization","name":"Blog | TheGioiMayChu","url":"https:\/\/thegioimaychu.vn\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/thegioimaychu.vn\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2018\/08\/cropped-ntcnlog-logo-2.png","contentUrl":"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2018\/08\/cropped-ntcnlog-logo-2.png","width":500,"height":73,"caption":"Blog | TheGioiMayChu"},"image":{"@id":"https:\/\/thegioimaychu.vn\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/thegioimaychu\/"]},{"@type":"Person","@id":"https:\/\/thegioimaychu.vn\/blog\/#\/schema\/person\/777f41403962330933a4fbcc80bec570","name":"TGMC Blog","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/ff179df3aeac078da5e07e40f2e014e99ab4120e2276b687bbe7e6964d99655e?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/ff179df3aeac078da5e07e40f2e014e99ab4120e2276b687bbe7e6964d99655e?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/ff179df3aeac078da5e07e40f2e014e99ab4120e2276b687bbe7e6964d99655e?s=96&d=mm&r=g","caption":"TGMC Blog"},"url":"https:\/\/thegioimaychu.vn\/blog\/author\/tgmc\/"}]}},"_links":{"self":[{"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/posts\/16833","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/users\/29"}],"replies":[{"embeddable":true,"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/comments?post=16833"}],"version-history":[{"count":9,"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/posts\/16833\/revisions"}],"predecessor-version":[{"id":16900,"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/posts\/16833\/revisions\/16900"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/media\/16850"}],"wp:attachment":[{"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/media?parent=16833"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/categories?post=16833"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/tags?post=16833"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}