{"id":16333,"date":"2023-07-11T21:41:27","date_gmt":"2023-07-11T14:41:27","guid":{"rendered":"https:\/\/www.thegioimaychu.vn\/blog\/?p=16333"},"modified":"2023-07-11T21:44:19","modified_gmt":"2023-07-11T14:44:19","slug":"sxm-vs-pcie-gpu-nao-tot-nhat-cho-dao-tao-cac-mo-hinh-ngon-ngu-lon-llm-nhu-gpt-4","status":"publish","type":"post","link":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/sxm-vs-pcie-gpu-nao-tot-nhat-cho-dao-tao-cac-mo-hinh-ngon-ngu-lon-llm-nhu-gpt-4-p16333\/","title":{"rendered":"SXM vs PCIe: GPU n\u00e0o t\u1ed1t nh\u1ea5t cho \u0111\u00e0o t\u1ea1o c\u00e1c m\u00f4 h\u00ecnh ng\u00f4n ng\u1eef l\u1edbn (LLM) nh\u01b0 GPT-4?"},"content":{"rendered":"<style>.iblink{color:#975!important;}.iblink:hover{color:orange!important;}<\/style><h2>NLP l\u00e0 g\u00ec v\u00e0 LLM l\u00e0 g\u00ec?<\/h2>\n<p>X\u1eed l\u00fd ng\u00f4n ng\u1eef t\u1ef1 nhi\u00ean (NLP) l\u00e0 m\u1ed9t nh\u00e1nh c\u1ee7a <a class=\"iblink\" href=\"\/blog\/tag\/ai\/\">Tr\u00ed tu\u1ec7 nh\u00e2n t\u1ea1o<\/a> (AI) cho ph\u00e9p m\u00e1y m\u00f3c hi\u1ec3u v\u00e0 di\u1ec5n gi\u1ea3i ng\u00f4n ng\u1eef c\u1ee7a con ng\u01b0\u1eddi.\u00a0Nh\u1eefng ti\u1ebfn b\u1ed9 g\u1ea7n \u0111\u00e2y trong h\u1ecdc s\u00e2u \u0111\u00e3 d\u1eabn \u0111\u1ebfn s\u1ef1 xu\u1ea5t hi\u1ec7n c\u1ee7a c\u00e1c m\u00f4 h\u00ecnh ng\u00f4n ng\u1eef l\u1edbn (LLM) th\u1ec3 hi\u1ec7n kh\u1ea3 n\u0103ng hi\u1ec3u ng\u00f4n ng\u1eef t\u1ef1 nhi\u00ean m\u1ed9t c\u00e1ch k\u1ef3 di\u1ec7u \u0111\u00e3 c\u00e1ch m\u1ea1ng h\u00f3a th\u1ebf gi\u1edbi c\u00f4ng ngh\u1ec7 v\u00e0 c\u00f3 t\u00e1c \u0111\u1ed9ng \u0111\u00e1ng k\u1ec3 \u0111\u1ebfn t\u01b0\u01a1ng lai.\u00a0C\u00e1c doanh nghi\u1ec7p v\u00e0 c\u00f4ng ty kh\u1edfi nghi\u1ec7p \u0111\u00e3 ch\u1ecdn \u0111\u00e0o t\u1ea1o c\u00e1c LLM n\u00e0y tr\u00ean ph\u1ea7n c\u1ee9ng chuy\u00ean d\u1ee5ng c\u1ee7a NVIDIA nh\u01b0 c\u00e1c h\u1ec7 th\u1ed1ng DGX.<\/p>\n<p>M\u00f4 h\u00ecnh ng\u00f4n ng\u1eef l\u1edbn (LLM) l\u00e0 m\u1ed9t lo\u1ea1i m\u00f4 h\u00ecnh ng\u00f4n ng\u1eef bao g\u1ed3m m\u1ed9t m\u1ea1ng th\u1ea7n kinh g\u1ed3m c\u00e1c tham s\u1ed1 \u0111\u01b0\u1ee3c \u0111\u00e0o t\u1ea1o tr\u00ean m\u1ed9t l\u01b0\u1ee3ng l\u1edbn d\u1eef li\u1ec7u v\u0103n b\u1ea3n kh\u00f4ng \u0111\u01b0\u1ee3c g\u1eafn nh\u00e3n.\u00a0LLM n\u1ed5i ti\u1ebfng nh\u1ea5t l\u00e0 series GPT (Generative Pre-training Transformer) c\u1ee7a OpenAI, \u0111\u01b0\u1ee3c \u0111\u00e0o t\u1ea1o tr\u00ean h\u00e0ng t\u1ef7 t\u1eeb, n\u00f3 ch\u00ednh l\u00e0 n\u1ec1n m\u00f3ng cho m\u00f4 h\u00ecnh ChatGPT \u0111\u01b0\u1ee3c bi\u1ebft \u0111\u1ebfn nhi\u1ec1u nh\u1ea5t hi\u1ec7n nay.\u00a0C\u00e1c \u1ee9ng d\u1ee5ng kh\u00e1c nhau s\u1eed d\u1ee5ng GPT l\u00e0m n\u1ec1n t\u1ea3ng \u0111\u1ec3 x\u00e2y d\u1ef1ng c\u00e1c chatbot, c\u00f4ng c\u1ee5 t\u00f3m t\u1eaft n\u1ed9i dung, v.v.\u00a0C\u00e1c LLM \u0111\u00e3 th\u1ec3 hi\u1ec7n hi\u1ec7u su\u1ea5t v\u01b0\u1ee3t tr\u1ed9i trong m\u1ed9t lo\u1ea1t c\u00e1c nhi\u1ec7m v\u1ee5 NLP nh\u01b0 d\u1ecbch ng\u00f4n ng\u1eef, tr\u1ea3 l\u1eddi c\u00e2u h\u1ecfi v\u00e0 t\u1ea1o v\u0103n b\u1ea3n.\u00a0ChatGPT (\u0111\u01b0\u1ee3c \u0111\u00e0o t\u1ea1o ban \u0111\u1ea7u d\u1ef1a tr\u00ean GPT-3) v\u00e0 ChatGPT Plus (\u0111\u01b0\u1ee3c \u0111\u00e0o t\u1ea1o tr\u00ean GPT-4) \u0111\u00e3 t\u1ea1o ra nh\u1eefng l\u00e0n s\u00f3ng l\u1edbn trong vi\u1ec7c \u0111\u01b0a AI \u0111\u1ebfn v\u1edbi c\u00f4ng ch\u00fang v\u00e0 ng\u01b0\u1eddi ti\u00eau d\u00f9ng.<\/p>\n<p>Vi\u1ec7c cho ph\u00e9p m\u00e1y t\u00ednh t\u01b0\u01a1ng t\u00e1c v\u1edbi th\u1ebf gi\u1edbi v\u1eadt ch\u1ea5t c\u1ee7a ch\u00fang ta \u0111\u00e3 tr\u1edf th\u00e0nh hi\u1ec7n th\u1ef1c.\u00a0LLM c\u00f3 nhi\u1ec1u \u1ee9ng d\u1ee5ng trong c\u00e1c ng\u00e0nh kh\u00e1c nhau nh\u01b0 chatbot \u0111\u01b0\u1ee3c c\u00e1 nh\u00e2n h\u00f3a, t\u1ef1 \u0111\u1ed9ng h\u00f3a d\u1ecbch v\u1ee5 kh\u00e1ch h\u00e0ng, ph\u00e2n t\u00edch t\u00ecnh c\u1ea3m v\u00e0 t\u1ea1o n\u1ed9i dung ho\u1eb7c th\u1eadm ch\u00ed l\u00e0 vi\u1ebft m\u00e3 l\u1eadp tr\u00ecnh.\u00a0V\u1eady t\u1ea1i sao c\u00e1c t\u1ed5 ch\u1ee9c quy m\u00f4 l\u1edbn n\u00e0y l\u1ea1i ch\u1ecdn NVIDIA DGX?\u00a0S\u1ef1 kh\u00e1c bi\u1ec7t gi\u1eefa DGX v\u00e0 GPU PCIe truy\u1ec1n th\u1ed1ng l\u00e0 g\u00ec?<\/p>\n<h2>NVIDIA DGX\/HGX v\u00e0 SXM form factor<\/h2>\n<p><img decoding=\"async\" src=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/07\/tgmc-blog-64acb296d8ce3.jpg\" alt=\"\u5c0e\u5165Nvidia HGX-2\u5e73\u81fa\uff0c\u8d85\u5fae\u63d0\u4f9b10U\u300116GPU\u4f3a\u670d\u5668| iThome\" \/><\/p>\n<p>Ki\u1ebfn tr\u00fac SXM l\u00e0 m\u1ed9t gi\u1ea3i ph\u00e1p socket b\u0103ng th\u00f4ng cao \u0111\u1ec3 k\u1ebft n\u1ed1i b\u1ed9 t\u0103ng t\u1ed1c NVIDIA Tensor Core v\u1edbi h\u1ec7 th\u1ed1ng DGX v\u00e0 HGX \u0111\u1ed9c quy\u1ec1n c\u1ee7a h\u1ecd.\u00a0\u0110\u1ed1i v\u1edbi m\u1ed7i th\u1ebf h\u1ec7 GPU NVIDIA Tensor Core (P100, V100, A100 v\u00e0 hi\u1ec7n t\u1ea1i l\u00e0 H100), c\u00e1c bo m\u1ea1ch HGX c\u1ee7a h\u1ec7 th\u1ed1ng DGX \u0111i k\u00e8m v\u1edbi socket SXM gi\u00fap nh\u1eadn \u0111\u01b0\u1ee3c b\u0103ng th\u00f4ng cao, cung c\u1ea5p ngu\u1ed3n \u0111i\u1ec7n, v.v. cho c\u00e1c th\u1ebb con GPU ph\u00f9 h\u1ee3p c\u1ee7a ch\u00fang.<\/p>\n<p>C\u00e1c bo m\u1ea1ch h\u1ec7 th\u1ed1ng HGX chuy\u00ean d\u1ee5ng k\u1ebft n\u1ed1i t\u1eebng GPU trong s\u1ed1 8 GPU qua NVLink cho ph\u00e9p b\u0103ng th\u00f4ng GPU-GPU cao.\u00a0Kh\u1ea3 n\u0103ng c\u1ee7a NVLink truy\u1ec1n d\u1eef li\u1ec7u gi\u1eefa c\u00e1c GPU c\u1ef1c nhanh cho ph\u00e9p ch\u00fang ho\u1ea1t \u0111\u1ed9ng nh\u01b0 m\u1ed9t c\u1ed7 m\u00e1y GPU duy nh\u1ea5t, trao \u0111\u1ed5i d\u1eef li\u1ec7u m\u00e0 kh\u00f4ng c\u1ea7n chuy\u1ec3n qua PCIe ho\u1eb7c c\u1ea7n giao ti\u1ebfp v\u1edbi CPU.\u00a0NVIDIA DGX H100 k\u1ebft n\u1ed1i 8 SXM5 H100 v\u1edbi b\u0103ng th\u00f4ng 900 GB\/gi\u00e2y tr\u00ean m\u1ed7i GPU th\u00f4ng qua 4 con chip NVLink Switch \u0111\u1ec3 c\u00f3 t\u1ed5ng b\u0103ng th\u00f4ng hai chi\u1ec1u tr\u00ean 7,2 TB\/gi\u00e2y.\u00a0M\u1ed7i GPU H100 SXM c\u0169ng \u0111\u01b0\u1ee3c k\u1ebft n\u1ed1i v\u1edbi CPU th\u00f4ng qua PCI Express \u0111\u1ec3 m\u1ecdi d\u1eef li\u1ec7u \u0111\u01b0\u1ee3c t\u00ednh to\u00e1n b\u1edfi b\u1ea5t k\u1ef3 GPU n\u00e0o trong s\u1ed1 8 GPU \u0111\u1ec1u c\u00f3 th\u1ec3 \u0111\u01b0\u1ee3c chuy\u1ec3n ti\u1ebfp tr\u1edf l\u1ea1i CPU.\u00a0Ch\u00fang ta s\u1ebd \u0111i qua c\u00e1c s\u01a1 \u0111\u1ed3 ki\u1ebfn \u200b\u200btr\u00fac \u1edf ph\u1ea7n sau.<\/p>\n<h2>NVIDIA H100 &#8211; PCIe form factor<\/h2>\n<p><img loading=\"lazy\" decoding=\"async\" width=\"800\" height=\"436\" class=\"alignnone wp-image-16335 size-full\" src=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/07\/TheGioiMayChu-Blog-Image-sxm-vs-pcie-gpu-tot-nhat-de-dao-tao-llm-nhu-gpt-4.png\" srcset=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/07\/TheGioiMayChu-Blog-Image-sxm-vs-pcie-gpu-tot-nhat-de-dao-tao-llm-nhu-gpt-4.png 800w, https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/07\/TheGioiMayChu-Blog-Image-sxm-vs-pcie-gpu-tot-nhat-de-dao-tao-llm-nhu-gpt-4-300x164.png 300w, https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/07\/TheGioiMayChu-Blog-Image-sxm-vs-pcie-gpu-tot-nhat-de-dao-tao-llm-nhu-gpt-4-768x419.png 768w, https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/07\/TheGioiMayChu-Blog-Image-sxm-vs-pcie-gpu-tot-nhat-de-dao-tao-llm-nhu-gpt-4-40x22.png 40w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\" \/><\/p>\n<p>B\u1ea1n kh\u00f4ng th\u1ec3 \u0111\u1ea1t \u0111\u01b0\u1ee3c b\u0103ng th\u00f4ng c\u00f3 hi\u1ec7u su\u1ea5t t\u01b0\u01a1ng t\u1ef1 khi k\u1ebft n\u1ed1i c\u00e1c card H100 PCIe th\u00f4ng qua c\u1ea7u n\u1ed1i NVLink (Bridge) m\u00e0 H100 PCIe h\u1ed7 tr\u1ee3.\u00a0C\u00e1c c\u1ea7u n\u1ed1i n\u00e0y ch\u1ec9 k\u1ebft n\u1ed1i c\u00e1c GPU v\u1edbi nhau theo c\u1eb7p \u0111\u1ec3 \u0111\u1ea1t t\u1ed1c \u0111\u1ed9 600 GB\/gi\u00e2y hai chi\u1ec1u, thay v\u00ec l\u00e0 900 GB\/gi\u00e2y \u0111\u1ea7y \u0111\u1ee7 tr\u00ean b\u1ea5t k\u1ef3 GPU n\u00e0o trong s\u1ed1 8 GPU trong h\u1ec7 th\u1ed1ng.<\/p>\n<p>Nh\u01b0ng c\u0169ng c\u1ea7n l\u01b0u \u00fd, NVIDIA H100 PCIe b\u1ea3n th\u00e2n n\u00f3 l\u00e0 m\u1ed9t GPU c\u1ef1c k\u1ef3 m\u1ea1nh m\u1ebd c\u00f3 th\u1ec3 \u0111\u01b0\u1ee3c tri\u1ec3n khai m\u1ed9t c\u00e1ch d\u1ec5 d\u00e0ng.\u00a0Ch\u00fang c\u00f3 th\u1ec3 d\u1ec5 d\u00e0ng \u0111\u01b0\u1ee3c \u0111\u01b0a v\u00e0o trung t\u00e2m d\u1eef li\u1ec7u \u0111\u1ec3 n\u00e2ng c\u1ea5p h\u1ec7 th\u1ed1ng \u0111\u00e1ng k\u1ec3 v\u1edbi nh\u1eefng thay \u0111\u1ed5i ki\u1ebfn \u200b\u200btr\u00fac t\u1ed1i thi\u1ec3u. V\u00e0 v\u1edbi H100 NVL, \u0111\u00e2y l\u00e0 b\u1ea3n m\u1edf r\u1ed9ng c\u1ee7a H100 PCIe b\u1eb1ng c\u00e1ch gh\u00e9p \u0111\u00f4i hai card v\u1edbi nhau \u0111\u1ec3 c\u00f3 t\u1ed5ng c\u1ed9ng 188GB b\u1ed9 nh\u1edb HBM3 v\u1edbi hi\u1ec7u su\u1ea5t \u0111\u00e3 c\u00f4ng b\u1ed1 t\u01b0\u01a1ng \u0111\u01b0\u01a1ng v\u1edbi H100 SXM5.<\/p>\n<p>\u2192 <a href=\"https:\/\/thegioimaychu.vn\/blog\/tag\/h100\">Kh\u00e1m ph\u00e1\u00a0th\u00eam chi ti\u1ebft v\u1ec1 GPU NVIDIA H100<\/a><\/p>\n<h2>S\u1ef1 kh\u00e1c bi\u1ec7t gi\u1eefa H100 SXM v\u00e0 PCIE<\/h2>\n<p>Trong ng\u00e0nh c\u00f4ng nghi\u1ec7p trung t\u00e2m d\u1eef li\u1ec7u v\u00e0 AI, NVIDIA DGX \u0111\u01b0\u1ee3c coi l\u00e0 v\u00e0ng theo \u0111\u00fang ngh\u0129a \u0111en.\u00a0M\u00e1y ch\u1ee7 AI t\u1ed1t nh\u1ea5t v\u00e0 m\u1ea1nh nh\u1ea5t.\u00a0N\u1ed5i b\u1eadt nh\u1ea5t l\u00e0 vi\u1ec7c OpenAI \u0111\u00e0o t\u1ea1o ChatGPT tr\u00ean h\u1ec7 th\u1ed1ng NVIDIA DGX c\u1ee7a h\u1ecd.\u00a0Tr\u00ean th\u1ef1c t\u1ebf, OpenAI \u0111\u00e3 nh\u1eadn t\u1eadn tay h\u1ec7 th\u1ed1ng NVIDIA DGX-1 \u0111\u1ea7u ti\u00ean v\u00e0o n\u0103m 2016.<\/p>\n<p>C\u00e1c t\u1eadp \u0111o\u00e0n l\u1edbn \u0111\u1ed5 x\u00f4 \u0111\u1ebfn NVIDIA DGX kh\u00f4ng ph\u1ea3i v\u00ec n\u00f3 hot m\u00e0 v\u00ec kh\u1ea3 n\u0103ng m\u1edf r\u1ed9ng quy m\u00f4 c\u1ee7a n\u00f3.\u00a0GPU SXM ph\u00f9 h\u1ee3p h\u01a1n cho vi\u1ec7c tri\u1ec3n khai m\u1edf r\u1ed9ng v\u1edbi t\u00e1m GPU H100 \u0111\u01b0\u1ee3c k\u1ebft n\u1ed1i ho\u00e0n to\u00e0n v\u1edbi c\u00f4ng ngh\u1ec7 k\u1ebft n\u1ed1i NVLink v\u00e0 NVSwitch.\u00a0Trong DGX v\u00e0 HGX, c\u00e1ch 8 GPU SXM k\u1ebft n\u1ed1i kh\u00e1c v\u1edbi PCIe;\u00a0m\u1ed7i GPU \u0111\u01b0\u1ee3c k\u1ebft n\u1ed1i v\u1edbi 4 chip NVLink Switch v\u1ec1 c\u01a1 b\u1ea3n cho ph\u00e9p t\u1ea5t c\u1ea3 c\u00e1c GPU ho\u1ea1t \u0111\u1ed9ng nh\u01b0 m\u1ed9t GPU l\u1edbn.\u00a0Kh\u1ea3 n\u0103ng m\u1edf r\u1ed9ng n\u00e0y c\u00f3 th\u1ec3 m\u1edf r\u1ed9ng h\u01a1n n\u1eefa v\u1edbi H\u1ec7 th\u1ed1ng NVIDIA NVLink Switch \u0111\u1ec3 tri\u1ec3n khai v\u00e0 k\u1ebft n\u1ed1i 256 DGX H100, nh\u1eb1m t\u1ea1o ra m\u1ed9t nh\u00e0 m\u00e1y AI \u0111\u01b0\u1ee3c GPU t\u0103ng t\u1ed1c.<\/p>\n<p>M\u1eb7t kh\u00e1c, H100 PCIe nh\u01b0 c\u00f3 trong H100 NVL, ch\u1ec9 c\u00f3 c\u00e1c c\u1eb7p GPU \u0111\u01b0\u1ee3c k\u1ebft n\u1ed1i th\u00f4ng qua NVLink Bridge.\u00a0GPU 1 ch\u1ec9 \u0111\u01b0\u1ee3c k\u1ebft n\u1ed1i tr\u1ef1c ti\u1ebfp v\u1edbi GPU 2, GPU 3 ch\u1ec9 \u0111\u01b0\u1ee3c k\u1ebft n\u1ed1i tr\u1ef1c ti\u1ebfp v\u1edbi GPU 4, v.v. GPU 1 v\u00e0 GPU 8 kh\u00f4ng \u0111\u01b0\u1ee3c k\u1ebft n\u1ed1i tr\u1ef1c ti\u1ebfp v\u00e0 do \u0111\u00f3 ch\u1ec9 c\u00f3 th\u1ec3 giao ti\u1ebfp d\u1eef li\u1ec7u qua c\u00e1c lane PCIe, ph\u1ea3i s\u1eed d\u1ee5ng \u0111\u1ebfn t\u00e0i nguy\u00ean CPU.\u00a0Bo m\u1ea1ch h\u1ec7 th\u1ed1ng NVIDIA DGX v\u00e0 HGX c\u00f3 t\u1ea5t c\u1ea3 c\u00e1c GPU SXM \u0111\u01b0\u1ee3c k\u1ebft n\u1ed1i v\u1edbi nhau th\u00f4ng qua chip NVLink Switch v\u00e0 do \u0111\u00f3 kh\u00f4ng b\u1ecb ch\u1eadm l\u1ea1i do c\u00e1c h\u1ea1n ch\u1ebf c\u1ee7a bus PCIe khi trao \u0111\u1ed5i d\u1eef li\u1ec7u gi\u1eefa c\u00e1c GPU.\u00a0Vi\u1ec7c g\u1eedi d\u1eef li\u1ec7u tr\u1edf l\u1ea1i CPU s\u1ebd v\u1eabn di\u1ec5n ra tr\u00ean c\u00e1c l\u00e0n PCIe.<\/p>\n<p>B\u1eb1ng c\u00e1ch b\u1ecf qua c\u00e1c lane PCI Express khi trao \u0111\u1ed5i d\u1eef li\u1ec7u gi\u1eefa c\u00e1c GPU, GPU SXM H100 t\u1ed1c \u0111\u1ed9 cao c\u00f3 th\u1ec3 \u0111\u1ea1t \u0111\u01b0\u1ee3c th\u00f4ng l\u01b0\u1ee3ng t\u1ed1i \u0111a m\u00e0 \u00edt b\u1ecb ch\u1eadm h\u01a1n so v\u1edbi phi\u00ean b\u1ea3n PCIe c\u1ee7a n\u00f3, ho\u00e0n h\u1ea3o \u0111\u1ec3 \u0111\u00e0o t\u1ea1o c\u00e1c m\u00f4 h\u00ecnh AI c\u1ef1c l\u1edbn c\u00f3 l\u01b0\u1ee3ng d\u1eef li\u1ec7u kh\u1ed5ng l\u1ed3 \u0111\u01b0\u1ee3c s\u1eed d\u1ee5ng \u0111\u1ec3 \u0111\u00e0o t\u1ea1o.\u00a0V\u1ea5n \u0111\u1ec1 ti\u00eau th\u1ee5 n\u0103ng l\u01b0\u1ee3ng v\u00e0 form-factor \u0111\u1ed9c quy\u1ec1n l\u00e0 s\u1ef1 \u0111\u00e1nh \u0111\u1ed5i \u0111\u1ec3 \u0111\u1ea1t \u0111\u01b0\u1ee3c hi\u1ec7u su\u1ea5t cao nh\u1ea5t, m\u00e0 \u0111i\u1ec1u \u0111\u00f3 c\u00f3 th\u1ec3 k\u00e9o d\u00e0i th\u1eddi gian \u0111\u00e0o t\u1ea1o v\u00e0 suy lu\u1eadn.\u00a0Nh\u01b0ng khi n\u00f3i \u0111\u1ebfn vi\u1ec7c ph\u00e1t tri\u1ec3n c\u00e1c m\u00f4 h\u00ecnh ng\u00f4n ng\u1eef l\u1edbn, truy\u1ec1n v\u0103n b\u1ea3n cho h\u00e0ng tri\u1ec7u ng\u01b0\u1eddi \u0111ang s\u1eed d\u1ee5ng d\u1ecbch v\u1ee5 c\u1ee7a b\u1ea1n, h\u00ecnh th\u1ee9c t\u00ednh to\u00e1n cao nh\u1ea5t \u0111\u01b0\u1ee3c mong mu\u1ed1n \u0111\u1ec3 \u0111\u1ea3m b\u1ea3o t\u00ednh \u1ed5n \u0111\u1ecbnh, t\u00ednh tr\u00f4i ch\u1ea3y v\u00e0 \u0111\u1ed9 tin c\u1eady.<\/p>\n<h2>B\u1ea1n n\u00ean ch\u1ecdn g\u00ec?\u00a0H100 SXM hay H100 PCIe?<\/h2>\n<p>N\u00f3 ph\u1ee5 thu\u1ed9c v\u00e0o tr\u01b0\u1eddng h\u1ee3p s\u1eed d\u1ee5ng c\u1ee7a b\u1ea1n.\u00a0M\u00f4 h\u00ecnh ng\u00f4n ng\u1eef l\u1edbn v\u00e0 AI s\u00e1ng t\u1ea1o (Generative AI) y\u00eau c\u1ea7u hi\u1ec7u su\u1ea5t cao.\u00a0Nh\u01b0ng s\u1ed1 l\u01b0\u1ee3ng ng\u01b0\u1eddi d\u00f9ng, kh\u1ed1i l\u01b0\u1ee3ng c\u00f4ng vi\u1ec7c v\u00e0 c\u01b0\u1eddng \u0111\u1ed9 \u0111\u00e0o t\u1ea1o \u0111\u00f3ng vai tr\u00f2 quan tr\u1ecdng trong vi\u1ec7c ch\u1ecdn h\u1ec7 th\u1ed1ng ph\u00f9 h\u1ee3p.<\/p>\n<p>DGX v\u00e0 HGX c\u1ee7a NVIDIA H100 l\u00e0 l\u1ef1a ch\u1ecdn t\u1ed1t nh\u1ea5t cho c\u00e1c t\u1ed5 ch\u1ee9c c\u00f3 th\u1ec3 t\u1eadn d\u1ee5ng hi\u1ec7u su\u1ea5t t\u00ednh to\u00e1n th\u00f4 v\u00e0 kh\u00f4ng l\u00e3ng ph\u00ed b\u1ea5t k\u1ef3 th\u1ee9 g\u00ec.\u00a0\u0110\u00e0o t\u1ea1o, suy lu\u1eadn v\u00e0 v\u1eadn h\u00e0nh li\u00ean t\u1ee5c c\u00f3 th\u1ec3 nhanh ch\u00f3ng gi\u1ea3m t\u1ed5ng chi ph\u00ed s\u1edf h\u1eefu khi \u0111\u01b0\u1ee3c s\u1eed d\u1ee5ng h\u1ebft ti\u1ec1m n\u0103ng.<\/p>\n<p>NVIDIA DGX c\u00f3 kh\u1ea3 n\u0103ng m\u1edf r\u1ed9ng t\u1ed1t nh\u1ea5t v\u00e0 mang l\u1ea1i hi\u1ec7u su\u1ea5t kh\u00f4ng th\u1ec3 s\u00e1nh \u0111\u01b0\u1ee3c v\u1edbi b\u1ea5t k\u1ef3 m\u00e1y ch\u1ee7 n\u00e0o kh\u00e1c \u1edf c\u00f9ng form-factor.\u00a0Vi\u1ec7c li\u00ean k\u1ebft nhi\u1ec1u NVIDIA DGX H100 v\u1edbi H\u1ec7 th\u1ed1ng NVSwitch c\u00f3 th\u1ec3 m\u1edf r\u1ed9ng nhi\u1ec1u DGX H100 th\u00e0nh m\u1ed9t c\u1ee5m SuperPod cho c\u00e1c m\u00f4 h\u00ecnh c\u1ef1c l\u1edbn.\u00a0NVIDIA DGX H100 c\u00f3 k\u00edch th\u01b0\u1edbc 8U v\u1edbi c\u1eb7p vi x\u1eed l\u00fd 2x Intel Xeon 8480C cho t\u1ed5ng s\u1ed1 112 CPU core.\u00a0NVIDIA DGX kh\u00f4ng th\u1ec3 t\u00f9y ch\u1ec9nh v\u00e0 l\u00e0 kh\u1ed1i x\u00e2y d\u1ef1ng cho c\u01a1 s\u1edf h\u1ea1 t\u1ea7ng \u0111i\u1ec7n to\u00e1n AI quy m\u00f4 ho\u00e0n ch\u1ec9nh.\u00a0V\u1edbi NVIDIA DGX, khi \u0111\u00e0o t\u1ea1o LLM c\u1ee7a b\u1ea1n c\u00f3 th\u1ec3 \u0111\u01b0\u1ee3c m\u1edf r\u1ed9ng m\u1ed9t c\u00e1ch d\u1ec5 d\u00e0ng.\u00a0Nhi\u1ec1u DGX h\u01a1n \u0111\u1ed3ng ngh\u0129a v\u1edbi vi\u1ec7c \u0111\u00e0o t\u1ea1o nhanh h\u01a1n v\u00e0 tri\u1ec3n khai m\u1ea1nh m\u1ebd h\u01a1n.<\/p>\n<p>NVIDIA HGX cung c\u1ea5p hi\u1ec7u su\u1ea5t GPU tuy\u1ec7t v\u1eddi trong m\u1ed9t h\u1ec7 th\u1ed1ng duy nh\u1ea5t m\u1edf ra t\u00f9y ch\u1ecdn \u0111\u1ec3 ng\u01b0\u1eddi d\u00f9ng t\u00f9y ch\u1ec9nh.\u00a0N\u1ec1n t\u1ea3ng HGX l\u00e0 n\u1ec1n t\u1ea3ng c\u00f3 th\u1ec3 t\u00f9y ch\u1ec9nh \u0111\u01b0\u1ee3c cung c\u1ea5p b\u1edfi c\u00e1c \u0111\u1ed1i t\u00e1c ch\u1ecdn l\u1ecdc (nh\u01b0 <a class=\"iblink\" href=\"\/supermicro\/\">Supermicro<\/a>, <a class=\"iblink\" href=\"\/asus\/\">ASUS<\/a>,&#8230;) \u0111\u1ec3 mang l\u1ea1i hi\u1ec7u su\u1ea5t m\u00e0 kh\u00e1ch h\u00e0ng mong mu\u1ed1n &#8211; CPU, b\u1ed9 nh\u1edb, b\u1ed9 l\u01b0u tr\u1eef, m\u1ea1ng &#8211; trong khi v\u1eabn t\u1eadn d\u1ee5ng c\u00f9ng m\u1ed9t bo m\u1ea1ch h\u1ec7 th\u1ed1ng NVIDIA H100 SXM5 8x (bao g\u1ed3m t\u1ea5t c\u1ea3 c\u00e1c t\u00ednh n\u0103ng NVLink).\u00a0C\u00e1c h\u1ec7 th\u1ed1ng n\u00e0y c\u00f3 th\u1ec3 \u0111\u00e1p \u1ee9ng nhu c\u1ea7u c\u1ee7a trung t\u00e2m d\u1eef li\u1ec7u b\u1eb1ng c\u00e1ch ch\u1ecdn NIC c\u1ee7a ri\u00eang b\u1ea1n, ch\u1ecdn s\u1ed1 Core mong mu\u1ed1n trong CPU v\u00e0 c\u00f3 th\u1ec3 l\u00e0 b\u1ed9 nh\u1edb b\u1ed5 sung.\u00a0NVIDIA HGX t\u01b0\u01a1ng t\u1ef1 nh\u01b0 DGX v\u1ec1 kh\u1ea3 n\u0103ng t\u00ednh to\u00e1n trong khi v\u1eabn h\u1ed7 tr\u1ee3 v\u00e0 ph\u00f9 h\u1ee3p v\u1edbi nhu c\u1ea7u \u0111\u00e0o t\u1ea1o LLM quy m\u00f4 l\u1edbn c\u1ee7a b\u1ea1n.<\/p>\n<p>Phi\u00ean b\u1ea3n NVIDIA H100 PCIe d\u00e0nh cho nh\u1eefng ng\u01b0\u1eddi l\u00e0m vi\u1ec7c v\u1edbi kh\u1ed1i l\u01b0\u1ee3ng c\u00f4ng vi\u1ec7c nh\u1ecf h\u01a1n v\u00e0 mu\u1ed1n c\u00f3 s\u1ef1 linh ho\u1ea1t t\u1ed1i \u0111a trong vi\u1ec7c quy\u1ebft \u0111\u1ecbnh s\u1ed1 l\u01b0\u1ee3ng GPU trong h\u1ec7 th\u1ed1ng c\u1ee7a m\u00ecnh.\u00a0Nh\u1eefng GPU n\u00e0y v\u1eabn t\u1ea1o ra m\u1ed9t &#8220;c\u00fa \u0111\u1ea5m th\u00e9p&#8221; khi n\u00f3i \u0111\u1ebfn hi\u1ec7u su\u1ea5t.\u00a0N\u00f3 c\u00f3 con s\u1ed1 hi\u1ec7u su\u1ea5t th\u00f4 th\u1ea5p h\u01a1n m\u1ed9t ch\u00fat nh\u01b0ng d\u1ec5 d\u00e0ng \u0111\u01b0\u1ee3c \u0111\u01b0a v\u00e0o b\u1ea5t k\u1ef3 h\u1ea1 t\u1ea7ng \u0111i\u1ec7n to\u00e1n n\u00e0o, khi\u1ebfn nh\u1eefng chi\u1ebfc GPU n\u00e0y tr\u1edf n\u00ean h\u1ea5p d\u1eabn.\u00a0H100 PCIe c\u0169ng \u0111\u01b0\u1ee3c cung c\u1ea5p \u1edf c\u00e1c form m\u00e1y ch\u1ee7 nh\u1ecf h\u01a1n nh\u01b0 1U v\u00e0 2U cho c\u00e1c trung t\u00e2m d\u1eef li\u1ec7u c\u00f3 GPU 2x ho\u1eb7c 4x trong c\u1ea5u h\u00ecnh CPU \u0111\u01a1n ho\u1eb7c k\u00e9p \u0111\u1ec3 cung c\u1ea5p s\u1ee9c m\u1ea1nh t\u00ednh to\u00e1n cho vi\u1ec7c ph\u00e1t tri\u1ec3n c\u00e1c LLM nh\u1ecf h\u01a1n.\u00a0T\u1ef7 l\u1ec7 CPU tr\u00ean GPU l\u00e0 1 tr\u00ean 1 s\u1ebd t\u1ed1t cho vi\u1ec7c tri\u1ec3n khai thi\u00ean v\u1ec1 kh\u1ea3 n\u0103ng \u1ea3o h\u00f3a h\u01a1n trong suy lu\u1eadn, c\u0169ng nh\u01b0 v\u00f4 s\u1ed1 \u1ee9ng d\u1ee5ng kh\u00e1c nhau nh\u01b0 ph\u00e2n t\u00edch d\u1eef li\u1ec7u,&#8230;<\/p>\n<div>____<br \/><b>B\u00e0i vi\u1ebft li\u00ean quan<\/b><\/div>\n<ul>\n<li><a href=\"https:\/\/thegioimaychu.vn\/blog\/?post_type=post&#038;p=23415\">B\u01b0\u1edbc v\u00e0o k\u1ef7 nguy\u00ean tr\u1ee3 l\u00fd AI c\u00e1 nh\u00e2n &#8211; so s\u00e1nh chi ti\u1ebft NVIDIA RTX Spark v\u00e0 DGX Spark<\/a><\/li>\n<li><a href=\"https:\/\/thegioimaychu.vn\/blog\/?post_type=post&#038;p=23322\">NVIDIA RTX PRO 4500 Blackwell Server Edition: B\u01b0\u1edbc nh\u1ea3y v\u1ecdt t\u1eeb th\u1ebf h\u1ec7 L4 cho h\u1ea1 t\u1ea7ng AI suy lu\u1eadn hi\u1ec7u n\u0103ng cao<\/a><\/li>\n<li><a href=\"https:\/\/thegioimaychu.vn\/blog\/?post_type=post&#038;p=23119\">NVIDIA NGC\u2011ready Low\u2011latency Edge AI: Gi\u1ea3i ph\u00e1p cho Retail, Manufacturing v\u00e0 Smart Cities<\/a><\/li>\n<li><a href=\"https:\/\/thegioimaychu.vn\/blog\/?post_type=post&#038;p=23110\">So s\u00e1nh s\u1ee9c m\u1ea1nh c\u1ee7a m\u00e1y t\u00ednh AI DGX Spark v\u1edbi c\u00e1c card GPU m\u00e1y tr\u1ea1m chuy\u00ean nghi\u1ec7p c\u1ee7a NVIDIA<\/a><\/li>\n<li><a href=\"https:\/\/thegioimaychu.vn\/blog\/?post_type=post&#038;p=22969\">T\u1eeb Orin \u0111\u1ebfn Thor: B\u01b0\u1edbc nh\u1ea3y v\u1ecdt ki\u1ebfn tr\u00fac c\u1ee7a NVIDIA JetPack 7.0 v\u00e0 t\u01b0\u01a1ng lai c\u1ee7a robot h\u00ecnh ng\u01b0\u1eddi<\/a><\/li>\n<li><a href=\"https:\/\/thegioimaychu.vn\/blog\/?post_type=post&#038;p=22887\">T\u1ea1i sao g\u1ecdi NVIDIA DGX Spark l\u00e0 Si\u00eau m\u00e1y t\u00ednh AI c\u00e1 nh\u00e2n?<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>NLP l&agrave; g&igrave; v&agrave; LLM l&agrave; g&igrave;? X&#7917; l&yacute; ng&ocirc;n ng&#7919; t&#7921; nhi&ecirc;n (NLP) l&agrave; m&#7897;t nh&aacute;nh c&#7911;a Tr&iacute; tu&#7879; nh&acirc;n t&#7841;o (AI) cho ph&eacute;p m&aacute;y m&oacute;c hi&#7875;u v&agrave; di&#7877;n gi&#7843;i ng&ocirc;n ng&#7919; c&#7911;a con ng&#432;&#7901;i.&nbsp;Nh&#7919;ng ti&#7871;n b&#7897; g&#7847;n &#273;&acirc;y trong h&#7885;c s&acirc;u &#273;&atilde; d&#7851;n &#273;&#7871;n s&#7921; xu&#7845;t hi&#7879;n c&#7911;a c&aacute;c m&ocirc; h&igrave;nh ng&ocirc;n ng&#7919;&#8230;<\/p>\n","protected":false},"author":2,"featured_media":16334,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":""},"categories":[3],"tags":[671,751,1314,498],"class_list":["post-16333","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai-hpc","tag-gpu","tag-h100","tag-nvidia","tag-sxm"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.3 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>SXM vs PCIe: GPU n\u00e0o t\u1ed1t nh\u1ea5t cho \u0111\u00e0o t\u1ea1o c\u00e1c m\u00f4 h\u00ecnh ng\u00f4n ng\u1eef l\u1edbn (LLM) nh\u01b0 GPT-4? - Blog | TheGioiMayChu<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/sxm-vs-pcie-gpu-nao-tot-nhat-cho-dao-tao-cac-mo-hinh-ngon-ngu-lon-llm-nhu-gpt-4-p16333\/\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:title\" content=\"SXM vs PCIe: GPU n\u00e0o t\u1ed1t nh\u1ea5t cho \u0111\u00e0o t\u1ea1o c\u00e1c m\u00f4 h\u00ecnh ng\u00f4n ng\u1eef l\u1edbn (LLM) nh\u01b0 GPT-4? - Blog | TheGioiMayChu\" \/>\n<meta name=\"twitter:description\" content=\"NLP l&agrave; g&igrave; v&agrave; LLM l&agrave; g&igrave;? X&#7917; l&yacute; ng&ocirc;n ng&#7919; t&#7921; nhi&ecirc;n (NLP) l&agrave; m&#7897;t nh&aacute;nh c&#7911;a Tr&iacute; tu&#7879; nh&acirc;n t&#7841;o (AI) cho ph&eacute;p m&aacute;y m&oacute;c hi&#7875;u v&agrave; di&#7877;n gi&#7843;i ng&ocirc;n ng&#7919; c&#7911;a con ng&#432;&#7901;i.&nbsp;Nh&#7919;ng ti&#7871;n b&#7897; g&#7847;n &#273;&acirc;y trong h&#7885;c s&acirc;u &#273;&atilde; d&#7851;n &#273;&#7871;n s&#7921; xu&#7845;t hi&#7879;n c&#7911;a c&aacute;c m&ocirc; h&igrave;nh ng&ocirc;n ng&#7919;...\" \/>\n<meta name=\"twitter:image\" content=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/07\/TheGioiMayChu-Blog-SXM-vs-PCIe.jpg\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Vanito Hoang\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"13 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/sxm-vs-pcie-gpu-nao-tot-nhat-cho-dao-tao-cac-mo-hinh-ngon-ngu-lon-llm-nhu-gpt-4-p16333\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/sxm-vs-pcie-gpu-nao-tot-nhat-cho-dao-tao-cac-mo-hinh-ngon-ngu-lon-llm-nhu-gpt-4-p16333\\\/\"},\"author\":{\"name\":\"Vanito Hoang\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#\\\/schema\\\/person\\\/feccec179330cfebfaa805639a357d18\"},\"headline\":\"SXM vs PCIe: GPU n\u00e0o t\u1ed1t nh\u1ea5t cho \u0111\u00e0o t\u1ea1o c\u00e1c m\u00f4 h\u00ecnh ng\u00f4n ng\u1eef l\u1edbn (LLM) nh\u01b0 GPT-4?\",\"datePublished\":\"2023-07-11T14:41:27+00:00\",\"dateModified\":\"2023-07-11T14:44:19+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/sxm-vs-pcie-gpu-nao-tot-nhat-cho-dao-tao-cac-mo-hinh-ngon-ngu-lon-llm-nhu-gpt-4-p16333\\\/\"},\"wordCount\":2701,\"publisher\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/sxm-vs-pcie-gpu-nao-tot-nhat-cho-dao-tao-cac-mo-hinh-ngon-ngu-lon-llm-nhu-gpt-4-p16333\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/wp-content\\\/uploads\\\/2023\\\/07\\\/TheGioiMayChu-Blog-SXM-vs-PCIe.jpg\",\"keywords\":[\"gpu\",\"H100\",\"NVIDIA\",\"sxm\"],\"articleSection\":[\"AI - HPC\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/sxm-vs-pcie-gpu-nao-tot-nhat-cho-dao-tao-cac-mo-hinh-ngon-ngu-lon-llm-nhu-gpt-4-p16333\\\/\",\"url\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/sxm-vs-pcie-gpu-nao-tot-nhat-cho-dao-tao-cac-mo-hinh-ngon-ngu-lon-llm-nhu-gpt-4-p16333\\\/\",\"name\":\"SXM vs PCIe: GPU n\u00e0o t\u1ed1t nh\u1ea5t cho \u0111\u00e0o t\u1ea1o c\u00e1c m\u00f4 h\u00ecnh ng\u00f4n ng\u1eef l\u1edbn (LLM) nh\u01b0 GPT-4? - Blog | TheGioiMayChu\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/sxm-vs-pcie-gpu-nao-tot-nhat-cho-dao-tao-cac-mo-hinh-ngon-ngu-lon-llm-nhu-gpt-4-p16333\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/sxm-vs-pcie-gpu-nao-tot-nhat-cho-dao-tao-cac-mo-hinh-ngon-ngu-lon-llm-nhu-gpt-4-p16333\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/wp-content\\\/uploads\\\/2023\\\/07\\\/TheGioiMayChu-Blog-SXM-vs-PCIe.jpg\",\"datePublished\":\"2023-07-11T14:41:27+00:00\",\"dateModified\":\"2023-07-11T14:44:19+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/sxm-vs-pcie-gpu-nao-tot-nhat-cho-dao-tao-cac-mo-hinh-ngon-ngu-lon-llm-nhu-gpt-4-p16333\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/sxm-vs-pcie-gpu-nao-tot-nhat-cho-dao-tao-cac-mo-hinh-ngon-ngu-lon-llm-nhu-gpt-4-p16333\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/sxm-vs-pcie-gpu-nao-tot-nhat-cho-dao-tao-cac-mo-hinh-ngon-ngu-lon-llm-nhu-gpt-4-p16333\\\/#primaryimage\",\"url\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/wp-content\\\/uploads\\\/2023\\\/07\\\/TheGioiMayChu-Blog-SXM-vs-PCIe.jpg\",\"contentUrl\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/wp-content\\\/uploads\\\/2023\\\/07\\\/TheGioiMayChu-Blog-SXM-vs-PCIe.jpg\",\"width\":1136,\"height\":644},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/sxm-vs-pcie-gpu-nao-tot-nhat-cho-dao-tao-cac-mo-hinh-ngon-ngu-lon-llm-nhu-gpt-4-p16333\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Trang ch\u1ee7\",\"item\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"AI - HPC\",\"item\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/.\\\/ai-hpc\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"SXM vs PCIe: GPU n\u00e0o t\u1ed1t nh\u1ea5t cho \u0111\u00e0o t\u1ea1o c\u00e1c m\u00f4 h\u00ecnh ng\u00f4n ng\u1eef l\u1edbn (LLM) nh\u01b0 GPT-4?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#website\",\"url\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/\",\"name\":\"Blog | TheGioiMayChu\",\"description\":\"C\u1eadp nh\u1eadt xu h\u01b0\u1edbng c\u00f4ng ngh\u1ec7 m\u00e1y ch\u1ee7\",\"publisher\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#organization\",\"name\":\"Blog | TheGioiMayChu\",\"url\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/wp-content\\\/uploads\\\/2018\\\/08\\\/cropped-ntcnlog-logo-2.png\",\"contentUrl\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/wp-content\\\/uploads\\\/2018\\\/08\\\/cropped-ntcnlog-logo-2.png\",\"width\":500,\"height\":73,\"caption\":\"Blog | TheGioiMayChu\"},\"image\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/thegioimaychu\\\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#\\\/schema\\\/person\\\/feccec179330cfebfaa805639a357d18\",\"name\":\"Vanito Hoang\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/e8187f37f72d74f9380a1367c8c530debee44f226a3301f0765c68f7cc1f3fa4?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/e8187f37f72d74f9380a1367c8c530debee44f226a3301f0765c68f7cc1f3fa4?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/e8187f37f72d74f9380a1367c8c530debee44f226a3301f0765c68f7cc1f3fa4?s=96&d=mm&r=g\",\"caption\":\"Vanito Hoang\"},\"url\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/author\\\/vanito\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"SXM vs PCIe: GPU n\u00e0o t\u1ed1t nh\u1ea5t cho \u0111\u00e0o t\u1ea1o c\u00e1c m\u00f4 h\u00ecnh ng\u00f4n ng\u1eef l\u1edbn (LLM) nh\u01b0 GPT-4? - Blog | TheGioiMayChu","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/sxm-vs-pcie-gpu-nao-tot-nhat-cho-dao-tao-cac-mo-hinh-ngon-ngu-lon-llm-nhu-gpt-4-p16333\/","twitter_card":"summary_large_image","twitter_title":"SXM vs PCIe: GPU n\u00e0o t\u1ed1t nh\u1ea5t cho \u0111\u00e0o t\u1ea1o c\u00e1c m\u00f4 h\u00ecnh ng\u00f4n ng\u1eef l\u1edbn (LLM) nh\u01b0 GPT-4? - Blog | TheGioiMayChu","twitter_description":"NLP l&agrave; g&igrave; v&agrave; LLM l&agrave; g&igrave;? X&#7917; l&yacute; ng&ocirc;n ng&#7919; t&#7921; nhi&ecirc;n (NLP) l&agrave; m&#7897;t nh&aacute;nh c&#7911;a Tr&iacute; tu&#7879; nh&acirc;n t&#7841;o (AI) cho ph&eacute;p m&aacute;y m&oacute;c hi&#7875;u v&agrave; di&#7877;n gi&#7843;i ng&ocirc;n ng&#7919; c&#7911;a con ng&#432;&#7901;i.&nbsp;Nh&#7919;ng ti&#7871;n b&#7897; g&#7847;n &#273;&acirc;y trong h&#7885;c s&acirc;u &#273;&atilde; d&#7851;n &#273;&#7871;n s&#7921; xu&#7845;t hi&#7879;n c&#7911;a c&aacute;c m&ocirc; h&igrave;nh ng&ocirc;n ng&#7919;...","twitter_image":"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/07\/TheGioiMayChu-Blog-SXM-vs-PCIe.jpg","twitter_misc":{"Written by":"Vanito Hoang","Est. reading time":"13 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/sxm-vs-pcie-gpu-nao-tot-nhat-cho-dao-tao-cac-mo-hinh-ngon-ngu-lon-llm-nhu-gpt-4-p16333\/#article","isPartOf":{"@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/sxm-vs-pcie-gpu-nao-tot-nhat-cho-dao-tao-cac-mo-hinh-ngon-ngu-lon-llm-nhu-gpt-4-p16333\/"},"author":{"name":"Vanito Hoang","@id":"https:\/\/thegioimaychu.vn\/blog\/#\/schema\/person\/feccec179330cfebfaa805639a357d18"},"headline":"SXM vs PCIe: GPU n\u00e0o t\u1ed1t nh\u1ea5t cho \u0111\u00e0o t\u1ea1o c\u00e1c m\u00f4 h\u00ecnh ng\u00f4n ng\u1eef l\u1edbn (LLM) nh\u01b0 GPT-4?","datePublished":"2023-07-11T14:41:27+00:00","dateModified":"2023-07-11T14:44:19+00:00","mainEntityOfPage":{"@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/sxm-vs-pcie-gpu-nao-tot-nhat-cho-dao-tao-cac-mo-hinh-ngon-ngu-lon-llm-nhu-gpt-4-p16333\/"},"wordCount":2701,"publisher":{"@id":"https:\/\/thegioimaychu.vn\/blog\/#organization"},"image":{"@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/sxm-vs-pcie-gpu-nao-tot-nhat-cho-dao-tao-cac-mo-hinh-ngon-ngu-lon-llm-nhu-gpt-4-p16333\/#primaryimage"},"thumbnailUrl":"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/07\/TheGioiMayChu-Blog-SXM-vs-PCIe.jpg","keywords":["gpu","H100","NVIDIA","sxm"],"articleSection":["AI - HPC"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/sxm-vs-pcie-gpu-nao-tot-nhat-cho-dao-tao-cac-mo-hinh-ngon-ngu-lon-llm-nhu-gpt-4-p16333\/","url":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/sxm-vs-pcie-gpu-nao-tot-nhat-cho-dao-tao-cac-mo-hinh-ngon-ngu-lon-llm-nhu-gpt-4-p16333\/","name":"SXM vs PCIe: GPU n\u00e0o t\u1ed1t nh\u1ea5t cho \u0111\u00e0o t\u1ea1o c\u00e1c m\u00f4 h\u00ecnh ng\u00f4n ng\u1eef l\u1edbn (LLM) nh\u01b0 GPT-4? - Blog | TheGioiMayChu","isPartOf":{"@id":"https:\/\/thegioimaychu.vn\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/sxm-vs-pcie-gpu-nao-tot-nhat-cho-dao-tao-cac-mo-hinh-ngon-ngu-lon-llm-nhu-gpt-4-p16333\/#primaryimage"},"image":{"@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/sxm-vs-pcie-gpu-nao-tot-nhat-cho-dao-tao-cac-mo-hinh-ngon-ngu-lon-llm-nhu-gpt-4-p16333\/#primaryimage"},"thumbnailUrl":"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/07\/TheGioiMayChu-Blog-SXM-vs-PCIe.jpg","datePublished":"2023-07-11T14:41:27+00:00","dateModified":"2023-07-11T14:44:19+00:00","breadcrumb":{"@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/sxm-vs-pcie-gpu-nao-tot-nhat-cho-dao-tao-cac-mo-hinh-ngon-ngu-lon-llm-nhu-gpt-4-p16333\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/sxm-vs-pcie-gpu-nao-tot-nhat-cho-dao-tao-cac-mo-hinh-ngon-ngu-lon-llm-nhu-gpt-4-p16333\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/sxm-vs-pcie-gpu-nao-tot-nhat-cho-dao-tao-cac-mo-hinh-ngon-ngu-lon-llm-nhu-gpt-4-p16333\/#primaryimage","url":"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/07\/TheGioiMayChu-Blog-SXM-vs-PCIe.jpg","contentUrl":"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/07\/TheGioiMayChu-Blog-SXM-vs-PCIe.jpg","width":1136,"height":644},{"@type":"BreadcrumbList","@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/sxm-vs-pcie-gpu-nao-tot-nhat-cho-dao-tao-cac-mo-hinh-ngon-ngu-lon-llm-nhu-gpt-4-p16333\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Trang ch\u1ee7","item":"https:\/\/thegioimaychu.vn\/blog\/"},{"@type":"ListItem","position":2,"name":"AI - HPC","item":"https:\/\/thegioimaychu.vn\/blog\/.\/ai-hpc\/"},{"@type":"ListItem","position":3,"name":"SXM vs PCIe: GPU n\u00e0o t\u1ed1t nh\u1ea5t cho \u0111\u00e0o t\u1ea1o c\u00e1c m\u00f4 h\u00ecnh ng\u00f4n ng\u1eef l\u1edbn (LLM) nh\u01b0 GPT-4?"}]},{"@type":"WebSite","@id":"https:\/\/thegioimaychu.vn\/blog\/#website","url":"https:\/\/thegioimaychu.vn\/blog\/","name":"Blog | TheGioiMayChu","description":"C\u1eadp nh\u1eadt xu h\u01b0\u1edbng c\u00f4ng ngh\u1ec7 m\u00e1y ch\u1ee7","publisher":{"@id":"https:\/\/thegioimaychu.vn\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/thegioimaychu.vn\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/thegioimaychu.vn\/blog\/#organization","name":"Blog | TheGioiMayChu","url":"https:\/\/thegioimaychu.vn\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/thegioimaychu.vn\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2018\/08\/cropped-ntcnlog-logo-2.png","contentUrl":"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2018\/08\/cropped-ntcnlog-logo-2.png","width":500,"height":73,"caption":"Blog | TheGioiMayChu"},"image":{"@id":"https:\/\/thegioimaychu.vn\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/thegioimaychu\/"]},{"@type":"Person","@id":"https:\/\/thegioimaychu.vn\/blog\/#\/schema\/person\/feccec179330cfebfaa805639a357d18","name":"Vanito Hoang","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/e8187f37f72d74f9380a1367c8c530debee44f226a3301f0765c68f7cc1f3fa4?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/e8187f37f72d74f9380a1367c8c530debee44f226a3301f0765c68f7cc1f3fa4?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/e8187f37f72d74f9380a1367c8c530debee44f226a3301f0765c68f7cc1f3fa4?s=96&d=mm&r=g","caption":"Vanito Hoang"},"url":"https:\/\/thegioimaychu.vn\/blog\/author\/vanito\/"}]}},"_links":{"self":[{"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/posts\/16333","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/comments?post=16333"}],"version-history":[{"count":7,"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/posts\/16333\/revisions"}],"predecessor-version":[{"id":16355,"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/posts\/16333\/revisions\/16355"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/media\/16334"}],"wp:attachment":[{"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/media?parent=16333"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/categories?post=16333"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/tags?post=16333"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}