{"id":20627,"date":"2024-11-13T15:35:07","date_gmt":"2024-11-13T08:35:07","guid":{"rendered":"https:\/\/thegioimaychu.vn\/blog\/?p=20627"},"modified":"2024-11-13T15:37:48","modified_gmt":"2024-11-13T08:37:48","slug":"gpudirect-rdma-la-gi","status":"publish","type":"post","link":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/gpudirect-rdma-la-gi-p20627\/","title":{"rendered":"GPUDirect RDMA l\u00e0 g\u00ec?"},"content":{"rendered":"<style>.iblink{color:#975!important;}.iblink:hover{color:orange!important;}<\/style><h2>NVIDIA GPUDirect RDMA l\u00e0 g\u00ec?<\/h2>\n<p><a href=\"https:\/\/docs.nvidia.com\/cuda\/gpudirect-rdma\/\" target=\"_blank\" rel=\"noreferrer noopener\">NVIDIA GPUDirect RDMA (Remote Direct Memory Access)<\/a>\u00a0l\u00e0 m\u1ed9t th\u00e0nh ph\u1ea7n c\u1ee7a gi\u1ea3i ph\u00e1p c\u00f4ng ngh\u1ec7 NVIDIA Magnum IO, cho ph\u00e9p truy\u1ec1n d\u1eef li\u1ec7u nhanh ch\u00f3ng gi\u1eefa GPU v\u00e0 c\u00e1c thi\u1ebft b\u1ecb kh\u00e1c m\u00e0 kh\u00f4ng c\u1ea7n \u0111\u1ebfn kh\u1ea3 n\u0103ng x\u1eed l\u00fd c\u1ee7a CPU hay b\u1ed9 nh\u1edb ch\u00ednh.<\/p>\n<p>Trong c\u00e1ch th\u1ee9c truy\u1ec1n d\u1eef li\u1ec7u truy\u1ec1n th\u1ed1ng, d\u1eef li\u1ec7u di chuy\u1ec3n t\u1eeb GPU \u0111\u1ebfn b\u1ed9 nh\u1edb ch\u00ednh (system memory), \u0111\u1ebfn NIC v\u00e0 cu\u1ed1i c\u00f9ng \u0111i \u0111\u1ebfn thi\u1ebft b\u1ecb \u0111\u00edch. Qu\u00e1 tr\u00ecnh n\u00e0y \u0111\u00f2i h\u1ecfi vi\u1ec7c t\u1ea1o nhi\u1ec1u b\u1ea3n copy c\u1ee7a d\u1eef li\u1ec7u v\u00e0 c\u1ea7n \u0111\u1ebfn CPU, l\u00e0m t\u0103ng \u0111\u1ed9 tr\u1ec5 v\u00e0 gi\u1ea3m hi\u1ec7u qu\u1ea3 chung c\u1ee7a h\u1ec7 th\u1ed1ng. Ng\u01b0\u1ee3c l\u1ea1i, qu\u00e1 tr\u00ecnh truy\u1ec1n d\u1eef li\u1ec7u GPUDirect RDMA \u0111\u01b0\u1ee3c t\u1ed1i \u01b0u h\u00f3a \u0111\u1ec3 d\u1eef li\u1ec7u c\u00f3 th\u1ec3 \u0111\u01b0\u1ee3c truy\u1ec1n tr\u1ef1c ti\u1ebfp t\u1eeb c\u00e1c b\u1ed9 nh\u1edb c\u1ee7a GPU tr\u00ean NIC ho\u1eb7c c\u00e1c thi\u1ebft b\u1ecb h\u1ed7 tr\u1ee3 RDMA kh\u00e1c m\u00e0 kh\u00f4ng c\u1ea7n th\u00f4ng qua b\u1ed9 nh\u1edb h\u1ec7 th\u1ed1ng hay CPU. \u0110\u01b0\u1eddng d\u1eabn tr\u1ef1c ti\u1ebfp n\u00e0y \u0111\u1ebfn b\u1ed9 nh\u1edb thi\u1ebft b\u1ecb v\u1ec7 tinh l\u00e0m gi\u1ea3m \u0111\u00e1ng k\u1ec3 \u0111\u1ed9 tr\u1ec5 v\u00e0 gi\u1ea3i ph\u00f3ng CPU cho c\u00e1c t\u00e1c v\u1ee5 kh\u00e1c.<\/p>\n<p>\u0110i\u1ec1u n\u00e0y mang l\u1ea1i m\u1ed9t s\u1ed1 l\u1ee3i \u00edch c\u01a1 b\u1ea3n m\u00e0 ch\u00fang ta s\u1ebd th\u1ea3o lu\u1eadn chi ti\u1ebft h\u01a1n d\u01b0\u1edbi \u0111\u00e2y:<\/p>\n<ul>\n<li><strong>\u0110\u1ed9 tr\u1ec5 th\u1ea5p h\u01a1n.<\/strong>\u00a0V\u00ec kh\u00f4ng \u0111i qua CPU ho\u1eb7c b\u1ed9 nh\u1edb h\u1ec7 th\u1ed1ng n\u00ean vi\u1ec7c truy\u1ec1n d\u1eef li\u1ec7u ch\u1ec9 m\u1ea5t th\u1eddi gian t\u1ed1i thi\u1ec3u.<\/li>\n<li><strong>B\u0103ng th\u00f4ng cao h\u01a1n.<\/strong>\u00a0B\u1eb1ng c\u00e1ch lo\u1ea1i b\u1ecf c\u00e1c b\u1ea3n sao d\u1eef li\u1ec7u kh\u00f4ng c\u1ea7n thi\u1ebft, h\u1ec7 th\u1ed1ng c\u00f3 th\u1ec3 \u0111\u1ea1t \u0111\u01b0\u1ee3c th\u00f4ng l\u01b0\u1ee3ng d\u1eef li\u1ec7u cao h\u01a1n.<\/li>\n<li><strong>Gi\u1ea3m t\u1ea3i cho CPU.<\/strong>\u00a0Vi\u1ec7c lo\u1ea1i tr\u1eeb CPU ra kh\u1ecfi vi\u1ec7c truy\u1ec1n d\u1eef li\u1ec7u s\u1ebd gi\u1ea3i ph\u00f3ng CPU \u0111\u1ec3 x\u1eed l\u00fd c\u00e1c t\u00e1c v\u1ee5 kh\u00e1c \u2014 m\u1ed9t l\u1ee3i th\u1ebf \u0111\u1eb7c bi\u1ec7t trong m\u00f4i tr\u01b0\u1eddng \u0111i\u1ec7n to\u00e1n song song.<\/li>\n<\/ul>\n<p>GPUDirect RDMA ethernet \u0111\u1eb7c bi\u1ec7t h\u1eefu \u00edch cho c\u00e1c h\u1ec7 th\u1ed1ng \u0111i\u1ec7n to\u00e1n hi\u1ec7u su\u1ea5t cao (HPC), ph\u00e2n t\u00edch d\u1eef li\u1ec7u v\u00e0 t\u1ea3i x\u1eed l\u00fd AI chuy\u00ean s\u00e2u. N\u00f3 \u0111\u01b0\u1ee3c thi\u1ebft k\u1ebf \u0111\u1ec3 ch\u1ea1y tr\u00ean c\u00e1c d\u00f2ng GPU data center cao c\u1ea5p c\u1ee7a NVIDIA.<\/p>\n<h2>Thi\u1ebft k\u1ebf c\u1ee7a GPUDirect RDMA<\/h2>\n<p>C\u1ea7n c\u00f3 nh\u1eefng g\u00ec \u0111\u1ec3 NVIDIA GPUDirect RDMA c\u00f3 th\u1ec3 truy\u1ec1n d\u1eef li\u1ec7u tr\u1ef1c ti\u1ebfp gi\u1eefa b\u1ed9 nh\u1edb GPU v\u00e0 c\u00e1c thi\u1ebft b\u1ecb h\u1ed7 tr\u1ee3 RDMA kh\u00e1c nh\u01b0 NIC v\u00e0 c\u00e1c strorage controller?<\/p>\n<p>Sau \u0111\u00e2y l\u00e0 t\u1ed5ng quan c\u01a1 b\u1ea3n v\u1ec1 thi\u1ebft k\u1ebf, ph\u1ea7n c\u1ee9ng v\u00e0 th\u00e0nh ph\u1ea7n ph\u1ea7n m\u1ec1m cho NVIDIA GPUDirect RDMA.<\/p>\n<p>T\u00edch h\u1ee3p c\u1ea5p ph\u1ea7n c\u1ee9ng cho GPUDirect RDMA bao g\u1ed3m:<\/p>\n<ul>\n<li><strong>GPU v\u00e0 NIC.<\/strong>\u00a0T\u00edch h\u1ee3p ph\u1ea7n c\u1ee9ng chuy\u00ean d\u1ee5ng gi\u1eefa GPU NVIDIA v\u00e0 c\u00e1c NIC c\u00f3 h\u1ed7 tr\u1ee3 cho RDMA v\u00e0 PCIe, v\u1edbi b\u1ed9 nh\u1edb v\u00e0 k\u1ebft n\u1ed1i peer-to-peer (P2P).<\/li>\n<li><strong>Memory Mapping.<\/strong>\u00a0B\u1ed9 nh\u1edb GPU \u0111\u01b0\u1ee3c \u00e1nh x\u1ea1 b\u1eb1ng c\u00e1ch s\u1eed d\u1ee5ng memory-mapped I\/O (MMIO) v\u00e0 c\u00e1c t\u00ednh n\u0103ng PCIe ti\u00ean ti\u1ebfn \u0111\u1ec3 NIC c\u00f3 th\u1ec3 truy c\u1eadp tr\u1ef1c ti\u1ebfp m\u00e0 kh\u00f4ng c\u1ea7n s\u1ef1 can thi\u1ec7p c\u1ee7a b\u1ed9 nh\u1edb h\u1ec7 th\u1ed1ng.<\/li>\n<li><strong>Truy\u1ec1n d\u1eef li\u1ec7u nh\u1ea5t qu\u00e1n.<\/strong>\u00a0Ph\u1ea7n c\u1ee9ng \u0111\u1ea3m b\u1ea3o d\u1eef li\u1ec7u \u0111\u01b0\u1ee3c \u0111\u1ed3ng b\u1ed9 h\u00f3a ch\u00ednh x\u00e1c tr\u00ean t\u1ea5t c\u1ea3 c\u00e1c th\u00e0nh ph\u1ea7n.<\/li>\n<\/ul>\n<p>Y\u00eau c\u1ea7u v\u1ec1 software stack cho m\u1ea1ng RDMA GPUDirect bao g\u1ed3m:<\/p>\n<ul>\n<li><strong>Driver cho Compute Unified Device Architecture (CUDA).<\/strong>\u00a0NVIDIA CUDA driver (tr\u00ecnh \u0111i\u1ec1u khi\u1ec3n thi\u1ebft b\u1ecb) cho ph\u00e9p \u00e1nh x\u1ea1 b\u1ed9 nh\u1edb quan tr\u1ecdng v\u00e0 kh\u1ea3 n\u0103ng truy\u1ec1n d\u1eef li\u1ec7u tr\u1ef1c ti\u1ebfp v\u00e0 h\u1ed7 tr\u1ee3 GPUDirect RDMA.<\/li>\n<li><strong>RDMA API.<\/strong>\u00a0H\u1ec7 th\u1ed1ng h\u1ed7 tr\u1ee3 RDMA, th\u01b0\u1eddng c\u00f3 m\u1ed9t stack ch\u1eb3ng h\u1ea1n nh\u01b0 OpenFabrics Enterprise Distribution (OFED). RDMA API cho ph\u00e9p c\u00e1c \u1ee9ng d\u1ee5ng kh\u1edfi t\u1ea1o v\u00e0 qu\u1ea3n l\u00fd vi\u1ec7c chuy\u1ec3n giao quy\u1ec1n truy c\u1eadp b\u1ed9 nh\u1edb tr\u1ef1c ti\u1ebfp.<\/li>\n<li><strong>H\u1ec7 \u0111i\u1ec1u h\u00e0nh h\u1ed7 tr\u1ee3 c\u00e1c tr\u00ecnh \u0111i\u1ec1u khi\u1ec3n GPU v\u00e0 API c\u1ea7n thi\u1ebft.<\/strong>\u00a0Linux th\u01b0\u1eddng \u0111\u01b0\u1ee3c s\u1eed d\u1ee5ng trong c\u00e1c m\u00f4i tr\u01b0\u1eddng t\u1eadn d\u1ee5ng GPUDirect RDMA do h\u1ed7 tr\u1ee3 m\u1ea1nh m\u1ebd cho t\u00ednh to\u00e1n HPC v\u00e0 GPU.<\/li>\n<\/ul>\n<p>Y\u00eau c\u1ea7u h\u1ec7 th\u1ed1ng cho GPUDirect RDMA bao g\u1ed3m:<\/p>\n<ul>\n<li><strong>GPU NVIDIA t\u01b0\u01a1ng th\u00edch.<\/strong>\u00a0H\u1ec7 th\u1ed1ng ph\u1ea3i h\u1ed7 tr\u1ee3 GPUDirect RDMA, th\u01b0\u1eddng l\u00e0 v\u1edbi c\u00e1c GPU hi\u1ec7u su\u1ea5t cao \u0111\u01b0\u1ee3c s\u1eed d\u1ee5ng trong c\u00e1c trung t\u00e2m d\u1eef li\u1ec7u, ch\u1eb3ng h\u1ea1n nh\u01b0 NVIDIA A100, V100 ho\u1eb7c c\u00e1c m\u1eabu t\u01b0\u01a1ng t\u1ef1.<\/li>\n<li><strong>NIC h\u1ed7 tr\u1ee3 RDMA.<\/strong>\u00a0C\u1ea7n c\u00f3 card giao ti\u1ebfp m\u1ea1ng (NIC) h\u1ed7 tr\u1ee3 RDMA v\u00ec NIC ph\u1ea3i t\u01b0\u01a1ng t\u00e1c tr\u1ef1c ti\u1ebfp v\u1edbi b\u1ed9 nh\u1edb GPU.<\/li>\n<li><strong>C\u1ea5u h\u00ecnh PCI express (PCIe).<\/strong>\u00a0H\u1ec7 th\u1ed1ng ph\u1ea3i h\u1ed7 tr\u1ee3 PCIe v\u1edbi kh\u1ea3 n\u0103ng giao ti\u1ebfp P2P \u0111\u1ec3 GPU v\u00e0 NIC c\u00f3 th\u1ec3 giao ti\u1ebfp tr\u1ef1c ti\u1ebfp. PCIe c\u00f3 li\u00ean quan ch\u1eb7t ch\u1ebd v\u1edbi GPUDirect RDMA v\u00e0 h\u1ed7 tr\u1ee3 t\u00ednh to\u00e1n hi\u1ec7u su\u1ea5t cao, \u0111\u1eb7c bi\u1ec7t l\u00e0 trong c\u00e1c m\u00f4i tr\u01b0\u1eddng s\u1eed d\u1ee5ng nhi\u1ec1u GPU, ch\u1eb3ng h\u1ea1n nh\u01b0 trong c\u00e1c trung t\u00e2m d\u1eef li\u1ec7u, t\u00ednh to\u00e1n khoa h\u1ecdc v\u00e0 \u0111\u00e0o t\u1ea1o AI.<\/li>\n<li><strong>Bo m\u1ea1ch ch\u1ee7 v\u00e0 CPU t\u01b0\u01a1ng th\u00edch.<\/strong>\u00a0H\u1ec7 th\u1ed1ng ph\u1ea3i c\u00f3 \u0111\u1ee7 s\u1ed1 l\u01b0\u1ee3ng lane PCIe v\u00e0 b\u0103ng th\u00f4ng \u0111\u1ec3 x\u1eed l\u00fd vi\u1ec7c truy\u1ec1n d\u1eef li\u1ec7u t\u1ed1c \u0111\u1ed9 cao m\u00e0 kh\u00f4ng b\u1ecb t\u1eafc ngh\u1ebdn. M\u1eb7c d\u00f9 kh\u00f4ng tr\u1ef1c ti\u1ebfp tham gia v\u00e0o vi\u1ec7c truy\u1ec1n d\u1eef li\u1ec7u, CPU v\u1eabn ph\u1ea3i \u0111\u1ee7 m\u1ea1nh \u0111\u1ec3 qu\u1ea3n l\u00fd to\u00e0n b\u1ed9 h\u1ec7 th\u1ed1ng m\u1ed9t c\u00e1ch hi\u1ec7u qu\u1ea3.<\/li>\n<li><strong>M\u00f4i tr\u01b0\u1eddng ph\u1ea7n m\u1ec1m.<\/strong>\u00a0C\u1ea7n c\u00f3 b\u1ea3n ph\u00e2n ph\u1ed1i Linux, th\u01b0\u1eddng nh\u01b0 m\u00f4 t\u1ea3 \u1edf tr\u00ean, v\u1edbi kernel h\u1ed7 tr\u1ee3 tr\u00ecnh \u0111i\u1ec1u khi\u1ec3n RDMA v\u00e0 NVIDIA GPUDirect RDMA.<\/li>\n<li><strong>H\u1ed7 tr\u1ee3 \u1ee9ng d\u1ee5ng.<\/strong>\u00a0C\u00e1c \u1ee9ng d\u1ee5ng c\u1ea7n \u0111\u01b0\u1ee3c thi\u1ebft k\u1ebf ho\u1eb7c s\u1eeda \u0111\u1ed5i \u0111\u1ec3 t\u1eadn d\u1ee5ng GPUDirect RDMA. \u0110i\u1ec1u n\u00e0y th\u01b0\u1eddng li\u00ean quan \u0111\u1ebfn vi\u1ec7c s\u1eed d\u1ee5ng c\u00e1c th\u01b0 vi\u1ec7n ho\u1eb7c API c\u1ee5 th\u1ec3 h\u1ed7 tr\u1ee3 RDMA v\u00e0 truy c\u1eadp b\u1ed9 nh\u1edb GPU tr\u1ef1c ti\u1ebfp.<\/li>\n<li><strong>Card giao ti\u1ebfp m\u1ea1ng (NIC).<\/strong>\u00a0GPUDirect RDMA y\u00eau c\u1ea7u NIC h\u1ed7 tr\u1ee3 RDMA nh\u01b0 nh\u1eefng NIC s\u1eed d\u1ee5ng giao th\u1ee9c InfiniBand, RoCE (RDMA over Converged Ethernet) ho\u1eb7c iWARP.<\/li>\n<li><strong>H\u1ec7 \u0111i\u1ec1u h\u00e0nh (OS).<\/strong>\u00a0Linux l\u00e0 OS ph\u1ed5 bi\u1ebfn nh\u1ea5t \u0111\u01b0\u1ee3c s\u1eed d\u1ee5ng cho GPUDirect RDMA, \u0111\u1eb7c bi\u1ec7t l\u00e0 c\u00e1c b\u1ea3n ph\u00e2n ph\u1ed1i nh\u01b0 Ubuntu, CentOS ho\u1eb7c Red Hat. OS ph\u1ea3i h\u1ed7 tr\u1ee3 RDMA v\u00e0 c\u00e1c tr\u00ecnh \u0111i\u1ec1u khi\u1ec3n c\u1ea7n thi\u1ebft.<\/li>\n<\/ul>\n<p>Quy tr\u00ecnh l\u00e0m vi\u1ec7c trong h\u1ec7 th\u1ed1ng RDMA GPUDirect:<\/p>\n<ul>\n<li><strong>\u0110\u0103ng k\u00fd.<\/strong>\u00a0B\u01b0\u1edbc \u0111\u0103ng k\u00fd ban \u0111\u1ea7u n\u00e0y v\u1edbi NIC RDMA gi\u00fap b\u1ed9 nh\u1edb c\u00f3 th\u1ec3 truy c\u1eadp \u0111\u1ec3 truy\u1ec1n tr\u1ef1c ti\u1ebfp.<\/li>\n<li><strong>Kh\u1edfi t\u1ea1o.<\/strong>\u00a0M\u1ed9t \u1ee9ng d\u1ee5ng ho\u1eb7c quy tr\u00ecnh k\u00edch ho\u1ea1t vi\u1ec7c truy\u1ec1n d\u1eef li\u1ec7u b\u1eb1ng API RDMA.<\/li>\n<li><strong>Truy\u1ec1n d\u1eef li\u1ec7u tr\u1ef1c ti\u1ebfp.<\/strong>\u00a0NIC tr\u1ef1c ti\u1ebfp \u0111\u1ecdc ho\u1eb7c ghi d\u1eef li\u1ec7u v\u00e0o b\u1ed9 nh\u1edb GPU qua bus PCIe, b\u1ecf qua CPU v\u00e0 b\u1ed9 nh\u1edb h\u1ec7 th\u1ed1ng.<\/li>\n<li><strong>X\u1eed l\u00fd ho\u00e0n t\u1ea5t.<\/strong>\u00a0\u1ee8ng d\u1ee5ng \u0111\u01b0\u1ee3c th\u00f4ng b\u00e1o v\u1ec1 vi\u1ec7c ho\u00e0n t\u1ea5t chuy\u1ec3n d\u1eef li\u1ec7u v\u00e0 d\u1eef li\u1ec7u c\u00f3 th\u1ec3 \u0111\u01b0\u1ee3c GPU ho\u1eb7c quy tr\u00ecnh kh\u00e1c s\u1eed d\u1ee5ng.<\/li>\n<\/ul>\n<h3>GPUDirect RDMA\u00a0CUDA<\/h3>\n<p>GPUDirect RDMA CUDA (Compute Unified Device Architecture) t\u00edch h\u1ee3p c\u00f4ng ngh\u1ec7 RDMA v\u00e0o n\u1ec1n t\u1ea3ng \u0111i\u1ec7n to\u00e1n song song v\u00e0 m\u00f4 h\u00ecnh l\u1eadp tr\u00ecnh NVIDIA, CUDA, \u0111\u1ec3 t\u1ea1o \u0111i\u1ec1u ki\u1ec7n thu\u1eadn l\u1ee3i cho c\u00e1c t\u01b0\u01a1ng t\u00e1c tr\u1ef1c ti\u1ebfp gi\u1eefa c\u00e1c \u1ee9ng d\u1ee5ng d\u1ef1a tr\u00ean CUDA v\u00e0 c\u00e1c thi\u1ebft b\u1ecb h\u1ed7 tr\u1ee3 RDMA.<\/p>\n<p>GPUDirect RDMA CUDA ho\u1ea1t \u0111\u1ed9ng nh\u01b0 th\u1ebf n\u00e0o:<\/p>\n<h3>T\u00edch h\u1ee3p CUDA<\/h3>\n<p>C\u00e1c \u1ee9ng d\u1ee5ng CUDA c\u00f3 th\u1ec3 t\u1eadn d\u1ee5ng GPUDirect RDMA v\u1edbi c\u00e1c API v\u00e0 th\u01b0 vi\u1ec7n CUDA c\u1ee5 th\u1ec3 h\u1ed7 tr\u1ee3 ch\u1ee9c n\u0103ng n\u00e0y. \u0110i\u1ec1u n\u00e0y cho ph\u00e9p \u1ee9ng d\u1ee5ng kh\u1edfi t\u1ea1o v\u00e0 qu\u1ea3n l\u00fd c\u00e1c ho\u1ea1t \u0111\u1ed9ng RDMA tr\u1ef1c ti\u1ebfp t\u1eeb GPU, b\u1ecf qua CPU \u0111\u1ec3 truy\u1ec1n d\u1eef li\u1ec7u.<\/p>\n<p>V\u00ed d\u1ee5, \u1ee9ng d\u1ee5ng CUDA c\u00f3 th\u1ec3 s\u1eed d\u1ee5ng API RDMA \u0111\u1ec3 \u0111\u0103ng k\u00fd b\u1ed9 nh\u1edb GPU v\u1edbi NIC h\u1ed7 tr\u1ee3 RDMA. Sau khi \u0111\u0103ng k\u00fd, NIC c\u00f3 th\u1ec3 \u0111\u1ecdc tr\u1ef1c ti\u1ebfp t\u1eeb ho\u1eb7c ghi v\u00e0o b\u1ed9 nh\u1edb GPU, cho ph\u00e9p trao \u0111\u1ed5i d\u1eef li\u1ec7u hi\u1ec7u qu\u1ea3 gi\u1eefa GPU v\u00e0 c\u00e1c thi\u1ebft b\u1ecb kh\u00e1c ho\u1eb7c GPU t\u1eeb xa qua m\u1ea1ng.<\/p>\n<h3>C\u00e1c \u1ee9ng d\u1ee5ng cho \u1ee9ng d\u1ee5ng GPUDirect RDMA CUDA:<\/h3>\n<p>C\u00e1c \u1ee9ng d\u1ee5ng bao g\u1ed3m thi\u1ebft l\u1eadp \u0111\u00e0o t\u1ea1o \u0111a n\u00fat cho h\u1ecdc m\u00e1y ph\u00e2n t\u00e1n v\u00e0 m\u00f4 ph\u1ecfng khoa h\u1ecdc cho m\u00f4i tr\u01b0\u1eddng \u0111i\u1ec7n to\u00e1n hi\u1ec7u su\u1ea5t cao (HPC). C\u00e1c \u1ee9ng d\u1ee5ng kh\u00e1c bao g\u1ed3m c\u00e1c \u1ee9ng d\u1ee5ng \u0111\u00f2i h\u1ecfi x\u1eed l\u00fd d\u1eef li\u1ec7u th\u1eddi gian th\u1ef1c, ch\u1eb3ng h\u1ea1n nh\u01b0 h\u1ec7 th\u1ed1ng giao d\u1ecbch t\u00e0i ch\u00ednh ho\u1eb7c ph\u00e2n t\u00edch video th\u1eddi gian th\u1ef1c.<\/p>\n<h2>\u0110i\u1ec3m benchmark GPUDirect RDMA<\/h2>\n<p>C\u00f3 m\u1ed9t s\u1ed1 \u0111i\u1ec3m benchmark RDMA GPUDirect quan tr\u1ecdng c\u1ea7n hi\u1ec3u v\u00e0 nhi\u1ec1u y\u1ebfu t\u1ed1 c\u00f3 th\u1ec3 \u1ea3nh h\u01b0\u1edfng \u0111\u1ebfn k\u1ebft qu\u1ea3 \u0111\u00e1nh gi\u00e1 chu\u1ea9n:<\/p>\n<p>K\u1ebft qu\u1ea3 chu\u1ea9n RDMA GPUDirect \u0111i\u1ec3n h\u00ecnh:<\/p>\n<ul>\n<li><strong>\u0110\u1ed9 tr\u1ec5 c\u1ee7a GPUDirect RDMA.<\/strong>\u00a0\u0110\u1ed1i v\u1edbi c\u00e1c tin nh\u1eafn nh\u1ecf, \u0111\u1ed9 tr\u1ec5 c\u00f3 th\u1ec3 th\u1ea5p t\u1edbi 2-5 micro gi\u00e2y.<\/li>\n<li><strong>B\u0103ng th\u00f4ng GPUDirect RDMA.<\/strong>\u00a0T\u1ed1c \u0111\u1ed9 n\u00e0y dao \u0111\u1ed9ng t\u1eeb 10 \u0111\u1ebfn 25 GB\/gi\u00e2y t\u00f9y thu\u1ed9c v\u00e0o th\u1ebf h\u1ec7 PCIe v\u00e0 c\u1ea5u h\u00ecnh ph\u1ea7n c\u1ee9ng c\u1ee5 th\u1ec3.<\/li>\n<li><strong>K\u00edch th\u01b0\u1edbc tin nh\u1eafn so v\u1edbi \u0111\u1ed9 tr\u1ec5\/th\u00f4ng l\u01b0\u1ee3ng.<\/strong>\u00a0T\u1ed1c \u0111\u1ed9 tin nh\u1eafn cao \u2014 \u0111\u1eb7c bi\u1ec7t l\u00e0 \u0111\u1ed1i v\u1edbi tin nh\u1eafn nh\u1ecf, \u0111i\u1ec1u n\u00e0y l\u00e0 b\u00ecnh th\u01b0\u1eddng \u2014 cho th\u1ea5y kh\u1ea3 n\u0103ng x\u1eed l\u00fd hi\u1ec7u qu\u1ea3 nhi\u1ec1u giao d\u1ecbch m\u1ed7i gi\u00e2y, m\u1ed9t k\u1ebft qu\u1ea3 quan tr\u1ecdng \u0111\u1ed1i v\u1edbi t\u1ea3i x\u1eed l\u00fd ph\u00e2n t\u00e1n.<\/li>\n<\/ul>\n<p>Nhi\u1ec1u y\u1ebfu t\u1ed1 \u1ea3nh h\u01b0\u1edfng \u0111\u1ebfn k\u1ebft qu\u1ea3 benchmark:<\/p>\n<ul>\n<li><strong>Th\u1ebf h\u1ec7 PCIe.<\/strong>\u00a0PCIe Gen4 cung c\u1ea5p b\u0103ng th\u00f4ng cao h\u01a1n so v\u1edbi Gen3, gi\u00fap c\u1ea3i thi\u1ec7n hi\u1ec7u su\u1ea5t.<\/li>\n<li><strong>Model GPU v\u00e0 NIC.<\/strong>\u00a0C\u00e1c model GPU v\u00e0 NIC c\u1ee5 th\u1ec3, c\u00f9ng v\u1edbi c\u00e1c phi\u00ean b\u1ea3n firmware hay driver c\u1ee7a ch\u00fang, c\u00f3 th\u1ec3 \u1ea3nh h\u01b0\u1edfng \u0111\u00e1ng k\u1ec3 \u0111\u1ebfn hi\u1ec7u su\u1ea5t.<\/li>\n<li><strong>C\u1ea5u h\u00ecnh h\u1ec7 th\u1ed1ng.<\/strong>\u00a0Thi\u1ebft l\u1eadp h\u1ec7 th\u1ed1ng t\u1ed5ng th\u1ec3, bao g\u1ed3m s\u1ed1 l\u01b0\u1ee3ng GPU, c\u1ea5u tr\u00fac m\u1ea1ng v\u00e0 ki\u1ebfn \u200b\u200btr\u00fac CPU, s\u1ebd \u1ea3nh h\u01b0\u1edfng \u0111\u1ebfn k\u1ebft qu\u1ea3 chu\u1ea9n.<\/li>\n<\/ul>\n<h2>C\u00e1c v\u00ed d\u1ee5 v\u1ec1 GPUDirect RDMA<\/h2>\n<p>NVIDIA GPUDirect RDMA \u0111\u01b0\u1ee3c s\u1eed d\u1ee5ng trong nhi\u1ec1u \u1ee9ng d\u1ee5ng HPC v\u00e0 d\u1eef li\u1ec7u chuy\u00ean s\u00e2u m\u00e0 vi\u1ec7c gi\u1ea3m thi\u1ec3u \u0111\u1ed9 tr\u1ec5 v\u00e0 t\u1ed1i \u0111a h\u00f3a th\u00f4ng l\u01b0\u1ee3ng d\u1eef li\u1ec7u l\u00e0 r\u1ea5t quan tr\u1ecdng. Sau \u0111\u00e2y l\u00e0 m\u1ed9t s\u1ed1 v\u00ed d\u1ee5 v\u1ec1 GPUDirect RDMA \u0111\u1ec3 b\u1ea1n c\u00e2n nh\u1eafc:<\/p>\n<ul>\n<li><strong>H\u1ecdc s\u00e2u ph\u00e2n t\u00e1n v\u00e0 \u0111\u00e0o t\u1ea1o AI.<\/strong>\u00a0Trong c\u00e1c t\u00e1c v\u1ee5 h\u1ecdc s\u00e2u quy m\u00f4 l\u1edbn, c\u00e1c m\u00f4 h\u00ecnh th\u01b0\u1eddng \u0111\u01b0\u1ee3c \u0111\u00e0o t\u1ea1o tr\u00ean GPU qua c\u00e1c n\u00fat trong m\u1ed9t c\u1ee5m ph\u00e2n t\u00e1n. GPUDirect RDMA chia s\u1ebb hi\u1ec7u qu\u1ea3 c\u00e1c tham s\u1ed1 v\u00e0 \u0111\u1ed9 d\u1ed1c m\u00f4 h\u00ecnh gi\u1eefa c\u00e1c GPU tr\u00ean c\u00e1c n\u00fat n\u00e0y \u0111\u1ec3 \u0111\u00e0o t\u1ea1o deep neural network (DNN) tr\u00ean c\u00e1c t\u00e1c v\u1ee5 nh\u01b0 nh\u1eadn d\u1ea1ng h\u00ecnh \u1ea3nh ho\u1eb7c x\u1eed l\u00fd ng\u00f4n ng\u1eef t\u1ef1 nhi\u00ean.<\/li>\n<li><strong>M\u00f4 ph\u1ecfng khoa h\u1ecdc v\u00e0 HPC.<\/strong>\u00a0M\u00f4 h\u00ecnh h\u00f3a kh\u00ed h\u1eadu v\u00e0 \u0111\u1ed9ng l\u1ef1c h\u1ecdc ch\u1ea5t l\u1ecfng ho\u1eb7c ph\u00e2n t\u1eed th\u01b0\u1eddng \u0111\u00f2i h\u1ecfi s\u1ee9c m\u1ea1nh x\u1eed l\u00fd c\u1ee7a nhi\u1ec1u GPU. C\u00e1c m\u00f4 ph\u1ecfng n\u00e0y li\u00ean quan \u0111\u1ebfn c\u00e1c t\u1eadp d\u1eef li\u1ec7u l\u1edbn ph\u1ea3i \u0111\u01b0\u1ee3c chia s\u1ebb v\u00e0 x\u1eed l\u00fd song song tr\u00ean c\u00e1c n\u00fat t\u00ednh to\u00e1n kh\u00e1c nhau. GPUDirect RDMA c\u00f3 th\u1ec3 truy\u1ec1n d\u1eef li\u1ec7u h\u1ea1t tr\u1ef1c ti\u1ebfp gi\u1eefa c\u00e1c GPU tr\u00ean c\u00e1c n\u00fat kh\u00e1c nhau, do \u0111\u00f3 c\u00e1c nh\u00e0 khoa h\u1ecdc c\u00f3 th\u1ec3 m\u00f4 ph\u1ecfng ngay c\u1ea3 c\u00e1c h\u1ec7 th\u1ed1ng ph\u00e2n t\u1eed ph\u1ee9c t\u1ea1p nhanh h\u01a1n.<\/li>\n<li><strong>Ph\u00e2n t\u00edch d\u1eef li\u1ec7u th\u1eddi gian th\u1ef1c v\u00e0 d\u1ecbch v\u1ee5 t\u00e0i ch\u00ednh.<\/strong>\u00a0C\u00e1c \u1ee9ng d\u1ee5ng nh\u01b0 giao d\u1ecbch t\u1ea7n su\u1ea5t cao y\u00eau c\u1ea7u x\u1eed l\u00fd d\u1eef li\u1ec7u th\u1ecb tr\u01b0\u1eddng c\u00f3 \u0111\u1ed9 tr\u1ec5 c\u1ef1c th\u1ea5p \u0111\u1ec3 \u0111\u01b0a ra quy\u1ebft \u0111\u1ecbnh trong t\u00edch t\u1eafc. GPUDirect RDMA c\u00f3 th\u1ec3 truy\u1ec1n d\u1eef li\u1ec7u tr\u1ef1c ti\u1ebfp t\u1eeb giao di\u1ec7n m\u1ea1ng \u0111\u1ec3 d\u1eef li\u1ec7u \u0111\u1ebfn c\u00f3 th\u1ec3 \u0111\u01b0\u1ee3c x\u1eed l\u00fd nhanh ch\u00f3ng v\u00e0 giao d\u1ecbch c\u00f3 th\u1ec3 \u0111\u01b0\u1ee3c th\u1ef1c hi\u1ec7n nhanh h\u01a1n so v\u1edbi \u0111\u1ed1i th\u1ee7 c\u1ea1nh tranh.<\/li>\n<li><strong>Vi\u1ec5n th\u00f4ng v\u00e0 m\u1ea1ng 5G.<\/strong>\u00a0C\u00e1c h\u1ec7 th\u1ed1ng ti\u00ean ti\u1ebfn h\u1ed7 tr\u1ee3 c\u00e1c \u1ee9ng d\u1ee5ng b\u0103ng th\u00f4ng cao nh\u01b0 live streaming video, th\u1ef1c t\u1ebf t\u0103ng c\u01b0\u1eddng v\u00e0 IoT \u0111\u00f2i h\u1ecfi ph\u1ea3i x\u1eed l\u00fd d\u1eef li\u1ec7u m\u1ea1ng nhanh ch\u00f3ng v\u00e0 hi\u1ec7u qu\u1ea3.<\/li>\n<li><strong>Xe t\u1ef1 h\u00e0nh v\u00e0 robot.<\/strong>\u00a0Ch\u00fang s\u1eed d\u1ee5ng GPUDirect RDMA \u0111\u1ec3 x\u1eed l\u00fd d\u1eef li\u1ec7u c\u1ea3m bi\u1ebfn t\u1eeb camera, LIDAR v\u00e0 RADAR theo th\u1eddi gian th\u1ef1c \u0111\u1ec3 ph\u00e1t hi\u1ec7n v\u1eadt th\u1ec3, l\u1eadp k\u1ebf ho\u1ea1ch \u0111\u01b0\u1eddng \u0111i v\u00e0 ra quy\u1ebft \u0111\u1ecbnh.<\/li>\n<\/ul>\n<h2>GPUDirect RDMA so v\u1edbi GPUDirect Storage<\/h2>\n<p>C\u1ea3\u00a0<a href=\"https:\/\/docs.nvidia.com\/datacenter\/cloud-native\/gpu-operator\/22.9.1\/gpu-operator-rdma.html\" target=\"_blank\" rel=\"noreferrer noopener\">GPUDirect Storage v\u00e0 GPUDirect RDMA<\/a>\u00a0\u0111\u1ec1u c\u1ea3i thi\u1ec7n hi\u1ec7u su\u1ea5t m\u00e0 kh\u00f4ng g\u00e2y qu\u00e1 t\u1ea3i cho CPU, nh\u01b0ng ch\u00fang \u0111\u1ea1t \u0111\u01b0\u1ee3c m\u1ee5c ti\u00eau \u0111\u00f3 theo nh\u1eefng c\u00e1ch kh\u00e1c nhau.<\/p>\n<p><a href=\"https:\/\/www.weka.io\/learn\/glossary\/gpu\/what-is-gpudirect-storage\/\" target=\"_blank\" rel=\"noreferrer noopener\">GPUDirect Storage<\/a>\u00a0\u0111\u1eb7c bi\u1ec7t cho ph\u00e9p truy\u1ec1n d\u1eef li\u1ec7u tr\u1ef1c ti\u1ebfp gi\u1eefa c\u00e1c <a class=\"iblink\" href=\"\/storage\/\">thi\u1ebft b\u1ecb l\u01b0u tr\u1eef<\/a> v\u00e0 b\u1ed9 nh\u1edb GPU \u0111\u1ec3 t\u1ed1i \u01b0u h\u00f3a quy\u1ec1n truy c\u1eadp cho c\u00e1c \u1ee9ng d\u1ee5ng ch\u1ea1y b\u1eb1ng GPU. N\u00f3 ho\u1ea1t \u0111\u1ed9ng m\u00e0 kh\u00f4ng quan t\u00e2m \u0111\u1ebfn v\u1ecb tr\u00ed l\u01b0u tr\u1eef. Ng\u01b0\u1ee3c l\u1ea1i, GPUDirect RDMA l\u00e0 c\u00f4ng ngh\u1ec7 r\u1ed9ng h\u01a1n t\u1ea1o \u0111i\u1ec1u ki\u1ec7n cho vi\u1ec7c truy\u1ec1n d\u1eef li\u1ec7u t\u1ed1c \u0111\u1ed9 cao b\u1eb1ng c\u00e1ch cho ph\u00e9p truy c\u1eadp b\u1ed9 nh\u1edb tr\u1ef1c ti\u1ebfp gi\u1eefa GPU v\u00e0 c\u00e1c thi\u1ebft b\u1ecb v\u00e0 <a class=\"iblink\" href=\"\/storage\/\">h\u1ec7 th\u1ed1ng l\u01b0u tr\u1eef<\/a> tr\u00ean to\u00e0n m\u1ea1ng. N\u00f3 ho\u1ea1t \u0111\u1ed9ng d\u1ef1a tr\u00ean thi\u1ebft b\u1ecb ho\u1eb7c v\u1ecb tr\u00ed l\u01b0u tr\u1eef m\u00e0 n\u00f3 \u0111ang truy c\u1eadp.<\/p>\n<h2>GPUDirect RDMA so v\u1edbi NVLink<\/h2>\n<p>Gi\u1ed1ng nh\u01b0 NVIDIA GPUDirect RDMA, NVLink c\u0169ng t\u0103ng c\u01b0\u1eddng truy\u1ec1n d\u1eef li\u1ec7u v\u00e0 giao ti\u1ebfp trong c\u00e1c h\u1ec7 th\u1ed1ng s\u1eed d\u1ee5ng GPU NVIDIA. Tuy nhi\u00ean, n\u00f3 c\u0169ng kh\u00e1c bi\u1ec7t \u1edf m\u1ed9t s\u1ed1 \u0111i\u1ec3m quan tr\u1ecdng:<\/p>\n<ul>\n<li>Trong khi GPUDirect RDMA giao ti\u1ebfp tr\u1ef1c ti\u1ebfp v\u1edbi c\u00e1c thi\u1ebft b\u1ecb kh\u00e1c qua bus PCIe, n\u00f3 kh\u00f4ng th\u1ec3 \u0111\u1ea1t \u0111\u01b0\u1ee3c c\u00f9ng b\u0103ng th\u00f4ng; NVLink l\u00e0 m\u1ed9t gi\u1ea3i ph\u00e1p thay th\u1ebf cho PCIe \u0111\u1ec3 giao ti\u1ebfp GPU-GPU ho\u1eb7c CPU-GPU trong c\u00f9ng m\u1ed9t n\u00fat.<\/li>\n<li>NVLink \u0111\u01b0\u1ee3c thi\u1ebft k\u1ebf d\u00e0nh ri\u00eang cho giao ti\u1ebfp t\u1ed1c \u0111\u1ed9 cao, \u0111\u1ed9 tr\u1ec5 th\u1ea5p, t\u1ea1o ra m\u1ed9t &#8220;mesh&#8221; GPU c\u00f3 th\u1ec3 chia s\u1ebb b\u1ed9 nh\u1edb v\u00e0 d\u1eef li\u1ec7u nhanh ch\u00f3ng. Mesh cho ph\u00e9p ph\u00e2n b\u1ed5 ngang h\u00e0ng gi\u1eefa nhi\u1ec1u GPU v\u1edbi b\u0103ng th\u00f4ng r\u1ea5t cao v\u00e0 \u0111\u1ed9 tr\u1ec5 th\u1ea5p v\u00e0 giao ti\u1ebfp \u1edf t\u1ed1c \u0111\u1ed9 cao h\u01a1n nhi\u1ec1u so v\u1edbi PCIe.<\/li>\n<\/ul>\n<h2>L\u1ee3i \u00edch c\u1ee7a GPUDirect RDMA<\/h2>\n<p>L\u1ee3i \u00edch c\u1ee7a vi\u1ec7c truy c\u1eadp b\u1ed9 nh\u1edb t\u1eeb xa tr\u1ef1c ti\u1ebfp b\u1eb1ng GPUDirect bao g\u1ed3m:<\/p>\n<ul>\n<li><strong>Gi\u1ea3m \u0111\u1ed9 tr\u1ec5.<\/strong>\u00a0B\u1ecf qua CPU trong qu\u00e1 tr\u00ecnh truy\u1ec1n d\u1eef li\u1ec7u gi\u00fap gi\u1ea3m \u0111\u1ed9 tr\u1ec5 v\u00e0 t\u0103ng b\u0103ng th\u00f4ng t\u1eeb 2-8 l\u1ea7n, gi\u00fap truy c\u1eadp d\u1eef li\u1ec7u nhanh h\u01a1n, \u0111\u1ecdc v\u00e0 ghi nhanh h\u01a1n v\u00e0 c\u1ea3i thi\u1ec7n hi\u1ec7u su\u1ea5t.<\/li>\n<li><strong>T\u0103ng th\u00f4ng l\u01b0\u1ee3ng.<\/strong>\u00a0GPUDirect RDMA t\u1ed1i \u01b0u h\u00f3a \u0111\u01b0\u1eddng d\u1eabn truy\u1ec1n d\u1eef li\u1ec7u, cho ph\u00e9p th\u00f4ng l\u01b0\u1ee3ng cao h\u01a1n gi\u1eefa c\u00e1c thi\u1ebft b\u1ecb l\u01b0u tr\u1eef v\u00e0 b\u1ed9 nh\u1edb GPU, n\u00e2ng cao hi\u1ec7u qu\u1ea3 t\u1ed5ng th\u1ec3 c\u1ee7a h\u1ec7 th\u1ed1ng.<\/li>\n<li><strong>C\u1ea3i thi\u1ec7n quy m\u00f4 l\u01b0u tr\u1eef.<\/strong>\u00a0GPUDirect RDMA cho ph\u00e9p truy c\u1eadp d\u1eef li\u1ec7u hi\u1ec7u qu\u1ea3 trong m\u00f4i tr\u01b0\u1eddng \u0111i\u1ec7n to\u00e1n ph\u00e2n t\u00e1n v\u00e0 \u0111a GPU, h\u1ed7 tr\u1ee3 c\u00e1c \u1ee9ng d\u1ee5ng quy m\u00f4 l\u1edbn.<\/li>\n<li><strong>Gi\u1ea3m t\u1ea3i CPU.<\/strong>\u00a0Truy\u1ec1n d\u1eef li\u1ec7u tr\u1ef1c ti\u1ebfp gi\u1eefa b\u1ed9 nh\u1edb l\u01b0u tr\u1eef v\u00e0 b\u1ed9 nh\u1edb GPU gi\u00fap gi\u1ea3m chi ph\u00ed CPU, gi\u1ea3i ph\u00f3ng t\u00e0i nguy\u00ean CPU cho c\u00e1c t\u00e1c v\u1ee5 kh\u00e1c v\u00e0 c\u1ea3i thi\u1ec7n hi\u1ec7u qu\u1ea3 chung c\u1ee7a h\u1ec7 th\u1ed1ng.<\/li>\n<\/ul>\n<div>____<br \/><b>B\u00e0i vi\u1ebft li\u00ean quan<\/b><\/div>\n<ul>\n<li><a href=\"https:\/\/thegioimaychu.vn\/blog\/?post_type=post&#038;p=23415\">B\u01b0\u1edbc v\u00e0o k\u1ef7 nguy\u00ean tr\u1ee3 l\u00fd AI c\u00e1 nh\u00e2n &#8211; so s\u00e1nh chi ti\u1ebft NVIDIA RTX Spark v\u00e0 DGX Spark<\/a><\/li>\n<li><a href=\"https:\/\/thegioimaychu.vn\/blog\/?post_type=post&#038;p=23322\">NVIDIA RTX PRO 4500 Blackwell Server Edition: B\u01b0\u1edbc nh\u1ea3y v\u1ecdt t\u1eeb th\u1ebf h\u1ec7 L4 cho h\u1ea1 t\u1ea7ng AI suy lu\u1eadn hi\u1ec7u n\u0103ng cao<\/a><\/li>\n<li><a href=\"https:\/\/thegioimaychu.vn\/blog\/?post_type=post&#038;p=23119\">NVIDIA NGC\u2011ready Low\u2011latency Edge AI: Gi\u1ea3i ph\u00e1p cho Retail, Manufacturing v\u00e0 Smart Cities<\/a><\/li>\n<li><a href=\"https:\/\/thegioimaychu.vn\/blog\/?post_type=post&#038;p=23110\">So s\u00e1nh s\u1ee9c m\u1ea1nh c\u1ee7a m\u00e1y t\u00ednh AI DGX Spark v\u1edbi c\u00e1c card GPU m\u00e1y tr\u1ea1m chuy\u00ean nghi\u1ec7p c\u1ee7a NVIDIA<\/a><\/li>\n<li><a href=\"https:\/\/thegioimaychu.vn\/blog\/?post_type=post&#038;p=22969\">T\u1eeb Orin \u0111\u1ebfn Thor: B\u01b0\u1edbc nh\u1ea3y v\u1ecdt ki\u1ebfn tr\u00fac c\u1ee7a NVIDIA JetPack 7.0 v\u00e0 t\u01b0\u01a1ng lai c\u1ee7a robot h\u00ecnh ng\u01b0\u1eddi<\/a><\/li>\n<li><a href=\"https:\/\/thegioimaychu.vn\/blog\/?post_type=post&#038;p=22887\">T\u1ea1i sao g\u1ecdi NVIDIA DGX Spark l\u00e0 Si\u00eau m\u00e1y t\u00ednh AI c\u00e1 nh\u00e2n?<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>NVIDIA GPUDirect RDMA l&agrave; g&igrave;? NVIDIA GPUDirect RDMA (Remote Direct Memory Access)&nbsp;l&agrave; m&#7897;t th&agrave;nh ph&#7847;n c&#7911;a gi&#7843;i ph&aacute;p c&ocirc;ng ngh&#7879; NVIDIA Magnum IO, cho ph&eacute;p truy&#7873;n d&#7919; li&#7879;u nhanh ch&oacute;ng gi&#7919;a GPU v&agrave; c&aacute;c thi&#7871;t b&#7883; kh&aacute;c m&agrave; kh&ocirc;ng c&#7847;n &#273;&#7871;n kh&#7843; n&#259;ng x&#7917; l&yacute; c&#7911;a CPU hay b&#7897; nh&#7899; ch&iacute;nh. Trong c&aacute;ch th&#7913;c truy&#7873;n&#8230;<\/p>\n","protected":false},"author":2,"featured_media":20629,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":""},"categories":[3],"tags":[1324,1314],"class_list":["post-20627","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai-hpc","tag-gpudirect","tag-nvidia"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.3 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>GPUDirect RDMA l\u00e0 g\u00ec? - Blog | TheGioiMayChu<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/gpudirect-rdma-la-gi-p20627\/\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:title\" content=\"GPUDirect RDMA l\u00e0 g\u00ec? - Blog | TheGioiMayChu\" \/>\n<meta name=\"twitter:description\" content=\"NVIDIA GPUDirect RDMA l&agrave; g&igrave;? NVIDIA GPUDirect RDMA (Remote Direct Memory Access)&nbsp;l&agrave; m&#7897;t th&agrave;nh ph&#7847;n c&#7911;a gi&#7843;i ph&aacute;p c&ocirc;ng ngh&#7879; NVIDIA Magnum IO, cho ph&eacute;p truy&#7873;n d&#7919; li&#7879;u nhanh ch&oacute;ng gi&#7919;a GPU v&agrave; c&aacute;c thi&#7871;t b&#7883; kh&aacute;c m&agrave; kh&ocirc;ng c&#7847;n &#273;&#7871;n kh&#7843; n&#259;ng x&#7917; l&yacute; c&#7911;a CPU hay b&#7897; nh&#7899; ch&iacute;nh. Trong c&aacute;ch th&#7913;c truy&#7873;n...\" \/>\n<meta name=\"twitter:image\" content=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2024\/11\/TheGioiMayChu-Blog-GPUDirect-RDMA.jpg\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Vanito Hoang\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"17 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/gpudirect-rdma-la-gi-p20627\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/gpudirect-rdma-la-gi-p20627\\\/\"},\"author\":{\"name\":\"Vanito Hoang\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#\\\/schema\\\/person\\\/feccec179330cfebfaa805639a357d18\"},\"headline\":\"GPUDirect RDMA l\u00e0 g\u00ec?\",\"datePublished\":\"2024-11-13T08:35:07+00:00\",\"dateModified\":\"2024-11-13T08:37:48+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/gpudirect-rdma-la-gi-p20627\\\/\"},\"wordCount\":3486,\"publisher\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/gpudirect-rdma-la-gi-p20627\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/wp-content\\\/uploads\\\/2024\\\/11\\\/TheGioiMayChu-Blog-GPUDirect-RDMA.jpg\",\"keywords\":[\"GPUDirect\",\"NVIDIA\"],\"articleSection\":[\"AI - HPC\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/gpudirect-rdma-la-gi-p20627\\\/\",\"url\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/gpudirect-rdma-la-gi-p20627\\\/\",\"name\":\"GPUDirect RDMA l\u00e0 g\u00ec? - Blog | TheGioiMayChu\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/gpudirect-rdma-la-gi-p20627\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/gpudirect-rdma-la-gi-p20627\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/wp-content\\\/uploads\\\/2024\\\/11\\\/TheGioiMayChu-Blog-GPUDirect-RDMA.jpg\",\"datePublished\":\"2024-11-13T08:35:07+00:00\",\"dateModified\":\"2024-11-13T08:37:48+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/gpudirect-rdma-la-gi-p20627\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/gpudirect-rdma-la-gi-p20627\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/gpudirect-rdma-la-gi-p20627\\\/#primaryimage\",\"url\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/wp-content\\\/uploads\\\/2024\\\/11\\\/TheGioiMayChu-Blog-GPUDirect-RDMA.jpg\",\"contentUrl\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/wp-content\\\/uploads\\\/2024\\\/11\\\/TheGioiMayChu-Blog-GPUDirect-RDMA.jpg\",\"width\":844,\"height\":500},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/gpudirect-rdma-la-gi-p20627\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Trang ch\u1ee7\",\"item\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"AI - HPC\",\"item\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/.\\\/ai-hpc\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"GPUDirect RDMA l\u00e0 g\u00ec?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#website\",\"url\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/\",\"name\":\"Blog | TheGioiMayChu\",\"description\":\"C\u1eadp nh\u1eadt xu h\u01b0\u1edbng c\u00f4ng ngh\u1ec7 m\u00e1y ch\u1ee7\",\"publisher\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#organization\",\"name\":\"Blog | TheGioiMayChu\",\"url\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/wp-content\\\/uploads\\\/2018\\\/08\\\/cropped-ntcnlog-logo-2.png\",\"contentUrl\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/wp-content\\\/uploads\\\/2018\\\/08\\\/cropped-ntcnlog-logo-2.png\",\"width\":500,\"height\":73,\"caption\":\"Blog | TheGioiMayChu\"},\"image\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/thegioimaychu\\\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#\\\/schema\\\/person\\\/feccec179330cfebfaa805639a357d18\",\"name\":\"Vanito Hoang\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/e8187f37f72d74f9380a1367c8c530debee44f226a3301f0765c68f7cc1f3fa4?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/e8187f37f72d74f9380a1367c8c530debee44f226a3301f0765c68f7cc1f3fa4?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/e8187f37f72d74f9380a1367c8c530debee44f226a3301f0765c68f7cc1f3fa4?s=96&d=mm&r=g\",\"caption\":\"Vanito Hoang\"},\"url\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/author\\\/vanito\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"GPUDirect RDMA l\u00e0 g\u00ec? - Blog | TheGioiMayChu","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/gpudirect-rdma-la-gi-p20627\/","twitter_card":"summary_large_image","twitter_title":"GPUDirect RDMA l\u00e0 g\u00ec? - Blog | TheGioiMayChu","twitter_description":"NVIDIA GPUDirect RDMA l&agrave; g&igrave;? NVIDIA GPUDirect RDMA (Remote Direct Memory Access)&nbsp;l&agrave; m&#7897;t th&agrave;nh ph&#7847;n c&#7911;a gi&#7843;i ph&aacute;p c&ocirc;ng ngh&#7879; NVIDIA Magnum IO, cho ph&eacute;p truy&#7873;n d&#7919; li&#7879;u nhanh ch&oacute;ng gi&#7919;a GPU v&agrave; c&aacute;c thi&#7871;t b&#7883; kh&aacute;c m&agrave; kh&ocirc;ng c&#7847;n &#273;&#7871;n kh&#7843; n&#259;ng x&#7917; l&yacute; c&#7911;a CPU hay b&#7897; nh&#7899; ch&iacute;nh. Trong c&aacute;ch th&#7913;c truy&#7873;n...","twitter_image":"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2024\/11\/TheGioiMayChu-Blog-GPUDirect-RDMA.jpg","twitter_misc":{"Written by":"Vanito Hoang","Est. reading time":"17 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/gpudirect-rdma-la-gi-p20627\/#article","isPartOf":{"@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/gpudirect-rdma-la-gi-p20627\/"},"author":{"name":"Vanito Hoang","@id":"https:\/\/thegioimaychu.vn\/blog\/#\/schema\/person\/feccec179330cfebfaa805639a357d18"},"headline":"GPUDirect RDMA l\u00e0 g\u00ec?","datePublished":"2024-11-13T08:35:07+00:00","dateModified":"2024-11-13T08:37:48+00:00","mainEntityOfPage":{"@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/gpudirect-rdma-la-gi-p20627\/"},"wordCount":3486,"publisher":{"@id":"https:\/\/thegioimaychu.vn\/blog\/#organization"},"image":{"@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/gpudirect-rdma-la-gi-p20627\/#primaryimage"},"thumbnailUrl":"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2024\/11\/TheGioiMayChu-Blog-GPUDirect-RDMA.jpg","keywords":["GPUDirect","NVIDIA"],"articleSection":["AI - HPC"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/gpudirect-rdma-la-gi-p20627\/","url":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/gpudirect-rdma-la-gi-p20627\/","name":"GPUDirect RDMA l\u00e0 g\u00ec? - Blog | TheGioiMayChu","isPartOf":{"@id":"https:\/\/thegioimaychu.vn\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/gpudirect-rdma-la-gi-p20627\/#primaryimage"},"image":{"@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/gpudirect-rdma-la-gi-p20627\/#primaryimage"},"thumbnailUrl":"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2024\/11\/TheGioiMayChu-Blog-GPUDirect-RDMA.jpg","datePublished":"2024-11-13T08:35:07+00:00","dateModified":"2024-11-13T08:37:48+00:00","breadcrumb":{"@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/gpudirect-rdma-la-gi-p20627\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/gpudirect-rdma-la-gi-p20627\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/gpudirect-rdma-la-gi-p20627\/#primaryimage","url":"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2024\/11\/TheGioiMayChu-Blog-GPUDirect-RDMA.jpg","contentUrl":"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2024\/11\/TheGioiMayChu-Blog-GPUDirect-RDMA.jpg","width":844,"height":500},{"@type":"BreadcrumbList","@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/gpudirect-rdma-la-gi-p20627\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Trang ch\u1ee7","item":"https:\/\/thegioimaychu.vn\/blog\/"},{"@type":"ListItem","position":2,"name":"AI - HPC","item":"https:\/\/thegioimaychu.vn\/blog\/.\/ai-hpc\/"},{"@type":"ListItem","position":3,"name":"GPUDirect RDMA l\u00e0 g\u00ec?"}]},{"@type":"WebSite","@id":"https:\/\/thegioimaychu.vn\/blog\/#website","url":"https:\/\/thegioimaychu.vn\/blog\/","name":"Blog | TheGioiMayChu","description":"C\u1eadp nh\u1eadt xu h\u01b0\u1edbng c\u00f4ng ngh\u1ec7 m\u00e1y ch\u1ee7","publisher":{"@id":"https:\/\/thegioimaychu.vn\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/thegioimaychu.vn\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/thegioimaychu.vn\/blog\/#organization","name":"Blog | TheGioiMayChu","url":"https:\/\/thegioimaychu.vn\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/thegioimaychu.vn\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2018\/08\/cropped-ntcnlog-logo-2.png","contentUrl":"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2018\/08\/cropped-ntcnlog-logo-2.png","width":500,"height":73,"caption":"Blog | TheGioiMayChu"},"image":{"@id":"https:\/\/thegioimaychu.vn\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/thegioimaychu\/"]},{"@type":"Person","@id":"https:\/\/thegioimaychu.vn\/blog\/#\/schema\/person\/feccec179330cfebfaa805639a357d18","name":"Vanito Hoang","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/e8187f37f72d74f9380a1367c8c530debee44f226a3301f0765c68f7cc1f3fa4?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/e8187f37f72d74f9380a1367c8c530debee44f226a3301f0765c68f7cc1f3fa4?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/e8187f37f72d74f9380a1367c8c530debee44f226a3301f0765c68f7cc1f3fa4?s=96&d=mm&r=g","caption":"Vanito Hoang"},"url":"https:\/\/thegioimaychu.vn\/blog\/author\/vanito\/"}]}},"_links":{"self":[{"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/posts\/20627","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/comments?post=20627"}],"version-history":[{"count":3,"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/posts\/20627\/revisions"}],"predecessor-version":[{"id":20715,"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/posts\/20627\/revisions\/20715"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/media\/20629"}],"wp:attachment":[{"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/media?parent=20627"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/categories?post=20627"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/tags?post=20627"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}