{"id":15692,"date":"2023-04-20T16:17:11","date_gmt":"2023-04-20T09:17:11","guid":{"rendered":"https:\/\/www.thegioimaychu.vn\/blog\/?p=15692"},"modified":"2023-06-09T14:36:47","modified_gmt":"2023-06-09T07:36:47","slug":"nvidia-dua-suy-luan-len-cap-do-moi-qua-cac-bai-kiem-tra-mlperf","status":"publish","type":"post","link":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/nvidia-dua-suy-luan-len-cap-do-moi-qua-cac-bai-kiem-tra-mlperf-p15692\/","title":{"rendered":"NVIDIA \u0111\u01b0a suy lu\u1eadn l\u00ean c\u1ea5p \u0111\u1ed9 m\u1edbi qua c\u00e1c b\u00e0i ki\u1ec3m tra MLPerf"},"content":{"rendered":"<style>.iblink{color:#975!important;}.iblink:hover{color:orange!important;}<\/style><p><strong><em>GPU NVIDIA H100 v\u00e0 L4 \u0111\u00e3 \u0111\u01b0a AI t\u1ea1o sinh (Generative AI) v\u00e0 t\u1ea5t c\u1ea3 c\u00e1c workload kh\u00e1c l\u00ean m\u1ed9t c\u1ea5p \u0111\u1ed9 m\u1edbi trong c\u00e1c b\u00e0i ki\u1ec3m tra \u0111i\u1ec3m benchmark MLPerf m\u1edbi nh\u1ea5t, trong khi Jetson AGX Orin cho th\u1ea5y m\u1ee9c t\u0103ng hi\u1ec7u su\u1ea5t v\u00e0 hi\u1ec7u qu\u1ea3 x\u1eed l\u00fd \u0111\u00e1ng k\u1ec3.<\/em><\/strong><\/p>\n<p><a href=\"https:\/\/www.nvidia.com\/en-us\/data-center\/resources\/mlperf-benchmarks\/\">MLPerf<\/a> v\u1eabn l\u00e0 ph\u00e9p \u0111o ch\u00ednh x\u00e1c v\u1ec1 hi\u1ec7u su\u1ea5t AI d\u01b0\u1edbi d\u1ea1ng \u0111i\u1ec3m benchmark \u0111\u1ed9c l\u1eadp c\u1ee7a b\u00ean th\u1ee9 ba.\u00a0N\u1ec1n t\u1ea3ng AI c\u1ee7a NVIDIA \u0111\u00e3 li\u00ean t\u1ee5c th\u1ec3 hi\u1ec7n s\u1ef1 d\u1eabn \u0111\u1ea7u trong c\u1ea3 \u0111\u00e0o t\u1ea1o v\u00e0 suy lu\u1eadn k\u1ec3 t\u1eeb l\u00fac MLPerf m\u1edbi \u0111\u01b0\u1ee3c \u0111\u01b0a ra, bao g\u1ed3m c\u1ea3 \u0111i\u1ec3m benchmark MLPerf Inference 3.0 \u0111\u01b0\u1ee3c ph\u00e1t h\u00e0nh ng\u00e0y h\u00f4m nay.<\/p>\n<p>\u201cBa n\u0103m tr\u01b0\u1edbc, khi ch\u00fang t\u00f4i gi\u1edbi thi\u1ec7u A100, th\u1ebf gi\u1edbi AI \u0111\u00e3 b\u1ecb chi ph\u1ed1i b\u1edfi <a class=\"iblink\" href=\"\/blog\/tag\/computer-vision\/\">Th\u1ecb gi\u00e1c m\u00e1y t\u00ednh<\/a> (<a class=\"iblink\" href=\"\/blog\/tag\/computer-vision\/\">Computer Vision<\/a>). V\u00e0 b\u00e2y gi\u1edd Generative AI \u0111\u00e3 xu\u1ea5t hi\u1ec7n\u201d, Jensen Huang, Ng\u01b0\u1eddi s\u00e1ng l\u1eadp ki\u00eam Gi\u00e1m \u0111\u1ed1c \u0111i\u1ec1u h\u00e0nh c\u1ee7a NVIDIA cho bi\u1ebft.<\/p>\n<p>\u201c\u0110\u00e2y ch\u00ednh l\u00e0 l\u00fd do t\u1ea1i sao ch\u00fang t\u00f4i x\u00e2y d\u1ef1ng Hopper, \u0111\u01b0\u1ee3c t\u1ed1i \u01b0u h\u00f3a \u0111\u1eb7c bi\u1ec7t cho GPT v\u1edbi Transformer Engine.\u00a0\u0110i\u1ec3m n\u1ed5i b\u1eadt c\u1ee7a MLPerf 3.0 hi\u1ec7n nay l\u00e0 Hopper mang l\u1ea1i hi\u1ec7u su\u1ea5t cao g\u1ea5p 4 l\u1ea7n so v\u1edbi A100.<\/p>\n<p>\u201cC\u1ea5p \u0111\u1ed9 ti\u1ebfp theo c\u1ee7a Generative AI y\u00eau c\u1ea7u h\u1ea1 t\u1ea7ng AI m\u1edbi \u0111\u1ec3 \u0111\u00e0o t\u1ea1o c\u00e1c m\u00f4 h\u00ecnh ng\u00f4n ng\u1eef l\u1edbn (Large Languague Models) v\u1edbi hi\u1ec7u qu\u1ea3 n\u0103ng l\u01b0\u1ee3ng cao.\u00a0Kh\u00e1ch h\u00e0ng \u0111ang m\u1edf r\u1ed9ng Hopper tr\u00ean quy m\u00f4 l\u1edbn, x\u00e2y d\u1ef1ng h\u1ea1 t\u1ea7ng AI v\u1edbi h\u00e0ng ch\u1ee5c ngh\u00ecn GPU Hopper \u0111\u01b0\u1ee3c k\u1ebft n\u1ed1i b\u1edfi NVIDIA NVLink v\u00e0 InfiniBand.<\/p>\n<p>\u201cNg\u00e0nh c\u00f4ng nghi\u1ec7p \u0111ang ho\u1ea1t \u0111\u1ed9ng li\u00ean t\u1ee5c \u0111\u1ec3 \u0111\u1ea1t \u0111\u01b0\u1ee3c nh\u1eefng ti\u1ebfn b\u1ed9 m\u1edbi trong Generative AI an to\u00e0n v\u00e0 \u0111\u00e1ng tin c\u1eady. V\u00e0 Hopper \u0111ang t\u1ea1o \u0111i\u1ec1u ki\u1ec7n cho c\u00f4ng vi\u1ec7c thi\u1ebft y\u1ebfu n\u00e0y\u201d, \u00f4ng \u1ea5y n\u00f3i th\u00eam.<\/p>\n<p>Nh\u1eefng <a href=\"https:\/\/www.nvidia.com\/en-us\/data-center\/resources\/mlperf-benchmarks\/\">k\u1ebft qu\u1ea3 MLPerf<\/a>\u00a0m\u1edbi nh\u1ea5t\u00a0cho th\u1ea5y NVIDIA \u0111\u01b0a kh\u1ea3 n\u0103ng suy lu\u1eadn c\u1ee7a AI l\u00ean c\u00e1c m\u1ee9c hi\u1ec7u su\u1ea5t v\u00e0 hi\u1ec7u qu\u1ea3 m\u1edbi t\u1eeb cloud cho \u0111\u1ebfn bi\u00ean.<\/p>\n<p>C\u1ee5 th\u1ec3, c\u00e1c\u00a0<a href=\"https:\/\/www.nvidia.com\/en-us\/data-center\/h100\/\">GPU NVIDIA H100 Tensor Core<\/a>\u00a0ch\u1ea1y trong c\u00e1c\u00a0<a href=\"https:\/\/www.nvidia.com\/en-us\/data-center\/dgx-h100\/\">h\u1ec7 th\u1ed1ng DGX H100<\/a>\u00a0mang l\u1ea1i hi\u1ec7u su\u1ea5t cao nh\u1ea5t trong m\u1ecdi th\u1eed nghi\u1ec7m v\u1ec1 suy lu\u1eadn AI, c\u00f4ng vi\u1ec7c c\u1ee7a vi\u1ec7c v\u1eadn h\u00e0nh c\u00e1c m\u1ea1ng n\u01a1-ron nh\u00e2n t\u1ea1o (Neural Networks) trong s\u1ea3n xu\u1ea5t.\u00a0Nh\u1edd\u00a0<a href=\"https:\/\/developer.nvidia.com\/blog\/?p=62958&amp;preview=1&amp;_ppp=80347d2303\">t\u1ed1i \u01b0u h\u00f3a ph\u1ea7n m\u1ec1m<\/a>, GPU \u0111\u00e3 mang l\u1ea1i hi\u1ec7u su\u1ea5t t\u0103ng t\u1edbi 54% k\u1ec3 t\u1eeb\u00a0<a href=\"https:\/\/blogs.nvidia.com\/blog\/2022\/09\/08\/hopper-mlperf-inference\/\">khi ra m\u1eaft<\/a>\u00a0v\u00e0o th\u00e1ng 9.<\/p>\n<p>Trong l\u0129nh v\u1ef1c ch\u0103m s\u00f3c s\u1ee9c kh\u1ecfe, c\u00e1c GPU H100 mang l\u1ea1i hi\u1ec7u su\u1ea5t t\u0103ng 31% k\u1ec3 t\u1eeb th\u00e1ng 9 tr\u00ean 3D-UNet, \u0111i\u1ec3m chu\u1ea9n MLPerf cho h\u00ecnh \u1ea3nh y khoa.<\/p>\n<p><a href=\"https:\/\/blogs.nvidia.com\/wp-content\/uploads\/2023\/04\/H100-GPU-inference-performance-MLPerf-scaled.jpg\"><img decoding=\"async\" src=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/04\/tgmc-blog-643f903e7280a.jpg\" \/><\/a><\/p>\n<p>\u0110\u01b0\u1ee3c h\u1ed7 tr\u1ee3 b\u1edfi\u00a0<a href=\"https:\/\/blogs.nvidia.com\/blog\/2022\/03\/22\/h100-transformer-engine\/\">Transformer Engine<\/a>\u00a0c\u1ee7a n\u00f3, GPU H100, d\u1ef1a tr\u00ean ki\u1ebfn \u200b\u200btr\u00fac Hopper, \u0111\u00e3 xu\u1ea5t s\u1eafc tr\u00ean BERT, m\u1ed9t\u00a0<a href=\"https:\/\/blogs.nvidia.com\/blog\/2023\/01\/26\/what-are-large-language-models-used-for\/\">m\u00f4 h\u00ecnh ng\u00f4n ng\u1eef l\u1edbn<\/a>\u00a0d\u1ef1a tr\u00ean transformer \u0111\u00e3 m\u1edf \u0111\u01b0\u1eddng cho vi\u1ec7c s\u1eed d\u1ee5ng r\u1ed9ng r\u00e3i Generative AI ng\u00e0y nay.<\/p>\n<p>Generative AI cho ph\u00e9p ng\u01b0\u1eddi d\u00f9ng nhanh ch\u00f3ng t\u1ea1o v\u0103n b\u1ea3n, h\u00ecnh \u1ea3nh, m\u00f4 h\u00ecnh 3D,&#8230; \u0110\u00f3 l\u00e0 kh\u1ea3 n\u0103ng m\u00e0 c\u00e1c c\u00f4ng ty t\u1eeb m\u1edbi th\u00e0nh l\u1eadp cho \u0111\u1ebfn nh\u00e0 cung c\u1ea5p d\u1ecbch v\u1ee5 cloud \u0111ang nhanh ch\u00f3ng \u00e1p d\u1ee5ng \u0111\u1ec3 k\u00edch ho\u1ea1t c\u00e1c m\u00f4 h\u00ecnh kinh doanh m\u1edbi v\u00e0 t\u0103ng t\u1ed1c c\u00e1c m\u00f4 h\u00ecnh kinh doanh hi\u1ec7n c\u00f3.<\/p>\n<p>H\u00e0ng tr\u0103m tri\u1ec7u ng\u01b0\u1eddi hi\u1ec7n \u0111ang s\u1eed d\u1ee5ng c\u00e1c c\u00f4ng c\u1ee5 Generative AI nh\u01b0 ChatGPT &#8211; c\u0169ng l\u00e0 m\u1ed9t Transformer Model &#8211; mong \u0111\u1ee3i c\u00f3 \u0111\u01b0\u1ee3c s\u1ef1 ph\u1ea3n h\u1ed3i ngay t\u1ee9c th\u00ec.<\/p>\n<p>T\u1ea1i kho\u1ea3nh kh\u1eafc iPhone c\u1ee7a AI n\u00e0y, hi\u1ec7u su\u1ea5t d\u1ef1a tr\u00ean suy lu\u1eadn l\u00e0 r\u1ea5t quan tr\u1ecdng.\u00a0H\u1ecdc s\u00e2u (<a class=\"iblink\" href=\"\/blog\/tag\/deep-learning\/\">Deep Learning<\/a>) hi\u1ec7n \u0111ang \u0111\u01b0\u1ee3c tri\u1ec3n khai g\u1ea7n nh\u01b0 \u1edf kh\u1eafp m\u1ecdi n\u01a1i, th\u00fac \u0111\u1ea9y nhu c\u1ea7u to l\u1edbn v\u1ec1 hi\u1ec7u su\u1ea5t suy lu\u1eadn t\u1eeb c\u00f4ng tr\u01b0\u1eddng cho \u0111\u1ebfn c\u00e1c\u00a0<a href=\"https:\/\/blogs.nvidia.com\/blog\/2020\/05\/14\/whats-a-recommender-system\/\">h\u1ec7 th\u1ed1ng \u0111\u1ec1 xu\u1ea5t<\/a>\u00a0tr\u1ef1c tuy\u1ebfn .<\/p>\n<h2>GPU L4 t\u0103ng t\u1ed1c v\u01b0\u1ee3t tr\u1ed9i<\/h2>\n<p><a href=\"https:\/\/www.nvidia.com\/en-us\/data-center\/l4\/\">GPU NVIDIA L4 Tensor Core<\/a>\u00a0xu\u1ea5t hi\u1ec7n l\u1ea7n \u0111\u1ea7u trong c\u00e1c th\u1eed nghi\u1ec7m MLPerf v\u1edbi t\u1ed1c \u0111\u1ed9 h\u01a1n 3 l\u1ea7n so v\u1edbi GPU T4 th\u1ebf h\u1ec7 tr\u01b0\u1edbc.\u00a0\u0110\u01b0\u1ee3c \u0111\u00f3ng g\u00f3i trong m\u1ed9t form factor low-profile, nh\u1eefng b\u1ed9 t\u0103ng t\u1ed1c n\u00e0y \u0111\u01b0\u1ee3c thi\u1ebft k\u1ebf \u0111\u1ec3 mang l\u1ea1i th\u00f4ng l\u01b0\u1ee3ng cao v\u00e0 \u0111\u1ed9 tr\u1ec5 th\u1ea5p \u1edf h\u1ea7u h\u1ebft m\u1ecdi m\u00e1y ch\u1ee7.<\/p>\n<p>Nh\u1eefng GPU L4 ch\u1ea1y t\u1ea5t c\u1ea3 c\u00e1c workload MLPerf.\u00a0Nh\u1edd h\u1ed7 tr\u1ee3 \u0111\u1ecbnh d\u1ea1ng FP8 ch\u00ednh, k\u1ebft qu\u1ea3 c\u1ee7a ch\u00fang \u0111\u1eb7c bi\u1ec7t \u1ea5n t\u01b0\u1ee3ng tr\u00ean m\u00f4 h\u00ecnh BERT \u0111\u00f2i h\u1ecfi hi\u1ec7u su\u1ea5t cao.<\/p>\n<p><a href=\"https:\/\/blogs.nvidia.com\/wp-content\/uploads\/2023\/04\/L4-GPU-inference-performance-on-MLPerf-scaled.jpg\"><img decoding=\"async\" src=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/04\/tgmc-blog-643f903f1ab4a.jpg\" \/><\/a><\/p>\n<p>Ngo\u00e0i hi\u1ec7u su\u1ea5t AI xu\u1ea5t s\u1eafc, GPU L4 c\u00f2n mang \u0111\u1ebfn kh\u1ea3 n\u0103ng decode h\u00ecnh \u1ea3nh nhanh h\u01a1n t\u1edbi 10 l\u1ea7n, x\u1eed l\u00fd video nhanh h\u01a1n t\u1edbi 3.2 l\u1ea7n v\u00e0 \u0111\u1ed3 h\u1ecda c\u0169ng nh\u01b0 hi\u1ec7u su\u1ea5t render nhanh h\u01a1n g\u1ea5p 4 l\u1ea7n.<\/p>\n<p>\u0110\u01b0\u1ee3c c\u00f4ng b\u1ed1 hai tu\u1ea7n tr\u01b0\u1edbc t\u1ea1i\u00a0<a href=\"https:\/\/www.nvidia.com\/gtc\/keynote\/\">GTC<\/a>, c\u00e1c b\u1ed9 t\u0103ng t\u1ed1c n\u00e0y \u0111\u00e3 c\u00f3 s\u1eb5n t\u1eeb c\u00e1c nh\u00e0 s\u1ea3n xu\u1ea5t h\u1ec7 th\u1ed1ng l\u1edbn v\u00e0\u00a0<a href=\"https:\/\/nvidianews.nvidia.com\/news\/nvidia-and-google-cloud-deliver-powerful-new-generative-ai-platform-built-on-the-new-l4-gpu-and-vertex-ai\">nh\u00e0 cung c\u1ea5p d\u1ecbch v\u1ee5 cloud<\/a>.\u00a0GPU L4 l\u00e0 s\u1ef1 b\u1ed5 sung m\u1edbi nh\u1ea5t cho danh m\u1ee5c <a href=\"https:\/\/nvidianews.nvidia.com\/news\/nvidia-launches-inference-platforms-for-large-language-models-and-generative-ai-workloads\">n\u1ec1n t\u1ea3ng suy lu\u1eadn AI<\/a>\u00a0c\u1ee7a NVIDIA\u00a0\u0111\u01b0\u1ee3c ra m\u1eaft t\u1ea1i GTC.<\/p>\n<h2>Software v\u00e0 network T\u1ecfa s\u00e1ng trong Th\u1eed nghi\u1ec7m H\u1ec7 th\u1ed1ng<\/h2>\n<p>N\u1ec1n t\u1ea3ng AI full-stack c\u1ee7a NVIDIA \u0111\u00e3 cho th\u1ea5y kh\u1ea3 n\u0103ng d\u1eabn \u0111\u1ea7u c\u1ee7a m\u00ecnh trong m\u1ed9t th\u1eed nghi\u1ec7m MLPerf m\u1edbi.<\/p>\n<p>C\u00e1i g\u1ecdi l\u00e0 \u0111i\u1ec3m chu\u1ea9n ph\u00e2n chia m\u1ea1ng, truy\u1ec1n d\u1eef li\u1ec7u \u0111\u1ebfn m\u1ed9t m\u00e1y ch\u1ee7 suy lu\u1eadn \u1edf xa.\u00a0N\u00f3 ph\u1ea3n \u00e1nh k\u1ecbch b\u1ea3n ph\u1ed5 bi\u1ebfn c\u1ee7a ng\u01b0\u1eddi d\u00f9ng doanh nghi\u1ec7p ch\u1ea1y c\u00e1c c\u00f4ng vi\u1ec7c AI tr\u00ean cloud v\u1edbi d\u1eef li\u1ec7u \u0111\u01b0\u1ee3c l\u01b0u tr\u1eef ph\u00eda sau t\u01b0\u1eddng l\u1eeda c\u1ee7a c\u00f4ng ty.<\/p>\n<p>Tr\u00ean BERT, c\u00e1c h\u1ec7 th\u1ed1ng\u00a0<a href=\"https:\/\/www.nvidia.com\/en-us\/data-center\/dgx-a100\/\">NVIDIA DGX A100<\/a>\u00a0\u1edf xa \u0111\u00e3 cung c\u1ea5p t\u1edbi 96% hi\u1ec7u su\u1ea5t c\u1ee5c b\u1ed9 t\u1ed1i \u0111a c\u1ee7a ch\u00fang, b\u1ecb ch\u1eadm l\u1ea1i m\u1ed9t ph\u1ea7n v\u00ec ch\u00fang c\u1ea7n \u0111\u1ee3i CPU ho\u00e0n th\u00e0nh m\u1ed9t s\u1ed1 t\u00e1c v\u1ee5.\u00a0Trong b\u00e0i test ResNet-50 v\u1ec1 Th\u1ecb gi\u00e1c m\u00e1y t\u00ednh, ch\u1ec9 \u0111\u01b0\u1ee3c x\u1eed l\u00fd b\u1edfi c\u00e1c GPU, ch\u00fang \u0111\u1ea1t ho\u00e0n to\u00e0n 100%.<\/p>\n<p>C\u1ea3 hai k\u1ebft qu\u1ea3 n\u00e0y ph\u1ea7n l\u1edbn nh\u1edd v\u00e0o k\u1ebft\u00a0<a href=\"https:\/\/www.nvidia.com\/en-au\/networking\/infiniband\/qm8700\/\">NVIDIA Quantum Infiniband<\/a>\u00a0Networking,\u00a0<a href=\"https:\/\/www.nvidia.com\/en-us\/networking\/ethernet-adapters\/\">NVIDIA ConnectX SmartNICs<\/a>\u00a0v\u00e0 ph\u1ea7n m\u1ec1m nh\u01b0\u00a0<a href=\"https:\/\/developer.nvidia.com\/gpudirect\">NVIDIA GPUDirect<\/a>.<\/p>\n<h2>Orin cho th\u1ea5y m\u1ee9c t\u0103ng g\u1ea5p 3.2 l\u1ea7n \u1edf bi\u00ean<\/h2>\n<p>M\u1ed9t c\u00e1ch ri\u00eang bi\u1ec7t, system-on-module NVIDIA Jetson AGX Orin mang l\u1ea1i m\u1ee9c t\u0103ng t\u1edbi 63% v\u1ec1 hi\u1ec7u su\u1ea5t n\u0103ng l\u01b0\u1ee3ng v\u00e0 81% v\u1ec1 hi\u1ec7u su\u1ea5t so v\u1edbi nh\u1eefng k\u1ebft qu\u1ea3 c\u1ee7a n\u00f3 m\u1ed9t n\u0103m tr\u01b0\u1edbc.\u00a0Jetson AGX Orin cung c\u1ea5p kh\u1ea3 n\u0103ng suy lu\u1eadn khi c\u1ea7n AI trong kh\u00f4ng gian h\u1ea1n ch\u1ebf \u1edf m\u1ee9c \u0111i\u1ec7n n\u0103ng th\u1ea5p, k\u1ec3 c\u1ea3 tr\u00ean c\u00e1c h\u1ec7 th\u1ed1ng ch\u1ea1y b\u1eb1ng pin.<\/p>\n<p><a href=\"https:\/\/blogs.nvidia.com\/wp-content\/uploads\/2023\/04\/Jetson-AGX-Orin-inference-performance-and-efficiency-scaled.jpg\"><img decoding=\"async\" src=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/04\/tgmc-blog-643f90402f06f.jpg\" \/><\/a><\/p>\n<p>\u0110\u1ed1i v\u1edbi c\u00e1c \u1ee9ng d\u1ee5ng c\u1ea7n c\u00e1c m\u00f4-\u0111un th\u1eadm ch\u00ed c\u00f2n nh\u1ecf h\u01a1n, ti\u00eau th\u1ee5 \u00edt \u0111i\u1ec7n n\u0103ng h\u01a1n, Jetson Orin NX 16G \u0111\u00e3 t\u1ecfa s\u00e1ng khi ra m\u1eaft trong c\u00e1c \u0111i\u1ec3m chu\u1ea9n.\u00a0N\u00f3 mang l\u1ea1i hi\u1ec7u su\u1ea5t g\u1ea5p t\u1edbi 3.2 l\u1ea7n so v\u1edbi b\u1ed9 x\u1eed l\u00fd Jetson Xavier NX th\u1ebf h\u1ec7 tr\u01b0\u1edbc.<\/p>\n<h2>H\u1ec7 sinh th\u00e1i NVIDIA AI r\u1ed9ng l\u1edbn<\/h2>\n<p>Nh\u1eefng k\u1ebft qu\u1ea3 MLPerf cho th\u1ea5y NVIDIA AI \u0111\u01b0\u1ee3c h\u1ed7 tr\u1ee3 b\u1edfi h\u1ec7 sinh th\u00e1i r\u1ed9ng nh\u1ea5t trong ng\u00e0nh v\u1ec1 H\u1ecdc m\u00e1y (Machine Learning).<\/p>\n<p>M\u01b0\u1eddi c\u00f4ng ty \u0111\u00e3 g\u1eedi nh\u1eefng k\u1ebft qu\u1ea3 tr\u00ean n\u1ec1n t\u1ea3ng NVIDIA trong v\u00f2ng n\u00e0y.\u00a0H\u1ecd \u0111\u1ebfn t\u1eeb d\u1ecbch v\u1ee5 cloud Microsoft Azure v\u00e0 c\u00e1c nh\u00e0 s\u1ea3n xu\u1ea5t h\u1ec7 th\u1ed1ng bao g\u1ed3m <a class=\"iblink\" href=\"\/asus\/\">ASUS<\/a>,\u00a0Dell Technologies, GIGABYTE, H3C,\u00a0Lenovo, Nettrix, <a class=\"iblink\" href=\"\/supermicro\/\">Supermicro<\/a> v\u00e0 xFusion.<\/p>\n<p>C\u00f4ng vi\u1ec7c c\u1ee7a h\u1ecd cho th\u1ea5y ng\u01b0\u1eddi d\u00f9ng c\u00f3 th\u1ec3 \u0111\u1ea1t \u0111\u01b0\u1ee3c hi\u1ec7u su\u1ea5t tuy\u1ec7t v\u1eddi v\u1edbi NVIDIA AI c\u1ea3 tr\u00ean cloud v\u00e0 trong c\u00e1c m\u00e1y ch\u1ee7 ch\u1ea1y trong trung t\u00e2m d\u1eef li\u1ec7u c\u1ee7a ri\u00eang h\u1ecd.<\/p>\n<p>C\u00e1c \u0111\u1ed1i t\u00e1c c\u1ee7a NVIDIA tham gia v\u00e0o MLPerf v\u00ec h\u1ecd bi\u1ebft \u0111\u00e2y l\u00e0 m\u1ed9t c\u00f4ng c\u1ee5 c\u00f3 gi\u00e1 tr\u1ecb \u0111\u1ec3 kh\u00e1ch h\u00e0ng \u0111\u00e1nh gi\u00e1 c\u00e1c nh\u00e0 cung c\u1ea5p v\u00e0 c\u00e1c n\u1ec1n t\u1ea3ng AI. Nh\u1eefng k\u1ebft qu\u1ea3 trong v\u00f2ng m\u1edbi nh\u1ea5t ch\u1ee9ng minh r\u1eb1ng hi\u1ec7u su\u1ea5t m\u00e0 h\u1ecd mang l\u1ea1i ng\u00e0y h\u00f4m nay s\u1ebd t\u0103ng l\u00ean c\u00f9ng v\u1edbi n\u1ec1n t\u1ea3ng NVIDIA.<\/p>\n<h2>Ng\u01b0\u1eddi d\u00f9ng c\u1ea7n hi\u1ec7u su\u1ea5t linh ho\u1ea1t<\/h2>\n<p>NVIDIA AI l\u00e0 n\u1ec1n t\u1ea3ng duy nh\u1ea5t ch\u1ea1y t\u1ea5t c\u1ea3 c\u00e1c k\u1ecbch b\u1ea3n v\u00e0 t\u1ea3i c\u00f4ng vi\u1ec7c suy lu\u1eadn MLPerf trong trung t\u00e2m d\u1eef li\u1ec7u v\u00e0 \u0111i\u1ec7n to\u00e1n bi\u00ean.\u00a0Hi\u1ec7u su\u1ea5t linh ho\u1ea1t v\u00e0 hi\u1ec7u qu\u1ea3 c\u1ee7a n\u00f3 gi\u00fap ng\u01b0\u1eddi d\u00f9ng tr\u1edf th\u00e0nh nh\u1eefng ng\u01b0\u1eddi chi\u1ebfn th\u1eafng th\u1ef1c s\u1ef1.<\/p>\n<p>C\u00e1c \u1ee9ng d\u1ee5ng trong th\u1ebf gi\u1edbi th\u1ef1c th\u01b0\u1eddng s\u1eed d\u1ee5ng nhi\u1ec1u lo\u1ea1i m\u1ea1ng n\u01a1-ron nh\u00e2n t\u1ea1o kh\u00e1c nhau, th\u01b0\u1eddng c\u1ea7n \u0111\u01b0a ra c\u00e2u tr\u1ea3 l\u1eddi trong th\u1eddi gian th\u1ef1c.<\/p>\n<p>V\u00ed d\u1ee5: m\u1ed9t \u1ee9ng d\u1ee5ng AI c\u00f3 th\u1ec3 c\u1ea7n hi\u1ec3u y\u00eau c\u1ea7u \u0111\u01b0\u1ee3c n\u00f3i c\u1ee7a ng\u01b0\u1eddi d\u00f9ng, ph\u00e2n lo\u1ea1i h\u00ecnh \u1ea3nh, \u0111\u01b0a ra \u0111\u1ec1 xu\u1ea5t v\u00e0 sau \u0111\u00f3 \u0111\u01b0a ra ph\u1ea3n h\u1ed3i d\u01b0\u1edbi d\u1ea1ng tin nh\u1eafn \u0111\u01b0\u1ee3c n\u00f3i b\u1eb1ng gi\u1ecdng n\u00f3i c\u1ee7a con ng\u01b0\u1eddi.\u00a0M\u1ed7i b\u01b0\u1edbc y\u00eau c\u1ea7u m\u1ed9t lo\u1ea1i m\u00f4 h\u00ecnh AI kh\u00e1c nhau.<\/p>\n<p>\u0110i\u1ec3m chu\u1ea9n MLPerf bao g\u1ed3m c\u00e1c workload AI n\u00e0y v\u00e0 m\u1ed9t s\u1ed1 workload ph\u1ed5 bi\u1ebfn kh\u00e1c.\u00a0\u0110\u00f3 l\u00e0 l\u00fd do t\u1ea1i sao c\u00e1c th\u1eed nghi\u1ec7m \u0111\u1ea3m b\u1ea3o nh\u1eefng ng\u01b0\u1eddi ra quy\u1ebft \u0111\u1ecbnh IT s\u1ebd nh\u1eadn \u0111\u01b0\u1ee3c hi\u1ec7u su\u1ea5t \u0111\u00e1ng tin c\u1eady v\u00e0 linh ho\u1ea1t \u0111\u1ec3 tri\u1ec3n khai.<\/p>\n<p>Ng\u01b0\u1eddi d\u00f9ng c\u00f3 th\u1ec3 d\u1ef1a v\u00e0o nh\u1eefng k\u1ebft qu\u1ea3 MLPerf \u0111\u1ec3 \u0111\u01b0a ra quy\u1ebft \u0111\u1ecbnh mua h\u00e0ng s\u00e1ng su\u1ed1t v\u00ec c\u00e1c b\u00e0i test \u0111\u1ec1u minh b\u1ea1ch v\u00e0 kh\u00e1ch quan.\u00a0C\u00e1c \u0111i\u1ec3m chu\u1ea9n nh\u1eadn \u0111\u01b0\u1ee3c s\u1ef1 h\u1ed7 tr\u1ee3 t\u1eeb m\u1ed9t nh\u00f3m r\u1ed9ng l\u1edbn bao g\u1ed3m Arm, Baidu, Facebook AI, Google, Harvard, Intel, Microsoft, Stanford v\u00e0 \u0110\u1ea1i h\u1ecdc Toronto.<\/p>\n<h2>Ph\u1ea7n m\u1ec1m b\u1ea1n c\u00f3 th\u1ec3 s\u1eed d\u1ee5ng<\/h2>\n<p>L\u1edbp ph\u1ea7n m\u1ec1m c\u1ee7a n\u1ec1n t\u1ea3ng NVIDIA AI,\u00a0<a href=\"https:\/\/www.nvidia.com\/en-us\/data-center\/products\/ai-enterprise\/\">NVIDIA AI Enterprise<\/a>, \u0111\u1ea3m b\u1ea3o ng\u01b0\u1eddi d\u00f9ng c\u00f3 \u0111\u01b0\u1ee3c hi\u1ec7u su\u1ea5t t\u1ed1i \u01b0u t\u1eeb c\u00e1c kho\u1ea3n \u0111\u1ea7u t\u01b0 c\u01a1 s\u1edf h\u1ea1 t\u1ea7ng c\u0169ng nh\u01b0 h\u1ed7 tr\u1ee3, b\u1ea3o m\u1eadt v\u00e0 \u0111\u1ed9 tin c\u1eady c\u1ea5p doanh nghi\u1ec7p c\u1ea7n thi\u1ebft \u0111\u1ec3 ch\u1ea1y AI trong trung t\u00e2m d\u1eef li\u1ec7u c\u1ee7a c\u00f4ng ty.<\/p>\n<p>T\u1ea5t c\u1ea3 ph\u1ea7n m\u1ec1m \u0111\u01b0\u1ee3c s\u1eed d\u1ee5ng cho c\u00e1c b\u00e0i test n\u00e0y \u0111\u1ec1u c\u00f3 s\u1eb5n t\u1eeb\u00a0<a href=\"https:\/\/github.com\/mlcommons\/inference_results_v3.0\">MLPerf repository<\/a>, v\u00ec v\u1eady b\u1ea5t k\u1ef3 ai c\u0169ng c\u00f3 th\u1ec3 nh\u1eadn \u0111\u01b0\u1ee3c nh\u1eefng k\u1ebft qu\u1ea3 \u0111\u1eb3ng c\u1ea5p th\u1ebf gi\u1edbi n\u00e0y.<\/p>\n<p>T\u1ed1i \u01b0u h\u00f3a li\u00ean t\u1ee5c \u0111\u01b0\u1ee3c \u0111\u1eb7t v\u00e0o c\u00e1c container c\u00f3 s\u1eb5n tr\u00ean\u00a0<a href=\"https:\/\/ngc.nvidia.com\/catalog\">NGC<\/a> &#8211; catalog c\u1ee7a NVIDIA d\u00e0nh cho ph\u1ea7n m\u1ec1m \u0111\u01b0\u1ee3c t\u0103ng t\u1ed1c b\u1edfi GPU.\u00a0Catalog n\u00e0y host\u00a0<a href=\"https:\/\/developer.nvidia.com\/tensorrt\">NVIDIA TensorRT<\/a>, \u0111\u01b0\u1ee3c s\u1eed d\u1ee5ng b\u1edfi m\u1ecdi l\u01b0\u1ee3t g\u1eedi trong v\u00f2ng n\u00e0y \u0111\u1ec3 t\u1ed1i \u01b0u h\u00f3a kh\u1ea3 n\u0103ng suy lu\u1eadn c\u1ee7a AI.<\/p>\n<p>\u0110\u1ecdc <a href=\"https:\/\/developer.nvidia.com\/blog\/?p=62958&amp;preview=1&amp;_ppp=80347d2303\">blog k\u1ef9 thu\u1eadt<\/a>\u00a0n\u00e0y\u00a0\u0111\u1ec3 t\u00ecm hi\u1ec3u s\u00e2u h\u01a1n v\u1ec1 c\u00e1c t\u1ed1i \u01b0u h\u00f3a th\u00fac \u0111\u1ea9y hi\u1ec7u su\u1ea5t v\u00e0 hi\u1ec7u qu\u1ea3 MLPerf c\u1ee7a NVIDIA.<\/p>\n<div>____<br \/><b>B\u00e0i vi\u1ebft li\u00ean quan<\/b><\/div>\n<ul>\n<li><a href=\"https:\/\/thegioimaychu.vn\/blog\/?post_type=post&#038;p=23415\">B\u01b0\u1edbc v\u00e0o k\u1ef7 nguy\u00ean tr\u1ee3 l\u00fd AI c\u00e1 nh\u00e2n &#8211; so s\u00e1nh chi ti\u1ebft NVIDIA RTX Spark v\u00e0 DGX Spark<\/a><\/li>\n<li><a href=\"https:\/\/thegioimaychu.vn\/blog\/?post_type=post&#038;p=23322\">NVIDIA RTX PRO 4500 Blackwell Server Edition: B\u01b0\u1edbc nh\u1ea3y v\u1ecdt t\u1eeb th\u1ebf h\u1ec7 L4 cho h\u1ea1 t\u1ea7ng AI suy lu\u1eadn hi\u1ec7u n\u0103ng cao<\/a><\/li>\n<li><a href=\"https:\/\/thegioimaychu.vn\/blog\/?post_type=post&#038;p=23119\">NVIDIA NGC\u2011ready Low\u2011latency Edge AI: Gi\u1ea3i ph\u00e1p cho Retail, Manufacturing v\u00e0 Smart Cities<\/a><\/li>\n<li><a href=\"https:\/\/thegioimaychu.vn\/blog\/?post_type=post&#038;p=23110\">So s\u00e1nh s\u1ee9c m\u1ea1nh c\u1ee7a m\u00e1y t\u00ednh AI DGX Spark v\u1edbi c\u00e1c card GPU m\u00e1y tr\u1ea1m chuy\u00ean nghi\u1ec7p c\u1ee7a NVIDIA<\/a><\/li>\n<li><a href=\"https:\/\/thegioimaychu.vn\/blog\/?post_type=post&#038;p=22969\">T\u1eeb Orin \u0111\u1ebfn Thor: B\u01b0\u1edbc nh\u1ea3y v\u1ecdt ki\u1ebfn tr\u00fac c\u1ee7a NVIDIA JetPack 7.0 v\u00e0 t\u01b0\u01a1ng lai c\u1ee7a robot h\u00ecnh ng\u01b0\u1eddi<\/a><\/li>\n<li><a href=\"https:\/\/thegioimaychu.vn\/blog\/?post_type=post&#038;p=22887\">T\u1ea1i sao g\u1ecdi NVIDIA DGX Spark l\u00e0 Si\u00eau m\u00e1y t\u00ednh AI c\u00e1 nh\u00e2n?<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>GPU NVIDIA H100 v&agrave; L4 &#273;&atilde; &#273;&#432;a AI t&#7841;o sinh (Generative AI) v&agrave; t&#7845;t c&#7843; c&aacute;c workload kh&aacute;c l&ecirc;n m&#7897;t c&#7845;p &#273;&#7897; m&#7899;i trong c&aacute;c b&agrave;i ki&#7875;m tra &#273;i&#7875;m benchmark MLPerf m&#7899;i nh&#7845;t, trong khi Jetson AGX Orin cho th&#7845;y m&#7913;c t&#259;ng hi&#7879;u su&#7845;t v&agrave; hi&#7879;u qu&#7843; x&#7917; l&yacute; &#273;&aacute;ng k&#7875;. MLPerf v&#7851;n l&agrave; ph&eacute;p&#8230;<\/p>\n","protected":false},"author":29,"featured_media":15699,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":""},"categories":[3],"tags":[1045,751,98,614,1074,1314],"class_list":["post-15692","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai-hpc","tag-generative-ai","tag-h100","tag-inference","tag-jetson","tag-l4","tag-nvidia"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.3 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>NVIDIA \u0111\u01b0a suy lu\u1eadn l\u00ean c\u1ea5p \u0111\u1ed9 m\u1edbi qua c\u00e1c b\u00e0i ki\u1ec3m tra MLPerf - Blog | TheGioiMayChu<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/nvidia-dua-suy-luan-len-cap-do-moi-qua-cac-bai-kiem-tra-mlperf-p15692\/\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:title\" content=\"NVIDIA \u0111\u01b0a suy lu\u1eadn l\u00ean c\u1ea5p \u0111\u1ed9 m\u1edbi qua c\u00e1c b\u00e0i ki\u1ec3m tra MLPerf - Blog | TheGioiMayChu\" \/>\n<meta name=\"twitter:description\" content=\"GPU NVIDIA H100 v&agrave; L4 &#273;&atilde; &#273;&#432;a AI t&#7841;o sinh (Generative AI) v&agrave; t&#7845;t c&#7843; c&aacute;c workload kh&aacute;c l&ecirc;n m&#7897;t c&#7845;p &#273;&#7897; m&#7899;i trong c&aacute;c b&agrave;i ki&#7875;m tra &#273;i&#7875;m benchmark MLPerf m&#7899;i nh&#7845;t, trong khi Jetson AGX Orin cho th&#7845;y m&#7913;c t&#259;ng hi&#7879;u su&#7845;t v&agrave; hi&#7879;u qu&#7843; x&#7917; l&yacute; &#273;&aacute;ng k&#7875;. MLPerf v&#7851;n l&agrave; ph&eacute;p...\" \/>\n<meta name=\"twitter:image\" content=\"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/04\/TheGioiMayChu-Blog-Image-latest-mlperf-tests.jpg\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"TGMC Blog\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"13 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/nvidia-dua-suy-luan-len-cap-do-moi-qua-cac-bai-kiem-tra-mlperf-p15692\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/nvidia-dua-suy-luan-len-cap-do-moi-qua-cac-bai-kiem-tra-mlperf-p15692\\\/\"},\"author\":{\"name\":\"TGMC Blog\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#\\\/schema\\\/person\\\/777f41403962330933a4fbcc80bec570\"},\"headline\":\"NVIDIA \u0111\u01b0a suy lu\u1eadn l\u00ean c\u1ea5p \u0111\u1ed9 m\u1edbi qua c\u00e1c b\u00e0i ki\u1ec3m tra MLPerf\",\"datePublished\":\"2023-04-20T09:17:11+00:00\",\"dateModified\":\"2023-06-09T07:36:47+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/nvidia-dua-suy-luan-len-cap-do-moi-qua-cac-bai-kiem-tra-mlperf-p15692\\\/\"},\"wordCount\":2524,\"publisher\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/nvidia-dua-suy-luan-len-cap-do-moi-qua-cac-bai-kiem-tra-mlperf-p15692\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/wp-content\\\/uploads\\\/2023\\\/04\\\/TheGioiMayChu-Blog-Image-latest-mlperf-tests.jpg\",\"keywords\":[\"generative AI\",\"H100\",\"inference\",\"jetson\",\"l4\",\"NVIDIA\"],\"articleSection\":[\"AI - HPC\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/nvidia-dua-suy-luan-len-cap-do-moi-qua-cac-bai-kiem-tra-mlperf-p15692\\\/\",\"url\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/nvidia-dua-suy-luan-len-cap-do-moi-qua-cac-bai-kiem-tra-mlperf-p15692\\\/\",\"name\":\"NVIDIA \u0111\u01b0a suy lu\u1eadn l\u00ean c\u1ea5p \u0111\u1ed9 m\u1edbi qua c\u00e1c b\u00e0i ki\u1ec3m tra MLPerf - Blog | TheGioiMayChu\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/nvidia-dua-suy-luan-len-cap-do-moi-qua-cac-bai-kiem-tra-mlperf-p15692\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/nvidia-dua-suy-luan-len-cap-do-moi-qua-cac-bai-kiem-tra-mlperf-p15692\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/wp-content\\\/uploads\\\/2023\\\/04\\\/TheGioiMayChu-Blog-Image-latest-mlperf-tests.jpg\",\"datePublished\":\"2023-04-20T09:17:11+00:00\",\"dateModified\":\"2023-06-09T07:36:47+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/nvidia-dua-suy-luan-len-cap-do-moi-qua-cac-bai-kiem-tra-mlperf-p15692\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/nvidia-dua-suy-luan-len-cap-do-moi-qua-cac-bai-kiem-tra-mlperf-p15692\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/nvidia-dua-suy-luan-len-cap-do-moi-qua-cac-bai-kiem-tra-mlperf-p15692\\\/#primaryimage\",\"url\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/wp-content\\\/uploads\\\/2023\\\/04\\\/TheGioiMayChu-Blog-Image-latest-mlperf-tests.jpg\",\"contentUrl\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/wp-content\\\/uploads\\\/2023\\\/04\\\/TheGioiMayChu-Blog-Image-latest-mlperf-tests.jpg\",\"width\":955,\"height\":508},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/ai-hpc\\\/nvidia-dua-suy-luan-len-cap-do-moi-qua-cac-bai-kiem-tra-mlperf-p15692\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Trang ch\u1ee7\",\"item\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"AI - HPC\",\"item\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/.\\\/ai-hpc\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"NVIDIA \u0111\u01b0a suy lu\u1eadn l\u00ean c\u1ea5p \u0111\u1ed9 m\u1edbi qua c\u00e1c b\u00e0i ki\u1ec3m tra MLPerf\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#website\",\"url\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/\",\"name\":\"Blog | TheGioiMayChu\",\"description\":\"C\u1eadp nh\u1eadt xu h\u01b0\u1edbng c\u00f4ng ngh\u1ec7 m\u00e1y ch\u1ee7\",\"publisher\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#organization\",\"name\":\"Blog | TheGioiMayChu\",\"url\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/wp-content\\\/uploads\\\/2018\\\/08\\\/cropped-ntcnlog-logo-2.png\",\"contentUrl\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/wp-content\\\/uploads\\\/2018\\\/08\\\/cropped-ntcnlog-logo-2.png\",\"width\":500,\"height\":73,\"caption\":\"Blog | TheGioiMayChu\"},\"image\":{\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/thegioimaychu\\\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/#\\\/schema\\\/person\\\/777f41403962330933a4fbcc80bec570\",\"name\":\"TGMC Blog\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/ff179df3aeac078da5e07e40f2e014e99ab4120e2276b687bbe7e6964d99655e?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/ff179df3aeac078da5e07e40f2e014e99ab4120e2276b687bbe7e6964d99655e?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/ff179df3aeac078da5e07e40f2e014e99ab4120e2276b687bbe7e6964d99655e?s=96&d=mm&r=g\",\"caption\":\"TGMC Blog\"},\"url\":\"https:\\\/\\\/thegioimaychu.vn\\\/blog\\\/author\\\/tgmc\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"NVIDIA \u0111\u01b0a suy lu\u1eadn l\u00ean c\u1ea5p \u0111\u1ed9 m\u1edbi qua c\u00e1c b\u00e0i ki\u1ec3m tra MLPerf - Blog | TheGioiMayChu","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/nvidia-dua-suy-luan-len-cap-do-moi-qua-cac-bai-kiem-tra-mlperf-p15692\/","twitter_card":"summary_large_image","twitter_title":"NVIDIA \u0111\u01b0a suy lu\u1eadn l\u00ean c\u1ea5p \u0111\u1ed9 m\u1edbi qua c\u00e1c b\u00e0i ki\u1ec3m tra MLPerf - Blog | TheGioiMayChu","twitter_description":"GPU NVIDIA H100 v&agrave; L4 &#273;&atilde; &#273;&#432;a AI t&#7841;o sinh (Generative AI) v&agrave; t&#7845;t c&#7843; c&aacute;c workload kh&aacute;c l&ecirc;n m&#7897;t c&#7845;p &#273;&#7897; m&#7899;i trong c&aacute;c b&agrave;i ki&#7875;m tra &#273;i&#7875;m benchmark MLPerf m&#7899;i nh&#7845;t, trong khi Jetson AGX Orin cho th&#7845;y m&#7913;c t&#259;ng hi&#7879;u su&#7845;t v&agrave; hi&#7879;u qu&#7843; x&#7917; l&yacute; &#273;&aacute;ng k&#7875;. MLPerf v&#7851;n l&agrave; ph&eacute;p...","twitter_image":"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/04\/TheGioiMayChu-Blog-Image-latest-mlperf-tests.jpg","twitter_misc":{"Written by":"TGMC Blog","Est. reading time":"13 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/nvidia-dua-suy-luan-len-cap-do-moi-qua-cac-bai-kiem-tra-mlperf-p15692\/#article","isPartOf":{"@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/nvidia-dua-suy-luan-len-cap-do-moi-qua-cac-bai-kiem-tra-mlperf-p15692\/"},"author":{"name":"TGMC Blog","@id":"https:\/\/thegioimaychu.vn\/blog\/#\/schema\/person\/777f41403962330933a4fbcc80bec570"},"headline":"NVIDIA \u0111\u01b0a suy lu\u1eadn l\u00ean c\u1ea5p \u0111\u1ed9 m\u1edbi qua c\u00e1c b\u00e0i ki\u1ec3m tra MLPerf","datePublished":"2023-04-20T09:17:11+00:00","dateModified":"2023-06-09T07:36:47+00:00","mainEntityOfPage":{"@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/nvidia-dua-suy-luan-len-cap-do-moi-qua-cac-bai-kiem-tra-mlperf-p15692\/"},"wordCount":2524,"publisher":{"@id":"https:\/\/thegioimaychu.vn\/blog\/#organization"},"image":{"@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/nvidia-dua-suy-luan-len-cap-do-moi-qua-cac-bai-kiem-tra-mlperf-p15692\/#primaryimage"},"thumbnailUrl":"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/04\/TheGioiMayChu-Blog-Image-latest-mlperf-tests.jpg","keywords":["generative AI","H100","inference","jetson","l4","NVIDIA"],"articleSection":["AI - HPC"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/nvidia-dua-suy-luan-len-cap-do-moi-qua-cac-bai-kiem-tra-mlperf-p15692\/","url":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/nvidia-dua-suy-luan-len-cap-do-moi-qua-cac-bai-kiem-tra-mlperf-p15692\/","name":"NVIDIA \u0111\u01b0a suy lu\u1eadn l\u00ean c\u1ea5p \u0111\u1ed9 m\u1edbi qua c\u00e1c b\u00e0i ki\u1ec3m tra MLPerf - Blog | TheGioiMayChu","isPartOf":{"@id":"https:\/\/thegioimaychu.vn\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/nvidia-dua-suy-luan-len-cap-do-moi-qua-cac-bai-kiem-tra-mlperf-p15692\/#primaryimage"},"image":{"@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/nvidia-dua-suy-luan-len-cap-do-moi-qua-cac-bai-kiem-tra-mlperf-p15692\/#primaryimage"},"thumbnailUrl":"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/04\/TheGioiMayChu-Blog-Image-latest-mlperf-tests.jpg","datePublished":"2023-04-20T09:17:11+00:00","dateModified":"2023-06-09T07:36:47+00:00","breadcrumb":{"@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/nvidia-dua-suy-luan-len-cap-do-moi-qua-cac-bai-kiem-tra-mlperf-p15692\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/nvidia-dua-suy-luan-len-cap-do-moi-qua-cac-bai-kiem-tra-mlperf-p15692\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/nvidia-dua-suy-luan-len-cap-do-moi-qua-cac-bai-kiem-tra-mlperf-p15692\/#primaryimage","url":"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/04\/TheGioiMayChu-Blog-Image-latest-mlperf-tests.jpg","contentUrl":"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2023\/04\/TheGioiMayChu-Blog-Image-latest-mlperf-tests.jpg","width":955,"height":508},{"@type":"BreadcrumbList","@id":"https:\/\/thegioimaychu.vn\/blog\/ai-hpc\/nvidia-dua-suy-luan-len-cap-do-moi-qua-cac-bai-kiem-tra-mlperf-p15692\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Trang ch\u1ee7","item":"https:\/\/thegioimaychu.vn\/blog\/"},{"@type":"ListItem","position":2,"name":"AI - HPC","item":"https:\/\/thegioimaychu.vn\/blog\/.\/ai-hpc\/"},{"@type":"ListItem","position":3,"name":"NVIDIA \u0111\u01b0a suy lu\u1eadn l\u00ean c\u1ea5p \u0111\u1ed9 m\u1edbi qua c\u00e1c b\u00e0i ki\u1ec3m tra MLPerf"}]},{"@type":"WebSite","@id":"https:\/\/thegioimaychu.vn\/blog\/#website","url":"https:\/\/thegioimaychu.vn\/blog\/","name":"Blog | TheGioiMayChu","description":"C\u1eadp nh\u1eadt xu h\u01b0\u1edbng c\u00f4ng ngh\u1ec7 m\u00e1y ch\u1ee7","publisher":{"@id":"https:\/\/thegioimaychu.vn\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/thegioimaychu.vn\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/thegioimaychu.vn\/blog\/#organization","name":"Blog | TheGioiMayChu","url":"https:\/\/thegioimaychu.vn\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/thegioimaychu.vn\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2018\/08\/cropped-ntcnlog-logo-2.png","contentUrl":"https:\/\/thegioimaychu.vn\/blog\/wp-content\/uploads\/2018\/08\/cropped-ntcnlog-logo-2.png","width":500,"height":73,"caption":"Blog | TheGioiMayChu"},"image":{"@id":"https:\/\/thegioimaychu.vn\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/thegioimaychu\/"]},{"@type":"Person","@id":"https:\/\/thegioimaychu.vn\/blog\/#\/schema\/person\/777f41403962330933a4fbcc80bec570","name":"TGMC Blog","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/ff179df3aeac078da5e07e40f2e014e99ab4120e2276b687bbe7e6964d99655e?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/ff179df3aeac078da5e07e40f2e014e99ab4120e2276b687bbe7e6964d99655e?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/ff179df3aeac078da5e07e40f2e014e99ab4120e2276b687bbe7e6964d99655e?s=96&d=mm&r=g","caption":"TGMC Blog"},"url":"https:\/\/thegioimaychu.vn\/blog\/author\/tgmc\/"}]}},"_links":{"self":[{"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/posts\/15692","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/users\/29"}],"replies":[{"embeddable":true,"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/comments?post=15692"}],"version-history":[{"count":6,"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/posts\/15692\/revisions"}],"predecessor-version":[{"id":15702,"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/posts\/15692\/revisions\/15702"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/media\/15699"}],"wp:attachment":[{"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/media?parent=15692"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/categories?post=15692"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/thegioimaychu.vn\/blog\/wp-json\/wp\/v2\/tags?post=15692"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}