升級JetPack軟體,輝達增強Jetson Orin單板電腦平臺性能
<div class="field field-name-field-image field-type-image field-label-hidden"><div class="field-items"><div class="field-item even"><img src="https://s4.itho.me/sites/default/files/jetson_orin_for_2024_christmas-main.jpg" width="960" height="421" alt="" /></div></div></div><div class="field field-name-body field-type-text-with-summary field-label-hidden"><div class="field-items"><div class="field-item even"> <p>針對機器人與邊緣運算的人工智慧應用需求,Nvidia提供GPU單板電腦硬體平臺Jetson系列,以目前而言,主流產品是搭配Ampere架構GPU的Jetson Orin世代,分為三個位階,分別是:<a href="https://nvidianews.nvidia.com/news/nvidia-sets-path-for-future-of-edge-ai-and-autonomous-machines-with-new-jetson-agx-orin-robotics-computer">2021年11月登場</a>的<a href="https://www.ithome.com.tw/review/152418">Jetson AGX Orin</a>、<a href="https://developer.nvidia.com/blog/delivering-server-class-performance-at-the-edge-with-nvidia-jetson-orin/">2022年4月發表</a>的Jetson Orin NX,以及<a href="https://nvidianews.nvidia.com/news/nvidia-jetson-orin-nano-sets-new-standard-for-entry-level-edge-ai-and-robotics-with-80x-performance-leap">2022年9月推出</a>的<a href="https://www.ithome.com.tw/review/154773">Jetson Orin Nano</a>,<a href="https://nvidianews.nvidia.com/news/foundation-model-isaac-robotics-platform">下一代硬體平臺Jetson Thor</a>推出的消息,於2024年3月GTC大會首度公開揭露,預計將改用Blackwell架構GPU,而依照Nvidia網站現行公開的產品發展藍圖來看,Jetson Orin世代將會供應到2032年,Jetson Thor世代會在2025年開始提供,率先推出的產品會是Jetson AGX Thor。</p> <p><a href="https://s4.itho.me/sites/default/files/images/Jetson_modules-Commercial_roadmap-2024-10-23.jpg"><img alt="" src="https://s4.itho.me/sites/default/files/images/Jetson_modules-Commercial_roadmap-2024-10-23.jpg" style="width: 600px;" /></a></p> <p><a href="https://s4.itho.me/sites/default/files/images/Jetson-2024-03-timeline-Orin Generation.jpg"><img alt="" src="https://s4.itho.me/sites/default/files/images/Jetson-2024-03-timeline-Orin%20Generation.jpg" style="width: 298px;" /></a> <a href="https://s4.itho.me/sites/default/files/images/Jetson Orin Porfolio-web.jpg"><img alt="" src="https://s4.itho.me/sites/default/files/images/Jetson%20Orin%20Porfolio-web.jpg" style="width: 198px;" /></a></p> <p>而在2024年下半到2025年3月GTC大會之間,Nvidia突然在12月下半發表搭載Jetson Orin Nano Super平臺的開發者套件,名為Jetson Orin Nano Super Developer Kit。</p> <p>由於此時過完感恩節,接近一年一度的耶誕佳節,Nvidia再度上演新的科技產品廚房秀,執行長黃仁勳從另一間房屋廚房的烤爐端出全新的AI電腦,也就是Jetson Orin Nano Super Developer Kit,他幽默地說,因為烤太久所以縮水了,他也回憶多年前發展Xavier時(編按:應該是指Drive PX Xavier),Nvidia創造全新的處理器類型,可用於機器人的設置,他們那時想像深度學習模型可以不斷進化,之後可以產生各式各樣的機器人,時至今日,已出現有腿的、有輪子的,人形的機器人也即將來到大家身邊,黃仁勳隨後簡短介紹Jetson Orin Nano Super特點之後,也提到HGX這類AI伺服器能執行的處理,像是大型語言模型(LLM),以及統一運算架構(CUDA)、CUDA的深層神經網路cuDNN等,Jetson Orin Nano Super也能執行。</p> <p> </p> <div class="media_embed" height="315px" width="560px"> <iframe allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" allowfullscreen="" frameborder="0" height="315px" referrerpolicy="strict-origin-when-cross-origin" src="https://www.youtube.com/embed/S9L2WGf1KrM?si=OxwFPBhOr6vi4NJF" title="YouTube video player" width="560px"></iframe></div> <p> </p> <p>話雖如此,Nvidia Jetson產品線的應用場景仍偏重在機器人與邊緣運算,能處理的運算規模仍有別於資料中心等級的AI系統。</p> <p>令人好奇的是:先前Nvidia已經提供搭載Jetson Orin Nano的開發者套件,名稱多了Super的新產品有何差異?Nvidia在新聞稿當中強調,比起原本的Jetson Orin Nano,Jetson Orin Nano Super的生成式AI推論效能領先幅度可達70%,</p> <p><a href="https://s4.itho.me/sites/default/files/images/2024-12-17-Nvidia Jetson Orin Boost-AI-web.jpg"><img alt="" src="https://s4.itho.me/sites/default/files/images/2024-12-17-Nvidia%20Jetson%20Orin%20Boost-AI-web.jpg" style="width: 600px;" /></a></p> <p>原因在於INT8整數運算效能從40 TOPS提升至67 TOPS(改善幅度為67%),記憶體頻寬從68 GB/s增加至102 GB/s(改善幅度為50%);而在技術部落格文章當中,也列出更多細部差異,像是處理器的時脈從1.5 GHz提升至1.7 GHz,GPU時脈從635 MHz增加至1020 MHz,供電模式也從7瓦、15瓦,增加25瓦這一項組態。</p> <p><a href="https://s4.itho.me/sites/default/files/images/2024-12-17-Jetson Orin Nano Super Developer Kit configuration comparison.jpg"><img alt="" src="https://s4.itho.me/sites/default/files/images/2024-12-17-Jetson%20Orin%20Nano%20Super%20Developer%20Kit%20configuration%20comparison.jpg" style="width: 600px;" /></a></p> <p><a href="https://s4.itho.me/sites/default/files/images/NVIDIA Jetson Series Comparison-YOLO.jpg"><img alt="" src="https://s4.itho.me/sites/default/files/images/NVIDIA%20Jetson%20Series%20Comparison-YOLO.jpg" style="width: 600px;" /></a></p> <p>而且在效能調高之際,Nvidia這個開發者套件的價格卻從<a href="https://developer.nvidia.com/embedded/faq">499美元</a>降至249美元,等於打5折促銷,希望藉此招攬更多開發者採用的意味相當濃厚。</p> <p><a href="https://s4.itho.me/sites/default/files/images/Nvidia Jetson Price.jpg"><img alt="" src="https://s4.itho.me/sites/default/files/images/Nvidia%20Jetson%20Price.jpg" style="width: 298px;" /></a> <a href="https://s4.itho.me/sites/default/files/images/store-NVIDIA Jetson Orin Nano Super Developer Kit.jpg"><img alt="" src="https://s4.itho.me/sites/default/files/images/store-NVIDIA%20Jetson%20Orin%20Nano%20Super%20Developer%20Kit.jpg" style="width: 298px;" /></a></p> <p>隨著新的開發者套件上市,先前已購買Jetson Orin Nano Developer Kit的用戶也能受益,Nvidia表示,<a href="https://www.jetson-ai-lab.com/initial_setup_jon.html">透過軟體升級,</a>開發者就能將手上的Jetson Orin Nano Developer Kit,<a href="https://developer.nvidia.com/embedded/learn/get-started-jetson-orin-nano-devkit#maxn">轉為Jetson Orin Nano Super Developer Kit</a>。</p> <p>此處提到的軟體,是Nvidia專門用於<a href="https://developer.nvidia.com/embedded/jetpack">搭配Jetson硬體平臺的AI應用軟體開發套件JetPack</a>,而且是<a href="https://forums.developer.nvidia.com/t/jetpack-6-1-release-announcement/308181">9月底出爐的JetPack 6.1正式版</a>,因為此套件包含的一項元件Jetson Linux,在新改版的36.4版當中,開始支援稱為MAXN的加速模式,但關於這方面突破的消息,是直到12月17日Jetson Orin Nano Super推出,才正式浮上檯面。</p> <p><a href="https://s4.itho.me/sites/default/files/images/JetPack Stack.jpg"><img alt="" src="https://s4.itho.me/sites/default/files/images/JetPack%20Stack.jpg" style="width: 600px;" /></a></p> <p>Nvidia已釋出基於JetPack 6.1而成的SD記憶卡映像檔,用戶可透過Nvidia SDK Manager來進行安裝,之後即可在單板電腦執行的Ubuntu Desktop作業系統當中,<a href="https://developer.nvidia.com/blog/nvidia-jetson-orin-nano-developer-kit-gets-a-super-boost/">將電源使用模式(Power Mode)切換為MAXN</a>,即可享有此次新增的加速效能。</p> <p><a href="https://s4.itho.me/sites/default/files/images/2024-12-17-Nvidia Jetson Orin-power-mode-selection.png"><img alt="" src="https://s4.itho.me/sites/default/files/images/2024-12-17-Nvidia%20Jetson%20Orin-power-mode-selection.png" style="width: 200px;" /></a></p> <p>值得注意的是,Nvidia在Jetsont常見問答集的網頁當中,稱呼此項軟體改進特色為Jetson Orin Super Mode,並在這裡與新聞稿、技術部落格文章提到,「超頻模式」適用的單板電腦產品,不單是Jetson Orin Nano平臺,也涵蓋Jetson Orin NX平臺,Nvidia也針對4種產品(Jetson Orin Nano 4 GB與8 GB,以及Jetson Orin NX 8GB與16 GB),具體列出「超頻」前後差異。</p> <p><img alt="" src="https://s4.itho.me/sites/default/files/images/Jetson%20Orin%20Boost.jpg" style="width: 298px;" /> <a href="https://s4.itho.me/sites/default/files/images/2024-12-17-Table-5_-Jetson-Orin-Nano-Super-and-Orin-NX-Super-module-specifications-1.jpg"><img alt="" src="https://s4.itho.me/sites/default/files/images/2024-12-17-Table-5_-Jetson-Orin-Nano-Super-and-Orin-NX-Super-module-specifications-1.jpg" style="width: 298px;" /></a></p> <p><span style="color:#008080;"><strong>產品資訊</strong></span></p> <p><span style="color:#0000FF;"><strong>Nvidia Jetson Orin Nano Super Developer Kit</strong></span><br /> ●原廠:Nvidia<br /> ●建議售價:249美元<br /> ●外形尺寸:103公釐 x 90.5公釐 x 34.77公釐<br /> ●包含元件:Jetson Orin Nano 8GB模組與參考設計載板、直流電源供應器、Wi-Fi無線網路介面控制器(802.11ac/ab/gn)、快速上手指南<br /> ●單板電腦硬體規格:6核心Arm Cortex-A78AE、8GB LPDDR5-10200記憶體、Nvidia Volta架構GPU(1024個CUDA核心、32個Tensor Core核心)、可支援外部連接NVMe儲存裝置,耗電為7至25瓦<br /> ●參考設計載板提供的接頭:1個GbE埠、1個DisplatPort 1.2埠、2個MIPI CSI-2攝影機接頭、2個M.2 Key M、1個M.2 Key E、4個USB 3.2 Gen2 Type-A、1個USB Type-C for UFP、1個直流電源接頭</p> <p>【註:規格與價格由廠商提供,因時有異動,正確資訊請洽廠商】</p> </div></div></div>