12.5 C
New York
Saturday, July 4, 2020
Home Reviews Nvidia Jetson Xavier NX review: Redefining GPU accelerated machine learning

Nvidia Jetson Xavier NX review: Redefining GPU accelerated machine learning

Nvidia launched the Jetson Xavier NX embedded System-on-Module (SoM) at the end of last year. It is pin-compatible with the Jetson Nano SoM and includes a CPU, a GPU, PMICs, DRAM, and flash storage. However, it was missing an important accessory, its own development kit. Since a SoM is an embedded board with just a row of connector pins, it is hard to use out-of-the-box. A development board connects all the pins on the module to ports like HDMI, Ethernet, and USB. A Jetson module combined with a development board looks similar to a Raspberry Pi or other Single Board Computers (SBC). But don’t be fooled this is no low-end, low-performance device.

Like the Jetson Nano, the Jetson Xavier NX developer kit is a machine learning platform; unlike the Jetson Nano, it isn’t an entry-level device. The Xavier is designed for applications that need some serious AI processing power.

Onboard of the SoM you get a hexa-core CPU using Nvidia’s custom Carmel ARM-based cores, a 384-core Volta-based GPU, and 8GB of LPDDR4x RAM @51.2 GB/s. The development board adds HDMI, DisplayPort, Gigabit Ethernet, 4x USB 3.1 ports, Wi-Fi, Bluetooth, 2x camera connectors, 40 GPIO pins, and an M.2 slot for an SSD!

NVIDIA Xavier NX development kit

The 8GB of RAM and support for M.2 NVMe makes this a significant upgrade to the Jetson Nano, but the real upgrade is in the processing power. Compared to the Jetson Nano, the Xavier NX is anywhere between two to seven times faster, depending on the application.

This is due to the improved CPU, hexa-core Nvidia Carmel (ARM v8.2 64-bit with 6 MB L2 + 4 MB L3 caches) upgraded from quad-core Cortex-A57; better GPU, 384-core Voltra compared to 128-core Maxwell; plus the inclusion of 48 tensor cores and two Deep Learning Accelerator (DLA) engines.

Read more: Artificial Intelligence vs Machine Learning: what’s the difference?

Nvidia’s Jetson modules are primarily designed for embedded applications, meaning the SoM will be embedded into a specific product. Anything from robots, drones, machine vision systems, high-resolution sensor arrays, video analytics, and autonomous machines can benefit from the machine learning performance, small form factor, and lower power requirements of the Xavier NX.

Nvidia’s primary aim is to sell the SoMs to device manufacturers. However, the development kit is essential for product design and development, and for anyone who wants to try advanced machine learning at home.

Performance and form factor are essential for embedded projects, but so is power usage. The Jetson Xavier NX delivers up to 21 Trillions Operations per Second (TOPS) while using up to 15 watts of power. When needed the board can be set into a 10W mode. Both power modes can be tweaked depending on how much CPU performance you need compared to the GPU performance. For example, you could run just two CPU cores at 1.9GHz and the GPU at 1.1GHz or alternatively you could use four CPU cores @1.2GHz and clock the GPU at 800Mhz. The level of control is exceptional.

NVIDIA Xavier NX development kit rear and heatsink

Tell me about the GPU

When you think of Nvidia you probably think about graphics cards and GPUs, and rightly so. While Graphic Processing Units are great for 3D gaming, it also turns out that they are good at running machine learning algorithms. Nvidia has a whole software eco-system based around its CUDA parallel computing and programming model. The CUDA toolkit gives you everything you need to develop GPU-accelerated applications and includes GPU-accelerated libraries, a compiler, development tools, and the CUDA runtime.

I was able to build Doom 3 for the Xavier NX and run it at 4K!

The Jetson Xavier NX has a 384 core GPU based on the Volta architecture. Each generation of GPU from Nvidia is based on a new microarchitecture design. This central design is then used to create different GPUs (with different core counts, and so on) for that generation. The Volta architecture is aimed at the datacenter and at AI applications. It can be found in PC graphic cards like the Nvidia Titan V.

Jetson Xavier NX running Doom 3 in a window

 

The potential for fast and smooth 3D games, like those based on the various 3D engines released under open source from ID software, is good. I was able to build Doom 3 for the Xavier NX and run it at 4K! At Ultra High Quality the board managed 41 fps. Not bad for 15 watts!

Nvidia has a universal software offering that covers all of its Jetson boards, including the Jetson Nano and the Jetson Xavier NX, called JetPack. It is based on Ubuntu Linux and comes pre-installed with the CUDA toolkit and other relevant GPU accelerated development packages like TensorRT and DeepStream. There is also a large collection of CUDA demos from smoke particle simulations to Mandelbrot rendering with a healthy dose of Gaussian blurs, jpeg encoding, and fog simulations along the way.

Read more: Jetson Nano review: Is it AI for the masses?

Make my machine learn

Having a good GPU for CUDA based computations and for gaming is nice, but the real power of the Jetson Nano is when you start using it for machine learning (or AI as the marketing people like to call it). Jetson Xavier NX supports all the popular AI frameworks including TensorFlow, PyTorch, MxNet, Keras, and Caffe.

NVIDIA Xavier NX development kit camera connection

All of Nvidia’s Jetson boards come with excellent documentation and example projects. Because they all use the same ecosystem and software (JetPack etc) then the examples work equally as well on the Jetson Nano or on the Jetson Xavier NX. A great place to start is the Hello AI World example.  It is simple to download and compile, and in just a few minutes, you will have an AI demo up and running for image classification, object detection, and semantic segmentation, all using pre-trained models.

I fished out a picture of a Jellyfish (pun intended) from my visit to the Monterey Bay Aquarium in 2018 and asked the image classifier to label it.

Why pre-trained? The hardest part about machine learning is getting to the point where you can present data to a model and get a result. Before that the model needs training, and training AI models is not a trivial effort. To help, Nvidia provides pre-trained models as well as a Transfer Learning ToolKit (TLT) which allows developers to take the pre-trained models and retrain them with their own data.

The Hello AI World demo gives you a set of tools to play around with including an image classifier, and an object detection program. These tools can either process photos or use a live camera feed. I fished out a picture of a Jellyfish (pun intended) from my visit to the Monterey Bay Aquarium in 2018 and asked the image classifier to label it.

jellyfish photo gary took output

But this is just the tip of the iceberg. To demonstrate the power of the Xavier NX board, Nvidia has a setup which shows the Xavier NX performing parallel machine learning tasks including gaze detection, pose detection, voice detection, and people detection, all at the same time from video feeds. A service robot in a retail environment would need all of these functions so it can tell when a person is looking at it (gaze detection), what the person is saying (voice detection), and where the person is pointing (pose detection).

nvidia xavier nx machine learning demo

The cloud has gone native

One of the core technologies of “the cloud” is containerization. The ability to run self-contained micro-services in a pre-defined environment. However this concept isn’t limited to huge servers in a data center, it can also be applied to smaller devices. Container software like Docker runs on Arm-based systems, including the Raspberry Pi and the Xavier NX.  The machine learning demo above is actually four separate containers running in parallel, on the development board.

This means that developers can move away from monolithic firmware images that include the base operating system along with the embedded applications and embrace micro-services and containers. Because the development of a self-contained service can be done without necessarily having to upgrade and update all the other applications then software updates become easier, and the options for scaling increase.

The Xavier NX fully supports Docker and the containers have full access to the machine learning capabilities of the board including the GPU, the tensor cores, and the DLA engines.

Jetson Xavier NX Ubuntu desktop

How fast is the Nvidia Jetson Xavier NX?

For those interested in some actual performance numbers. Using my “threadtesttool” (here on GitHub) with eight threads each calculating the first 12,500,000 primes, the Jetson Xavier was able to perform the test in 15 seconds. This compares to 46 seconds on the Jetson Nano and 92 seconds on a Raspberry Pi 4.

The tool can also test single-core performance by asking it use just one thread. That takes 10 seconds on the Jetson Xavier NX and 46 seconds on the Raspberry Pi 4. If you set the Xavier NX into its 2x core 15W mode, where the CPU clock speeds are higher, then performing the same test takes only seven seconds!

Here are some CUDA performance numbers comparing the Jetson Nano with the Jetson Xavier:

convolutionFFT2D (in secs) 15.1 8.4
fastWalshTransform (in secs) 12.2 3.5
matrixMul (in GFlop/s) 30.2 215.25
sortingNetworks 21.2 5.0

Even a cursory look at these numbers shows how much faster the Xavier NX is compared to the Nano.

When you factor in the support for a 4K display, 8GB of RAM, and the access to NVMe storage, the Xavier NX development board is a joy to use.

Any good for doing development work?

As an Arm development environment, the Jetson Nano is excellent. You get access to all the standard programming languages like C, C++, Python, Java, Javascript, Go, and Rust. Plus there are all the Nvidia libraries and SDKs, like CUDA, cuDNN, and TensorRT. You can even install IDEs like Microsoft Visual Code!

As I mentioned earlier, I was able to grab the software for the Doom 3 engine and build the game quite easily. Plus I was able to try different machine learning tools like PyTorch and Numba. When you factor in the support for a 4K display, 8GB of RAM, and the access to NVMe storage, the Xavier NX development board is a joy to use.

Jetson Xavier NX running Microsoft Visual Code

Is the Nvidia Jetson Xavier NX the right board for you?

If you are just starting with machine learning then the Xavier NX probably isn’t the right option for your first investment. You can learn the basics of ML and AI on just about anything including a Raspberry Pi. If you want to benefit from some hardware-based acceleration then the Jetson Nano is highly recommended.

NVIDIA Xavier NX development kit underside

But if you have outgrown the Jetson Nano, or you are are looking to build a professional product that requires greater processing power, then the Xavier NX is a must. Also, if you are just looking for a decent Arm-based development machine, for remote builds or as a desktop, then the Xavier NX is a potential winner.

The bottom line is this: if the Raspberry Pi 4 is good enough for you, stick with it. If you want better overall performance, hardware-accelerated machine learning, and a way into the Jetson ecosystem, then get a Jetson Nano. If you need more than that, then get an Xavier NX development kit.

Latest

Hoverwatch keylogger for Android

A keylogger Android application is basically any software or program that allows you to monitor or watch the keystrokes of someone else by recording these keystrokes while they use their Android smartphones. The application then allows you access to the recorded information. Since the whole point of a keylogger Android app is to be able to monitor someone without their knowledge, keylogger applications have enhanced features that ensure that the monitoring process is carried out in a stealthy manner. We shall go into full details of the features and particularly those of the Hoverwatch keylogger for Android later on in the article.When it comes to the legality of using hacking software programs such as the keylogger Android application, such programs are for one legal to own or possess. However, when a keylogger App is used for criminal purposes such as identity theft or stealing then the use of such application is illegal and thus punishable under federal law as well as state laws. It is an offense to secretly install a keylogger on another person’s phone.Using information that has been illicitly obtained from a keylogger application is also an offense on its own. It is however important to take note that in some states the surreptitious use of keylogger apps is legal and especially so in an employer-employee relationship.About the Hoverwatch keylogger Android applicationKeylogger programs can sound so intimidating particularly because a lot of computer lingua is associated with programs of this kind. It would not therefore come as a shock to wonder whether the use of a keylogger Android application and in this case Hoverwatch, requires any special knowledge whatsoever in the installation and use of such apps.If you have a similar question or doubts as to the same then the answer is simply that no special know how or skills is required for one to install and use Hoverwatch. Hoverwatch is a completely user-friendly application and just about anyone from a guru down to a lay man can make their way through the Hoverwatch app.Navigation through the Hoverwatch application is also particularly made easier with the step by step guide on the process of installation as well as use that is available in Hoverwatch.com website.There is so much ease with how you can get data from any Android phone with Hoverwatch keylogger for Android. All you have to do after installing Hoverwatch in any phone you would like to monitor is to log in to your Hoverwatch online account.This could be from any device and the result is that you will get access to all the information that has been recorded from the phone you are monitoring. And just like that you will have all the data without breaking a sweat. Isn’t that very easy?Now that some basic information about Hoverwatch has been established it is time to get into the details of some of the features that have been integrated into the Hoverwatch keylogger application for Android . These features include:The invisibility featureThis is the most essential feature of Hoverwatch keylogger Android App. This particular feature ensures that the Hoverwatch app stays hidden so that your monitoring activities stay hidden from those being monitored. This in turn means that accurate information is obtained and especially for parental control purposes.Tracking of text messages and callsWith this feature you can track all the outgoing as well as incoming calls and text messages. It also allows you to view any images sent via MMS from your personal Hoverwatch account.Geolocation featureThe specialty of this feature is in physical tracking; that is, you can get the geographical location of the monitored Android device just from your account.SIM card replacementThe SIM replacement feature proves helpful by allowing you to still be able to monitor an Android device even after a SIM card is replaced or even removed by the user of the monitored device.Whatsapp, Facebook and viber trackingConversations held through these mobile applications including all the images, videos and audios shared are recorded and made accessible to your online account thanks to this feature.Tracking of up to five devicesAn installation of the Hoverwatch parental control gives you the opportunity to monitor a maximum of five devices.Other features of the Hoverwatch keylogger app include;Front camera photoSnapchat spyContacts trackingAndroid screenshotsTodo list trackingPhone internet history trackingSupport and pricing policy of the Hoverwatch keylogger Android applicationThe Hoverwatch support application provided for in the Hoverwatch website goes a long way in promoting the user friendliness of both the website and the app. Here is where the step by step guide on the installation process for the Hoverwatch keylogger Android app is contained.It is also at this section that any inquiries from the users can be made. Removal instructions are also contained in this section in the event someone would like to uninstall the Hoverwatch application.The pricing policy of the Hoverwatch keylogger Android application is categorized into three plans that is; the personal, business as well as professional plans. Each of these plans then has subcategories of a one month plan, three months plan and lastly a twelve months plan. It is absolutely up to each individual user to evaluate and choose a plan that best suits them.In conclusion, knowing the activities and whereabouts of our loved ones is very vital if at all we are to ensure that they are safe and protected at all times. One way of doing this is through keylogger Android applications such as Hoverwatch.Great care should however be exercised by users in terms of understanding the scope of the privacy laws in one’s state. Use of the Hoverwatch app for ulterior motives should be refrained and if not the liability of such use falls entirely on the user. If you are searching for a keylogger app for Android then you should definitely give the Hoverwatch keylogger Android application a try.

10 can’t-miss deals for the Fourth of July weekend

Believe it or not, the first half of 2020 is finally over. It’s July and we’re ready to tackle the rest of the year. It’s time for hot days and hotter deals.The 4th of July is the perfect time to save on new gadgets, gear, and gizmos. If you’re on the hunt to pick up something new for yourself, a loved one, or a friend, consider the following offers.While these deals are already worth your attention, we’re here to sweeten things up even more. For a limited time you can save an extra 15% on your purchase by entering coupon code JULYFOURTH15 at checkout on purchases of $50 or more.Jam Audio Tune In Neckband Style Bluetooth HeadphonesDon’t change the channel — Tune In’s ergonomically designed collar rests on your neck for up to 12 hours of playtime. These earphones let you play music from your device via Bluetooth technology. Use it during workouts, jogging, or commute. The neckband style makes sure that you won’t lose your earphones no matter what you do. $30MOZA Mini-Mi Wireless Charging Smartphone GimbalCapable of stabilizing your phone for stunningly smooth shots, gimbals are already pretty impressive, but the MOZA Mini-MI goes one step further. Engineered with wireless charging tech, this smartphone gimbal keeps your device energized while you record. $95VILTA-M Pro 3-Axis Handheld Smartphone Stabilizer GimbalTake your video shoots to the next level with this VILTA-M Pro 3-Axis Handheld Smartphone Stabilizer Gimbal. Made for creative, adventurous production, the VILTA-M Pro features various focus and zoom settings choices for cinematic quality footage. $119Robo 360° Rotation Smart AI Object Tracking GimbalThe Robo Smart Gimbal lets you film yourself totally hands-free. Using AI technology, Robo automatically recognizes your face and follows you wherever you go. It proceeds to intelligent shooting with infinite 360° rotation — once your face is detected, it starts taking pictures or videos automatically. $40LOFT Battery Base for Google HomeGoogle Home has great voice-controlled features and quality audio but falls short when it comes to portability, as it must remain plugged-in to work. LOFT is a portable battery base that solves this problem by making Google Home cordless, thus portable, so you can move your device from room to room with ease. $17JOT Battery Base for Google Home MiniThe JOT is a portable, battery base for your Google Home Mini designed to provide rechargeable, cord-free mobility at your fingertips. Simply nest the Google Home Mini securely into JOT to untether and enjoy cordless use anywhere in your home. $17datAshur PRO² 256-bit Encrypted USB 3.2 Flash DriveWe usually use flash drives for on-the-go storing and transferring of files whether for school, work, or business. But sometimes these very ordinary drives are prone to malware as well as easy targets to hacking. Never compromise your data again! datAshur® PRO² is a fully-encrypted flash drive that gives advanced security to your portable data. $80CleanTray UV Light Sterilization CaseLet’s face it. Your phone and other daily items are 10 times dirtier than most toilet seats…and you touch it about 47 times a day. Get rid of all the nasties with this CleanTray UV Light Sterilization Case. Using 4 UV-C LED lights, this case kills 99.99% of germs and bacteria in just 5 minutes — 2 times faster than other UV devices. $70Bluetooth Smart WatchAdd some intelligence to your everyday accessories with this sleek, modern smartwatch. Just add in your own SIM card, and this watch allows you to make phone calls, send text messages and much more right from your wrist. It’s also optimized as a fitness watch with a pedometer, calorie calculator, distance meter, and more integrated into the watch. $30BENTOSTACK POWERHUB 5000Less is more. The BentoStack PowerHub 5000 is a compact accessory organizer combining a charge cover, Type-C hub, and a storage compartment, all in one minimalistic stackable case. $100

These cases will keep your Moto E (2020) looking fantastic for a long time

For years, the Moto E has been a fan-favorite for offering a decent smartphone experience for just a fraction of

How to watch Juventus vs. Torino live stream from anywhere

Torino make the short journey across Turin to the Juventus Stadium today for the Derby della Mole. Don't miss a