High Level working of Qualcomm AI Engine SDK

   Working of AI Engine SDK 

Qualcomm AI Engine Directs works through something called "backends" which are basically software components that help the AI Engine communicate with different parts of the Qualcomm processors. 

These backends are often packaged as shared libraries, which are like bundles of code that can be easily used by other programs.

There are different types of backends each designed for a specific hardware accelerator core:


1.CPU backends:-It is for Snapdragon CPU.It helps AI Engine SDK works better with CPU.

2.DSP backends:-This one is for the Hexagon Dsp accelerator.It helps the AI  engine use the DSP efficiently.

3.GPU backends:- This is for the Adreno GPU.It helps the AI Engine utilize the GPU's power.

4.Htp backends :-This is for the Hexagon tensor processor. It helps the AI Engine communicate with the HTP.

5.HTA backends:- This one is for the Snapdragon Hta accelerator.

6.Lpai backends:- This one is for the Snapdragon Lpai accelerator.

7.Saver Backend:- This one captures AI operations for troubleshooting.

Each backend has its own library file(like libQnnCpu.so for CPU), and they have specific names based on the platform(like 'aarch64-android' or 'x86_64-linux-clang').These libraries help developers integrate AI functionality into their apps for different Qualcomm processors.

In essence, these backends make it easier for developers to optimise and run AI applications on Qualcomm processors by providing a bridge between the software and the hardware.


Comments

Post a Comment

Popular posts from this blog

T02:- How to setup the Qualcomm Neural Processing SDK

Image
    Setup of Qualcomm Neural Processing SDK We will now understand how we can setup the Qualcomm Neural Processing Engine SDK in our system   -> To start  with first thing we have to understand what is required for this setup.       1 . Oracle Virtual Box  https://www.virtualbox.org/wiki/Downloads       2 . Ubuntu 20.04   https://releases.ubuntu.com/focal/      We can also work with WSL2 environment that will work on Windows 10/11.       3 . Any Machine Learning Framework         3.1 Tensorflow         3.2 Pytorch         3.3 Tensorflow lite         3.4 Onnx       4 . Android NDK       5 . Microsoft Visual C++(Resdistrubution) So now we will go to the practical aspect of the setup of the Neural Processing SDK(SNPE). 1 .We will first download the Virtual box as per the requirement. ...
Read more

T01:- Introduction to Ondevice AI

Image
                Understanding Of On-device Ai Smart stuff like phones and cars are getting smarter . They can crunch data and learn without needing the internet all the time. Qualcomm is a big part of making this happens.                                       Fig - 1.1(On-device AI) So, What is On-device AI? On-device means smart devices like phones or smartwatches can work without need of constant internet connection. Its like having a live brain inside your gadgets, making quick decisions and performing task without the need of live servers. This technology is good for things like voice assistants and image recognition , as it reduces the latency and ensures privacy by keeping data local.                                           Fig- 1.2 ( ON-...
Read more

Integration Workflow of Ai engine sdk

Image
                        Integration Workflow . Training and Inference workflow:- This diagram illustrates the difference between training a neural       network(done on server) and running inference(making predictions) on device. Training involves creating and optimizing a neural network model using large datasets, typically done off device. Inference is the process of using the trained model to make predictions or decisions based on new data which is usually done on device where the application runs. .Qualcomm AI engine Direct integration workflow:-  It details how to integrate trained deep learning(DL networks) into applications using Qualcomm AI engine SDK. It involves converting the trained model into format suitable  for execution on the Qualcomm chipsets and integrating them into applications. Now, lets connect these workflows with an explanation of the integration process. Integration WorkST...
Read more