C01:- Chatbot

                      Workflow of Chatbot

  • MySQL: For storing and managing user data.
  • Python: For implementing the core logic of the chatbot.
  • Large Language Model (LLM): For generating human-like responses.
  • Flask: For creating a web server that handles incoming requests.

    • Detailed Workflow:

    Step 1: User Query Handling

    1. User Question: The user asks a question through the chatbot interface.
    2. Flask Server: The Flask server receives the user's question.

    Step 2: Processing Query

    1. Query Processing: The Flask server processes the user’s question. Depending on the question, it might:
      • Directly fetch information from a pre-defined database (if needed).
      • Generate a prompt for the Large Language Model (e.g., Gemini).

    Step 3: Generating Responses

    1. Prompt Creation: The Flask server prepares a prompt that includes the user's question.
    2. LLM Invocation: The prompt is sent to the Large Language Model.
    3. Response Generation: The LLM processes the prompt and generates a response.

    Step 4: Sending Response

    1. Response Delivery: The Flask server receives the response from the LLM and sends it back to the user.


    Flow Diagram




    Comments

    Post a Comment

    Popular posts from this blog

    T02:- How to setup the Qualcomm Neural Processing SDK

    Image
        Setup of Qualcomm Neural Processing SDK We will now understand how we can setup the Qualcomm Neural Processing Engine SDK in our system   -> To start  with first thing we have to understand what is required for this setup.       1 . Oracle Virtual Box  https://www.virtualbox.org/wiki/Downloads       2 . Ubuntu 20.04   https://releases.ubuntu.com/focal/      We can also work with WSL2 environment that will work on Windows 10/11.       3 . Any Machine Learning Framework         3.1 Tensorflow         3.2 Pytorch         3.3 Tensorflow lite         3.4 Onnx       4 . Android NDK       5 . Microsoft Visual C++(Resdistrubution) So now we will go to the practical aspect of the setup of the Neural Processing SDK(SNPE). 1 .We will first download the Virtual box as per the requirement. ...
    Read more

    T01:- Introduction to Ondevice AI

    Image
                    Understanding Of On-device Ai Smart stuff like phones and cars are getting smarter . They can crunch data and learn without needing the internet all the time. Qualcomm is a big part of making this happens.                                       Fig - 1.1(On-device AI) So, What is On-device AI? On-device means smart devices like phones or smartwatches can work without need of constant internet connection. Its like having a live brain inside your gadgets, making quick decisions and performing task without the need of live servers. This technology is good for things like voice assistants and image recognition , as it reduces the latency and ensures privacy by keeping data local.                                           Fig- 1.2 ( ON-...
    Read more

    Integration Workflow of Ai engine sdk

    Image
                            Integration Workflow . Training and Inference workflow:- This diagram illustrates the difference between training a neural       network(done on server) and running inference(making predictions) on device. Training involves creating and optimizing a neural network model using large datasets, typically done off device. Inference is the process of using the trained model to make predictions or decisions based on new data which is usually done on device where the application runs. .Qualcomm AI engine Direct integration workflow:-  It details how to integrate trained deep learning(DL networks) into applications using Qualcomm AI engine SDK. It involves converting the trained model into format suitable  for execution on the Qualcomm chipsets and integrating them into applications. Now, lets connect these workflows with an explanation of the integration process. Integration WorkST...
    Read more