ar-poster2-scaled

Monitoring Sensor’s Data in the Air using Augmented Reality

by
ESP32 ProjectsIoT Projects

We at techiesms studios, running a Series called AR with IoT and this is the fourth episode of that series. So till now we were easily able to control our Home Appliances over internet using Augmented Reality and Internet Of Things both using touch screen buttons and virtual buttons.

Now in this episode, we will try to read data from server and display that data in the Air using Augmented Reality.

Components Required

For Hardware part of the project you’ll need 

  • ESP32 / NodeMCU board
  • DHT11 Sensor

For Software part you’ll need 

  • Blynk App
  • Unity Hub

Hardware Connection Diagram

IoT part of the project 

For the IoT part, I have used Blynk IoT Platform. In which, I just made a simple blynk project of displaying Temperature and Humidity data using Gauge widget. Here the temperature data is stored in virtual pin V0 and humidity data is stored in virtual pin V1

After that, we have made a code in which, the temperature data from DHT11 sensors gets pushed to virtual pin V0 and Humidity data is pushed to Virtual pin V1. You can copy and paste the code from below, just change the SSID name, Password and Blynk Auth token. 

/*************************************************************
  Download latest Blynk library here:
    https://github.com/blynkkk/blynk-library/releases/latest

  Blynk is a platform with iOS and Android apps to control
  Arduino, Raspberry Pi and the likes over the Internet.
  You can easily build graphic interfaces for all your
  projects by simply dragging and dropping widgets.

    Downloads, docs, tutorials: http://www.blynk.cc
    Sketch generator:           http://examples.blynk.cc
    Blynk community:            http://community.blynk.cc
    Follow us:                  http://www.fb.com/blynkapp
                                

  Blynk library is licensed under MIT license
  This example code is in public domain.

 *************************************************************

  This example shows how value can be pushed from Arduino to
  the Blynk App.

  WARNING :
  For this example you'll need Adafruit DHT sensor libraries:
    https://github.com/adafruit/Adafruit_Sensor
    https://github.com/adafruit/DHT-sensor-library

  App project setup:
    Value Display widget attached to V5
    Value Display widget attached to V6
 *************************************************************/

/* Comment this out to disable prints and save space */
#define BLYNK_PRINT Serial

/* Fill-in your Template ID (only if using Blynk.Cloud) */
//#define BLYNK_TEMPLATE_ID   "YourTemplateID"

#include <WiFi.h>
#include <WiFiClient.h>
#include <BlynkSimpleEsp32.h>
#include <DHT.h>

// You should get Auth Token in the Blynk App.
// Go to the Project Settings (nut icon).
char auth[] = "YourAuthToken";

// Your WiFi credentials.
// Set password to "" for open networks.
char ssid[] = "YourNetworkName";
char pass[] = "YourPassword";

#define DHTPIN 2          // What digital pin we're connected to

// Uncomment whatever type you're using!
#define DHTTYPE DHT11     // DHT 11
//#define DHTTYPE DHT22   // DHT 22, AM2302, AM2321
//#define DHTTYPE DHT21   // DHT 21, AM2301

DHT dht(DHTPIN, DHTTYPE);
BlynkTimer timer;

// This function sends Arduino's up time every second to Virtual Pin (5).
// In the app, Widget's reading frequency should be set to PUSH. This means
// that you define how often to send data to Blynk App.
void sendSensor()
{
  float h = dht.readHumidity();
  float t = dht.readTemperature(); // or dht.readTemperature(true) for Fahrenheit

  if (isnan(h) || isnan(t)) {
    Serial.println("Failed to read from DHT sensor!");
    return;
  }
  // You can send any value at any time.
  // Please don't send more that 10 values per second.
  Blynk.virtualWrite(V1, h);
  Blynk.virtualWrite(V0, t);
}

void setup()
{
  // Debug console
  Serial.begin(9600);

  Blynk.begin(auth, ssid, pass);

  dht.begin();

  // Setup a function to be called every second
  timer.setInterval(1000L, sendSensor);
}

void loop()
{
  Blynk.run();
  timer.run();
}

Till this step, we will be easily able to monitor sensor’s data on the Blynk App. But we want to monitor that using API so that later on we can integrate it with AR. And the good news is that, Blynk do provide us APIs. 

So to get the data to virtual pin of our blynk device, the format of API is something like this.

http://blynk-cloud.com/auth_token/get/pin

For example, If I want to read data from virtual pin ‘V1’ of my blynk project, the API will be like this,

http://blynk-cloud.com/MY_AUTH_TOKEN/get/V1

So with this, we have successfully covered the IoT part of our project. Now let’s jump on to the AR part. 

AR part of project 

For AR, we will be using Unity Hub software on our computer. Just goto this link and download unity hub

While Setting up unity, you’ll need four things, one is the target image, second is Button Image, third is Template Image and fourth is C# Script. All the things are provided below, so you can easily download and use them

Target Image
Button Image
Template Image
using System.Collections;
using UnityEngine;
using UnityEngine.UI;
using UnityEngine.Networking;
using Vuforia;

public class click : MonoBehaviour
{
    InputField field;
    InputField Hum;
    public VirtualButtonBehaviour Vb_on;
 
    void Start()
    {
        field = GameObject.Find("TextInputField").GetComponent<InputField>();
        
        Hum = GameObject.Find("InputField1").GetComponent<InputField>();

        Vb_on.RegisterOnButtonPressed(OnButtonPressed_on);
        // GameObject.Find("GetButton").GetComponent<Button>().onClick.AddListener(GetData);
    }

    public void OnButtonPressed_on(VirtualButtonBehaviour Vb_on)
    {
        GetData_tem();
        GetData_hum();
        Debug.Log("Click");
    }
 
    void GetData_tem() => StartCoroutine(GetData_Coroutine1());
    void GetData_hum() => StartCoroutine(GetData_Coroutine());
 
    IEnumerator GetData_Coroutine1()
    {
        Debug.Log("Getting Data");
        field.text = "Loading...";
        string uri = "http://blynk-cloud.com/vKqIp55UdG2GoZcvY3un4sPyQpoxgnG3/get/v0";
        using(UnityWebRequest request = UnityWebRequest.Get(uri))
        {
            yield return request.SendWebRequest();
            if (request.isNetworkError || request.isHttpError)
                field.text = request.error;
            else
            {

                field.text = request.downloadHandler.text;
                field.text = field.text.Substring(2,2);
            }
        }
    }
    IEnumerator GetData_Coroutine()
    {
        Debug.Log("Getting Data");
        Hum.text = "Loading...";
        string uri = "http://blynk-cloud.com/vKqIp55UdG2GoZcvY3un4sPyQpoxgnG3/get/v1";
        using(UnityWebRequest request = UnityWebRequest.Get(uri))
        {
            yield return request.SendWebRequest();
            if (request.isNetworkError || request.isHttpError)
                Hum.text = request.error;
            else
            {

                Hum.text = request.downloadHandler.text;
                Hum.text = Hum.text.Substring(2,2);
            }
        }
    }
}

You need to save this code with the name, Click.cs

Full Tutorial 

We have prepared a full detailed tutorial video for AR+IOT which is uploaded on YouTube. So in case you want to understand it in more clear manner, I’ll suggest you to go through this video and do let me know your feedback in comment section.

92 Responses

  6. how much coffee for 8 cups

    Hi! I could have sworn I’ve been to this web site before but after looking at some of the posts I realized it’s new to me.
    Nonetheless, I’m definitely delighted I discovered it and I’ll be book-marking it
    and checking back frequently!

    https://3dprintinghq.blogspot.com/

    https://manuallawnaerator.blogspot.com/

    https://privatejet2charter.blogspot.com/

    https://thedailyheadgear.blogspot.com/

    https://soapmakingrecipes.blogspot.com/

    https://best-hunting-tips.blogspot.com/

    https://netracecar.blogspot.com/

    https://techcamping.blogspot.com/

    <a https://best-decaf-how much coffee for 8 cupshow much coffee for 8 cups.blogspot.com/

  8. ?????

    I am curious to find out what blog system you are working with? I’m having some small security issues with my latest blog and I’d like to find something more risk-free. Do you have any solutions?

  20. Homer Buccieri

    I haven’t checked in here for a while as I thought it was getting boring, but the last few posts are great quality so I guess I will add you back to my everyday bloglist. You deserve it my friend 🙂

  27. may xong khi dung

    What’s Happening i am new to this, I stumbled upon this I have discovered It absolutely helpful and it has helpedme out loads. I’m hoping to give a contribution & assist othercustomers like its helped me. Good job.

  31. graliontorile

    I love your blog.. very nice colors & theme. Did you create this website yourself? Plz reply back as I’m looking to create my own blog and would like to know wheere u got this from. thanks

  33. more info

    Hey! I could have sworn I’ve been to this blog before but after browsing through someof the post I realized it’s new to me. Nonetheless, I’m definitely delightedI found it and I’ll be bookmarking and checking back frequently!服装 soho 外贸公司

  34. Visit Our Website

    Thanks , I’ve recently been searching for info about this subject for a while and yours is the best I have discovered so far. However, what concerning the conclusion? Are you sure in regards to the source?

  37. https://biggu.id

    Hi, I do think this is an excellent web site. I stumbledupon it 😉 I am going to come back once again since I saved as a favorite it. Money and freedom is the best way to change, may you be rich and continue to help others.

  40. may loc khi panasonic

    Normally I do not read post on blogs, however I would like to say that this write-up very forced me to check out and do it! Your writing style has been surprised me. Thank you, quite nice article.

  41. cau nang rua xe o to

    Thanks for the auspicious writeup. It actually was a amusement account it.Glance complex to more introduced agreeable from you!By the way, how could we be in contact?Feel free to visit my blog post; hemp seed contains

  44. journaling

    Hi there! This article could not be written any better!Looking through this article reminds me of my previous roommate!He continually kept talking about this. I will send this post to him.Pretty sure he will have a good read. Thank you for sharing!

  45. zoritoler imol

    Thanks a bunch for sharing this with all of us you really know what you’re talking about! Bookmarked. Please also visit my web site =). We could have a link exchange contract between us!

  50. TrudeyKaet

    how to develop critical thinking skills
    [url=”https://criticalthinking2020.net”]critical thinking exercises for kids[/url]
    flaschcards on six rules of critical thinking

  60. Kevinsic

    Песков: боевые действия прекратятся, если Киев прикажет националистам сложить оружие
    Бизнесмен Михальченко получил 20 лет за хищения при строительстве резиденции Путина
    Польша потребует компенсацию от «Газпрома» за остановку поставок газа
    Минобороны: ВКС России ударили по оружейным ангарам в Кременчуге
    как найти зеркало Омг

    [url=https://xn—-7sbkzejnta4h.com/]Омг рабочее зеркало на сегодня[/url]

  61. Aaronchogs

    Песков: боевые действия прекратятся, если Киев прикажет националистам сложить оружие
    Бизнесмен Михальченко получил 20 лет за хищения при строительстве резиденции Путина
    Польша потребует компенсацию от «Газпрома» за остановку поставок газа
    Минобороны: ВКС России ударили по оружейным ангарам в Кременчуге
    как найти ссылку на Омг

    [url=https://xn—-7sbkzejnta4h.com/]Вход на Омг[/url]

  62. Patrickhew

    Песков: боевые действия прекратятся, если Киев прикажет националистам сложить оружие
    Бизнесмен Михальченко получил 20 лет за хищения при строительстве резиденции Путина
    Польша потребует компенсацию от «Газпрома» за остановку поставок газа
    Минобороны: ВКС России ударили по оружейным ангарам в Кременчуге
    Омг ссылка зеркало рабочее

    [url=https://xn—-7sbkzejnta4h.com/]ссылка на Омг через браузер[/url]

  63. Charlesbeits

    Песков: боевые действия прекратятся, если Киев прикажет националистам сложить оружие
    Бизнесмен Михальченко получил 20 лет за хищения при строительстве резиденции Путина
    Польша потребует компенсацию от «Газпрома» за остановку поставок газа
    Минобороны: ВКС России ударили по оружейным ангарам в Кременчуге
    Омг ссылка на сайт зеркало

    [url=https://xn—-7sbkzejnta4h.com/]Омг магазин[/url]

  82. AudreKaet

    nursing dissertation help
    [url=”https://writing-a-dissertation.net”]medical dissertation writing services[/url]
    cheap dissertation help in los angeles

Add a Comment

Your email address will not be published. Required fields are marked *