CASA0022 - MSc CE Dissertation

Augmented Sensor: A location-based Augmented Reality app for monitoring outdoor IoT networks

This paper demonstrates the ability to build a location-based Augmented Reality mobile application for assisting IoT professionals to conduct daily inspections on outdoor sensors. The primary object of this study is to establish the prototype and test the usability to understand how well a location-based AR mobile application can help track outdoor IoT sensors’ contextual information.

🎨 Find the iOS application installation on Unity_ios_app (Please follow the How to install the App part)

🚀 Download the design of user interfaces built by Figma on User Interface

🦆 Check the demo video on Youtube link

🚗 Find the User Testing Instructions and User Testing Survey on User Testing

Features

• Welcome interface
• Register and login
  • Creating an account for use
• User instruction
  • Showing the functionalities of each button
• Map view
  • Displaying the locations of sensors and user
• AR notification
  • Notifying users are near a sensor and able to start the AR experience
• AR with digital representation
  • 3D digital representation of sensors
• Sensor data dashboard
  • Showing real-time sensor data
• Sensor status dashboard
  • Showing live sensor status
• Information dashboard
  • Showing project and sensor information
• Screenshot
  • Saving screenshot to Firebase and local file system.
• Adding a new sensor to the database
  • Saving new information to Firebase

User Flow

User Interfaces

User interfaces of Welcome page (left), Register page (middle), and Log in page (right)

User interfaces of User instruction (left), Main page (middle), Map view (right)

User interfaces of AR notification (left), Sensor data dashboard (middle), Sensor status dashboard (right)

User interfaces of Project information (left), Screenshot (middle), Adding new sensor (right)

System Architecture

Authentication

Map

AR and Digital Representation

Sensor data dashboard / Sensor status dashboard

Project and Sensor Information Dashboard

Screenshot

Add a new sensor to the database

How to install the App

Requirement

• Any iOS System (Suggestions: iPhone X and above)

Steps

1. Download Unity_ios_app folder in repository
2. Download Unity_ios_app_others from this link
3. Put Frameworks folder inside the downloaded Unity_ios_app folder
4. Put libil2cpp.a and libiPhone-lib.a inside Unity_ios_app -> Libraries
5. Put resources.assets.resS inside Unity_ios_app -> Data
6. Open Unity_ios_app -> Unity-iPhone.xcworkspace in Xcode
7. Run the applicaion on the ios devices

Packages and Libraries Used

• m2mqtt- https://github.com/eclipse/paho.mqtt.m2mqtt

• gltFast- https://github.com/atteneder/glTFast

• Firebase Authentication SDK- https://firebase.google.com/docs/auth

• Firebase Realtime Database- https://firebase.google.com/docs/database

• Firebase Storage- https://firebase.google.com/docs/storage

• Mapbox SDK- https://www.mapbox.com/unity

• Vuforia SDK- https://developer.vuforia.com/

• NativeGallery- https://github.com/yasirkula/UnityNativeGallery

• Scaniverse- https://scaniverse.com/

Contact Details