Building A Simple ARCore Demo With Augmented Faces

Introduction

 

In this article, I will explain the Google ARCore basics with augmented face examples.

 

ARCore

 

ARCore integrates the Android device camera and motion features to produce augmented reality experiences in your app or game. Augmented reality (AR) describes user experiences that add 2D or 3D elements to the live view from a device's camera, in a way that makes those elements appear to inhabit the real world. ARCore combines device motion tracking, camera scene capture, advanced scene processing, and display conveniences to simplify the task of building an AR experience. You can use these technologies to create many kinds of AR experiences using the back camera or front camera of an Android device.

 

Prerequisites

 

This article recommends that you should have a basic understanding of Android development, and the basics of the ARCore framework.

 

To test out your ARCore app, you will need one of Samsung's ARCore compatible devices, which are devices that have Samsung Gallaxy A8 processors & (Api Level = 26 ) or higher. Let's dive right into the following points below:

• Creating a New Project for ARCore apps
• Setting Up Google ARCore Scene View
• Connecting Google ARCore
• Configuring of AugmentedFace controller
• Allowing Camera Usage
• Adding 3D Facemask view
• Player Setting ARCore Scene

Creating a New Project

 

In the Xcode menu, select File > New > Project ... Choose Single View App and press next. Xcode has the ARCore template but actually, you can just use the Single View App template to build an AR app.

 

 

You can name your project whatever you want. I named my project world tracking demo, and pressed next to create a new project.

 

Setting Up Google ARCore Scene View

 

Now open up main.Assets. Drag the ARCore Scene view onto your view controller.

 

Connecting Google ARCore

 

On the Main.Google ARCore file, go up to the toolbar and open up the Assistant Editor. Add an import statement at the top of the HomeViewController.AugmentedFaces files to import ARCore.

 

Then, hold control and drag from the Google ARCore Scene View to the HomeViewContoller.AugmentedFaces file. When prompted, name the Google ARCore sceneView.

 

 

Configuration of AugmentedFaces Controller

 

Now it's time to configure the Google ARCore Scene View. Insert the following code into the AugmentedFaces Controller.

using System.Collections.Generic;
using GoogleARCore;
using UnityEngine;
using UnityEngine.UI;
public class AugmentedFacesExampleController: MonoBehaviour {
    public GameObject FaceAttachment;
    private bool m_IsQuitting = false;
    private List < AugmentedFace > m_TempAugmentedFaces = new List < AugmentedFace > ();
    public void Awake() {
        Application.targetFrameRate = 60;
    }
    public void Update() {
        _UpdateApplicationLifecycle();
        Session.GetTrackables < AugmentedFace > (m_TempAugmentedFaces, TrackableQueryFilter.All);
        if (m_TempAugmentedFaces.Count == 0) {
            Screen.sleepTimeout = SleepTimeout.SystemSetting;
            FaceAttachment.SetActive(false);
        } else {
            Screen.sleepTimeout = SleepTimeout.NeverSleep;
            FaceAttachment.SetActive(true);
        }
    }
    private void _UpdateApplicationLifecycle() {
        if (Input.GetKey(KeyCode.Escape)) {
            Application.Quit();
        }
        if (m_IsQuitting) {
            return;
        }
        if (Session.Status == SessionStatus.ErrorPermissionNotGranted) {
            _ShowAndroidToastMessage("Camera permission is needed to run this application.");
            m_IsQuitting = true;
            Invoke("_DoQuit", 0.5 f);
        } else if (Session.Status.IsError()) {
            _ShowAndroidToastMessage("ARCore encountered a problem connecting.  Please start the app again.");
            m_IsQuitting = true;
            Invoke("_DoQuit", 0.5 f);
        }
    }
    private void _DoQuit() {
        Application.Quit();
    }
    private void _ShowAndroidToastMessage(string message) {
        AndroidJavaClass unityPlayer = new AndroidJavaClass("com.unity3d.player.UnityPlayer");
        AndroidJavaObject unityActivity = unityPlayer.GetStatic < AndroidJavaObject > ("currentActivity");
        if (unityActivity != null) {
            AndroidJavaClass toastClass = new AndroidJavaClass("android.widget.Toast");
            unityActivity.Call("runOnUiThread", new AndroidJavaRunnable(() => {
                AndroidJavaObject toastObject = toastClass.CallStatic < AndroidJavaObject > ("makeText", unityActivity, message, 0);
                toastObject.Call("show");
            }));
        }
    }
  }
}

In the above viewDidLoad() method, we initialized an AR configuration called ARWorldTrackingConfiguration.This is a configuration for running world tracking. 

 

Allowing camera permission

 

Before we run our app, we need to get user permission that we will utilize their device's camera for augmented reality. So open up Info.plist. Select the ARCore Device. Drag the ARCamera for Camera Config filter. Set the value permission message.

 

 

Now you should be able to see your camera's view.

 

We have configured our sceneView's session to run the world tracking configuration.

 

Adding 3D AugmentedFacesView

 

We are going to add a 3D AugmentedFaces on the scene View, the code is shown below

 

 

Now add AugmentedFaces that is called from the viewdidLoad() AugmentedFace.

using System.Collections;
using System.Collections.Generic;
using UnityEngine;
using UnityEngine.SceneManagement;

public class menustart : MonoBehaviour
{
    public void ChangeSceneStratfacemask1(string sceneName)

    {
        Application.LoadLevel ("facemask1");
    }

}

Player Setting Google ARCore Scene

 

In the Xcode menu, select File > Build Settings > Player Setting ... Switch the platform and open XR Setting and select ARCore Supported.

 

 

Build and Run the app, and you will able to see a floating 3D augmented face.