rAbout ARCore XR PluginUse the ARCore XR Plugin package to enable ARCore support via Unity's multi-platform XR API. This package implements the following XR Subsystems:SessionCameraDepthInputPlanesRaycastAnchorsFace trackingImage trackingEnvironment probesThis version of ARCore XR Plugin uses ARCore 1.17 and supports the following functionality:Device localizationHorizontal plane detectionVertical plane detectionPoint cloudsPass-through camera viewLight estimationAnchorsOriented feature pointsHit testingSession managementARCore APK on-demand installationImage trackingFace trackingEnvironment probesIt doesn't support the following subsystems:Object trackingParticipantInstalling ARCore XR PluginTo install this package, follow the instructions in the Package Manager documentation.In addition, install the AR Foundation package, which uses ARCore XR Plugin and provides many useful scripts and prefabs. For more information about this package, see the AR Foundation documentation.Using ARCore XR PluginThe ARCore XR Plugin implements the native endpoints required for building Handheld AR apps targeting Google’s ARCore platform using Unity's multi-platform XR API. However, this package doesn't expose any public scripting interface of its own. In most cases, you should use the scripts, prefabs, and assets provided by AR Foundation as the basis for your Handheld AR apps.Including the ARCore XR Plugin also includes source files, static libraries, shader files, and plug-in metadata.Build SettingsYou can flag ARCore XR Plugin as either required or optional.If ARCore is optional, the Play Store lets users install your app on devices that don't support ARCore, or that support ARCore but don't have it installed. This is useful if you want to provide different alternatives depending on whether AR is available.AR is required by default.To create an ARCoreSettings Asset and assign it to your build settings, open the Project Settings window (from Unity's main menu, go to Edit > Project Settings), then navigate to XR > ARCore, as shown in the screenshot below:Note: If ARCore is required, the availability check will always report that ARCore is supported, even on unsupported devices. This is because the Play Store prevents the installation of apps that require ARCore on unsupported devices, so these apps always assume they're running on a supported device. However, if you install an Android APK onto an unsupported device via USB (called "side loading") or via Unity, the unsupported device will report that ARCore is supported.SessionARCore implements XRSessionSubsystem.GetAvailabilityAsync. The list of devices ARCore supports is frequently updated to include additional devices. If ARCore isn't already installed on a device, your app needs to check with the Play Store to see if there's a version of ARCore that supports that device. GetAvailabilityAsync returns a Promise which can be used in a coroutine. For ARCore, this check may take some time.If the device is supported, but ARCore is not installed (or requires an update), you need to call XRSessionSubsystem.InstallAsync, which also returns a Promise.For more information, see the ARSubsystems session documentation.Depth subsystemRaycasts always return a Pose for the item the raycast hit. When raycasting against feature points, the pose is oriented to provide an estimate for the surface the feature point might represent.The depth subsystem doesn't require additional resources, so enabling it doesn't affect performanceARCore's depth subsystem will only ever produce a single XRPointCloud.For more information, see the ARSubsystems depth subsystem documentation.Plane trackingARCore supports plane subsumption (that is, one plane can be included in another). When this happens, the subsumed plane isn't removed, but won't be updated any further.ARCore provides boundary points for all its planes.The ARCore plane subsystem requires additional CPU resources and can be energy-intensive. Enabling both horizontal and vertical plane detection requires additional resources. Consider disabling plane detection when your app doesn't need it to save energy.Setting the plane detection mode to PlaneDetectionMode.None is equivalent to Stopping subsystem.For more information, see the ARSubsystems plane subsystem documentation.Image trackingTo use image tracking on ARCore, you must first create a reference image library. To learn how to do this, see the AR Subsystems documentation on image tracking.When building the Player for Android, each reference image library is used to generate a corresponding imgdb file, which is how ARCore represents reference image libraries. These files are placed in your project's StreamingAssets folder, in a subdirectory called HiddenARCore, so they can be accessed at runtime.ARCore's AR reference images can be either JPEG or PNG files. If a different type of source texture is specified in the XRReferenceImageLibrary, the ARCore build processor will attempt to convert the texture to a PNG for ARCore to use. Exporting a Texture2D to PNG can fail for several reasons. For example - the texture must be marked both readable and uncompressed in the texture importer settings. If you plan to use the texture at runtime (and not just as a source Asset for the reference image), you should create a separate PNG or JPEG as the source Asset, because those texture import settings can negatively affect performance or memory at runtime.Reference image dimensionsImage dimensions are optional on ARCore; however, specifying them can improve image detection. If you specify the dimensions for a reference image, ARCore only receives the image's width, and then computes the height from the image's aspect ratio.Face trackingFor information about face tracking, see the ARSubsystems Face Tracking documentation.In addition to the core functionality, the ARCore face subsystem has methods that allow access to ARCore-specific features. ARCore provides access to regions, which are specific features on a face. Currently, these features are:Nose tipForehead leftForehead rightEach region has a Pose associated with it. To access face regions, you need to obtain an instance of the ARCoreFaceSubsystem:XRFaceSubsystem faceSubsystem = ...
#if UNITY_ANDROID
var arcoreFaceSubsystem = faceSubsystem as ARCoreFaceSubsystem;
if (arcoreFaceSubsystem != null)
{
var regionData = new NativeArray<ARCoreFaceRegionData>(0, Allocator.Temp);
arcoreFaceSubsystem.GetRegionPoses(faceId, Allocator.Temp, ref regionData);
using (regionData)
{
foreach (var data in regionData)
{
Debug.LogFormat("Region {0} is at {1}", data.region, data.pose);
}
}
}
#endif
Light estimationARCore light estimation has two modes of operation: LightEstimationMode.AmbientIntensity and LightEstimationMode.EnvironmentalHDR. LightEstimationMode.AmbientIntensity providers color correction and average pixel intensity information, while LightEstimationMode.EnvironmentalHDR provides an estimated Main Light Direction, HDR Color, and the ambient SphericalHarmonicsL2 (see SphericalHarmonicsL2 for more information on Spherical Harmonics). The two modes can't be used simultaneously.Additionally, the light estimation modes are either used or affected by other subsystems, namely the ARCoreFaceSubsystem and the ARCoreEnvironmentProbeSubsystem. If one or both of these subsystems is present and enabled, the light estimation mode will have its behaviour modified depending on the configuration.FunctionalitySupported light estimation modesModifiableFace trackingLightEstimationMode.AmbientIntensity, LightEstimationMode.DisabledYesEnvironment probesLightEstimationMode.EnvironmentalHDRNoFace tracking: ARCore doesn't support LightEstimationMode.EnvironmentalHDR while face tracking and rendering won't work if that mode is specified. To prevent this, the providers only allow LightEstimationMode.AmbientIntensity or LightEstimationMode.Disabled modes to be set while tracking faces or it will enforce LightEstimationMode.Disabled.Environment probes: ARCore environment probes rely on the light estimation mode being LightEstimationMode.EnvironmentalHDR to surface and update the cubemap, and therefore take ownership of the setting.Camera configurationXRCameraConfiguration contains an IntPtr field nativeConfigurationHandle, which is a platform-specific handle. For ARCore, this handle is the pointer to the ArCameraConfiguration. The native object is managed by Unity and should not be manually destroyed.Technical detailsRequirementsThis version of ARCore XR Plugin is compatible with the following versions of the Unity Editor:2019.42020.12020.2Known limitationsThe AR Core Supported setting in the XR Settings section of the Android Player settings must remain disabled in order for apps built with the ARCore XR Plugin to work properly.Color Temperature in degrees Kelvin is not presently supported.Package contentsThis version of ARCore XR Plugin includes:A shared library which provides implementation of the XR Subsystems listed aboveA shader used for rendering the camera imageA plugin metadata file
