ARCore SDK for Android v1.30.0

Known issues

• None

Other changes

• Annotated API return values with @NonNull and @Nullable.
• Updated the build tool versions used for building samples: Gradle to 7.0.2 and Android Gradle plugin to 7.0.4. Upgrading these tools is not required for existing ARCore applications. For new features, known issues, incompatibility information, see Android documentation on Android Gradle plugin.

ARCore SDK for Android v1.29.0

Known issues

• None

Breaking & behavioral changes

• Beginning in November 2022, AR-enabled apps will no longer be able to acquire NDK images or image metadata. The SDK versions impacted depend on the specific function being called, see the deprecation announcement to learn more.
  • C: Calls to ArImage_getNdkImage and ArImage_getNdkCameraMetadata will always return nullptr for the AImage and ACameraMetadata objects.
  • Java: The Image object returned by Frame#acquireCameraImage() will be of size 0x0 pixels. Calls to Frame#getImageMetadata() will always throw IllegalArgumentException.
  • Unity (AR Foundation):
    • When using AR Foundation 2.1 (Unity 2019 LTS), calls to XRCameraSubsystem.TryGetLatestImage(out XRCameraImage) will always return false.
    • AR Foundation 4.x and later versions are unaffected, calls to XRCameraSubsystem.TryGetLatestImage(out XRCameraImage) will behave normally.
  • ARCore SDK for Unity (deprecated): Calls to Frame.CameraImage.AcquireCameraImageBytes() will be of size 0x0 pixels. Calls to Frame.CameraMetadata.GetAllCameraMetadataTags() will return an empty List<CameraMetadataTag>.
• ArImage#getCropRect() now returns a full-sized crop rectangle, i.e. all pixels in the Image are valid. See android.media.Image#getCropRect() for additional information.

Other changes

• hello_ar_java and hello_ar_kotlin: Changed an object's color when it is placed using SCREENSPACE_WITH_APPROXIMATE_DISTANCE to better distinguish objects placed using Instant Placement.

Bug fixes

• persistent_cloud_anchor_java: Added a missing build dependency to the sample. Fixes a bug where hosting any anchor would have state CloudAnchorState ERROR_NOT_AUTHORIZED even if the project was set up correctly.

ARCore SDK for Android v1.28.0

Known issues

• None

Breaking & behavioral changes

• Beginning in November 2022, AR-enabled apps will no longer be able to acquire NDK images or image metadata. The SDK versions impacted depend on the specific function being called, see the deprecation announcement to learn more.
  • C: Calls to ArImage_getNdkImage and ArImage_getNdkCameraMetadata will always return nullptr for the AImage and ACameraMetadata objects.
  • Java: The Image object returned by Frame#acquireCameraImage() will be of size 0x0 pixels. Calls to Frame#getImageMetadata() will always throw IllegalArgumentException.
  • Unity (AR Foundation):
    • When using AR Foundation 2.1 (Unity 2019 LTS), calls to XRCameraSubsystem.TryGetLatestImage(out XRCameraImage) will always return false.
    • AR Foundation 4.x and later versions are unaffected, calls to XRCameraSubsystem.TryGetLatestImage(out XRCameraImage) will behave normally.
  • ARCore SDK for Unity (deprecated): Calls to Frame.CameraImage.AcquireCameraImageBytes() will be of size 0x0 pixels. Calls to Frame.CameraMetadata.GetAllCameraMetadataTags() will return an empty List<CameraMetadataTag>.
• ArImage#getCropRect() now returns a full-sized crop rectangle, i.e. all pixels in the Image are valid. See android.media.Image#getCropRect() for additional information.

New APIs and capabilities

• None

Deprecations

• None

Other changes

• None

Bug fixes

• None

ARCore SDK for Android v1.27.0

Known issues

• None

Breaking & behavioral changes

• None

New APIs and capabilities

• None

Deprecations

• None

Other changes

• Added hello_ar_kotlin to demonstrate best practices when using Kotlin. For more information see the QuickStart for Android.
• Added ml_kotlin to demonstrate how an image classification model can be used with ARCore. For more information see Use ARCore as input for Machine Learning models.

Bug fixes

• None

ARCore SDK for Android v1.26.0

Known issues

• None

Breaking & behavioral changes

• targetSdkVersion inside the ARCore aar has been updated to API level 31. Specifying a targetSdkVersion in your project's build.gradle or AndroidManifest.xml will override the ARCore value.

New APIs and capabilities

• Added support for describing ARCore dataset locations with URIs for Recording and Playback.
  • C: Developer guide
  • Java: Developer guide

Deprecations

• The file path string based Recording and Playback methods RecordingConfig#getMp4DatasetFilePath() and RecordingConfig#setMp4DatasetFilePath() have been deprecated in favor of URI based methods RecordingConfig#getMp4DatasetUri() and RecordingConfig#setMp4DatasetUri().

Other changes

• Updated Java and native sample apps to targetSdkVersion 31 (Android 12).

Bug fixes

• None

ARCore SDK for Android v1.25.0

New APIs and capabilities

• None

Deprecations

• None

Other changes

• Updated Java and native sample apps to targetSdkVersion 30 (Android 11).

Bug fixes

• Various bug fixes and performance improvements.

ARCore SDK for Android v1.24.0

New APIs and capabilities

• Added new Raw Depth API that provides a depth image without image-space filtering.
  • All devices that support the existing Depth API in ARCore supported devices now also support the new Raw Depth API.
  • Java: Developer guide, Frame#acquireRawDepthImage(), Frame#acquireRawDepthConfidenceImage(), Config.DepthMode.RAW_DEPTH_ONLY.
  • C: Developer guide, ArFrame_acquireRawDepthImage(), ArFrame_acquireRawDepthConfidenceImage(), AR_DEPTH_MODE_RAW_DEPTH_ONLY.
• Added new Custom Data Track Recording/Playback API, augmentations of the recording and playback features that allow developers to record and playback data to and from custom specified tracks, packaged as MP4 recordings.
  • Java: Developer guide, Track, Frame#recordTrackData(), Frame#getUpdatedTrackData().
  • C: Developer guide, ArTrack, ArFrame_recordTrackData(), ArFrame_getUpdatedTrackData().
• Added new trackable type DepthPoint that provides a calculated depth pose with each frame by hit testing. These values are sampled from the latest depth image, which yields more accurate results on non-planar or low-texture areas in the environment.

Deprecations

None

Other changes

• Java: Added new raw_depth_java sample app.
• Java: Updated hello_ar_java to use DepthPoint hit results from Frame#hitTest() when placing assets.
• C: Updated hello_ar_c to use ArDepthPoint hit results from ArFrame_hitTest() when placing assets.

Bug fixes

• Fixed memory leaks in hello_ar_c when rendering a plane that was subsumed and when attempting to render a plane that was not being tracked.

ARCore SDK for Android v1.23.0

Breaking & behavioral changes

• AR-enabled apps built using ARCore SDK 1.11.0 or earlier are no longer able to host or resolve Cloud Anchors.
  • C: Cloud Anchors returned by ArSession_hostAndAcquireNewCloudAnchor and ArSession_resolveAndAcquireNewCloudAnchor will always have the state AR_CLOUD_ANCHOR_STATE_ERROR_INTERNAL.
  • Java: Cloud Anchors returned by Session#hostCloudAnchor(Anchor) and Session#resolveCloudAnchor(java.lang.String) will always have the state Anchor.CloudAnchorState.ERROR_INTERNAL.
  • Apps built with ARCore SDK 1.12.0 or later are unaffected. Their use of Cloud Anchors APIs is covered by the deprecation policy.

New APIs and capabilities

• Developers can enable ARCore API call logging to the Android debug log by sending a broadcast intent.
• Developers can enable the ARCore performance overlay by sending a broadcast intent.
• Added new API for switching between rear-facing (world) and front-facing (selfie) camera configs within the current Session.
  • Java: Developer guide, CameraConfigFilter.getFacingDirection(), CameraConfigFilter.setFacingDirection().
  • C: Developer guide, ArCameraConfigFilter_getFacingDirection() ArCameraConfigFilter_setFacingDirection().

Deprecations

• The following session features are being deprecated:
  • Java: Feature FRONT_CAMERA is deprecated. To create a session using the front-facing (selfie) camera, use Session.setCameraConfig(CameraConfig) to set a front-facing(selfie) camera config retrieved from Session.getSupportedCameraConfigs(CameraConfigFilter).
  • C: Feature AR_SESSION_FEATURE_FRONT_CAMERA is deprecated. To create a session using the front-facing (selfie) camera, use ArSession_setCameraConfig to set a front-facing(selfie) camera config retrieved from ArSession_getSupportedCameraConfigsWithFilter.

Deletions

• The following deprecated APIs have been deleted:
  • ArImageMetadata_getNdkCameraMetadata
  • ArImage_getNdkImage

Other changes

• Java: Updated hello_ar_java to use the cubemaps provided by Environmental HDR Lighting Estimation for specular reflections.
• Updated augmented_faces_java sample app to use the new ArCameraConfigFilter_setFacingDirection() API to create a session using the front-facing (selfie) camera instead of using the FRONT_CAMERA Session feature, which has been deprecated.
• Updated computer_vision_c sample app to use functions of 'ArImage' instead of functions of AImage to obtain image data, to avoid using previously deprecated ArImage_getNdkImage.

Bug fixes

• Various bug fixes and performance improvements.

ARCore SDK for Android v1.22.0

Breaking & behavioral changes

• Beginning in January 2021, AR-enabled apps built using ARCore SDK 1.11.0 or earlier will no longer be able to host or resolve Cloud Anchors.
  • C: Cloud Anchors returned by ArSession_hostAndAcquireNewCloudAnchor and ArSession_resolveAndAcquireNewCloudAnchor will always have the state AR_CLOUD_ANCHOR_STATE_ERROR_INTERNAL.
  • Java: Cloud Anchors returned by Session#hostCloudAnchor(Anchor) and Session#resolveCloudAnchor(java.lang.String) will always have the state Anchor.CloudAnchorState.ERROR_INTERNAL.
  • Apps built with ARCore SDK 1.12.0 or later are unaffected. Their use of Cloud Anchors APIs is covered by the Cloud Anchors deprecation policy.

Known issues

• Support for stereo camera depth is expected to become available in ARCore SDK 1.23.0.

New APIs and capabilities

None.

Deprecations

None.

Other changes

• Java: Updated hello_ar_java to use the cubemaps provided by Environmental HDR Lighting Estimation for specular reflections.

Bug fixes

• Various bug fixes and performance improvements.

ARCore SDK for Android v1.21.0

Upcoming breaking change affecting Cloud Anchors apps built using ARCore SDK 1.11.0 or earlier

Beginning in December 2020, AR-enabled apps built using ARCore SDK 1.11.0 or earlier will no longer be able to host or resolve Cloud Anchors.

• C: Cloud Anchors returned by ArSession_hostAndAcquireNewCloudAnchor and ArSession_resolveAndAcquireNewCloudAnchor will always have the state AR_CLOUD_ANCHOR_STATE_ERROR_INTERNAL.
• Java: Cloud Anchors returned by Session#hostCloudAnchor(Anchor) and Session#resolveCloudAnchor(java.lang.String) will always have the state Anchor.CloudAnchorState.ERROR_INTERNAL.

Apps built with ARCore SDK 1.12.0 or later are unaffected. Their use of Cloud Anchors APIs is covered by the Cloud Anchors deprecation policy.

Known issues

• Issue 141500087: When using Android Emulator x86_64 system images on macOS with ARCore SDK 1.16.0 or later, Google Play Services for AR will crash. As a workaround, use an x86 system image.

Breaking & behavioral changes

None.

New APIs and capabilities

• Added Recording and Playback of ARCore datasets. The Recording feature lets the app capture the data required to replay the AR session.
  • C: Developer guide, ArSession_startRecording(), ArSession_stopRecording(), ArRecordingConfig(), ArSession_getRecordingStatus(), ArSession_getPlaybackStatus(), ArSession_setPlaybackDataset().
  • Java: Developer guide, session.startRecording(recordingConfig), session.stopRecording(), RecordingConfig(), session.getRecordingStatus(), session.setPlaybackDataset(), session.getPlaybackStatus().
• Added new APIs for Stereo Camera usage in CameraConfigFilter and CameraConfig:
  • C: Developer guide, ArCameraConfigFilter_getStereoCameraUsage() ArCameraConfigFilter_setStereoCameraUsage() ArCameraConfig_getStereoCameraUsage().
  • Java: Developer guide, CameraConfigFilter.getStereoCameraUsage(), CameraConfigFilter.setStereoCameraUsage(). CameraConfig.getStereoCameraUsage().
  • Support for stereo camera depth is expected to become available in ARCore SDK 1.22.0.

Deprecations

None.

Other changes

• C: Updated ArCoreApk_requestInstall to clarify runtime behavior, noting when and how ARCore device profile data is downloaded and updated.
• Java: Updated hello_ar_java to use Environmental HDR Lighting Estimation mode.

Bug fixes

• Fixed memory leak in hello_ar_c, which now correctly releases acquired depth images.
• Fixed crash in hello_ar_java which occurred on certain GPUs.