Verify smoke tests #6994

tejasd · 2025-05-27T15:19:10Z

No description provided.

github-actions · 2025-05-27T15:19:26Z

📝 PRs merging into main branch

Our main branch should always be in a releasable state. If you are working on a larger change, or if you don't want this change to see the light of the day just yet, consider using a feature branch first, and only merge into the main branch when the code complete and ready to be released.

google-oss-bot · 2025-05-27T15:19:48Z

	1 Warning
⚠️	Did you forget to add a changelog entry? (Add the 'no-changelog' label to the PR to silence this warning.)

Generated by 🚫 Danger

github-actions · 2025-05-27T15:24:38Z

Test Results

57 files - 7 57 suites - 7 1m 16s ⏱️ - 1m 5s
970 tests +651 961 ✅ +643 0 💤 - 1 9 ❌ +9
978 runs +336 969 ✅ +329 0 💤 - 2 9 ❌ +9

For more details on these failures, see this check.

Results for commit da3cc07. ± Comparison against base commit ec4b353.

This pull request removes 319 and adds 970 tests. Note that renamed tests count towards both.

com.google.firebase.inappmessaging.FirebaseInAppMessagingTest ‑ addClickListener_forwardsEventListenerRequestsToDeveloperListenerManager
com.google.firebase.inappmessaging.FirebaseInAppMessagingTest ‑ addDismissListener_forwardsEventListenerRequestsToDeveloperListenerManager
com.google.firebase.inappmessaging.FirebaseInAppMessagingTest ‑ addDisplayErrorListener_forwardsEventListenerRequestsToDeveloperListenerManager
com.google.firebase.inappmessaging.FirebaseInAppMessagingTest ‑ addImpressionListener_forwardsEventListenerRequestsToDeveloperListenerManager
com.google.firebase.inappmessaging.FirebaseInAppMessagingTest ‑ addRemoveAllListeners_WorksAsExpected
com.google.firebase.inappmessaging.FirebaseInAppMessagingTest ‑ addRemoveListeners_WorksAsExpected
com.google.firebase.inappmessaging.FirebaseInAppMessagingTest ‑ automaticDataCollectionDisabling_clearsInDataCollectionHelper
com.google.firebase.inappmessaging.FirebaseInAppMessagingTest ‑ automaticDataCollectionDisabling_disablesInDataCollectionHelper
com.google.firebase.inappmessaging.FirebaseInAppMessagingTest ‑ automaticDataCollectionEnabling_enablesInDataCollectionHelper
com.google.firebase.inappmessaging.FirebaseInAppMessagingTest ‑ clearDisplayListener_removesListener
…

com.google.firebase.perf.FirebasePerfRegistrarTest ‑ testGetComponents
com.google.firebase.perf.FirebasePerformanceTest ‑ firebasePerformanceInitialization_providesRcProvider_remoteConfigManagerIsSet
com.google.firebase.perf.FirebasePerformanceTest ‑ initFirebasePerformance_injectsMetadataIntoConfigResolver
com.google.firebase.perf.FirebasePerformanceTest ‑ initializeFirebasePerformance_emptyMetadataAndCache_metadataAndContextInjected
com.google.firebase.perf.FirebasePerformanceTest ‑ setDataCollectionDefaultEnabled_whenForceDisabledThenCleared_respectsGlobalFlag
com.google.firebase.perf.FirebasePerformanceTest ‑ setDataCollectionDefaultEnabled_whenForceDisabledThenCleared_respectsManifestTrue
com.google.firebase.perf.FirebasePerformanceTest ‑ setDataCollectionDefaultEnabled_whenForceEnabledThenCleared_respectsGlobalFlag
com.google.firebase.perf.FirebasePerformanceTest ‑ setDataCollectionDefaultEnabled_whenForceEnabledThenCleared_respectsManifestFalse
com.google.firebase.perf.FirebasePerformanceTest ‑ testAddingMoreThanMaxLocalAttributes
com.google.firebase.perf.FirebasePerformanceTest ‑ testBothManifestsAgree
…

google-oss-bot · 2025-05-27T15:25:27Z

Coverage Report ¹

Affected Products

No changes between base commit (ec4b353) and merge commit (9890901).

Test Logs

https://storage.googleapis.com/firebase-sdk-metric-reports/lnbHmI1J6Y.html

google-oss-bot · 2025-05-27T15:34:54Z

Size Report ¹

Affected Products

firebase-perf
Type Base (ec4b353) Merge (9890901) Diff
aar 316 kB 316 kB +84 B (+0.0%)
apk (aggressive) 1.63 MB 1.63 MB +88 B (+0.0%)
apk (release) 10.1 MB 10.1 MB +36 B (+0.0%)

Test Logs

https://storage.googleapis.com/firebase-sdk-metric-reports/SjBGs2D46L.html

google-oss-bot · 2025-05-27T16:10:02Z

Startup Time Report ¹

Note: Layout is sometimes suboptimal due to limited formatting support on GitHub. Please check this report on GCS.

Notes

This report is for comparing the base commit (ec4b353) and the CI merge commit (9890901)
Please check below reports for each individual commit to find more details (Perfetto traces, histograms, detailed measurements)
- ec4b353: https://storage.googleapis.com/firebase-sdk-metric-reports/lfZEWizPAh/index.html
- 9890901: https://storage.googleapis.com/firebase-sdk-metric-reports/KKWGhXaT5P/index.html

Startup Times

`fire-perf`

Device Statistics Distributions

oriole-32

Percentile	`ec4b353`	`9890901`	Diff	Significant (?)
p10	266 ±18 μs	260 ±22 μs	-5.68 μs (-2.1%)	NO
p25	276 ±15 μs	271 ±22 μs	-5.57 μs (-2.0%)	NO
p50	292 ±13 μs	287 ±20 μs	-4.96 μs (-1.7%)	NO
p75	323 ±13 μs	321 ±21 μs	-1.87 μs (-0.6%)	NO
p90	365 ±22 μs	394 ±40 μs	+28.4 μs (+7.8%)	NO

20 test runs in comparison

Commit	Test Runs
`ec4b353`	2025-05-22_18:50:15.497154_NUXL 2025-05-22_18:50:15.497195_oUaZ 2025-05-22_18:50:15.497205_hrGe 2025-05-22_18:50:15.497220_xqil 2025-05-22_18:50:15.497228_czLQ 2025-05-22_18:50:15.497235_HSoT 2025-05-22_18:50:15.497242_tvEj 2025-05-22_18:50:15.497248_QYyQ 2025-05-22_18:50:15.497255_XThK 2025-05-22_18:50:15.497262_ZLJp
`9890901`	2025-05-27_15:37:32.148876_Khuh 2025-05-27_15:37:32.148910_cEwU 2025-05-27_15:37:32.148917_YlTT 2025-05-27_15:37:32.148970_KKRJ 2025-05-27_15:37:32.148980_XsHz 2025-05-27_15:37:32.148987_VCDt 2025-05-27_15:37:32.148994_OfOv 2025-05-27_15:37:32.149001_AwBQ 2025-05-27_15:37:32.149008_Qmsr 2025-05-27_15:37:32.149015_tvrZ

redfin-30

Percentile	`ec4b353`	`9890901`	Diff	Significant (?)
p10	723 ±64 μs	750 ±49 μs	+27.3 μs (+3.8%)	NO
p25	769 ±56 μs	787 ±48 μs	+18.4 μs (+2.4%)	NO
p50	836 ±50 μs	856 ±56 μs	+19.6 μs (+2.3%)	NO
p75	917 ±59 μs	962 ±72 μs	+45.4 μs (+5.0%)	NO
p90	1.01 ±0.09 ms	1.06 ±0.07 ms	+53.0 μs (+5.2%)	NO

20 test runs in comparison

Commit	Test Runs
`ec4b353`	2025-05-22_18:50:15.497154_NUXL 2025-05-22_18:50:15.497195_oUaZ 2025-05-22_18:50:15.497205_hrGe 2025-05-22_18:50:15.497220_xqil 2025-05-22_18:50:15.497228_czLQ 2025-05-22_18:50:15.497235_HSoT 2025-05-22_18:50:15.497242_tvEj 2025-05-22_18:50:15.497248_QYyQ 2025-05-22_18:50:15.497255_XThK 2025-05-22_18:50:15.497262_ZLJp
`9890901`	2025-05-27_15:37:32.148876_Khuh 2025-05-27_15:37:32.148910_cEwU 2025-05-27_15:37:32.148917_YlTT 2025-05-27_15:37:32.148970_KKRJ 2025-05-27_15:37:32.148980_XsHz 2025-05-27_15:37:32.148987_VCDt 2025-05-27_15:37:32.148994_OfOv 2025-05-27_15:37:32.149001_AwBQ 2025-05-27_15:37:32.149008_Qmsr 2025-05-27_15:37:32.149015_tvrZ

`fire-sessions`

Device Statistics Distributions

oriole-32

Percentile	`ec4b353`	`9890901`	Diff	Significant (?)
p10	2.35 ±1 ms	2.30 ±0.7 ms	-51.4 μs (-2.2%)	NO
p25	2.55 ±1 ms	2.48 ±0.7 ms	-63.0 μs (-2.5%)	NO
p50	2.94 ±1 ms	2.86 ±0.7 ms	-84.6 μs (-2.9%)	NO
p75	3.59 ±1 ms	3.48 ±0.7 ms	-111 μs (-3.1%)	NO
p90	4.41 ±1 ms	4.27 ±0.9 ms	-139 μs (-3.2%)	NO

20 test runs in comparison

Commit	Test Runs
`ec4b353`	2025-05-22_18:50:15.497154_NUXL 2025-05-22_18:50:15.497195_oUaZ 2025-05-22_18:50:15.497205_hrGe 2025-05-22_18:50:15.497220_xqil 2025-05-22_18:50:15.497228_czLQ 2025-05-22_18:50:15.497235_HSoT 2025-05-22_18:50:15.497242_tvEj 2025-05-22_18:50:15.497248_QYyQ 2025-05-22_18:50:15.497255_XThK 2025-05-22_18:50:15.497262_ZLJp
`9890901`	2025-05-27_15:37:32.148876_Khuh 2025-05-27_15:37:32.148910_cEwU 2025-05-27_15:37:32.148917_YlTT 2025-05-27_15:37:32.148970_KKRJ 2025-05-27_15:37:32.148980_XsHz 2025-05-27_15:37:32.148987_VCDt 2025-05-27_15:37:32.148994_OfOv 2025-05-27_15:37:32.149001_AwBQ 2025-05-27_15:37:32.149008_Qmsr 2025-05-27_15:37:32.149015_tvrZ

redfin-30

Percentile	`ec4b353`	`9890901`	Diff	Significant (?)
p10	4.30 ±0.9 ms	4.63 ±1 ms	+332 μs (+7.7%)	NO
p25	4.68 ±1 ms	5.07 ±1 ms	+390 μs (+8.3%)	NO
p50	5.24 ±1 ms	5.83 ±2 ms	+589 μs (+11.2%)	NO
p75	5.98 ±2 ms	7.11 ±3 ms	+1.13 ms (+18.9%)	NO
p90	6.85 ±2 ms	8.63 ±5 ms	+1.78 ms (+26.0%)	NO

20 test runs in comparison

Commit	Test Runs
`ec4b353`	2025-05-22_18:50:15.497154_NUXL 2025-05-22_18:50:15.497195_oUaZ 2025-05-22_18:50:15.497205_hrGe 2025-05-22_18:50:15.497220_xqil 2025-05-22_18:50:15.497228_czLQ 2025-05-22_18:50:15.497235_HSoT 2025-05-22_18:50:15.497242_tvEj 2025-05-22_18:50:15.497248_QYyQ 2025-05-22_18:50:15.497255_XThK 2025-05-22_18:50:15.497262_ZLJp
`9890901`	2025-05-27_15:37:32.148876_Khuh 2025-05-27_15:37:32.148910_cEwU 2025-05-27_15:37:32.148917_YlTT 2025-05-27_15:37:32.148970_KKRJ 2025-05-27_15:37:32.148980_XsHz 2025-05-27_15:37:32.148987_VCDt 2025-05-27_15:37:32.148994_OfOv 2025-05-27_15:37:32.149001_AwBQ 2025-05-27_15:37:32.149008_Qmsr 2025-05-27_15:37:32.149015_tvrZ

`timeToInitialDisplay`

Device Statistics Distributions

oriole-32

Percentile	`ec4b353`	`9890901`	Diff	Significant (?)
p10	199 ±5 ms	201 ±6 ms	+1.38 ms (+0.7%)	NO
p25	204 ±5 ms	206 ±6 ms	+2.01 ms (+1.0%)	NO
p50	212 ±5 ms	215 ±6 ms	+3.42 ms (+1.6%)	NO
p75	219 ±5 ms	224 ±6 ms	+5.14 ms (+2.4%)	NO
p90	225 ±6 ms	234 ±7 ms	+9.18 ms (+4.1%)	NO

20 test runs in comparison

Commit	Test Runs
`ec4b353`	2025-05-22_18:50:15.497154_NUXL 2025-05-22_18:50:15.497195_oUaZ 2025-05-22_18:50:15.497205_hrGe 2025-05-22_18:50:15.497220_xqil 2025-05-22_18:50:15.497228_czLQ 2025-05-22_18:50:15.497235_HSoT 2025-05-22_18:50:15.497242_tvEj 2025-05-22_18:50:15.497248_QYyQ 2025-05-22_18:50:15.497255_XThK 2025-05-22_18:50:15.497262_ZLJp
`9890901`	2025-05-27_15:37:32.148876_Khuh 2025-05-27_15:37:32.148910_cEwU 2025-05-27_15:37:32.148917_YlTT 2025-05-27_15:37:32.148970_KKRJ 2025-05-27_15:37:32.148980_XsHz 2025-05-27_15:37:32.148987_VCDt 2025-05-27_15:37:32.148994_OfOv 2025-05-27_15:37:32.149001_AwBQ 2025-05-27_15:37:32.149008_Qmsr 2025-05-27_15:37:32.149015_tvrZ

redfin-30

Percentile	`ec4b353`	`9890901`	Diff	Significant (?)
p10	225 ±5 ms	247 ±3 ms	+21.6 ms (+9.6%)	MAYBE
p25	232 ±5 ms	254 ±4 ms	+22.3 ms (+9.6%)	MAYBE
p50	239 ±4 ms	261 ±4 ms	+22.6 ms (+9.5%)	YES
p75	247 ±5 ms	271 ±5 ms	+23.6 ms (+9.6%)	MAYBE
p90	257 ±6 ms	284 ±10 ms	+27.3 ms (+10.6%)	NO

20 test runs in comparison

Commit	Test Runs
`ec4b353`	2025-05-22_18:50:15.497154_NUXL 2025-05-22_18:50:15.497195_oUaZ 2025-05-22_18:50:15.497205_hrGe 2025-05-22_18:50:15.497220_xqil 2025-05-22_18:50:15.497228_czLQ 2025-05-22_18:50:15.497235_HSoT 2025-05-22_18:50:15.497242_tvEj 2025-05-22_18:50:15.497248_QYyQ 2025-05-22_18:50:15.497255_XThK 2025-05-22_18:50:15.497262_ZLJp
`9890901`	2025-05-27_15:37:32.148876_Khuh 2025-05-27_15:37:32.148910_cEwU 2025-05-27_15:37:32.148917_YlTT 2025-05-27_15:37:32.148970_KKRJ 2025-05-27_15:37:32.148980_XsHz 2025-05-27_15:37:32.148987_VCDt 2025-05-27_15:37:32.148994_OfOv 2025-05-27_15:37:32.149001_AwBQ 2025-05-27_15:37:32.149008_Qmsr 2025-05-27_15:37:32.149015_tvrZ

https://storage.googleapis.com/firebase-sdk-metric-reports/Wv6XhvXNgu/index.html

test

da3cc07

google-oss-bot added the size/XS label May 27, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Verify smoke tests #6994

Verify smoke tests #6994

Uh oh!

tejasd commented May 27, 2025

Uh oh!

github-actions bot commented May 27, 2025

Uh oh!

google-oss-bot commented May 27, 2025

Uh oh!

github-actions bot commented May 27, 2025

Uh oh!

google-oss-bot commented May 27, 2025

Uh oh!

google-oss-bot commented May 27, 2025

`firebase-perf`

Uh oh!

google-oss-bot commented May 27, 2025

`fire-perf`

`fire-sessions`

`timeToInitialDisplay`

Uh oh!

Uh oh!

Verify smoke tests #6994

Are you sure you want to change the base?

Verify smoke tests #6994

Uh oh!

Conversation

tejasd commented May 27, 2025

Uh oh!

github-actions bot commented May 27, 2025

📝 PRs merging into main branch

Uh oh!

google-oss-bot commented May 27, 2025

Uh oh!

github-actions bot commented May 27, 2025

Test Results

Uh oh!

google-oss-bot commented May 27, 2025

Coverage Report 1

Affected Products

Test Logs

Uh oh!

google-oss-bot commented May 27, 2025

Size Report 1

Affected Products

firebase-perf

Test Logs

Uh oh!

google-oss-bot commented May 27, 2025

Startup Time Report 1

Notes

Startup Times

fire-perf

fire-sessions

timeToInitialDisplay

Uh oh!

Uh oh!

Coverage Report ¹

Size Report ¹

`firebase-perf`

Startup Time Report ¹

`fire-perf`

`fire-sessions`

`timeToInitialDisplay`