Skip to content

Conversation

@glitchminer
Copy link
Contributor

What does the PR do

  • introduced ci/Jenkinsfile.test-e2e.android so Jenkins can run Android smoke tests on BrowserStack (in preparation for PR checks and nightly runs)
  • updated config and the reporting/logging structure to give one report folder per run for export (inlcuding logs & screenshots)

Successfully ran with simulated config locally but still to be tested from Jenkins directly

@glitchminer glitchminer requested review from a team as code owners October 28, 2025 22:57
@glitchminer glitchminer requested review from Rsttskyy and removed request for a team October 28, 2025 22:57
@status-im-auto
Copy link
Member

status-im-auto commented Oct 28, 2025

Jenkins Builds

Click to see older builds (74)
Commit #️⃣ Finished (UTC) Duration Platform Result
✔️ 162d5a5 #1 2025-10-28 23:06:07 ~8 min tests/nim 📄log
✔️ 162d5a5 #1 2025-10-28 23:08:01 ~10 min android/arm64 🤖apk 📲
✔️ 162d5a5 #1 2025-10-28 23:10:22 ~12 min ios/aarch64 📦pkg
✔️ 162d5a5 #1 2025-10-28 23:15:25 ~17 min linux/x86_64 📦tgz
✔️ 162d5a5 #1 2025-10-28 23:17:03 ~19 min macos/aarch64 🍎dmg
✔️ 162d5a5 #1 2025-10-28 23:19:25 ~21 min windows/x86_64 💿exe
✔️ 162d5a5 #1 2025-10-28 23:20:33 ~22 min macos/aarch64-nwaku 🍎dmg
✔️ 162d5a5 #1 2025-10-28 23:21:34 ~24 min linux/x86_64-nwaku 📦tgz
✔️ 162d5a5 PR19163 2025-10-28 23:28:44 ~9 min tests/e2e-windows 📊rpt
✔️ 162d5a5 pr19163 2025-10-28 23:32:10 ~16 min tests/e2e 📊rpt
✔️ 162d5a5 #2 2025-11-07 13:45:09 ~8 min tests/nim 📄log
✔️ 162d5a5 #2 2025-11-07 13:46:04 ~9 min ios/aarch64 📦pkg
✔️ 162d5a5 #2 2025-11-07 13:51:31 ~14 min tests/ui 📄log
✔️ 162d5a5 #2 2025-11-07 13:51:53 ~14 min macos/aarch64 🍎dmg
✖️ 162d5a5 #2 2025-11-07 13:53:59 ~17 min linux/x86_64 📦tgz
✔️ 162d5a5 #2 2025-11-07 13:56:27 ~19 min macos/aarch64-nwaku 🍎dmg
✖️ 162d5a5 #2 2025-11-07 13:59:35 ~22 min windows/x86_64 💿exe
✔️ 162d5a5 #2 2025-11-07 14:00:26 ~23 min linux/x86_64-nwaku 📦tgz
✔️ 162d5a5 #3 2025-11-10 14:52:24 ~7 min ios/aarch64 📦pkg
✔️ 162d5a5 #3 2025-11-10 14:52:59 ~8 min tests/nim 📄log
162d5a5 #3 2025-11-10 14:56:17 ~11 min macos/aarch64 📄log
162d5a5 #3 2025-11-10 14:56:48 ~12 min macos/aarch64-nwaku 📄log
✖️ 162d5a5 #3 2025-11-10 15:02:14 ~17 min linux/x86_64 📦tgz
✔️ 162d5a5 #3 2025-11-10 15:03:39 ~18 min tests/ui 📄log
✔️ 162d5a5 #3 2025-11-10 15:04:40 ~20 min linux/x86_64-nwaku 📦tgz
✔️ 162d5a5 #3 2025-11-10 15:05:03 ~20 min windows/x86_64 💿exe
✔️ 162d5a5 PR19163 2025-11-10 15:17:53 ~12 min tests/e2e-windows 📊rpt
✔️ a21a910 #4 2025-11-12 15:08:30 ~6 min tests/nim 📄log
✔️ a21a910 #4 2025-11-12 15:11:33 ~9 min android/arm64 🤖apk 📲
✔️ a21a910 #4 2025-11-12 15:12:51 ~10 min ios/aarch64 📱ipa
✔️ a21a910 #4 2025-11-12 15:14:34 ~12 min macos/aarch64 🍎dmg
✔️ a21a910 #4 2025-11-12 15:16:09 ~14 min tests/ui 📄log
✔️ a21a910 #4 2025-11-12 15:24:01 ~22 min linux/x86_64-nwaku 📦tgz
✔️ a21a910 #4 2025-11-12 15:26:02 ~23 min windows/x86_64 💿exe
✖️ a21a910 PR19163 2025-11-12 15:37:16 ~11 min tests/e2e-windows 📊rpt
✔️ 41c709e2 #5 2025-11-12 17:37:30 ~20 min android/arm64 🤖apk 📲
✔️ f913cba4 #6 2025-11-13 17:38:13 ~22 min android/arm64 🤖apk 📲
✔️ 84d6d5c4 #7 2025-11-14 17:27:28 ~11 min android/arm64 🤖apk 📲
✔️ 2dbfaf5c #8 2025-11-15 17:27:37 ~12 min android/arm64 🤖apk 📲
✔️ 644cb06e #9 2025-11-17 17:27:24 ~11 min android/arm64 🤖apk 📲
✔️ dd2efa4c #10 2025-11-18 17:25:08 ~9 min android/arm64 🤖apk 📲
✔️ d711ae49 #11 2025-11-19 17:25:28 ~9 min android/arm64 🤖apk 📲
b8dc5e01 #12 2025-11-20 17:24:21 ~8 min android/arm64 📄log
✔️ 1abc3bc5 #13 2025-11-21 17:38:13 ~21 min android/arm64 🤖apk 📲
✔️ 31df6f0b #14 2025-11-22 17:28:02 ~12 min android/arm64 🤖apk 📲
✔️ ec509d82 #15 2025-11-24 17:40:46 ~24 min android/arm64 🤖apk 📲
✔️ 18c3d3df #16 2025-11-25 17:52:01 ~35 min android/arm64 🤖apk 📲
✔️ ddb2b47f #17 2025-11-26 17:44:38 ~28 min android/arm64 🤖apk 📲
✔️ f10f9f4e #18 2025-11-27 17:39:25 ~23 min android/arm64 🤖apk 📲
✔️ 054fa6fc #19 2025-11-28 17:37:04 ~20 min android/arm64 🤖apk 📲
✔️ 3a103e2a #20 2025-11-29 17:39:03 ~23 min android/arm64 🤖apk 📲
✔️ dff904fc #21 2025-12-01 17:42:14 ~25 min android/arm64 🤖apk 📲
✔️ 36ce919b #22 2025-12-02 17:45:36 ~29 min android/arm64 🤖apk 📲
✔️ a26aef9d #23 2025-12-03 17:37:59 ~21 min android/arm64 🤖apk 📲
✔️ 0bba4c4 #5 2025-12-04 13:19:30 ~7 min tests/nim 📄log
✖️ 0bba4c4 #5 2025-12-04 13:23:41 ~12 min ios/aarch64 📱ipa
✔️ 0bba4c4 #5 2025-12-04 13:26:16 ~14 min tests/ui 📄log
✔️ 0bba4c4 #5 2025-12-04 13:30:26 ~18 min macos/aarch64 🍎dmg
✔️ 0bba4c4 #5 2025-12-04 13:35:43 ~23 min windows/x86_64 💿exe
✔️ 0bba4c4 #5 2025-12-04 13:36:20 ~24 min macos/aarch64-nwaku 🍎dmg
✖️ 0bba4c4 PR19163 2025-12-04 13:50:58 ~15 min tests/e2e-windows 📊rpt
✔️ dedf22d7 #24 2025-12-04 13:22:25 ~10 min android/arm64 🤖apk 📲
✔️ 2194edd7 #25 2025-12-04 17:36:14 ~20 min android/arm64 🤖apk 📲
✔️ 0511399 #6 2025-12-04 18:52:36 ~6 min tests/nim 📄log
✖️ 0511399 #6 2025-12-04 18:57:56 ~12 min ios/aarch64 📱ipa
✔️ 0511399 #6 2025-12-04 18:59:22 ~13 min tests/ui 📄log
✔️ 0511399 #6 2025-12-04 19:02:16 ~16 min linux/x86_64 📦tgz
✔️ 0511399 #6 2025-12-04 19:04:54 ~18 min macos/aarch64 🍎dmg
✔️ 0511399 #6 2025-12-04 19:05:45 ~19 min macos/aarch64-nwaku 🍎dmg
✔️ 0511399 #6 2025-12-04 19:06:22 ~20 min windows/x86_64 💿exe
✖️ 0511399 PR19163 2025-12-04 19:20:23 ~13 min tests/e2e-windows 📊rpt
✔️ 0511399 pr19163 2025-12-04 19:20:46 ~18 min tests/e2e 📊rpt
✔️ 6387e722 #26 2025-12-04 18:55:16 ~9 min android/arm64 🤖apk 📲
✔️ 8a7ea94b #27 2025-12-05 17:37:16 ~21 min android/arm64 🤖apk 📲
Commit #️⃣ Finished (UTC) Duration Platform Result
✔️ 79c58cd8 #28 2025-12-06 17:34:54 ~19 min android/arm64 🤖apk 📲
✔️ e832fbca #29 2025-12-08 17:39:16 ~23 min android/arm64 🤖apk 📲

Base automatically changed from e2e_appium/add-browserstack-tests to e2e_appium/add-browserstack November 7, 2025 13:36
@glitchminer glitchminer force-pushed the e2e_appium/add-browserstack branch from 42e0569 to 220c950 Compare November 10, 2025 11:42
Base automatically changed from e2e_appium/add-browserstack to master November 10, 2025 14:44
- wallet locators
- app lifecycle management
- toast message handling (visibility checks and logging).
- saved addresses page
…ertions

- Replaced instances of LambdaTest reporting with Cloud reporting
- Assertion messages for clarity
- Updated test methods for toast handling
Copy link
Member

@jakubgs jakubgs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Much better, but needs some more work. You make a few weird assumptions about availability of env variables.

def runId = env.E2E_RUN_ID?.trim()
def reportsPattern = runId ? "test/e2e_appium/reports/${runId}/**/*.xml" : "test/e2e_appium/reports/**/*.xml"
junit allowEmptyResults: true, testResults: reportsPattern
def archivePattern = runId ? "test/e2e_appium/reports/${runId}/**/*" : "test/e2e_appium/reports/**/*"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why is this pattern wider than the one above? How are those artifacts useful?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The junit pattern is for only the final pytest results xml.

The wider pattern captures the reports folder for the run for further analysis when needed, investigating failures etc. It can include screenshots (on fail or when configured), page dumps and logs. It could be possible to use only BrowserStack for this but would have to consider access by wider team if necessary.

Copy link
Member

@jakubgs jakubgs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is looking pretty good right now, but I just noticed that you didn't actually run it. We don't yet have a job for this.

So you've been just dry-writing this the whole time? Haha. You will have to ask one of my engineers, for example @markoburcul , to help you set up a job for this. And you're also missing a way to trigger it.

@glitchminer
Copy link
Contributor Author

Thanks for the feedback @jakubgs

Yeah, just based on the other e2e files to start with.

I had briefly mentioned to @siddarthkay a while back that this was being worked on but there were dependencies to resolve in the framework itself and the priority has been the recent releases. There's an issue for setting up a job here if that's any help: https://github.com/status-im/infra-ci/issues/222

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants