Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: cicd e2e label requirements + pr automation #12243

Merged
merged 22 commits into from
Dec 3, 2024
Merged

Conversation

jake-perkins
Copy link
Contributor

@jake-perkins jake-perkins commented Nov 8, 2024

Description

This PR does a few things

  1. Automatically set new PRs targeting main to "draft" state.
  2. Enforce the E2E Bitrise Status Check on lifecycle on incoming PRs which will essentially enforce that the PR has 1 of the two labels 'Run Smoke E2E' or 'No E2E Smoke Needed'

With this change we're looking to improve the posture on our PR lifecycle with auto drafts and enforce a higher standard for incoming changes towards or E2E testing posture.

Related issues

[Fixes:]

#11747

Manual testing steps

UC1 : Nether E2E Label is set
-> https://github.com/MetaMask/metamask-mobile/actions/runs/11826040868/job/32951145968?pr=12243
Expected : Not Mergeable

UC2 : docs PR

Should run: false, Reason: The pull request is documentation related.
Skipping Bitrise status check. due to the following reason: The pull request is documentation related.
Created 'Bitrise E2E Status' check with skipped status for commit dea08a9
https://github.com/MetaMask/metamask-mobile/actions/runs/11826187817/job/32951608300?pr=12243

Expected: Mergeable

UC3 : No E2E Smoke Needed Label is set

Anti label: true
Should run: false, Reason: The pull request has the anti-label.
Skipping Bitrise status check. due to the following reason: The pull request has the anti-label.
Created 'Bitrise E2E Status' check with skipped status for commit dea08a9[22]
https://github.com/MetaMask/metamask-mobile/actions/runs/11826234735/job/32951749305?pr=12243

Expected Mergeable

UC4: Smoke E2E Label is set

Should run: true, Reason: The smoke test label is present.
Starting Bitrise build for commit dea08a9

Screenshots/Recordings

Before

N/A CICD Changes only

After

N/A CICD Changes only

Pre-merge author checklist

Pre-merge reviewer checklist

  • I've manually tested the PR (e.g. pull and build branch, run the app, test code being changed).
  • I confirm that this PR addresses all acceptance criteria described in the ticket it closes and includes the necessary testing evidence such as recordings and or screenshots.

@jake-perkins jake-perkins requested a review from a team as a code owner November 8, 2024 19:50
Copy link
Contributor

github-actions bot commented Nov 8, 2024

CLA Signature Action: All authors have signed the CLA. You may need to manually re-run the blocking PR check if it doesn't pass in a few minutes.

@metamaskbot metamaskbot added the team-dev-ops DevOps team label Nov 8, 2024
@jake-perkins jake-perkins added No QA Needed Apply this label when your PR does not need any QA effort. Run Smoke E2E Triggers smoke e2e on Bitrise labels Nov 12, 2024
@jake-perkins jake-perkins changed the title sample commit chore: cicd testing Nov 12, 2024
Copy link
Contributor

github-actions bot commented Nov 12, 2024

https://bitrise.io/ Bitrise

❌❌❌ pr_smoke_e2e_pipeline failed on Bitrise! ❌❌❌

Commit hash: 93cf729
Build link: https://app.bitrise.io/app/be69d4368ee7e86d/pipelines/c9a8a4c3-2374-4233-84db-324076bae6fe

Note

  • You can kick off another pr_smoke_e2e_pipeline on Bitrise by removing and re-applying the Run Smoke E2E label on the pull request

Tip

  • Check the documentation if you have any doubts on how to understand the failure on bitrise

@jake-perkins jake-perkins removed the Run Smoke E2E Triggers smoke e2e on Bitrise label Nov 12, 2024
@jake-perkins jake-perkins changed the title chore: cicd testing cicd: e2e label + pr automation Nov 13, 2024
@jake-perkins jake-perkins changed the title cicd: e2e label + pr automation cicd: e2e label requirements + pr automation Nov 13, 2024
@jake-perkins jake-perkins changed the title cicd: e2e label requirements + pr automation feat: cicd e2e label requirements + pr automation Nov 13, 2024
@jake-perkins jake-perkins changed the title feat: cicd e2e label requirements + pr automation docs: cicd e2e label requirements + pr automation Nov 13, 2024
@jake-perkins jake-perkins added the No E2E Smoke Needed If the PR does not need E2E smoke test run label Nov 13, 2024
@jake-perkins jake-perkins changed the title docs: cicd e2e label requirements + pr automation feat: cicd e2e label requirements + pr automation Nov 13, 2024
@jake-perkins jake-perkins added No E2E Smoke Needed If the PR does not need E2E smoke test run and removed No E2E Smoke Needed If the PR does not need E2E smoke test run labels Nov 13, 2024
@jake-perkins jake-perkins added Run Smoke E2E Triggers smoke e2e on Bitrise and removed Run Smoke E2E Triggers smoke e2e on Bitrise labels Nov 13, 2024
Copy link
Contributor

github-actions bot commented Nov 13, 2024

https://bitrise.io/ Bitrise

❌❌❌ pr_smoke_e2e_pipeline failed on Bitrise! ❌❌❌

Commit hash: 7dc1d78
Build link: https://app.bitrise.io/app/be69d4368ee7e86d/pipelines/292a66c1-06fc-48b6-9228-d0883ad6997b

Note

  • You can kick off another pr_smoke_e2e_pipeline on Bitrise by removing and re-applying the Run Smoke E2E label on the pull request

Tip

  • Check the documentation if you have any doubts on how to understand the failure on bitrise

@jake-perkins jake-perkins added Run Smoke E2E Triggers smoke e2e on Bitrise and removed Run Smoke E2E Triggers smoke e2e on Bitrise labels Nov 13, 2024
Copy link
Contributor

github-actions bot commented Nov 13, 2024

https://bitrise.io/ Bitrise

❌❌❌ pr_smoke_e2e_pipeline failed on Bitrise! ❌❌❌

Commit hash: 65c7d93
Build link: https://app.bitrise.io/app/be69d4368ee7e86d/pipelines/bcb3a72f-0237-499d-9c4b-aae4a0913ed7

Note

  • You can kick off another pr_smoke_e2e_pipeline on Bitrise by removing and re-applying the Run Smoke E2E label on the pull request

Tip

  • Check the documentation if you have any doubts on how to understand the failure on bitrise

@jake-perkins jake-perkins mentioned this pull request Nov 14, 2024
9 tasks
@jake-perkins jake-perkins added Run Smoke E2E Triggers smoke e2e on Bitrise and removed Run Smoke E2E Triggers smoke e2e on Bitrise labels Nov 14, 2024
Copy link
Contributor

github-actions bot commented Nov 14, 2024

https://bitrise.io/ Bitrise

❌❌❌ pr_smoke_e2e_pipeline failed on Bitrise! ❌❌❌

Commit hash: 8bc90d6
Build link: https://app.bitrise.io/app/be69d4368ee7e86d/pipelines/af758848-fdc3-4702-a422-32daa171e31e

Note

  • You can kick off another pr_smoke_e2e_pipeline on Bitrise by removing and re-applying the Run Smoke E2E label on the pull request

Tip

  • Check the documentation if you have any doubts on how to understand the failure on bitrise

Copy link
Contributor

@Cal-L Cal-L left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Left some comments

.github/scripts/bitrise/run-bitrise-e2e-check.ts Outdated Show resolved Hide resolved
.github/scripts/bitrise/run-bitrise-e2e-check.ts Outdated Show resolved Hide resolved
.github/scripts/bitrise/run-bitrise-e2e-check.ts Outdated Show resolved Hide resolved
@jake-perkins jake-perkins added Run Smoke E2E Triggers smoke e2e on Bitrise and removed Run Smoke E2E Triggers smoke e2e on Bitrise labels Dec 3, 2024
Copy link
Contributor

github-actions bot commented Dec 3, 2024

https://bitrise.io/ Bitrise

✅✅✅ pr_smoke_e2e_pipeline passed on Bitrise! ✅✅✅

Commit hash: 2857ecb
Build link: https://app.bitrise.io/app/be69d4368ee7e86d/pipelines/55dfd3d5-eb97-4d5e-ad80-c3519a2a5c1b

Note

  • You can kick off another pr_smoke_e2e_pipeline on Bitrise by removing and re-applying the Run Smoke E2E label on the pull request

Copy link

sonarqubecloud bot commented Dec 3, 2024

Copy link
Contributor

@Cal-L Cal-L left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@jake-perkins jake-perkins added Run Smoke E2E Triggers smoke e2e on Bitrise and removed Run Smoke E2E Triggers smoke e2e on Bitrise labels Dec 3, 2024
@jake-perkins jake-perkins added this pull request to the merge queue Dec 3, 2024
Merged via the queue into main with commit d4737f0 Dec 3, 2024
44 checks passed
@jake-perkins jake-perkins deleted the branch-sample branch December 3, 2024 22:19
@github-actions github-actions bot locked and limited conversation to collaborators Dec 3, 2024
@metamaskbot metamaskbot added the release-7.38.0 Issue or pull request that will be included in release 7.38.0 label Dec 3, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
No QA Needed Apply this label when your PR does not need any QA effort. release-7.38.0 Issue or pull request that will be included in release 7.38.0 Run Smoke E2E Triggers smoke e2e on Bitrise team-dev-ops DevOps team
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants