Skip to content

ci: run slow tests separately#1827

Draft
atravitz wants to merge 2 commits intomainfrom
ci/run_slow_tests_separately
Draft

ci: run slow tests separately#1827
atravitz wants to merge 2 commits intomainfrom
ci/run_slow_tests_separately

Conversation

@atravitz
Copy link
Contributor

@atravitz atravitz commented Feb 4, 2026

we only run slow tests when code is pushed to main, but it's not clear from our current test set up that that is a difference between PR CI and scheduled or manual CI.

Checklist

  • All new code is appropriately documented (user-facing code must have complete docstrings).
  • Added a news entry, or the changes are not user-facing.
  • Ran pre-commit: you can run pre-commit locally or comment on this PR with pre-commit.ci autofix.

Manual Tests: these are slow so don't need to be run every commit, only before merging and when relevant changes are made (generally at reviewer-discretion).

Developers certificate of origin

@atravitz atravitz changed the title run slow tests separately ci: run slow tests separately Feb 4, 2026
@github-actions
Copy link

github-actions bot commented Feb 4, 2026

🚨 API breaking changes detected! 🚨
View logs for this step

@atravitz
Copy link
Contributor Author

atravitz commented Feb 4, 2026

@mikemhenry- this might cause issues with our codecov. thoughts?

@codecov
Copy link

codecov bot commented Feb 4, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 93.01%. Comparing base (f7561cd) to head (eb24b73).
⚠️ Report is 6 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1827      +/-   ##
==========================================
- Coverage   95.27%   93.01%   -2.27%     
==========================================
  Files         201      201              
  Lines       17589    17575      -14     
==========================================
- Hits        16758    16347     -411     
- Misses        831     1228     +397     
Flag Coverage Δ
fast-tests 93.01% <ø> (?)
slow-tests ?

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant