Script for running integtests in whichever repos the user specifies #290
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…revented the printout of the pytest duration summary when running integtests from the base release
…n a couple of long options; added some echo statements to give feedback to the user on what is happening.
Expanded the documentation for integtest scripts, including detailed usage information for each script's help command.
Expanded the documentation for integtest scripts to include detailed usage instructions and examples for each script.
Added examples of using the list_repos_with_integtests.sh script to find repositories with integration tests.
Added usage example for list_repos_with_integtests.sh script and removed redundant section.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
In recent discussions about the running of integtests (regression tests and integration tests), people (including me) mentioned several requests for enhancements. Those included the following:
This changes covered by this PR attempt to meet that need. A global bundle script named
dunedaq_integtest_bundle.shhas been created and a couple of utility scripts for finding repos with integtests and listing the integtests in a given repo are included.A markdown document has been created in the
docssubdirectory of this repo with an introduction to these new scripts. Please refer to that document for instructions on how to use the scripts.Testing of these changes would include running various combinations of integtests using the
dunedaq_integtest_bundle.shscript and specifying different command-line options to customize the behavior of the script.To get access to these scripts before they are merged to the
developbranch ofdaqsystemtest, users should include thekbiery/global_bundle_scriptbranch ofdaqsystemtestin their local software area(s) and rebuild the software area to get the scripts copied into the appropriatebinareas.Please note that some of the command-line options that were available in the older
daqsystemtest_integtest_bundle.shscript have not been carried forward to the new global bundle script. For example, ones that specify the Nth thru Mth tests to be run. That functionality became less useful in the global bundle script since the list of tests to be run is much more dynamic with that script.Type of change
Testing checklist
pytest -s minimal_system_quick_test.py)dunedaq_integtest_bundle.sh)