Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 0 additions & 1 deletion .vortex/docs/content/development/composer.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -586,7 +586,6 @@ environment keeps its full tooling.
|---------|-------------|---------------|
| [`behat/behat`](https://github.com/Behat/Behat) | A PHP framework for Behavior-Driven Development (BDD), running human-readable stories that describe the behavior of your application. It facilitates communication between developers, stakeholders, and clients. | [Behat](testing/behat.mdx) |
| [`dantleech/gherkin-lint`](https://github.com/dantleech/gherkin-lint) | Lints the Gherkin feature files used in Behat tests, checking syntax and formatting for consistency. | [Gherkin Lint](code-quality/gherkin-lint.mdx) |
| [`drevops/behat-format-progress-fail`](https://github.com/drevops/behat-format-progress-fail) | A Behat output formatter that prints compact progress and expands the detail only for failing scenarios. | [Behat](testing/behat.mdx) |
| [`drevops/behat-screenshot`](https://github.com/drevops/behat-screenshot) | Automatically captures a screenshot when a Behat scenario fails, which helps to understand why a test failed. | [Behat](testing/behat.mdx) |
| [`drevops/behat-steps`](https://github.com/drevops/behat-steps) | A collection of pre-defined Behat step definitions for Drupal, speeding up the process of writing new tests. | [Behat](testing/behat.mdx) |
| [`drevops/phpcs-standard`](https://github.com/drevops/phpcs-standard) | A PHP_CodeSniffer coding standard that extends the Drupal coding standards with additional rules and best practices. | [PHPCS](code-quality/phpcs.mdx) |
Expand Down
5 changes: 1 addition & 4 deletions .vortex/docs/content/development/testing/behat.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -177,7 +177,6 @@ The configuration uses the following contexts and extensions:
- [Drupal Extension](https://github.com/jhedstrom/drupalextension): an integration layer between Behat, Mink Extension, and Drupal. It provides step definitions for common testing scenarios specific to Drupal sites.
- [Behat Steps](https://github.com/drevops/behat-steps): a library of re-usable Behat steps for Drupal.
- [Behat Screenshot](https://github.com/drevops/behat-screenshot): extension and step definitions to create HTML and image screenshots on demand or when tests fail.
- [Behat Progress Fail Output Extension](https://github.com/drevops/behat-format-progress-fail): output formatter, see [Output format](#output-format).

### FeatureContext

Expand Down Expand Up @@ -217,9 +216,7 @@ pipeline handles animation.

### Output format

Out of the box, **Vortex** comes with the [Behat Progress formatter](https://github.com/drevops/behat-format-progress-fail)
output formatter to show progress as TAP and failures inline. This lets a test
run continue after a failure while maintaining a minimal output.
Out of the box, **Vortex** uses Behat's built-in `progress` formatter with the `inline_failures` option turned on in `behat.yml`. It prints a dot for each passed step and the details of each failed, pending, or undefined step as soon as it happens. The test run continues after a failure while the output stays minimal.

## Observing the browser

Expand Down
2 changes: 0 additions & 2 deletions .vortex/installer/src/Prompts/Handlers/Tools.php
Original file line number Diff line number Diff line change
Expand Up @@ -497,15 +497,13 @@ public static function getToolDefinitions(string $filter = 'all'): array {
'title' => 'Behat',
'present' => fn(): mixed => File::contains($this->destinationDir . '/composer.json', 'behat/behat') ||
File::contains($this->destinationDir . '/composer.json', 'drupal/drupal-extension') ||
File::contains($this->destinationDir . '/composer.json', 'drevops/behat-format-progress-fail') ||
File::contains($this->destinationDir . '/composer.json', 'drevops/behat-screenshot') ||
File::contains($this->destinationDir . '/composer.json', 'drevops/behat-steps') ||
File::exists($this->destinationDir . '/behat.yml'),
'composer.json' => function (JsonManipulator $cj): void {
$cj->removeSubNode('require-dev', 'behat/behat');
$cj->removeSubNode('require-dev', 'drupal/drupal-extension');
$cj->removeSubNode('require-dev', 'dantleech/gherkin-lint');
$cj->removeSubNode('require-dev', 'drevops/behat-format-progress-fail');
$cj->removeSubNode('require-dev', 'drevops/behat-screenshot');
$cj->removeSubNode('require-dev', 'drevops/behat-steps');
},
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -18,8 +18,9 @@ default:
- DrevOps\BehatScreenshotExtension\Context\ScreenshotContext

formatters:
# Show test progress and explicit fail information whule continuing the test run.
progress_fail: true
# Show test progress and explicit fail information while continuing the test run.
progress:
inline_failures: true

# Output test results in JUnit format.
junit:
Expand Down Expand Up @@ -93,9 +94,6 @@ default:
- step
- datetime

# Show explicit fail information and continue the test run.
DrevOps\BehatFormatProgressFail\FormatExtension: ~

# Profiles for parallel testing. CI derives the profile number from the index
# of the runner it is on minus 'VORTEX_CI_BEHAT_PROFILE_OFFSET', so profiles
# stay numbered from 'p0' regardless of which runner Behat starts on. Adding a
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,6 @@
"require-dev": {
"behat/behat": "__VERSION__",
"dantleech/gherkin-lint": "__VERSION__",
"drevops/behat-format-progress-fail": "__VERSION__",
"drevops/behat-screenshot": "__VERSION__",
"drevops/behat-steps": "__VERSION__",
"drevops/phpcs-standard": "__VERSION__",
Expand Down
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
@@ -52,9 +52,9 @@
@@ -53,9 +53,9 @@
api_driver: drupal
drush_driver: drush
drupal:
Expand Down
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
@@ -121,38 +121,38 @@
@@ -120,38 +120,38 @@
"[web-root]/update.php": false
},
"locations": {
Expand Down
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
@@ -52,9 +52,9 @@
@@ -53,9 +53,9 @@
api_driver: drupal
drush_driver: drush
drupal:
Expand Down
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
@@ -121,38 +121,38 @@
@@ -120,38 +120,38 @@
"[web-root]/update.php": false
},
"locations": {
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@
},
"require-dev": {
"behat/behat": "__VERSION__",
@@ -66,7 +69,7 @@
@@ -65,7 +68,7 @@
"url": "https://packages.drupal.org/8"
}
],
Expand All @@ -26,7 +26,7 @@
"prefer-stable": true,
"autoload-dev": {
"classmap": [
@@ -84,7 +87,11 @@
@@ -83,7 +86,11 @@
"phpstan/extension-installer": true,
"pyrech/composer-changelogs": true,
"symfony/runtime": true,
Expand All @@ -39,7 +39,7 @@
},
"bump-after-update": true,
"discard-changes": true,
@@ -159,6 +166,17 @@
@@ -158,6 +165,17 @@
"patchLevel": {
"drupal/core": "-p2"
},
Expand Down
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
@@ -41,17 +41,10 @@
"drevops/behat-format-progress-fail": "__VERSION__",
@@ -40,17 +40,10 @@
"dantleech/gherkin-lint": "__VERSION__",
"drevops/behat-screenshot": "__VERSION__",
"drevops/behat-steps": "__VERSION__",
- "drevops/phpcs-standard": "__VERSION__",
Expand All @@ -16,7 +16,7 @@
"phpunit/phpunit": "__VERSION__",
"pyrech/composer-changelogs": "__VERSION__",
"softcreatr/jsonpath": "^0.10 || ^1.0",
@@ -77,11 +70,9 @@
@@ -76,11 +69,9 @@
"allow-plugins": {
"composer/installers": true,
"cweagans/composer-patches": true,
Expand Down
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
@@ -41,17 +41,10 @@
"drevops/behat-format-progress-fail": "__VERSION__",
@@ -40,17 +40,10 @@
"dantleech/gherkin-lint": "__VERSION__",
"drevops/behat-screenshot": "__VERSION__",
"drevops/behat-steps": "__VERSION__",
- "drevops/phpcs-standard": "__VERSION__",
Expand All @@ -16,7 +16,7 @@
"phpunit/phpunit": "__VERSION__",
"pyrech/composer-changelogs": "__VERSION__",
"softcreatr/jsonpath": "^0.10 || ^1.0",
@@ -77,11 +70,9 @@
@@ -76,11 +69,9 @@
"allow-plugins": {
"composer/installers": true,
"cweagans/composer-patches": true,
Expand Down
Original file line number Diff line number Diff line change
@@ -1,10 +1,9 @@
@@ -36,23 +36,15 @@
@@ -36,22 +36,15 @@
"drush/drush": "__VERSION__"
},
"require-dev": {
- "behat/behat": "__VERSION__",
- "dantleech/gherkin-lint": "__VERSION__",
- "drevops/behat-format-progress-fail": "__VERSION__",
- "drevops/behat-screenshot": "__VERSION__",
- "drevops/behat-steps": "__VERSION__",
"drevops/phpcs-standard": "__VERSION__",
Expand All @@ -22,7 +21,7 @@
"pyrech/composer-changelogs": "__VERSION__",
"softcreatr/jsonpath": "^0.10 || ^1.0",
"vincentlanglet/twig-cs-fixer": "__VERSION__"
@@ -68,11 +60,6 @@
@@ -67,11 +60,6 @@
],
"minimum-stability": "stable",
"prefer-stable": true,
Expand Down
Original file line number Diff line number Diff line change
@@ -1,10 +1,9 @@
@@ -36,23 +36,15 @@
@@ -36,22 +36,15 @@
"drush/drush": "__VERSION__"
},
"require-dev": {
- "behat/behat": "__VERSION__",
- "dantleech/gherkin-lint": "__VERSION__",
- "drevops/behat-format-progress-fail": "__VERSION__",
- "drevops/behat-screenshot": "__VERSION__",
- "drevops/behat-steps": "__VERSION__",
"drevops/phpcs-standard": "__VERSION__",
Expand All @@ -22,7 +21,7 @@
"pyrech/composer-changelogs": "__VERSION__",
"softcreatr/jsonpath": "^0.10 || ^1.0",
"vincentlanglet/twig-cs-fixer": "__VERSION__"
@@ -68,11 +60,6 @@
@@ -67,11 +60,6 @@
],
"minimum-stability": "stable",
"prefer-stable": true,
Expand Down
Original file line number Diff line number Diff line change
@@ -1,10 +1,9 @@
@@ -36,14 +36,8 @@
@@ -36,13 +36,8 @@
"drush/drush": "__VERSION__"
},
"require-dev": {
- "behat/behat": "__VERSION__",
- "dantleech/gherkin-lint": "__VERSION__",
- "drevops/behat-format-progress-fail": "__VERSION__",
- "drevops/behat-screenshot": "__VERSION__",
- "drevops/behat-steps": "__VERSION__",
"drevops/phpcs-standard": "__VERSION__",
Expand Down
Original file line number Diff line number Diff line change
@@ -1,10 +1,9 @@
@@ -36,14 +36,8 @@
@@ -36,13 +36,8 @@
"drush/drush": "__VERSION__"
},
"require-dev": {
- "behat/behat": "__VERSION__",
- "dantleech/gherkin-lint": "__VERSION__",
- "drevops/behat-format-progress-fail": "__VERSION__",
- "drevops/behat-screenshot": "__VERSION__",
- "drevops/behat-steps": "__VERSION__",
"drevops/phpcs-standard": "__VERSION__",
Expand Down
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
@@ -41,14 +41,11 @@
"drevops/behat-format-progress-fail": "__VERSION__",
@@ -40,14 +40,11 @@
"dantleech/gherkin-lint": "__VERSION__",
"drevops/behat-screenshot": "__VERSION__",
"drevops/behat-steps": "__VERSION__",
- "drevops/phpcs-standard": "__VERSION__",
Expand All @@ -13,7 +13,7 @@
"phpspec/prophecy-phpunit": "__VERSION__",
"phpstan/extension-installer": "__VERSION__",
"phpstan/phpstan": "__VERSION__",
@@ -77,7 +74,6 @@
@@ -76,7 +73,6 @@
"allow-plugins": {
"composer/installers": true,
"cweagans/composer-patches": true,
Expand Down
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
@@ -41,14 +41,11 @@
"drevops/behat-format-progress-fail": "__VERSION__",
@@ -40,14 +40,11 @@
"dantleech/gherkin-lint": "__VERSION__",
"drevops/behat-screenshot": "__VERSION__",
"drevops/behat-steps": "__VERSION__",
- "drevops/phpcs-standard": "__VERSION__",
Expand All @@ -13,7 +13,7 @@
"phpspec/prophecy-phpunit": "__VERSION__",
"phpstan/extension-installer": "__VERSION__",
"phpstan/phpstan": "__VERSION__",
@@ -77,7 +74,6 @@
@@ -76,7 +73,6 @@
"allow-plugins": {
"composer/installers": true,
"cweagans/composer-patches": true,
Expand Down
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
@@ -45,13 +45,10 @@
@@ -44,13 +44,10 @@
"drupal/coder": "__VERSION__",
"drupal/drupal-extension": "__VERSION__",
"ergebnis/composer-normalize": "__VERSION__",
Expand All @@ -12,7 +12,7 @@
"phpunit/phpunit": "__VERSION__",
"pyrech/composer-changelogs": "__VERSION__",
"softcreatr/jsonpath": "^0.10 || ^1.0",
@@ -81,7 +78,6 @@
@@ -80,7 +77,6 @@
"drupal/core-composer-scaffold": true,
"ergebnis/composer-normalize": true,
"php-http/discovery": true,
Expand Down
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
@@ -45,13 +45,10 @@
@@ -44,13 +44,10 @@
"drupal/coder": "__VERSION__",
"drupal/drupal-extension": "__VERSION__",
"ergebnis/composer-normalize": "__VERSION__",
Expand All @@ -12,7 +12,7 @@
"phpunit/phpunit": "__VERSION__",
"pyrech/composer-changelogs": "__VERSION__",
"softcreatr/jsonpath": "^0.10 || ^1.0",
@@ -81,7 +78,6 @@
@@ -80,7 +77,6 @@
"drupal/core-composer-scaffold": true,
"ergebnis/composer-normalize": true,
"php-http/discovery": true,
Expand Down
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
@@ -49,10 +49,8 @@
@@ -48,10 +48,8 @@
"mikey179/vfsstream": "__VERSION__",
"palantirnet/drupal-rector": "__VERSION__",
"phpcompatibility/php-compatibility": "__VERSION__",
Expand All @@ -9,7 +9,7 @@
"pyrech/composer-changelogs": "__VERSION__",
"softcreatr/jsonpath": "^0.10 || ^1.0",
"vincentlanglet/twig-cs-fixer": "__VERSION__"
@@ -68,11 +66,6 @@
@@ -67,11 +65,6 @@
],
"minimum-stability": "stable",
"prefer-stable": true,
Expand Down
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
@@ -49,10 +49,8 @@
@@ -48,10 +48,8 @@
"mikey179/vfsstream": "__VERSION__",
"palantirnet/drupal-rector": "__VERSION__",
"phpcompatibility/php-compatibility": "__VERSION__",
Expand All @@ -9,7 +9,7 @@
"pyrech/composer-changelogs": "__VERSION__",
"softcreatr/jsonpath": "^0.10 || ^1.0",
"vincentlanglet/twig-cs-fixer": "__VERSION__"
@@ -68,11 +66,6 @@
@@ -67,11 +65,6 @@
],
"minimum-stability": "stable",
"prefer-stable": true,
Expand Down
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
@@ -47,7 +47,6 @@
@@ -46,7 +46,6 @@
"ergebnis/composer-normalize": "__VERSION__",
"mglaman/phpstan-drupal": "__VERSION__",
"mikey179/vfsstream": "__VERSION__",
Expand Down
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
@@ -47,7 +47,6 @@
@@ -46,7 +46,6 @@
"ergebnis/composer-normalize": "__VERSION__",
"mglaman/phpstan-drupal": "__VERSION__",
"mikey179/vfsstream": "__VERSION__",
Expand Down
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
@@ -54,8 +54,7 @@
@@ -53,8 +53,7 @@
"phpstan/phpstan": "__VERSION__",
"phpunit/phpunit": "__VERSION__",
"pyrech/composer-changelogs": "__VERSION__",
Expand Down
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
@@ -54,8 +54,7 @@
@@ -53,8 +53,7 @@
"phpstan/phpstan": "__VERSION__",
"phpunit/phpunit": "__VERSION__",
"pyrech/composer-changelogs": "__VERSION__",
Expand Down
Original file line number Diff line number Diff line change
@@ -1,10 +1,9 @@
@@ -36,26 +36,10 @@
@@ -36,25 +36,10 @@
"drush/drush": "__VERSION__"
},
"require-dev": {
- "behat/behat": "__VERSION__",
- "dantleech/gherkin-lint": "__VERSION__",
- "drevops/behat-format-progress-fail": "__VERSION__",
- "drevops/behat-screenshot": "__VERSION__",
- "drevops/behat-steps": "__VERSION__",
- "drevops/phpcs-standard": "__VERSION__",
Expand All @@ -26,7 +25,7 @@
},
"conflict": {
"drupal/drupal": "*"
@@ -68,20 +52,13 @@
@@ -67,20 +52,13 @@
],
"minimum-stability": "stable",
"prefer-stable": true,
Expand Down
8 changes: 3 additions & 5 deletions behat.yml
Original file line number Diff line number Diff line change
Expand Up @@ -18,8 +18,9 @@ default:
- DrevOps\BehatScreenshotExtension\Context\ScreenshotContext

formatters:
# Show test progress and explicit fail information whule continuing the test run.
progress_fail: true
# Show test progress and explicit fail information while continuing the test run.
progress:
inline_failures: true

# Output test results in JUnit format.
junit:
Expand Down Expand Up @@ -93,9 +94,6 @@ default:
- step
- datetime

# Show explicit fail information and continue the test run.
DrevOps\BehatFormatProgressFail\FormatExtension: ~

# Profiles for parallel testing. CI derives the profile number from the index
# of the runner it is on minus 'VORTEX_CI_BEHAT_PROFILE_OFFSET', so profiles
# stay numbered from 'p0' regardless of which runner Behat starts on. Adding a
Expand Down
3 changes: 1 addition & 2 deletions composer.json
Original file line number Diff line number Diff line change
Expand Up @@ -39,9 +39,8 @@
"drush/drush": "^13.8.0"
},
"require-dev": {
"behat/behat": "^3.33.0",
"behat/behat": "^3.34.0",
"dantleech/gherkin-lint": "^0.2.4",
"drevops/behat-format-progress-fail": "^1.5.1",
"drevops/behat-screenshot": "^2.6.0",
"drevops/behat-steps": "^3.14.2",
"drevops/phpcs-standard": "^1.1.0",
Expand Down
Loading