Skip to content

Do not ignore SKIP as a new test result after re-test#23

Open
miczyg1 wants to merge 1 commit into
v7.3-merged-changesfrom
rerun_failed_no_ignore_skips
Open

Do not ignore SKIP as a new test result after re-test#23
miczyg1 wants to merge 1 commit into
v7.3-merged-changesfrom
rerun_failed_no_ignore_skips

Conversation

@miczyg1
Copy link
Copy Markdown
Member

@miczyg1 miczyg1 commented May 7, 2026

Fixes the problem where unsupported/skipped tests in rerun would not get their state updated from FAIL to SKIP.

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>
@miczyg1
Copy link
Copy Markdown
Member Author

miczyg1 commented May 7, 2026

Simple test:

*** Test Cases ***
Rebot Skip Test
    Skip If   "${SKIP_NOW}" == "yes"
    Fail

Commands:

robot -L TRACE -v SKIP_NOW:no test.robot
robot -L TRACE --rerunfailed output.xml -l new_log.html -r new_report.html -o new_output.xml -v SKIP_NOW:yes test.robot
rebot --log merged_log.html --report merged_report.html --output merged_output.xml --merge output.xml new_output.xml

merged_log.html

@miczyg1 miczyg1 requested a review from philipanda May 7, 2026 09:37
if old is None:
test.message = self._create_add_message(test)
self.current.tests.append(test)
elif test.skipped:
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe make it conditional using a flag passed to rebot?
This way there would be less friction in future rebases of the fork.

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggestions to the flag name?

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe --skip-overrides-fail?

Test merge should have been successful suite name=Custom
Log should have been created with Fail keywords flattened

Merge ignores skip
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The test fails for me:

----------------------------------------------------------------------------------------------------
FAIL: Robot.Rebot.Merge.Merge skip result
Evaluating expression "'Test skipped using 'NOT skip' tag pattern.' != ''" failed: SyntaxError: invalid syntax (<string>, line 1)
----------------------------------------------------------------------------------------------------

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants