Skip to content

removed old test trigger and added pom config for running rascal tests directly - #34

Open
jurgenvinju wants to merge 21 commits into
mainfrom
feat/rascal-tests
Open

removed old test trigger and added pom config for running rascal tests directly#34
jurgenvinju wants to merge 21 commits into
mainfrom
feat/rascal-tests

Conversation

@jurgenvinju

@jurgenvinju jurgenvinju commented Aug 10, 2026

Copy link
Copy Markdown
Member

No description provided.

@github-actions

github-actions Bot commented Aug 13, 2026

Copy link
Copy Markdown

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
105    ↓46 100    ↓47 1    ↑1 4 0 0 1m 4s    ↓2m 7s

Test Results

failed 1 failed ↑1
passed 100 passed ↓47
skipped 4 skipped

Details

tests 105 tests in 12 suites ↓46
clock 1m 4s ↓2m 7s
tool Rascal test runner
build Build and Deploy arrow-right builds link #172
pull-request removed old test trigger and added pom config for running rascal tests directly link #34

Failed Tests

testEqTrue

Skipped Tests

testDefParamUnSet
testDefParamSet
fullyDecompileBankClass
fullyDecompileRoundtripClass

Insights

Average Tests per Run Total Flaky Tests Total Failed Slowest Test (p95)
128 0 1 12.7s

Fail Rate

Fail Rate 0.39%    ↑0.39
Test 📝 Results 📊 Passed ✅ Failed ❌ Fail Rate (%) 📈
testEqTrue 3 2 1 33.33    ↑33.33

builds: Run #172

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Pending ⏳ Other ❓ Flaky 🍂 Duration ⏱️
105 100 1 4 0 0 0 1m 4s

❌ Some tests failed!

Name Failure Message
❌ testEqTrue Test lang::flybytes::tests::ComparisonTests::testEqTrue failed due to test returned false

Actual parameters:
int =>7

Slowest Tests

Test 📝 Results 📊 Duration (avg) ⏱️ Duration (p95) ⏱️
arrayLengthStringFilled 2 8.9s 12.7s
arrayLengthFilled 2 10.0s 10.1s
testEqFalse 3 6.4s 9.2s
testLt 3 4.8s 7.5s
testGt 3 4.9s 7.4s
testLe 3 5.2s 7.1s
testNEqTrue 3 4.9s 6.7s
intVariables 2 5.2s 5.7s
testGt2 2 4.7s 5.5s
testEqTrue2 2 3.5s 5.1s

± Comparison with run #171 at 5724edb | ⏱️ Measured over 2 runs.

Github Test Reporter by CTRF 💚

@github-actions

github-actions Bot commented Aug 13, 2026

Copy link
Copy Markdown

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
105 100 1 4 0 0 1m    ↓4.0s

Test Results

failed 1 failed
passed 100 passed
skipped 4 skipped

Details

tests 105 tests in 12 suites
clock 1m ↓4.0s
tool Rascal test runner
build Build and Deploy arrow-right builds link #173
pull-request removed old test trigger and added pom config for running rascal tests directly link #34

Failed Tests

testEqTrue

Skipped Tests

testDefParamSet
testDefParamUnSet
fullyDecompileRoundtripClass
fullyDecompileBankClass

Insights

Average Tests per Run Total Flaky Tests Total Failed Slowest Test (p95)
120 0 2 12.7s

Fail Rate

Fail Rate 0.55%    ↑0.16
Test 📝 Results 📊 Passed ✅ Failed ❌ Fail Rate (%) 📈
testEqTrue 4 2 2 50.00    ↑16.67

builds: Run #173

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Pending ⏳ Other ❓ Flaky 🍂 Duration ⏱️
105 100 1 4 0 0 0 1m

❌ Some tests failed!

Name Failure Message
❌ testEqTrue Test lang::flybytes::tests::ComparisonTests::testEqTrue failed due to test returned false

Actual parameters:
int =>0

Slowest Tests

Test 📝 Results 📊 Duration (avg) ⏱️ Duration (p95) ⏱️
arrayLengthStringFilled 3 7.4s 12.7s
arrayLengthFilled 3 7.9s 10.1s
testEqFalse 4 7.0s 9.2s
testLt 4 4.6s 7.5s
testGt 4 4.7s 7.4s
testLe 4 4.7s 7.1s
testNEqTrue 4 4.6s 6.7s
intVariables 3 5.1s 5.7s
testGt2 3 4.1s 5.5s
testEqTrue2 3 2.7s 5.1s

Files

100 passed, 1 failed, and 4 skipped in 1m across 12 files

File Path Passed Failed Flaky Skipped Duration
✅ src/lang/flybytes/tests/VariableTests.rsc
        ✅ boolVariableTrue (4.0s)
        ✅ stringVariable (12ms)
        ✅ boolVariableFalse (5ms)
        ✅ floatVariables (2.2s)
        ✅ intVariables (4.9s)
 ✅ 5 11.2s
✅ src/lang/flybytes/tests/SwitchTests.rsc
        ✅ simpleSwitch3lookup (36ms)
        ✅ compactDefaultSwitch3Lookup (5ms)
        ✅ simpleSwitch2lookup (2ms)
        ✅ compactDefaultSwitch4Auto (1ms)
        ✅ simpleDefaultSwitch2Lookup (1ms)
        ✅ simpleSwitch3auto (1ms)
        ✅ simpleDefaultSwitch2Auto (1ms)
        ✅ compactDefaultSwitch3Auto (1ms)
        ✅ simpleSwitch1table (1ms)
        ✅ simpleDefaultSwitch1Lookup (1ms)
        ✅ simpleSwitch1auto (1ms)
        ✅ simpleDefaultSwitch2Table (1ms)
        ✅ simpleSwitch2auto (1ms)
        ✅ simpleSwitch3table (1ms)
        ✅ compactDefaultSwitch2Lookup (1ms)
        ✅ compactDefaultSwitch3Table (1ms)
        ✅ compactDefaultSwitch2Table (1ms)
        ✅ compactDefaultSwitch4Table (2ms)
        ✅ simpleDefaultSwitch3Lookup (1ms)
        ✅ simpleDefaultSwitch3Table (1ms)
        ✅ simpleSwitch2table (1ms)
        ✅ simpleDefaultSwitch1Table (1ms)
        ✅ simpleDefaultSwitch1Auto (1ms)
        ✅ compactDefaultSwitch4Lookup (1ms)
        ✅ simpleSwitch1lookup (1ms)
        ✅ simpleDefaultSwitch3Auto (1ms)
        ✅ compactDefaultSwitch1Lookup (1ms)
        ✅ compactDefaultSwitch2Auto (1ms)
        ✅ compactDefaultSwitch1Auto (1ms)
        ✅ compactDefaultSwitch1Table (1ms)
 ✅ 30 68ms
✅ src/lang/flybytes/tests/OtherExpressionTests.rsc
        ✅ testCoerceIntDouble (19ms)
        ✅ testNew (2ms)
        ✅ testInc (3ms)
        ✅ testCoerceDoubleInt (3ms)
        ✅ testIncStat (2ms)
 ✅ 5 29ms
✅ src/lang/flybytes/tests/NoCastCheckTest.rsc
        ✅ upcastTest (17ms)
        ✅ downcastTest (2ms)
 ✅ 2 19ms
✅ src/lang/flybytes/tests/MonitorTests.rsc
        ✅ monitorReturnTest (19ms)
        ✅ monitorBreakTest (1ms)
        ✅ monitorUncaughtThrowTest (3ms)
 ✅ 3 23ms
✅ src/lang/flybytes/tests/MirrorTests.rsc
        ✅ annoMirror (32ms)
        ✅ longId (3.5s)
        ✅ arrayLoadStringSingleton (5ms)
        ✅ stringId (208ms)
        ✅ longStatic (24ms)
        ✅ arrayLengthStringFilled (4.4s)
        ✅ newInstance (2ms)
        ✅ floatStatic (4ms)
        ✅ staticClassName (30ms)
        ✅ arrayLoadLong (2ms)
        ✅ invokeMethod (1ms)
        ✅ objectClassName (1ms)
        ✅ floatId (6ms)
        ✅ doubleStatic (2ms)
        ✅ byteId (585ms)
        ✅ getField (1ms)
        ✅ arrayLoadInteger (1ms)
        ✅ intId (424ms)
        ✅ arrayLengthDefault (1ms)
        ✅ shortId (454ms)
        ✅ arrayMirror (383ms)
        ✅ arrayLengthFilled (3.9s)
        ✅ doubleId (2ms)
        ✅ intStatic (1ms)
        ✅ arrayLoadObjectNull (1ms)
        ✅ invokeStatic (1ms)
        ✅ arrayLoadStringNull (1ms)
        ✅ arrayLoadStringTwo (1ms)
 ✅ 28 14.0s
✅ src/lang/flybytes/tests/LoopTests.rsc
        ✅ testNormalDoWhile (11ms)
        ✅ testNormalFor (10ms)
        ✅ testBreakNested (2ms)
        ✅ testNormalDoWhile2 (4ms)
        ✅ testNestedFor (2ms)
        ✅ testForContinue (1ms)
        ✅ testBreakFor (2ms)
 ✅ 7 32ms
✅ src/lang/flybytes/tests/InterfaceTests.rsc
        ✅ testInterfaceDefaultMethod (9ms)
        ✅ implementAbstractMethodInvokeVirtual (5ms)
        ✅ implementAbstractMethodInvokeInterface (2ms)
 ✅ 3 16ms
✅ src/lang/flybytes/tests/GotoTests.rsc
        ✅ breakContinueLabeledBlock (11ms)
 ✅ 1 11ms
✅ src/lang/flybytes/tests/DefaultParameters.rsc
        ⏭️ testDefParamSet (1ms)
        ⏭️ testDefParamUnSet (1ms)
 ⏭️ 2 not captured
✅ src/lang/flybytes/tests/DecompileTests.rsc
        ⏭️ fullyDecompileRoundtripClass (1ms)
        ⏭️ fullyDecompileBankClass (1ms)
        ✅ fullyDecompileAccountClass (348ms)
 ✅ 1 ⏭️ 2 348ms
❌ src/lang/flybytes/tests/ComparisonTests.rsc
        ✅ testEqFalse (8.7s)
        ✅ testGt (4.3s)
        ✅ testEqFalse2 (1.3s)
        ✅ testLe (3.5s)
        ✅ testNEqTrue (3.8s)
        ✅ testNEqFalse (2.8s)
        ❌ testEqTrue (4ms)
        ✅ testLe2 (1.8s)
        ✅ testEqTrue3 (7ms)
        ✅ testEqTrue2 (1.2s)
        ✅ testEqFalse3 (4ms)
        ✅ testGeInt (3.0s)
        ✅ testLt2 (2.3s)
        ✅ testGt2 (2.9s)
        ✅ testGeReal (3.9s)
        ✅ testLt (3.7s)
 ✅ 15 ❌ 1 43.4s

± Comparison with run #172 at 72e5618 | ⏱️ Measured over 3 runs.

Github Test Reporter by CTRF 💚

@github-actions

github-actions Bot commented Aug 13, 2026

Copy link
Copy Markdown

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
105 100 1 4 0 0 40.3s    ↓20.1s

Test Results

failed 1 failed
passed 100 passed
skipped 4 skipped

Details

tests 105 tests in 12 suites
clock 40.3s ↓20.1s
tool Rascal test runner
build Build and Deploy arrow-right builds link #174
pull-request removed old test trigger and added pom config for running rascal tests directly link #34

Failed Tests

testEqTrue

Skipped Tests

testDefParamUnSet
testDefParamSet
fullyDecompileBankClass
fullyDecompileRoundtripClass

Insights

Average Tests per Run Total Flaky Tests Total Failed Slowest Test (p95)
117 0 3 15.7s

Fail Rate

Fail Rate 0.64%    ↑0.09
Test 📝 Results 📊 Passed ✅ Failed ❌ Fail Rate (%) 📈
testEqTrue 5 2 3 60.00    ↑10.00

builds: Run #174

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Pending ⏳ Other ❓ Flaky 🍂 Duration ⏱️
105 100 1 4 0 0 0 40.3s

❌ Some tests failed!

Name Failure Message
❌ testEqTrue Test lang::flybytes::tests::ComparisonTests::testEqTrue failed due to test returned false

Actual parameters:
int =>-940424174582697081727716768479487389

Slowest Tests

Test 📝 Results 📊 Duration (avg) ⏱️ Duration (p95) ⏱️
intVariables 4 7.8s 15.7s
arrayLengthStringFilled 4 6.2s 12.7s
arrayLengthFilled 4 6.6s 10.1s
testEqFalse 5 6.0s 9.2s
testLt 5 4.1s 7.5s
testGt 5 4.3s 7.4s
testLe 5 4.3s 7.1s
testNEqTrue 5 4.1s 6.7s
testGt2 4 3.7s 5.5s
testEqTrue2 4 2.4s 5.1s

Suites

100 passed, 1 failed, and 4 other

Suite Passed Failed Other Duration
✅ src/lang/flybytes/tests/VariableTests.rsc
        ✅ intVariables
        ✅ boolVariableTrue
        ✅ floatVariables
        ✅ boolVariableFalse
        ✅ stringVariable
 ✅ 5 ❌ 0 ⏭️ 0 18.8s
✅ src/lang/flybytes/tests/SwitchTests.rsc
        ✅ simpleSwitch2table
        ✅ simpleDefaultSwitch1Table
        ✅ simpleDefaultSwitch2Table
        ✅ compactDefaultSwitch3Lookup
        ✅ compactDefaultSwitch1Auto
        ✅ compactDefaultSwitch2Lookup
        ✅ simpleDefaultSwitch2Lookup
        ✅ simpleDefaultSwitch1Auto
        ✅ simpleSwitch1table
        ✅ compactDefaultSwitch1Lookup
        ✅ simpleDefaultSwitch2Auto
        ✅ compactDefaultSwitch4Table
        ✅ compactDefaultSwitch2Table
        ✅ simpleSwitch2auto
        ✅ simpleSwitch1lookup
        ✅ compactDefaultSwitch4Auto
        ✅ simpleDefaultSwitch3Auto
        ✅ simpleSwitch3lookup
        ✅ simpleSwitch1auto
        ✅ compactDefaultSwitch1Table
        ✅ compactDefaultSwitch3Auto
        ✅ simpleDefaultSwitch1Lookup
        ✅ simpleSwitch2lookup
        ✅ compactDefaultSwitch3Table
        ✅ simpleSwitch3table
        ✅ simpleDefaultSwitch3Table
        ✅ simpleDefaultSwitch3Lookup
        ✅ compactDefaultSwitch4Lookup
        ✅ simpleSwitch3auto
        ✅ compactDefaultSwitch2Auto
 ✅ 30 ❌ 0 ⏭️ 0 97ms
✅ src/lang/flybytes/tests/OtherExpressionTests.rsc
        ✅ testIncStat
        ✅ testNew
        ✅ testInc
        ✅ testCoerceDoubleInt
        ✅ testCoerceIntDouble
 ✅ 5 ❌ 0 ⏭️ 0 14ms
✅ src/lang/flybytes/tests/NoCastCheckTest.rsc
        ✅ downcastTest
        ✅ upcastTest
 ✅ 2 ❌ 0 ⏭️ 0 10ms
✅ src/lang/flybytes/tests/MonitorTests.rsc
        ✅ monitorReturnTest
        ✅ monitorBreakTest
        ✅ monitorUncaughtThrowTest
 ✅ 3 ❌ 0 ⏭️ 0 16ms
✅ src/lang/flybytes/tests/MirrorTests.rsc
        ✅ intStatic
        ✅ stringId
        ✅ annoMirror
        ✅ doubleId
        ✅ intId
        ✅ longId
        ✅ arrayLoadStringNull
        ✅ arrayLoadStringTwo
        ✅ arrayLoadInteger
        ✅ arrayLengthDefault
        ✅ arrayLengthStringFilled
        ✅ staticClassName
        ✅ arrayMirror
        ✅ shortId
        ✅ floatId
        ✅ newInstance
        ✅ arrayLoadLong
        ✅ longStatic
        ✅ doubleStatic
        ✅ arrayLoadStringSingleton
        ✅ byteId
        ✅ arrayLengthFilled
        ✅ objectClassName
        ✅ invokeMethod
        ✅ arrayLoadObjectNull
        ✅ floatStatic
        ✅ getField
        ✅ invokeStatic
 ✅ 28 ❌ 0 ⏭️ 0 8.6s
✅ src/lang/flybytes/tests/LoopTests.rsc
        ✅ testNestedFor
        ✅ testNormalDoWhile2
        ✅ testNormalFor
        ✅ testBreakNested
        ✅ testBreakFor
        ✅ testNormalDoWhile
        ✅ testForContinue
 ✅ 7 ❌ 0 ⏭️ 0 16ms
✅ src/lang/flybytes/tests/InterfaceTests.rsc
        ✅ testInterfaceDefaultMethod
        ✅ implementAbstractMethodInvokeVirtual
        ✅ implementAbstractMethodInvokeInterface
 ✅ 3 ❌ 0 ⏭️ 0 9ms
✅ src/lang/flybytes/tests/GotoTests.rsc
        ✅ breakContinueLabeledBlock
 ✅ 1 ❌ 0 ⏭️ 0 5ms
✅ src/lang/flybytes/tests/DefaultParameters.rsc
        ⏭️ testDefParamUnSet
        ⏭️ testDefParamSet
 ✅ 0 ❌ 0 ⏭️ 2 not captured
✅ src/lang/flybytes/tests/DecompileTests.rsc
        ⏭️ fullyDecompileBankClass
        ✅ fullyDecompileAccountClass
        ⏭️ fullyDecompileRoundtripClass
 ✅ 1 ❌ 0 ⏭️ 2 223ms
❌ src/lang/flybytes/tests/ComparisonTests.rsc
        ✅ testLe2
        ✅ testEqTrue3
        ✅ testLt2
        ✅ testGt2
        ✅ testLt
        ✅ testNEqFalse
        ✅ testEqFalse
        ✅ testEqFalse2
        ✅ testEqFalse3
        ✅ testEqTrue2
        ❌ testEqTrue
        ✅ testGeReal
        ✅ testNEqTrue
        ✅ testGeInt
        ✅ testLe
        ✅ testGt
 ✅ 15 ❌ 1 ⏭️ 0 29.7s

Files

100 passed, 1 failed, and 4 skipped in 40.3s across 12 files

File Path Passed Failed Flaky Skipped Duration
✅ src/lang/flybytes/tests/VariableTests.rsc
        ✅ intVariables (15.7s)
        ✅ boolVariableTrue (1ms)
        ✅ floatVariables (3.1s)
        ✅ boolVariableFalse (1ms)
        ✅ stringVariable (3ms)
 ✅ 5 18.8s
✅ src/lang/flybytes/tests/SwitchTests.rsc
        ✅ simpleSwitch2table (10ms)
        ✅ simpleDefaultSwitch1Table (2ms)
        ✅ simpleDefaultSwitch2Table (1ms)
        ✅ compactDefaultSwitch3Lookup (4ms)
        ✅ compactDefaultSwitch1Auto (1ms)
        ✅ compactDefaultSwitch2Lookup (3ms)
        ✅ simpleDefaultSwitch2Lookup (1ms)
        ✅ simpleDefaultSwitch1Auto (1ms)
        ✅ simpleSwitch1table (1ms)
        ✅ compactDefaultSwitch1Lookup (5ms)
        ✅ simpleDefaultSwitch2Auto (1ms)
        ✅ compactDefaultSwitch4Table (1ms)
        ✅ compactDefaultSwitch2Table (1ms)
        ✅ simpleSwitch2auto (1ms)
        ✅ simpleSwitch1lookup (1ms)
        ✅ compactDefaultSwitch4Auto (1ms)
        ✅ simpleDefaultSwitch3Auto (1ms)
        ✅ simpleSwitch3lookup (1ms)
        ✅ simpleSwitch1auto (1ms)
        ✅ compactDefaultSwitch1Table (1ms)
        ✅ compactDefaultSwitch3Auto (1ms)
        ✅ simpleDefaultSwitch1Lookup (1ms)
        ✅ simpleSwitch2lookup (1ms)
        ✅ compactDefaultSwitch3Table (1ms)
        ✅ simpleSwitch3table (1ms)
        ✅ simpleDefaultSwitch3Table (1ms)
        ✅ simpleDefaultSwitch3Lookup (59ms)
        ✅ compactDefaultSwitch4Lookup (1ms)
        ✅ simpleSwitch3auto (1ms)
        ✅ compactDefaultSwitch2Auto (1ms)
 ✅ 30 97ms
✅ src/lang/flybytes/tests/OtherExpressionTests.rsc
        ✅ testIncStat (8ms)
        ✅ testNew (1ms)
        ✅ testInc (1ms)
        ✅ testCoerceDoubleInt (3ms)
        ✅ testCoerceIntDouble (1ms)
 ✅ 5 14ms
✅ src/lang/flybytes/tests/NoCastCheckTest.rsc
        ✅ downcastTest (9ms)
        ✅ upcastTest (1ms)
 ✅ 2 10ms
✅ src/lang/flybytes/tests/MonitorTests.rsc
        ✅ monitorReturnTest (13ms)
        ✅ monitorBreakTest (1ms)
        ✅ monitorUncaughtThrowTest (2ms)
 ✅ 3 16ms
✅ src/lang/flybytes/tests/MirrorTests.rsc
        ✅ intStatic (1.8s)
        ✅ stringId (223ms)
        ✅ annoMirror (9ms)
        ✅ doubleId (9ms)
        ✅ intId (243ms)
        ✅ longId (154ms)
        ✅ arrayLoadStringNull (1ms)
        ✅ arrayLoadStringTwo (3ms)
        ✅ arrayLoadInteger (1ms)
        ✅ arrayLengthDefault (1ms)
        ✅ arrayLengthStringFilled (2.7s)
        ✅ staticClassName (1ms)
        ✅ arrayMirror (238ms)
        ✅ shortId (398ms)
        ✅ floatId (2ms)
        ✅ newInstance (1ms)
        ✅ arrayLoadLong (1ms)
        ✅ longStatic (1ms)
        ✅ doubleStatic (1ms)
        ✅ arrayLoadStringSingleton (1ms)
        ✅ byteId (399ms)
        ✅ arrayLengthFilled (2.4s)
        ✅ objectClassName (1ms)
        ✅ invokeMethod (2ms)
        ✅ arrayLoadObjectNull (1ms)
        ✅ floatStatic (1ms)
        ✅ getField (1ms)
        ✅ invokeStatic (1ms)
 ✅ 28 8.6s
✅ src/lang/flybytes/tests/LoopTests.rsc
        ✅ testNestedFor (6ms)
        ✅ testNormalDoWhile2 (2ms)
        ✅ testNormalFor (4ms)
        ✅ testBreakNested (1ms)
        ✅ testBreakFor (1ms)
        ✅ testNormalDoWhile (1ms)
        ✅ testForContinue (1ms)
 ✅ 7 16ms
✅ src/lang/flybytes/tests/InterfaceTests.rsc
        ✅ testInterfaceDefaultMethod (5ms)
        ✅ implementAbstractMethodInvokeVirtual (2ms)
        ✅ implementAbstractMethodInvokeInterface (2ms)
 ✅ 3 9ms
✅ src/lang/flybytes/tests/GotoTests.rsc
        ✅ breakContinueLabeledBlock (5ms)
 ✅ 1 5ms
✅ src/lang/flybytes/tests/DefaultParameters.rsc
        ⏭️ testDefParamUnSet (1ms)
        ⏭️ testDefParamSet (1ms)
 ⏭️ 2 not captured
✅ src/lang/flybytes/tests/DecompileTests.rsc
        ⏭️ fullyDecompileBankClass (1ms)
        ✅ fullyDecompileAccountClass (223ms)
        ⏭️ fullyDecompileRoundtripClass (1ms)
 ✅ 1 ⏭️ 2 223ms
❌ src/lang/flybytes/tests/ComparisonTests.rsc
        ✅ testLe2 (4.0s)
        ✅ testEqTrue3 (7ms)
        ✅ testLt2 (2.2s)
        ✅ testGt2 (2.3s)
        ✅ testLt (2.2s)
        ✅ testNEqFalse (1.8s)
        ✅ testEqFalse (2.1s)
        ✅ testEqFalse2 (1.6s)
        ✅ testEqFalse3 (8ms)
        ✅ testEqTrue2 (1.3s)
        ❌ testEqTrue (3ms)
        ✅ testGeReal (2.7s)
        ✅ testNEqTrue (1.8s)
        ✅ testGeInt (2.4s)
        ✅ testLe (2.6s)
        ✅ testGt (2.7s)
 ✅ 15 ❌ 1 29.7s

± Comparison with run #173 at 1a7d1ef | ⏱️ Measured over 4 runs.

Github Test Reporter by CTRF 💚

@github-actions

github-actions Bot commented Aug 13, 2026

Copy link
Copy Markdown

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
151    ↑46 147    ↑47 0    ↓1 4 0 0 2m 47s    ↑2m 7s

Test Results

passed 147 passed ↑47
skipped 4 skipped

Details

tests 151 tests in 18 suites ↑46
clock 2m 47s ↑2m 7s
tool Rascal test runner
build Build and Deploy arrow-right builds link #175
pull-request removed old test trigger and added pom config for running rascal tests directly link #34

Skipped Tests

testDefParamSet
testDefParamUnSet
fullyDecompileRoundtripClass
fullyDecompileBankClass

Insights

Average Tests per Run Total Flaky Tests Total Failed Slowest Test (p95)
123 0 3 15.7s

Fail Rate

Fail Rate 0.49%    ↓0.15
Test 📝 Results 📊 Passed ✅ Failed ❌ Fail Rate (%) 📈
testEqTrue 7 4 3 42.86    ↓17.14
testEqTrue 7 4 3 42.86    ↓17.14

builds: Run #175

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Pending ⏳ Other ❓ Flaky 🍂 Duration ⏱️
151 147 0 4 0 0 0 2m 47s

🎉 All tests passed!

Slowest Tests

Test 📝 Results 📊 Duration (avg) ⏱️ Duration (p95) ⏱️
intVariables 5 7.3s 15.7s
arrayLengthStringFilled 5 7.7s 13.6s
arrayLengthFilled 5 6.0s 10.1s
testEqFalse 7 5.6s 9.2s
testEqFalse 7 5.6s 9.2s
testGe 2 7.5s 8.2s
testLt 7 4.5s 8.0s
testLt 7 4.5s 8.0s
testGt 7 4.6s 7.4s
testGt 7 4.6s 7.4s

Files

147 passed, 0 failed, and 4 skipped in 2m 47s across 18 files

File Path Passed Failed Flaky Skipped Duration
✅ src/lang/flybytes/tests/VariableTests.rsc
        ✅ stringVariable (3.5s)
        ✅ boolVariableFalse (9ms)
        ✅ intVariables (5.6s)
        ✅ boolVariableTrue (2ms)
        ✅ floatVariables (1.3s)
 ✅ 5 10.5s
✅ src/lang/flybytes/tests/SwitchTests.rsc
        ✅ compactDefaultSwitch4Auto (16ms)
        ✅ compactDefaultSwitch1Table (2ms)
        ✅ simpleSwitch2auto (1ms)
        ✅ simpleSwitch2lookup (8ms)
        ✅ compactDefaultSwitch4Table (1ms)
        ✅ simpleSwitch1auto (1ms)
        ✅ simpleSwitch3auto (1ms)
        ✅ simpleDefaultSwitch2Table (1ms)
        ✅ simpleDefaultSwitch1Lookup (1ms)
        ✅ compactDefaultSwitch4Lookup (1ms)
        ✅ compactDefaultSwitch2Table (1ms)
        ✅ compactDefaultSwitch1Lookup (1ms)
        ✅ simpleDefaultSwitch1Table (1ms)
        ✅ simpleSwitch3table (1ms)
        ✅ simpleDefaultSwitch1Auto (1ms)
        ✅ compactDefaultSwitch3Auto (1ms)
        ✅ compactDefaultSwitch3Lookup (1ms)
        ✅ compactDefaultSwitch1Auto (1ms)
        ✅ simpleDefaultSwitch3Lookup (1ms)
        ✅ compactDefaultSwitch2Auto (1ms)
        ✅ simpleSwitch3lookup (1ms)
        ✅ compactDefaultSwitch3Table (1ms)
        ✅ simpleDefaultSwitch3Table (1ms)
        ✅ simpleSwitch1table (1ms)
        ✅ compactDefaultSwitch2Lookup (1ms)
        ✅ simpleDefaultSwitch3Auto (1ms)
        ✅ simpleSwitch2table (1ms)
        ✅ simpleDefaultSwitch2Lookup (1ms)
        ✅ simpleSwitch1lookup (1ms)
        ✅ simpleDefaultSwitch2Auto (1ms)
 ✅ 30 48ms
✅ src/lang/flybytes/tests/OtherExpressionTests.rsc
        ✅ testCoerceDoubleInt (17ms)
        ✅ testNew (2ms)
        ✅ testCoerceIntDouble (3ms)
        ✅ testInc (3ms)
        ✅ testIncStat (1ms)
 ✅ 5 26ms
✅ src/lang/flybytes/tests/NoCastCheckTest.rsc
        ✅ upcastTest (12ms)
        ✅ downcastTest (2ms)
 ✅ 2 14ms
✅ src/lang/flybytes/tests/MonitorTests.rsc
        ✅ monitorBreakTest (20ms)
        ✅ monitorReturnTest (1ms)
        ✅ monitorUncaughtThrowTest (2ms)
 ✅ 3 23ms
✅ src/lang/flybytes/tests/MirrorTests.rsc
        ✅ staticClassName (23ms)
        ✅ arrayLoadStringSingleton (2.7s)
        ✅ byteId (693ms)
        ✅ arrayLengthStringFilled (13.6s)
        ✅ arrayLengthDefault (1ms)
        ✅ longStatic (23ms)
        ✅ arrayLoadInteger (1ms)
        ✅ objectClassName (1ms)
        ✅ floatStatic (6ms)
        ✅ arrayLoadStringNull (1ms)
        ✅ doubleId (7ms)
        ✅ longId (369ms)
        ✅ doubleStatic (2ms)
        ✅ annoMirror (10ms)
        ✅ intStatic (1ms)
        ✅ newInstance (7ms)
        ✅ getField (1ms)
        ✅ arrayLoadObjectNull (1ms)
        ✅ floatId (4ms)
        ✅ invokeMethod (1ms)
        ✅ arrayLoadStringTwo (12ms)
        ✅ shortId (1.9s)
        ✅ stringId (448ms)
        ✅ arrayMirror (294ms)
        ✅ invokeStatic (1ms)
        ✅ arrayLengthFilled (4.0s)
        ✅ intId (358ms)
        ✅ arrayLoadLong (1ms)
 ✅ 28 24.4s
✅ src/lang/flybytes/tests/LoopTests.rsc
        ✅ testNestedFor (10ms)
        ✅ testBreakFor (2ms)
        ✅ testBreakNested (3ms)
        ✅ testNormalDoWhile2 (3ms)
        ✅ testNormalFor (10ms)
        ✅ testForContinue (2ms)
        ✅ testNormalDoWhile (3ms)
 ✅ 7 33ms
✅ src/lang/flybytes/tests/InterfaceTests.rsc
        ✅ implementAbstractMethodInvokeVirtual (13ms)
        ✅ testInterfaceDefaultMethod (1ms)
        ✅ implementAbstractMethodInvokeInterface (3ms)
 ✅ 3 17ms
✅ src/lang/flybytes/tests/GotoTests.rsc
        ✅ breakContinueLabeledBlock (10ms)
 ✅ 1 10ms
✅ src/lang/flybytes/tests/DefaultParameters.rsc
        ⏭️ testDefParamSet (1ms)
        ⏭️ testDefParamUnSet (1ms)
 ⏭️ 2 not captured
✅ src/lang/flybytes/tests/DecompileTests.rsc
        ⏭️ fullyDecompileRoundtripClass (1ms)
        ✅ fullyDecompileAccountClass (288ms)
        ⏭️ fullyDecompileBankClass (1ms)
 ✅ 1 ⏭️ 2 288ms
✅ src/lang/flybytes/tests/ComparisonTests.rsc
        ✅ testGeReal (6.5s)
        ✅ testGt2 (3.5s)
        ✅ testLt (2.9s)
        ✅ testGt (3.4s)
        ✅ testEqFalse3 (14ms)
        ✅ testEqFalse2 (2.0s)
        ✅ testNEqTrue (3.4s)
        ✅ testGeInt (3.4s)
        ✅ testEqTrue (2.8s)
        ✅ testEqTrue2 (1.2s)
        ✅ testNEqFalse (2.2s)
        ✅ testEqTrue3 (2ms)
        ✅ testLt2 (3.3s)
        ✅ testLe (3.4s)
        ✅ testLe2 (3.9s)
        ✅ testEqFalse (3.1s)
 ✅ 16 44.9s
✅ src/lang/flybytes/tests/ClassTests.rsc
        ✅ staticFieldInitializer (23ms)
        ✅ newInstanceCallGetter (2ms)
        ✅ newInstanceGetUnitializedInteger (2ms)
        ✅ newInstanceCallSetter (4ms)
        ✅ extendTest (6ms)
        ✅ staticMethod (7ms)
 ✅ 6 44ms
✅ src/lang/flybytes/tests/CatchTests.rsc
        ✅ finallyTest (12ms)
        ✅ finallyBreakTest (4ms)
        ✅ finallyContinueTest (1ms)
        ✅ testCatch (1ms)
        ✅ multipleTestCatch (2ms)
 ✅ 5 20ms
✅ src/lang/flybytes/tests/BranchingTests.rsc
        ✅ testNEqTrue (6.3s)
        ✅ testGe (6.8s)
        ✅ testLe (6.3s)
        ✅ testIfMethodTrue (2ms)
        ✅ testGt (7.3s)
        ✅ testLt (8.0s)
        ✅ testIfEqBoolFalse (1ms)
        ✅ testIfMethodFalse (1ms)
        ✅ testIfFalse (1ms)
        ✅ testNEqFalse (4.6s)
        ✅ testIfEqBoolTrue (1ms)
        ✅ testIfTrue (1ms)
        ✅ testIfEqTrue (1ms)
        ✅ testEqTrue (4.7s)
        ✅ testIfEqFalse (1ms)
        ✅ testEqFalse (6.1s)
 ✅ 16 50.1s
✅ src/lang/flybytes/tests/ArrayTests.rsc
        ✅ primitiveArrays0 (24ms)
        ✅ primitiveArrays10 (14ms)
        ✅ boolArrayTrue1 (2ms)
        ✅ primitiveArrays1 (5ms)
        ✅ boolArrayFalse10 (4ms)
        ✅ boolInitArrayTrue (1ms)
        ✅ boolArrayFalse1 (1ms)
 ✅ 7 51ms
✅ src/lang/flybytes/tests/ArithmeticTests.rsc
        ✅ testDivReal (4.7s)
        ✅ testNeg1 (2.5s)
        ✅ testRem (4.2s)
        ✅ testNeg (2.6s)
        ✅ testSub2 (4.2s)
        ✅ testMul (5.1s)
        ✅ testMul2 (2.1s)
        ✅ testAdd (5.9s)
        ✅ testDivInt (4.0s)
        ✅ testSub (6.7s)
        ✅ testAdd2 (3.4s)
 ✅ 11 45.2s
✅ src/lang/flybytes/tests/AnnotationTests.rsc
        ✅ noCrashWithAnnosTest (15ms)
 ✅ 1 15ms

± Comparison with run #174 at 2d07e4c | ⏱️ Measured over 5 runs.

Github Test Reporter by CTRF 💚

@github-actions

github-actions Bot commented Aug 13, 2026

Copy link
Copy Markdown

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
151 147 0 4 0 0 2m 35s    ↓12.3s

Test Results

passed 147 passed
skipped 4 skipped

Details

tests 151 tests in 18 suites
clock 2m 35s ↓12.3s
tool Rascal test runner
build Build and Deploy arrow-right builds link #176
pull-request removed old test trigger and added pom config for running rascal tests directly link #34

Skipped Tests

testDefParamUnSet
testDefParamSet
fullyDecompileBankClass
fullyDecompileRoundtripClass

Insights

Average Tests per Run Total Flaky Tests Total Failed Slowest Test (p95)
128 0 3 15.7s

Fail Rate

Fail Rate 0.39%    ↓0.10
Test 📝 Results 📊 Passed ✅ Failed ❌ Fail Rate (%) 📈
testEqTrue 9 6 3 33.33    ↓9.53
testEqTrue 9 6 3 33.33    ↓9.53

builds: Run #176

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Pending ⏳ Other ❓ Flaky 🍂 Duration ⏱️
151 147 0 4 0 0 0 2m 35s

🎉 All tests passed!

Slowest Tests

Test 📝 Results 📊 Duration (avg) ⏱️ Duration (p95) ⏱️
intVariables 6 6.9s 15.7s
arrayLengthStringFilled 6 7.3s 13.6s
arrayLengthFilled 6 6.5s 10.1s
testEqFalse 9 5.4s 9.2s
testEqFalse 9 5.4s 9.2s
testGe 3 7.5s 8.2s
testLt 9 4.5s 8.0s
testLt 9 4.5s 8.0s
testGt 9 4.7s 7.4s
testGt 9 4.7s 7.4s

Files

147 passed, 0 failed, and 4 skipped in 2m 35s across 18 files

File Path Passed Failed Flaky Skipped Duration
✅ src/lang/flybytes/tests/VariableTests.rsc
        ✅ boolVariableTrue (3.8s)
        ✅ boolVariableFalse (7ms)
        ✅ floatVariables (2.2s)
        ✅ intVariables (5.0s)
        ✅ stringVariable (5ms)
 ✅ 5 11.0s
✅ src/lang/flybytes/tests/SwitchTests.rsc
        ✅ compactDefaultSwitch1Auto (20ms)
        ✅ compactDefaultSwitch3Lookup (5ms)
        ✅ compactDefaultSwitch4Auto (1ms)
        ✅ simpleSwitch3lookup (1ms)
        ✅ compactDefaultSwitch1Lookup (1ms)
        ✅ compactDefaultSwitch3Auto (1ms)
        ✅ simpleSwitch1auto (1ms)
        ✅ compactDefaultSwitch2Table (1ms)
        ✅ compactDefaultSwitch4Lookup (1ms)
        ✅ simpleDefaultSwitch2Lookup (1ms)
        ✅ compactDefaultSwitch2Lookup (1ms)
        ✅ compactDefaultSwitch3Table (1ms)
        ✅ simpleDefaultSwitch1Auto (1ms)
        ✅ simpleSwitch2auto (1ms)
        ✅ simpleDefaultSwitch3Auto (1ms)
        ✅ simpleDefaultSwitch2Table (1ms)
        ✅ compactDefaultSwitch2Auto (1ms)
        ✅ compactDefaultSwitch4Table (1ms)
        ✅ simpleDefaultSwitch3Table (1ms)
        ✅ simpleDefaultSwitch1Lookup (1ms)
        ✅ simpleSwitch3table (1ms)
        ✅ simpleSwitch2table (1ms)
        ✅ simpleSwitch3auto (1ms)
        ✅ simpleSwitch1lookup (1ms)
        ✅ simpleDefaultSwitch2Auto (1ms)
        ✅ simpleSwitch2lookup (1ms)
        ✅ simpleDefaultSwitch3Lookup (1ms)
        ✅ compactDefaultSwitch1Table (1ms)
        ✅ simpleSwitch1table (1ms)
        ✅ simpleDefaultSwitch1Table (1ms)
 ✅ 30 48ms
✅ src/lang/flybytes/tests/OtherExpressionTests.rsc
        ✅ testInc (15ms)
        ✅ testNew (2ms)
        ✅ testCoerceIntDouble (5ms)
        ✅ testCoerceDoubleInt (3ms)
        ✅ testIncStat (2ms)
 ✅ 5 27ms
✅ src/lang/flybytes/tests/NoCastCheckTest.rsc
        ✅ downcastTest (13ms)
        ✅ upcastTest (2ms)
 ✅ 2 15ms
✅ src/lang/flybytes/tests/MonitorTests.rsc
        ✅ monitorUncaughtThrowTest (16ms)
        ✅ monitorReturnTest (1ms)
        ✅ monitorBreakTest (1ms)
 ✅ 3 18ms
✅ src/lang/flybytes/tests/MirrorTests.rsc
        ✅ arrayLoadObjectNull (16ms)
        ✅ intStatic (2.9s)
        ✅ intId (601ms)
        ✅ arrayLengthDefault (1ms)
        ✅ floatStatic (7ms)
        ✅ annoMirror (11ms)
        ✅ objectClassName (13ms)
        ✅ newInstance (1ms)
        ✅ arrayLoadInteger (3ms)
        ✅ arrayLoadStringTwo (1ms)
        ✅ staticClassName (1ms)
        ✅ longId (401ms)
        ✅ longStatic (1ms)
        ✅ arrayLoadLong (2ms)
        ✅ doubleStatic (1ms)
        ✅ doubleId (5ms)
        ✅ arrayLengthStringFilled (5.0s)
        ✅ getField (1ms)
        ✅ floatId (4ms)
        ✅ arrayLoadStringSingleton (1ms)
        ✅ arrayLengthFilled (8.9s)
        ✅ arrayLoadStringNull (1ms)
        ✅ invokeStatic (1ms)
        ✅ shortId (494ms)
        ✅ stringId (501ms)
        ✅ byteId (445ms)
        ✅ arrayMirror (301ms)
        ✅ invokeMethod (1ms)
 ✅ 28 19.6s
✅ src/lang/flybytes/tests/LoopTests.rsc
        ✅ testBreakNested (13ms)
        ✅ testNormalDoWhile2 (4ms)
        ✅ testBreakFor (2ms)
        ✅ testNormalDoWhile (1ms)
        ✅ testNestedFor (1ms)
        ✅ testForContinue (2ms)
        ✅ testNormalFor (5ms)
 ✅ 7 28ms
✅ src/lang/flybytes/tests/InterfaceTests.rsc
        ✅ implementAbstractMethodInvokeInterface (13ms)
        ✅ testInterfaceDefaultMethod (2ms)
        ✅ implementAbstractMethodInvokeVirtual (1ms)
 ✅ 3 16ms
✅ src/lang/flybytes/tests/GotoTests.rsc
        ✅ breakContinueLabeledBlock (11ms)
 ✅ 1 11ms
✅ src/lang/flybytes/tests/DefaultParameters.rsc
        ⏭️ testDefParamUnSet (1ms)
        ⏭️ testDefParamSet (1ms)
 ⏭️ 2 not captured
✅ src/lang/flybytes/tests/DecompileTests.rsc
        ✅ fullyDecompileAccountClass (268ms)
        ⏭️ fullyDecompileBankClass (1ms)
        ⏭️ fullyDecompileRoundtripClass (1ms)
 ✅ 1 ⏭️ 2 268ms
✅ src/lang/flybytes/tests/ComparisonTests.rsc
        ✅ testGeReal (6.5s)
        ✅ testEqTrue3 (18ms)
        ✅ testNEqTrue (4.6s)
        ✅ testLe2 (2.2s)
        ✅ testLt2 (3.8s)
        ✅ testNEqFalse (2.6s)
        ✅ testLt (3.9s)
        ✅ testEqFalse3 (4ms)
        ✅ testGt2 (3.5s)
        ✅ testGt (3.9s)
        ✅ testGeInt (3.7s)
        ✅ testLe (3.9s)
        ✅ testEqFalse2 (2.7s)
        ✅ testEqTrue (2.1s)
        ✅ testEqTrue2 (2.0s)
        ✅ testEqFalse (4.1s)
 ✅ 16 49.5s
✅ src/lang/flybytes/tests/ClassTests.rsc
        ✅ staticMethod (33ms)
        ✅ extendTest (7ms)
        ✅ staticFieldInitializer (1ms)
        ✅ newInstanceGetUnitializedInteger (2ms)
        ✅ newInstanceCallSetter (3ms)
        ✅ newInstanceCallGetter (2ms)
 ✅ 6 48ms
✅ src/lang/flybytes/tests/CatchTests.rsc
        ✅ testCatch (13ms)
        ✅ finallyTest (3ms)
        ✅ multipleTestCatch (2ms)
        ✅ finallyContinueTest (4ms)
        ✅ finallyBreakTest (1ms)
 ✅ 5 23ms
✅ src/lang/flybytes/tests/BranchingTests.rsc
        ✅ testIfEqBoolFalse (10ms)
        ✅ testIfEqBoolTrue (1ms)
        ✅ testGe (7.4s)
        ✅ testIfMethodTrue (1ms)
        ✅ testGt (6.5s)
        ✅ testEqFalse (5.7s)
        ✅ testLe (5.9s)
        ✅ testIfMethodFalse (1ms)
        ✅ testIfTrue (1ms)
        ✅ testNEqTrue (5.5s)
        ✅ testNEqFalse (4.1s)
        ✅ testLt (5.7s)
        ✅ testIfFalse (1ms)
        ✅ testEqTrue (3.6s)
        ✅ testIfEqTrue (1ms)
        ✅ testIfEqFalse (1ms)
 ✅ 16 44.4s
✅ src/lang/flybytes/tests/ArrayTests.rsc
        ✅ primitiveArrays10 (41ms)
        ✅ boolInitArrayTrue (2ms)
        ✅ primitiveArrays0 (4ms)
        ✅ boolArrayFalse10 (2ms)
        ✅ primitiveArrays1 (5ms)
        ✅ boolArrayTrue1 (1ms)
        ✅ boolArrayFalse1 (1ms)
 ✅ 7 55ms
✅ src/lang/flybytes/tests/ArithmeticTests.rsc
        ✅ testNeg (2.1s)
        ✅ testDivReal (4.2s)
        ✅ testSub (4.9s)
        ✅ testSub2 (2.6s)
        ✅ testMul (5.3s)
        ✅ testAdd (6.0s)
        ✅ testMul2 (1.3s)
        ✅ testRem (3.6s)
        ✅ testAdd2 (3.6s)
        ✅ testNeg1 (1.8s)
        ✅ testDivInt (3.7s)
 ✅ 11 39.1s
✅ src/lang/flybytes/tests/AnnotationTests.rsc
        ✅ noCrashWithAnnosTest (13ms)
 ✅ 1 13ms

± Comparison with run #175 at 3a2b91d | ⏱️ Measured over 6 runs.

Github Test Reporter by CTRF 💚

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@jurgenvinju