Skip to content

Commit

Permalink
Update plots
Browse files Browse the repository at this point in the history
  • Loading branch information
aslakhellesoy committed Dec 7, 2022
1 parent 8e5c43f commit 61029ff
Show file tree
Hide file tree
Showing 85 changed files with 975 additions and 807 deletions.
8 changes: 1 addition & 7 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@ Let `TFi` be the index of the `i`th failing test on ordering `T′` of `T`.
The APTF of test suite `T′` is given by the equation:

```math
APTF = 1 - {{\sum_{i=1}^m TF_i} \over nm} + {1 \over 2n}
APTF = 1 - {\sum_{i=1}^m TF_i \over nm} + {1 \over 2n}
```

High values indicate that the test failures occur early in the testing process while low values indicate the test failures occur later.
Expand All @@ -32,7 +32,6 @@ In order to generate the box plot metrics you need:
* GNU Make
* Gnuplot
* Maven
* A Comet API key (optional)
* A build of SmartBear's TCP engine (optional)

## Usage
Expand All @@ -41,11 +40,6 @@ Download and extract the [RTPTorrent dataset]. Define an environment variable po

export RTP_TORRENT=...

Define Comet environment variables (optional)

export COMET_URL=https://chiron.comet.smartesting.com
export COMET_API_KEY=...

Define SmartBear TCP environment variables (optional)

export SMARTBEAR_TCP_DIR=...
Expand Down
11 changes: 6 additions & 5 deletions results/rtptorrent/[email protected]
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Original file line number Diff line number Diff line change
Expand Up @@ -20,11 +20,11 @@
0.9642857142857143
0.9642857142857143
0.9642857142857143
0.8928571428571429
0.8214285714285714
0.9285714285714286
0.8928571428571429
0.8928571428571429
0.8928571428571429
0.8928571428571429
0.9666666666666667
0.9666666666666667
0.9
Original file line number Diff line number Diff line change
Expand Up @@ -23,8 +23,8 @@
0.8928571428571429
0.9285714285714286
0.8928571428571429
0.9642857142857143
0.8928571428571429
0.8928571428571429
0.9666666666666667
0.8928571428571429
0.8333333333333334
0.9666666666666667
33 changes: 17 additions & 16 deletions results/rtptorrent/[email protected]
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Original file line number Diff line number Diff line change
@@ -1,30 +1,30 @@
0.96875
0.96875
0.96875
0.9716981132075472
0.9905660377358491
0.9905660377358491
0.3867924528301887
0.9433962264150944
0.9433962264150944
0.9433962264150944
0.9622641509433962
0.9622641509433962
0.9811320754716981
0.96875
0.9150943396226415
0.5
0.9150943396226415
0.96875
0.96875
0.96875
0.9968553459119497
0.9779874213836478
0.9779874213836478
1.0
1.0
1.0
1.0
0.6852425180598556
0.9339622641509434
0.12264150943396224
0.9150943396226415
0.9150943396226415
0.9905660377358491
0.9905660377358491
0.9262295081967213
0.3875128998968008
0.8508771929824561
0.8854166666666667
0.6916835699797159
0.9528301886792453
0.6744421906693712
0.9575471698113208
0.96875
Original file line number Diff line number Diff line change
Expand Up @@ -15,16 +15,16 @@
0.96875
0.96875
0.96875
1.0
1.0
1.0
1.0
1.0
1.0
1.0
0.9905660377358491
0.9905660377358491
0.9905660377358491
0.9905660377358491
0.9905660377358491
0.9905660377358491
0.9918032786885246
0.7017543859649122
0.9912280701754386
0.9166666666666667
0.7068965517241379
0.9905660377358491
0.9952830188679246
0.96875
Original file line number Diff line number Diff line change
Expand Up @@ -15,16 +15,16 @@
0.65625
0.65625
0.65625
0.7012578616352202
0.7201257861635221
0.6949685534591196
0.7578616352201258
0.7955974842767296
0.8962264150943396
0.6803278688524591
0.08490566037735847
0.14150943396226412
0.06603773584905659
0.2547169811320755
0.3679245283018868
0.669811320754717
0.024590163934426253
0.32507739938080493
0.20175438596491233
0.14583333333333334
0.37271805273833675
0.17924528301886788
0.18396226415094336
0.65625
Original file line number Diff line number Diff line change
Expand Up @@ -15,16 +15,16 @@
0.84375
0.84375
0.09375
0.7955974842767296
0.9528301886792453
0.8018867924528302
0.7201257861635221
0.7264150943396227
0.3679245283018868
0.839622641509434
0.8005464480874317
0.3867924528301887
0.14150943396226412
0.160377358490566
0.5
0.38524590163934425
0.48039215686274517
0.6403508771929824
0.6875000000000001
0.5116632860040567
0.9150943396226415
0.919811320754717
0.46875
Original file line number Diff line number Diff line change
@@ -1,30 +1,30 @@
0.96875
0.96875
0.96875
0.9905660377358491
0.9905660377358491
0.7264150943396227
0.7264150943396227
0.7264150943396227
0.7264150943396227
0.7264150943396227
0.7264150943396227
0.53125
0.9528301886792453
0.9528301886792453
0.9716981132075472
0.9716981132075472
0.6792452830188679
0.6792452830188679
0.6792452830188679
0.6792452830188679
0.6792452830188679
0.6792452830188679
0.96875
0.8773584905660378
0.8773584905660378
0.96875
0.96875
0.96875
0.53125
1.0
1.0
0.9905660377358491
0.9905660377358491
1.0
1.0
0.9699453551912568
0.6351909184726523
0.605263157894737
0.8333333333333334
0.6272819472616633
0.9905660377358491
0.9716981132075472
0.9528301886792453
0.9528301886792453
0.9528301886792453
0.9528301886792453
0.9716981132075472
0.9262295081967213
0.6568627450980393
0.9035087719298246
0.7083333333333334
0.6607505070993914
0.9575471698113208
0.96875
27 changes: 20 additions & 7 deletions results/rtptorrent/[email protected]
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading

0 comments on commit 61029ff

Please sign in to comment.