HOW TO STRESS TEST A SOLUTION

general
1

Today I tried to solve one of the problems of CODECHEF LONG and I found a solution for it also but when I submitted it, I got WA.
So I wrote a BRUTE FORCE SOLUTION for it and for some testcases which I checked both solution gave same answer so far and I am sure that brute force solution is correct and Now I want to check testcases for which my optimized solution is failing…
So does anyone know how to STRESS TEST a solution using RANDOM TESTCASES GENERATOR…
PLEASE help me if anyone know how to do so…

2 Likes
2

I usually do something like e.g. this, then run (in bash):

while true; do ./a.out --test | tee last-testcase.txt | ./a.out ; if [ "$?" -ne "0" ]; then break; fi; done

until it either finds a breaking testcase (which will be stored in tee last-testcase.txt) or I get bored :slight_smile:

4 Likes
3

Sorry but I am unable to understand what you said, see I just used fastolymiccoding STRESS TESTING feature and then it runs many testcases but it’s just showing what is answer given by BRUTE FORCE solution and what answer is given by optimized solution.
It is not showing on which testcase my program gives wrong solution…
I can’t even understand what you wrote… I am new to programming, could you please tell me in an easier way…
Please.

1 Like
4

This is the bash script that I use.

SCRIPT 
for((i = 1;; ++i)); do
    echo $i
    ./gen $i > in
    diff -w <(./a < in) <(./brute < in) || break
done
Testing Folder

image

a.cpp → Wrong Solution
gen.cpp → Test-case generator
brute.cpp → Slow but correct solution
s.sh → bash script attached above
in → Stores the test-case for which a.cpp fails
Just run the bash script by executing bash s.sh command from the testing directory and view the test-case fromin file once the bash script finds a counter-case

1 Like
6

Thank you for helping me… I found the corner testcase

1 Like
7

Thank you…I found the corner case…

8

I have created the same directory structure as you shown in photo but it still giving error no such a file or directory .
can u give me ur discord id so that i can contact with you

10

request sended (my id : revenge#1213

11

Either write a code using random library to produce file with inputs
or use
the link
https://test-case-generator.herokuapp.com/

1 Like