We should be doing this the same way as with caas tests where we are smart enough to only delete those where tests were successful