Cancel lease after being told I was not approved?

Until you execute (sign) a lease with them, they have no claim to your deposit. And since that isn't going to happen, put a stop payment on the check through your bank.