You can remove the outside handle by taking the two phillips screws out of the outer escutcheon. The handle then pulls out and you can work on it. As others have said, the inside locking lever might be the issue if it is pushed to 'lock'. Have you tried jiggling the handle whilst turning the key?