Swaping out door handles on a 4th gen 4runner.

Need some help here guys. I'm trying to swap out exterior chrome door handles with black ones on a 4runner and I am having a hard time with the drivers door. I got all the other doors done already but I can't seem to get the key lock mechanism out after loosening the #30 Torx screw.

I have read that our tacos are the same as the 4runners so the write ups that I have seen both just say pull it out. Is it just that easy? It should just pull out? The one I'm playing with will not just pull out! I seem to think that something needs to be removed from the back/inside of the door before it will come out.

Any advice you might have would be great. Thanks!

 

Well after spraying some WD-40 and just playing (wiggling back and forth) with the lock for awhile, I was able to finally pull it out.
So I write this encase some time in the future, someone else has this problem, they will learn that you just have to stay with it.