i think you'll be fine mate. Buy a cheap 2+2, drive it for a few years, park it in shopping centers and don't worry if someone opens there door onto it, get some gutter rash from not knowing where your tires are and then run up the ass of someone cause you were busy eating a burger or changing cd. Once it's all out of your system, if you still like them, buy a nice Z and treasure it but still enjoy it... after all, nearly anything can be fixed
I am another one saying go for the l28. Mainly because it is so much less hassle and won't have to be off the road that long. If you are lucky you may even be able to find an l28 for free, there are a lot of them just lying around in peoples sheds. Get it rebuilt and don't skimp on machine work like porting and polishing and balancing the parts.
In regards to being hard to drive... I believe these cars are hard to drive, especially if you are learning in it. This is mainly because the accelerators can be very touchy when taking off (you usually have to ease them on slowly and gradually) which can make it hard if you aren't used to using the clutch and accelerator (usually the hardest part when you are learning in any car). If the gearbox isn't in the best shape then you may have to double the clutch or be more accurate on your gear changes. You sit quite low and the windscreen is quite narrow compared to other cars so you don;t have the best viewpoint. The steering can be pretty heavy (especially if you are as weedy as I was when i was in high school, good for a workout though) and the turning circle isn't the greatest (especially the 2+2's). Then if you take into account the possibility of worn out suspension/steering components/bushings, your ride might be all over the road. Although a lot of this depends on the condition of the car you buy and most of these problems can be fixed with stock replacement or through modifications.
After saying all this, don't let any of that scare you, if you learn to drive in a Z you should be able to drive nearly any car (and I say it's harder, but it's really not THAT hard). And not to mention you will have a ton of fun. In a zed you feel connected with the road which is something you don't get in every car.