I'm actually not a big horror fan myself....at all. I don't hate the genre, I just don't care about it. Which is why I think I actually really enjoyed the first Saw. It's kind of surprising because, I wouldn't really just call it a straight out 'horror'. It's more drama, and gore, and yes there is a difference.
I think you should at least watch the first one. The others, screw 'em xD