Tabletop gaming in general is certainly not as difficult as the general public believes it to be. Can you roll a twenty sided die, look at the number and add (or subtract) numbers you wrote down earlier? Congrats, you have all the skills you need to start playing D&D. You'll learn everything else quickly as you go.

Heck, I learned how to play Warhammer 40k in 5 minutes today, having stayed away from it thinking that tabletop war games were usually full of obscure and hard to remember rules. I think I looked at the book 3 times in 4 hours.