If you've never ridden an EV motorcycle before, I'm here to tell you that they are fun, as well as quick off the line. Even ones that don't have a very high top speed are usually plenty quick at first, simply by virtue of instant torque availability with the merest twist of your right wrist. Examples that can legit go fast, like the Zero SR/F, are of course even more fun to those of us who've been riding combustion motorcycles because we like going fast on two wheels.
Are there issues? Sure, there are plenty, but if we're speaking specifically about the concept of having fun, then that isn't one of them. They make different noises than combustion bikes (not no noise, contrary to what you may have been told), and you may feel differently about them for that reason. Prices are starting to come down now, with established industry players like Honda and Royal Enfield throwing their weight behind development of EV motorbikes that don't cost an arm and a leg.
That's good news, but what about the very real problem of range anxiety? Swappable batteries aren't a bad idea, but they do either require you to a) have your own spare batteries at both ends of your journey to swap out, b) carry an extra battery with you, which can be heavy and impractical (but it's something that e-bike riders already frequently do), or c) utilize a commercial battery swap-and-go network that may or may not exist in your area.