The great thing about martial arts is you can be at any fitness level and do great. That's because there's no rush or pressure to do anything quickly. You can learn at your own pace.
If you have a knack for it, you can speed through techniques. If it's a bit harder for you, take your time. All we care about is that you're having fun, learning and progressing, and staying safe.
Self-defense means doing everything in your power to AVOID violence! It means being diplomatic and peaceful. In fact, people who have had problems with violence in the past often become peaceful and balanced through martial arts.