My standing desk has a treadmill underneath it, so if I ever get bored of standing around playing computer games, I'll go for a jog while playing computer games. Maybe even throw in a little split screen television series action in their to mix things up.
I have actually started going to the gym after highschool, I was in a bad shape and I really needed it, first time in a gym is REALLY hard and awkward, but I've gone a long way since then. I love working out, love that aching feeling you get when you're done from a hard exercise, however I seriously can't commit to keep going as I should go, as a medicine student it's impossible to do both at once, especially when I have exams, so I always end up going 3 weeks then stop going for another 2, then go back again.
The problem here is that when I go back, I can't continue from the place I left on, I have to go a few steps back, so it makes improving really hard.
Sometimes I think that I'm not eating as well as I should, and some people around me tell me that I should take protein shakes, other are telling me not to. I personally don't like taking these stuff, but I might change my mind soon.
Sounds like you are taking too much time off from the gym. Two or three days rest won't kill you and will actually help because your body needs recovery time to heal and keep going. But anything more than that like you are doing and yes, you will not be able to do what you did last time, two weeks ago.