Will I gain weight if i binge for one day and not exercise on that day?

Although I'm 106 pounds, i look normal and healthy not skinny looking or emaciated (i'm 5'8). I play handball for my school team and we basically train everyday for about 2 hours or more. If we dont train for a whole week, I'll jog instead for 30-45 minutes at least 4 times a week. I eat about 500-700 calories daily and I always control myself to not consume a lot of calories.. is it okay to binge eat once a week and not exercise on that day? I'll usually feel kinda fat if i do that.. Today is my binge day.. i guess. I ate roti canai this morning, about 300 calories of food for lunch, a blueberry muffin, 7 2-inch milk bars and a drink box of soy milk. Will I gain weight?