Not just you. He totally did it to me, especially during training. Knowing Gladio, he pushed harder on you because you didn't have as much experience as the rest of us- it was his weird way of keeping you alive.

[Gladio is just kind of like that. Not everybody gets him. Not even Noct, a lot of the time.]