I count him lost, who is lost to shame. [Lat. , Nam ego illum periisse duco, cui quidem periit pudor. ]
I suppose the situation varies from field to field. If you're a mathematician, your proficiency in English may not be such a problem. If you're in the humanities or social sciences, there is no doubt that it is a handicap for you.