When I speak in my native language with people from my native country...?

I sometimes slip english words or propositions without realizing it. Of course, I didn't forget the language. But I'm so used to English, living in an English speaking country. That happens especially when I'm tired. Do you think that is embaring or I should apologize for it?