Drinking water hot and tastes horrible when central heating turned on. Pressure on combi boiler up?

Any help much appreciated as I have drank this water this am. Water tastes oily and when my son ran a bath this morning water started off brown. When central heating not on water is cold as it should be but still smells strange