If I have a fire in the fireplace in my living room, why does my kitchen get colder?

As the fire burns in the fireplace it draws air from the rest of the house. Most of the warm air goes up the chimney and cold air is drawn into the house. Doors on the fireplace may help some as would an insert.