Every Magento installation has certain core configuration data already set. When you update those values from the administration interfaces, changes are saved mainly to core_config_data database table.
As always, there are times you need to get your hands on it. In some cases you will wish to chance settings directly from the code. This blog will demonstrates it in the proper way.