Yes it should not take time but it seems you are using W3 Total Cache on your site therefore it is taking time so please make sure to clear W3 Total Cache after making any changes on your site.