How to Localize Your World