Board Thread:Spoilers!/@comment-24304025-20150122183805/@comment-25355646-20150122231642

The door couldn't lead to Camelot because Camelot is a kingdom in the Enchanted Forest, not a realm that the hat would lead to.