Ever wonder how the Giant's Mask works? Well let me fill you in...
The Giant's Mask does not actually make Link bigger (shocking I know). There are actually two area's for the map. The normal, large, version and then a smaller one which is placed high above the normal one. When the player equips the mask they are swapped to the smaller version with their position translated accordingly. Some adjustments are made such as the camera and Twinmold's size to make Link appear to now be "large".