Twin Towers

I know I'm a little late on this, but I still think they should rebuild the Twin Towers. Let me explain. If only one tower was destroyed, no one would object to rebuilding the other tower. So why doesn't the same logic hold for both destroyed towers? Also if both towers were destroyed by something other than a terrorist attack, like a natural disaster, most people would want to rebuild them again. So how is this any different?