It wasn't what you think that brought on the end of the Roman Empire.