Most likely named after a coaching inn called the Elephant and Castle.
A popular story says the name comes from 'Infanta de Castile', a Spanish princess, but historians doubt it. An elephant carrying a castle was a common sign, used for example by the Cutlers' Company.