Wharton, Duke of Wharton, Philip James