Khan: Some within UNC's rank and file want me out