Charles is married to Stacey Kawasaki Djou. Born and raised in Hawaii, Stacey graduated from Kalani High School and the University of Hawaii at Manoa. An attorney, Stacey earned her law degree from the University of Hawaii, William S. Richardson School of Law. Together they raise their three children in Hawaii Kai.