Jim Bouton endured a lengthy battle with vascular dementia before dying Wednesday at age 80, his family said.