Neurofibrillary tangles are intracellular accumulations of hyperphosphorylated and misfolded tau protein characteristic of Alzheimer’s disease and other tauopathies. Classic cross-sectional studies of Alzheimer patient brains showed associations of tangle accumulation with neuronal loss, synapse loss, and dementia, which led to the supposition that tangles are toxic to neurons. More recent advances in imaging techniques and mouse models have allowed the direct exploration of the question of toxicity of aggregated versus soluble tau and have surprisingly challenged the view of tangles as toxic species in the brain. Here, we review these recent experiments on the nature of the toxicity of tau with particular emphasis on our experiments imaging tangles in the intact brain through a cranial window, which allows observation of tangle formation and longitudinal imaging of the fate of tangle-bearing neurons.