"There are a number of ways chronic anxiety can destroy you," states Aldwin. That includes increased levels of cortisol, often known as the stress hormone. Elevated cortisol levels interfere with memory and learning, lower immune function and bone density, and increase blood pressure, cholesterol and cardiovascular disease.