People in their 50s are most concerned about falling ill and not being able to work, according to figures from Alliance Trust Savings.
The firm's latest annual retirement confidence index suggests that other concerns that those in their 50s have include not saving enough for their senior years and losing their job.
Also, working people in their 60s feel that their comfortable retirement is most under threat from inflation movements, falling ill and being unable to work and a stock market crash.
Fluctuations in inflation were listed as only the 10th biggest worry for people aged 20 to 29 years.
Head of pensions at Alliance Trust Hyman Wolanski comments: "Pension planning is an ongoing process and it is vital people take their changing circumstances throughout their life into consideration when choosing the right pension arrangement for them."
In recent days, wealth management service provider Informed Choice noted the "massive" differences between different pension plans and annuities and urged consumers to shop around for them.