As average longevity increases, there will be more and more elderly people, as long as definition of elderly people unchanges.
Though Japan's aging society is often attributed to low fertility rate, it's not the only reason. The other reason is that more and more people could live longer than before. It means population of elderly people are increasing, even if fertility rate remains.
Increasing longevity means people can work until higher age. So, we had better change limitation of age in working place and definition of elderly people.