Australia has a modern economy and banking system. There are tax agreements with many countries, although UK pensions are currently frozen at the rate when you first receive them, meaning you lose out in real terms each year due to inflation.
Note that tests covering your eligibility for residence and the criteria determining your individual tax residency situation are not the same. Both tax and visa requirement regulations are complex and it is strongly recommended you seek professional guidance from qualified taxation professionals and approved immigration agents.