Fuller wrote several works, addressing the issues in his time. During the years 1798 – 1813, Fuller undertook several lengthy journeys away from home. He visited Scotland 5 times as well as going to Wales and Ireland (1804). This began to take a toll on his health. He had a sort of stroke in 1793, which left him rarely without headaches.