I think it depends on your circumstances. For me the X100 has allowed me to continue with my photography in a way that still makes it a challenge and enabling me to get some great images without having the weight and size of DSLR.
My hands are becoming very arthritic to the point that i have to have injections in my joints to control the pain, i found it impossible to hold the 40D, firstly i took the battery pack off hoping that weight difference would help, but it wasn't always the weight i found problems opening my hand sometimes enough to hold the 40D.
It took me a while to get used to the Fuji menu structure, but that's to be expected after only ever using Canon. So for me the Fuji has been a life saver.