Well, having done some research, I have found out that you can buy LPG without fuel duty - just VAT if it isn't going to be used on the road.
Think about it, it's widely used in forklifts, hot air baloons, generators etc and none of those have to pay it.
But I bet a conversion for my big beemer engine would cost more than the rest of my build put together!