This is not straightforward, but start by looking at the link below.
You need to get your head around the definition of the terms 'resident' and 'domiciled'.
http://www.direct.gov.uk/en/MoneyTaxAndBenefit s/Taxes/LeavingOrComingIntoTheUK/DG_10027480
You and your husband would not be resident in any tax year when you spend more than 183 days out of the country. However you are always domiciled here.
I believe that means that any income earned abroad that you bring back into the UK will be taxed. I also believe that you can have part of the income paid offshore (locally or elsewhere) for your local expenditure and possibly future non-UK holidays.
Most international companies will pay for their ex-pat staff to get a bit of tax advice before they go out and try and 'help' them minimise tax. Have you asked?