No don't go to the local building inspector as if you alert the local authority to a potential problem you can compromise your ability to get indemnity insurance cover. I believe such cover will last indefinitely and costs like something between �60 and �200.
Normally there is a restriction on the time period (12 months) in which the local authority can force you to make changes to a construction which wasn't built with reference to Building Regs.
This is not an uncommon situation although I've not come across case where they are quibbling over work which was done so long ago!