The former TV chef has spoken out after years of anti-Semitic hate forced him to close down his Jewish bakery.