Field gave birth to the couple's first child - daughter Theodra Teddy Rose - last year.
"Ayda wants to go back to work but I don't want her to. I'm a bit caveman about it all," femalefirst.co.uk quoted Williams as saying.
"I say, 'You won't leave the cave. I don't want you to leave the cave. I want you to stay here with me and do the supporting thing...' Not having her there does scare me a bit," he added.
However, the singer does admit that Field, who was seen in television show "Days of our Lives", is very talented.
"But she's really f***ing talented and incredibly charismatic. But, selfishly, I want her to be at home with me," he said.
