Wondering if the Tea Party caucus in the House intentionally gives John Boehner headaches? One congressman says that is the case.

Rep. Louie Gohmert (R-TX) appeared on Fox News Monday morning and was asked by anchor Bill Hemmer if the most conservative members of the chamber gives the House Speaker "fits."

Gohmert indicated that they are indeed making Boehner's job more difficult.

"In one of our conferences I was trying to be nice and I said, "Look, I know it's got to be difficult negotiating with the man in the White House' and he leaned into his mic and said 'And dealing with you,'" he said.

"So I take that as a 'yes'?" Hemmer asked.

Gohmert replied, "You would take it correctly."

WATCH: Video from Fox News, which is from September 26, 2011.