Fox News host Bill O'Reilly knocked opponents of same sex marriage on Tuesday night, claiming they had a weak argument that relied entirely on religious beliefs.

The conservative Fox News host was discussing two cases before the Supreme Court regarding same sex marriage with his colleague Megyn Kelly.

During the segment, O'Reilly remarked that public policy should not be based on religion. Kelly responded by saying that arguments against same sex marriage were not very persuasive when the religious element was removed.

"I agree with you 100 percent, the compelling argument is on the side of homosexuals," O'Reilly said. "That is where the compelling argument is. We're Americans, we just want to be treated like everybody else."

"That's a compelling argument, and to deny that you've got to have a very strong argument on the other side. And the other side hasn't been able to do anything but thump the Bible."

"I support civil unions, I always have," he added. "The gay marriage thing, I don't feel that strongly about it one way or the other. I think the states should do it."

Watch video, courtesy of Fox News, below:

[Correction: This post originally said that O'Reilly claimed our policy should be decided by religion.]