The head of the Senate Armed Services Committee said Tuesday the only way to hold the top U.S. intelligence official accountable for lying to Congress was to fire him.

Speaking at a Christian Science Monitor breakfast meeting, Sen. Carl Levin (D-MI) stopped short of himself calling on President Barack Obama to fire Director of National Intelligence James Clapper.

"I'm troubled by that testimony," he said. "I don't know how he has tried to wiggle out from it, but I'm troubled by it, so how do you hold him accountable? I guess the only way to do that would be for the President to somehow or other fire him. I think he made it clear he regrets saying what he said and I don't want to call on the President to fire him, although I'm troubled by it."

During a Senate Intelligence Committee hearing in March, Sen. Ron Wyden (D-OR) specifically asked Clapper if the National Security Agency collected “any type of data at all on millions or hundreds of millions of Americans?” Clapper denied the NSA amassed such data, but that testimony was later proven false by former NSA contractor Edward Snowden.

Clapper has said he provided the “least untruthful answer possible.”

Levin said he felt adequately informed about the NSA's surveillance programs with the exception of PRISM, a program that intercepted foreign Internet communications. Though "in principle" the NSA was doing what intelligence services had done for decades, current technologies allowed for levels of surveillance that were previously unthinkable, the senator added.

"They can't look at the substance of my conversations, but they can find out a heck of a lot about me by what phone calls I make," Levin remarked. "If this technology were in the hands of [former FBI director] J. Edgar Hoover, would I feel comfortable? No. But, on the other hand, I wasn't comfortable with J. Edgar Hoover with his technology."

Watch this video from C-SPAN, broadcast July 16, 2013.