Five members of the U.S. military were allegedly involved in the prostitution scandal in Colombia that saw 12 Secret Service members relieved of duty.

The United States Southern Command (USSOUTHCOM) said that it would punish the military members for "inappropriate conduct" at the same hotel the service agents were located at. Unlike the agents, the soldiers were not sent home.

"The personnel are currently in Colombia but confined to quarters and under orders not to have contact with other individuals," the statement said. "They will return to the United States with the rest of the support contingency at the conclusion of the mission."

General Douglas Fraser, the commander of the Southern Command, told Reuters that he was "disappointed by the entire incident and (said) that this behavior is not in keeping with the professional standards expected of members of the United States military."

The five military members were apart of the support team with the Secret Service for President Barack Obama's trip to the Summit of Americas in Colombia.