A prosecutor said Tuesday that Webster, a married father of three, looked enraged on the video, which shows that he "goes after that cop like a junkyard dog -- teeth clenched and fists clenched," according to NBC.
"These videos shock the conscience," the prosecutor said at a bail hearing in federal court in White Plains, New York. "We believe he had a gun at the Capitol and thank God he didn't fire a shot then."
A judge ordered Webster detained without bail because of his potential danger to the public.
Webster who as a cop had duties that included guarding the perimeter of City Hall and Gracie Mansion, the official residence of New York's mayors, surrendered Monday at the FBI's Hudson Valley office, according to NBC.