Ironically, J. Robert Oppenheimer, the figure best associated with the Manhattan Project, was almost kicked off after attending left-wing Communist meetings in the 1930s.