A group wants to use a plot downtown to memorialize African American history, which has faced opposition from some residents.