The problem of race (and immigration) within the American working class is a deep one that affected the IWW and the SPA and the racism within the working class cannot be wished away.
Frederick Douglass, an ex-slave, was closer than many to understanding the connection with wage-labour and slavery.
It can only be addressed when it is tackled direct on.
Even the SLP was in many ways patriotic to the US Constitution myth of the Founding Fathers