Add colors to the palette to generate the matrix.