Principles of Photography

If light is made up of the colors of the rainbow and photography is the capturing of light, in black and white photography where does the color go?