Colored tiles are only active if the upfacing number matching those on the tile. Try to rotate the dice to match the number.
Unity3D Blender opencv