There a couple ways to select by color.
1.) The edit menu has Select by Color which will use the colors of any selected objects and select all other objects that are colored with those colors.
2.) Right-click the color chip and chose Select Object. This is useful when there are a large number of objects on the page and you want to easily find and select one or a few based on color.