The APOGEE Stellar Parameter and Chemical Abundance Pipeline (ASPCAP) has now produced individual chemical abundances for 15 different elements: C, N, O, Na, Mg, Al, Si, S, K, Ca, Ti, V, Mn, Fe, and Ni. We will present comparisons of the ASPCAP abundances for stars in clusters with those derived from manual stellar parameter and abundance analyses of the same stars using the APOGEE spectra. These comparisons can be used to assess whether any of the elemental results from the automated pipeline contain larger than expected scatter, systematic offsets, or trends with stellar parameters, such as effective temperature, surface gravity, or metallicity. Using the subset of trustworthy abundances, we present early results of peculiar chemical substructures found in the APOGEE dataset.