Non-target screening of veterinary drugs using tandem mass spectrometric data was performed on the SmartMass platform. This newly developed software uses the characteristic fragmentation patterns (CFP) to identify chemicals, especially those containing particular substructures. A mixture of 17 sulfonamides was separated by ultra performance liquid chromatography (UPLC), and SmartMass was used to process the tandem mass spectrometry (MS/MS) data acquired on an Orbitrap mass spectrometer. The data were automatically extracted, and each sulfonamide was recognized and analyzed with a prebuilt analysis rule. By using this software, over 98% of the false candidate structures were eliminated, and all the correct structures were found within the top 10 of the ranking lists. Furthermore, SmartMass could also be used to identify slightly modified contraband drugs and metabolites with simple prebuilt rules.