Journal of Computing and Information Science in Engineering
Generative Artificial Intelligence for Classification, Prediction, and Discovery of Consumer Product Recalls
Historical information offers valuable insights throughout product development, and recalled products in particular reveal potential design risks, yet they remain underutilized. We curate RECALL-MM, a multimodal dataset from the US Consumer Product Safety Commission (CPSC) recall database, augmented using generative methods. First, we employ generative artificial intelligence (GenAI) to classify hazards from textual descriptors; using GPT-4o, we achieve a relaxed accuracy of 0.73 against reference hazard labels. Second, we benchmark five state-of-the-art vision–language models (VLMs) on hazard pre-diction from product images, where Top-1 accuracy ranges from 23% to 40% and Top-3 reaches 67% with GPT-5. Although classical retrieval baselines (Sentence-BERT and ResNet50 nearest-neighbors) exceed VLM accuracy, the foundation models still identify the correct hazard among three plausible guesses well above chance, zero-shot, from a single image. The near-equivalence of image-feature and large language model (LLM)-dis-tilled text retrieval suggests that visual interpretation carries most of the predictive signal, motivating continued development of flexible multimodal models. To complement these metrics, we apply an LLM-as-Judge framework that scores long-form predictions on a two-axis rubric, highlighting GenAI strengths and challenges in capturing hazard mechanisms and modalities. Finally, two application studies present interactive clustering maps
that embed all recalls into a shared latent space to support hazard discovery. Together, these studies show how computational and GenAI-driven methods can leverage recall archives to classify, predict, and discover hazards, ultimately supporting risk-informed tools in early-stage engineering design.
Associated Researchers
Diana Bolanos
University of California, Berkeley
Kosa Goucher-Lambert
University of California, Berkeley
Related Publications
2025
RECALL-MM: A Multimodal Dataset of Consumer Product Recalls for Risk Analysis using Computational Methods and Large Language ModelsNew multi-modal design dataset contains historical information about…
2026
Hierarchical free-form deformation with rigid feature preservation for shape-parameterized model order reductionIntroducing a new geometry deformation method that enables fast…
2025
Evaluating the Role of Model Size in Agentic AI for Expert-Like Material SelectionThis research evaluates the role of model size in agentic AI tools for…
Get in touch
Something pique your interest? Get in touch if you’d like to learn more about Autodesk Research, our projects, people, and potential collaboration opportunities.
Contact us