01877nas a2200217   4500008004100000245008400041210006900125260000800194300001100202490000600213520119200219653002101411653002101432653000801453653001401461653000801475100002901483700001901512700001801531856011001549       2025                        eng d00aRetrieval augmented generation for building datasets from scientific literature0 aRetrieval augmented generation for building datasets from scient  cJUL  a0350060 v83 a<p>
	In this work, we show that employing retrieval augmented generation (RAG) with a large language model (LLM) enables us to extract accurate data from scientific literature and construct datasets. The rapid growth in publications necessitates the automation of extraction of structured data as it is crucial for training machine learning(ML) models. The pipeline developed is simple and can be adjusted accordingly with natural language as input. Quantization enables us to run LLMs on consumer hardware and remove the reliance on closed-source models. Both Llama3-8B and Gemma2-9B with RAG give structured output consistently and with high accuracy as compared to direct prompting. Using the newly developed protocol, we created a data set of metal hydrides for solid-state hydrogen storage from paper abstracts. The accuracy of the generated dataset was &gt;88% in the cases tested. Further, we demonstrate that the generated dataset is ready-to-use for ML models by testing it with HYST to predict the H(2)wt\textbackslash% at a given temperature. Thus, we demonstrate a pipeline to create datasets from scientific literature at minimal computational cost and high accuracy.</p>
10adataset building10aHydrogen storage10aLLM10amaterials10aRAG1 aMaharana, Piyush, Ranjan1 aVerma, Ashwini1 aJoshi, Kavita  uhttps://library.ncl.res.in/content/retrieval-augmented-generation-building-datasets-scientific-literature