Project description
Application for data mining in historical documents
While digitisation has made historical texts accessible, academics and students still encounter difficulties when working with institutions that house vast digital repositories. The ERC-funded HistText project aims to develop an innovative application for large-scale data mining in historical textual corpora. This collaborative effort between historians and computer scientists focuses on employing machine learning techniques to analyse extensive text archives. The application is designed to handle databases containing billions of words across millions of multilingual documents. It features a user-friendly interface, advanced text analysis methods, and robust data visualisation capabilities. With its emphasis on advanced text analysis and user accessibility, HistText seeks to revolutionise large-scale textual analysis and offer a new approach to understanding historical documents.
Objective
HistText is a groundbreaking application developed to address the complex challenges of large-scale data mining in textual corpora, with a particular focus on historical documents. Created in the context of the ERC-funded ENP-China project, which aims to study the evolution of Chinese elites from the 19th century to 1949, HistText is the result of a synergistic collaboration between historians and computer scientists exploring machine learning applications for extensive text archives. Designed to manage databases containing billions of words across millions of multilingual documents, HistText offers a robust and versatile platform that streamlines the process of extracting and visualizing valuable insights. The application features a user-friendly interface, advanced text analysis techniques, and powerful data visualization capabilities. It provides a simplified approach for novice users to conduct complex data queries and analyses, while also offering a comprehensive R-library for more expert users. The main challenge that the proof of concept aims to tackle is to make HistText a fully packageable and transferable tool that can cater to the specialized needs of scholars and institutions holding vast digital repositories. With its focus on advanced text analysis and user accessibility, HistText stands as an invaluable resource not only for academics in the digital humanities but also for students and the general public. In terms of broader applications, HistText has the potential to be integrated into a wide range of institutions (libraries, digital content providers, etc.). The platform is exceptionally well-suited for analyzing a wide range of text genres, including newspapers, periodicals, directories, and diaries, among others. By offering a scalable, user-friendly, and methodologically rigorous tool, HistText aims to revolutionize how we approach large-scale textual analysis, providing a new pathway for understanding historical documents.
Programme(s)
- HORIZON.1.1 - European Research Council (ERC) Main Programme
Funding Scheme
HORIZON-ERC-POC - HORIZON ERC Proof of Concept GrantsHost institution
13284 Marseille
France