Assessing the collapse susceptibility of abandoned cavities at a regional scale is associated with large uncertainties that are mainly related to the very nature of the phenomena, but also to the difficulty in collecting exhaustive information at such a scale on often "forgotten" structures. In this context, the expert's role is essential, because he is able to synthesize the information resulting from the inventory and from the commonly imprecise, if not vague, criteria on the basis of his experience and his knowledge of the regional geological and historical and economic context. In this article, we propose mathematical tools for representing and processing this information in order to give flexibility to this step and manage the uncertainty inherent in the expert's information. The first tool, based on the weight of evidence theory, is for managing the uncertainty due to the heterogeneous spatial distribution of the data, whereas the second tool, based on the fuzzy set theory, is for managing the imprecision and incompleteness of available data, which hinder the definition of the class boundaries of the quantitative decision criteria. Based on an appropriate representation of the uncertainty sources (related to the input data and to the expert diagnostic), we then propose a methodology that integrates the uncertainty in the final output of the collapse susceptibility assessment and provides a confidence indicator useful within the decision-making process. The proposed methodology is applied to the Arras territory in the North of France, where abandoned chalk pits (dating back to the Roman ages) and war saps (i.e. covered trenches) located in the vicinity of the First World War front lines both raise difficulties for urban planning.