A Fragmented Field: A Systematic Literature Review on Conceptual Compatibility in Multilingual Software Systems
This repository contains the primary data, analysis scripts, and figures associated with the systematic literature review (SLR) submitted to J.UCS on October, 2025.
Warning: This work is currently under peer review. The materials are made available solely to ensure transparency and reproducibility for reviewers and editors. Public reuse, redistribution, or citation is not permitted until formal acceptance and publication of the associated article.
The repository is organized into three main modules corresponding to the methodology described in the article:
Content: Raw Data, Screening & Extraction Materials.
- Raw Search Exports: Contains the unprocessed, raw export files (.CSV) directly obtained from the search tools/databases (e.g.,
PhdSLR-...-RAW.csv). These represent the initial corpus before any screening. - Screening Data: Contains the processed spreadsheets used during the manual screening phase (e.g.,
PhdSLR-...-SCREENING.csv). - Extraction Data: Contains the final data extraction spreadsheets with the categorized information from the 82 primary studies (e.g.,
PhdSLR-...-EXTRACTION.csv).
Content: Selection Audit, Data Preparation & Generated Outputs.
Scripts & Project Files:
SLR_Conceptual_Compatibility.Rproj: RStudio project file to ensure a consistent working environment for running the analysis scripts.Alignment21.R&Alignment22.R: Scripts used for data alignment and preparation for each sub-question.DecisionGapAudit21.R&DecisionGapAudit22.R: Scripts to perform and visualize the quantitative consistency audit of the screening process (ROC/Calibration plots).
Data:
PhdSLR-...-Sub-question2.1-SCREENING(2).csv: Raw screening data for Sub-question 2.1 (corresponds to RQ1).PhdSLR-...-Sub-question2.2-SCREENING(2).csv: Raw screening data for Sub-question 2.2 (corresponds to RQ2).
Generated Output Directories:
/decision_gap_outputs_SQ2.1/: Contains figures and other outputs related to the consistency audit for SQ2.1./decision_gap_outputs_SQ2.2/: Contains figures and other outputs related to the consistency audit for SQ2.2./slr_outputs_sq21/: Contains general analysis figures for SQ2.1./slr_outputs_sq22/: Contains general analysis figures for SQ2.2.
Content: Descriptive Statistics (Paper Figures 3 & 4).
Scripts & Project Files:
SLR_QUANTITATIVE_ASSESSMENT...SYSTEMS.Rproj: Specific RStudio project file for the descriptive analysis module.SLR_Quantitative_Assessment_of_Conceptual_Compatibility_Venue_Temporal.R: The R script used to analyze the field's demographics and generate the visualizations.
Data:
SLR_venue_temporal_data.csv: The dataset containing venue types and publication years used for these specific analyses.
Generated Outputs:
figure_temporal_trend.pdf: Visualizes the publication trends over time (Figure 3).figure_venues_rq1.pdf: Venue distribution for RQ1 studies (Figure 4a).figure_venues_rq2.pdf: Venue distribution for RQ2 studies (Figure 4b).
LICENSE.txt: The license file for the repository's contents.README.md: This file.
This repository and its contents are released for review purposes only.
The data, figures, and derived materials may not be reused, redistributed, or cited until the official publication of the associated article.
This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License (CC BY-NC-ND 4.0).
You are free to:
- Share — copy and redistribute the material in any medium or format.
Under the following terms:
- Attribution — You must give appropriate credit.
- NonCommercial — You may not use the material for commercial purposes.
- NoDerivatives — You may not distribute modified versions of the material.
The license will be re-evaluated and possibly relaxed after the article's acceptance.
For any questions or access requests, please contact:
Mikel Vandeloise
- University of Namur, Belgium
- [mikel.vandeloise@unamur.be]