JetBrains-Research/commit-message-editing-visualization

Commit Message Editing Visualisation ✍️🔍📊

This space provides a visualization app for exploring the commit message edits datasets (🤗 expert-labeled and 🤗 synthetic) from 📜 Towards Realistic Evaluation of Commit Message Generation by Matching Online and Offline Settings paper and also hosts important artifacts from our work.

Artifacts

• —📊`metrics_analysis.ipynb` contains the code for metrics calculation and analysis;
• —📈`chart.ipynb` contains the code for Figure 4 with edit distance distribution;
• —🗃️`data_stats.ipynb` contains the code for obtaining the dataset statistics from Table 1;
• —⬅️`generation_steps/synthetic_backward.py` contains the code for Synthetic Backward generation proposed in our paper;
• —➡️`generation_steps/synthetic_forward.py` contains the code for Synthetic Forward generation proposed in our paper.

Visualization

• —🔍 Click on Examples Exploration tab to browse through nicely-formatted examples from our dataset.
• —📈 Click on Dataset Statistics tab to see the major statistics for our dataset.
• —📊 Click on Experimental Results tab to see additional metrics tested as target online metrics alongside our main edit distance results.