This article outlines a methodology for analyzing Copilot-related problems through systematic data extraction from GitHub issues and discussions. The researchers identified specific data items to capture information on problems, causes, and solutions related to Copilot's usage. A pilot study validated the feasibility of their data extraction approach, leading to defined criteria for identifying and recording issues to ensure accurate analysis. This structured methodology is intended to address three primary research questions focused on understanding the nature of problems encountered by users and potential solutions.
To effectively analyze issues associated with Copilot usage, we developed specific data extraction criteria ensuring systematic retrieval of information related to problems, causes, and solutions.
Our pilot data extraction affirmed that key information regarding reported problems and proposed solutions could be reliably gathered from various GitHub sources, enhancing the study's validity.
Collection
[
|
...
]