Automated bug reporting

[chunhualiao]

What problem or use case are you trying to solve?

Currently, users have to manually collect and type in context and error messages when reporting bugs. This process is time-consuming, error-prone, and discourages thorough bug reporting, which can delay fixes and improvements.

Describe the UX of the solution you'd like

OpenHands should automatically collect relevant context, such as logs, stack traces, and error messages, when a bug occurs.

Users will be prompted by OpenHands to review and revise the collected data and grant explicit permission before the data is submitted as a bug report to GitHub issue trackers. The process should be seamless and user-friendly, minimizing effort while respecting user privacy.

Security and privacy must be prioritized, ensuring sensitive information is detected and anonymized before submission.

Do you have thoughts on the technical implementation?

OpenHands can use a combination of the following techniques for implementation:
1. Error Handling Hooks: Integrate hooks to capture exceptions and runtime errors in supported environments.
2. Context Capture: Automatically collect metadata, such as system info, environment variables, and the state of the application at the time of the error.
3. Permission Workflow: Build a permission layer where users can review, redact sensitive information, and approve submissions.
4. GitHub API Integration: Use the GitHub API to programmatically create issues with the captured data, categorizing bugs by labels, severity, or other relevant criteria.

Describe alternatives you've considered

Integrate with tools like Sentry or Bugsnag, which specialize in error tracking and reporting.

Additional context

OpenHands is the best github repo with fastest response time to my bug reports. I am super impressed. Yet I think bug reporting should be automated as much as possible.