Skip to content

Remove feature flag `code_generation_update_libraries_prompt`"

Leaminn Ma requested to merge remove-ff-code_generation_update_libraries_prompt into master

What does this MR do and why?

In #477101 (closed), we rolled out a feature that improves the library instructions in the code generation prompt. It has been rolled out since 2024-08-08 12PM PT.

The charts show there has been no negative impact to the code generation acceptance rate nor latency. There looks to be a slight improvement to acceptance rate, but we cannot ascertain definitively if it was due to this libraries prompt improvement.

Given that there has been no negative impact, we can proceed with removing the feature flag.

MR acceptance checklist

Please evaluate this MR against the MR acceptance checklist. It helps you analyze changes to reduce risks in quality, performance, reliability, security, and maintainability.

Related to #477101 (closed)

Edited by Leaminn Ma

Merge request reports