More language support for chunking functions.
This MR adds support for more languages for chunking functions.
The current logic for current_block
and current_context
chunking functions is very general that should work with minimal changes for other languages.
This MR aims to add support for existing languages in the content_v1 BQ table
-
Rust: Works as is. Added tests in this MR. -
GO: Should work with an additional function node type. Added tests in this MR. -
c_sharp: added logic for finding the current context. -
c: added logic for finding the declaration block. -
ruby
Ref: https://gitlab.com/gitlab-org/modelops/applied-ml/code-suggestions/prompt-library/-/issues/22
Edited by Hongtao Yang