Use new indexer version, log errors to elasticsearch.log
What does this MR do and why?
Related #373268 (closed) (old gitlab-elasticsearch-indexer#105 (moved))
- use new version of gitlab-elasticsearch-indexer
- change to always log output to elasticsearch.log file (even if status is 0)
- include
status
field in logged data - update documentation
Screenshots or screen recordings
example from elasticsearch.log
{"severity":"DEBUG","time":"2022-09-09T14:25:52.602Z","correlation_id":"5d36d5c2bc52ffc485a86b28e23891ec","message":"indexing_commit_range","project_id":6,"from_sha":"fc5fc4123ff9045caae217c0ee676bdcae205c2a","to_sha":"aafdd38ea1d3b2639273ee3223ed4b9c8b220dfb","index_wiki":false}
{"severity":"WARN","time":"2022-09-09T14:25:53.267Z","correlation_id":"5d36d5c2bc52ffc485a86b28e23891ec","message":"time=\"2022-09-09T10:25:52-04:00\" level=info msg=\"Setting timeout\" timeout=24h0m0s\ntime=\"2022-09-09T10:25:52-04:00\" level=debug msg=\"Indexing from fc5fc4123ff9045caae217c0ee676bdcae205c2a to aafdd38ea1d3b2639273ee3223ed4b9c8b220dfb\" IndexNameCommits=gitlab-development-commits IndexNameDefault=gitlab-development Permissions=\"\u0026{20 20}\" blobType=blob projectID=6 skipCommits=false\ntime=\"2022-09-09T10:25:52-04:00\" level=debug msg=\"Indexing blob change\" operation=PUT path=README.md\ntime=\"2022-09-09T10:25:52-04:00\" level=debug msg=\"Indexing commit\" commitID=035f6b6a5da8d0b0fe1df4fce65d7eb4b15d5964\ntime=\"2022-09-09T10:25:52-04:00\" level=debug msg=\"Indexing commit\" commitID=139a74f7cc31ac0d2ab7ed81b4b67e5c7d021d42\ntime=\"2022-09-09T10:25:52-04:00\" level=debug msg=\"Indexing commit\" commitID=c4351d6addb01d0938419af583f2b5441c31f721\ntime=\"2022-09-09T10:25:52-04:00\" level=debug msg=\"Indexing commit\" commitID=c13c6584a80a35071358af58c04a400b58593818\ntime=\"2022-09-09T10:25:52-04:00\" level=debug msg=\"Indexing commit\" commitID=8e2812d5076b8921817132e476ef2b66feb8966c\ntime=\"2022-09-09T10:25:52-04:00\" level=debug msg=\"Indexing commit\" commitID=684354c9690612fd1c4d58191085bc4afe721c49\ntime=\"2022-09-09T10:25:52-04:00\" level=debug msg=\"Indexing commit\" commitID=712583978e953f26c4c30e7b3f79d00a4faf3a99\ntime=\"2022-09-09T10:25:52-04:00\" level=debug msg=\"Indexing commit\" commitID=3fcb35d9352b88aacfe804bc6ba0d7d6a3c57d1d\ntime=\"2022-09-09T10:25:52-04:00\" level=debug msg=\"Indexing commit\" commitID=aafdd38ea1d3b2639273ee3223ed4b9c8b220dfb\n","status":0,"project_id":6,"from_sha":"fc5fc4123ff9045caae217c0ee676bdcae205c2a","to_sha":"aafdd38ea1d3b2639273ee3223ed4b9c8b220dfb","index_wiki":false}
How to set up and validate locally
Note: Advanced Search must be installed and enabled in gdk. gdk reconfigure
needs to be run to pull the new indexer down (i think)
- add
DEBUG
to the env variables sent over the the indexer if you want to see multi line output (this is what will happen when an error occurs)
- edit any repository file for any project
- verify that the indexer output show up in the elasticsearch.log
MR acceptance checklist
This checklist encourages us to confirm any changes have been analyzed to reduce risks in quality, performance, reliability, security, and maintainability.
-
I have evaluated the MR acceptance checklist for this MR.
Edited by Terri Chu