Skip to content

Use new indexer version, log errors to elasticsearch.log

Terri Chu requested to merge tchu-log-indexer-to-elasticsearch-log into master

What does this MR do and why?

Related #373268 (closed) (old gitlab-elasticsearch-indexer#105 (moved))

Screenshots or screen recordings

example from elasticsearch.log
{"severity":"DEBUG","time":"2022-09-09T14:25:52.602Z","correlation_id":"5d36d5c2bc52ffc485a86b28e23891ec","message":"indexing_commit_range","project_id":6,"from_sha":"fc5fc4123ff9045caae217c0ee676bdcae205c2a","to_sha":"aafdd38ea1d3b2639273ee3223ed4b9c8b220dfb","index_wiki":false}
{"severity":"WARN","time":"2022-09-09T14:25:53.267Z","correlation_id":"5d36d5c2bc52ffc485a86b28e23891ec","message":"time=\"2022-09-09T10:25:52-04:00\" level=info msg=\"Setting timeout\" timeout=24h0m0s\ntime=\"2022-09-09T10:25:52-04:00\" level=debug msg=\"Indexing from fc5fc4123ff9045caae217c0ee676bdcae205c2a to aafdd38ea1d3b2639273ee3223ed4b9c8b220dfb\" IndexNameCommits=gitlab-development-commits IndexNameDefault=gitlab-development Permissions=\"\u0026{20 20}\" blobType=blob projectID=6 skipCommits=false\ntime=\"2022-09-09T10:25:52-04:00\" level=debug msg=\"Indexing blob change\" operation=PUT path=README.md\ntime=\"2022-09-09T10:25:52-04:00\" level=debug msg=\"Indexing commit\" commitID=035f6b6a5da8d0b0fe1df4fce65d7eb4b15d5964\ntime=\"2022-09-09T10:25:52-04:00\" level=debug msg=\"Indexing commit\" commitID=139a74f7cc31ac0d2ab7ed81b4b67e5c7d021d42\ntime=\"2022-09-09T10:25:52-04:00\" level=debug msg=\"Indexing commit\" commitID=c4351d6addb01d0938419af583f2b5441c31f721\ntime=\"2022-09-09T10:25:52-04:00\" level=debug msg=\"Indexing commit\" commitID=c13c6584a80a35071358af58c04a400b58593818\ntime=\"2022-09-09T10:25:52-04:00\" level=debug msg=\"Indexing commit\" commitID=8e2812d5076b8921817132e476ef2b66feb8966c\ntime=\"2022-09-09T10:25:52-04:00\" level=debug msg=\"Indexing commit\" commitID=684354c9690612fd1c4d58191085bc4afe721c49\ntime=\"2022-09-09T10:25:52-04:00\" level=debug msg=\"Indexing commit\" commitID=712583978e953f26c4c30e7b3f79d00a4faf3a99\ntime=\"2022-09-09T10:25:52-04:00\" level=debug msg=\"Indexing commit\" commitID=3fcb35d9352b88aacfe804bc6ba0d7d6a3c57d1d\ntime=\"2022-09-09T10:25:52-04:00\" level=debug msg=\"Indexing commit\" commitID=aafdd38ea1d3b2639273ee3223ed4b9c8b220dfb\n","status":0,"project_id":6,"from_sha":"fc5fc4123ff9045caae217c0ee676bdcae205c2a","to_sha":"aafdd38ea1d3b2639273ee3223ed4b9c8b220dfb","index_wiki":false}
_Screenshots are required for UI changes, and strongly recommended for all other merge requests._

How to set up and validate locally

Note: Advanced Search must be installed and enabled in gdk. gdk reconfigure needs to be run to pull the new indexer down (i think)

  1. add DEBUG to the env variables sent over the the indexer if you want to see multi line output (this is what will happen when an error occurs)
drawing
  1. edit any repository file for any project
  2. verify that the indexer output show up in the elasticsearch.log

MR acceptance checklist

This checklist encourages us to confirm any changes have been analyzed to reduce risks in quality, performance, reliability, security, and maintainability.

Edited by Terri Chu

Merge request reports

Loading