Update Elastic Stack chart to 2.0.0 to support kubernetes 1.16
What does this MR do?
Issue: #212255 (closed)
An upstream PR was necessary to fix our Elastic Stack configuration on Kubernetes 1.16. https://github.com/helm/charts/pull/21640
This MR uses the newly released chart. Since it includes an update from filebeat 6 to 7, a number of things are necessary:
- indices created by filebeat 6 are not compatible with indices created by filebeat 7. Most noteably the
offset
field is renamed tolog.offset
. This means we can't query old data after the upgrade. I updated the curator configuration to clean up those indices explicitely. - The new filebeat chart includes an update to the kubernetes labels. Since those fields are immutable, we first need to delete the old filebeat resources before upgrading. For this I added a
preinstall
script that replays the same install command with--set filebeat.enabled=false
.
Please note that this chart is deprecated and will be replaced in 13.0 #212564 (closed) so I'm looking for a quick fix and to avoid major changes in 12.10, please keep it in mind in your review
Screenshots
Does this MR meet the acceptance criteria?
Conformity
-
Changelog entry -
Documentation (if required) -
Code review guidelines -
Merge request performance guidelines -
Style guides -
Database guides -
Separation of EE specific content
Availability and Testing
-
Review and add/update tests for this feature/bug. Consider all test levels. See the Test Planning Process. -
Tested in all supported browsers -
Informed Infrastructure department of a default or new setting change, if applicable per definition of done
Security
If this MR contains changes to processing or storing of credentials or tokens, authorization and authentication methods and other items described in the security review guidelines:
-
Label as security and @ mention @gitlab-com/gl-security/appsec
-
The MR includes necessary changes to maintain consistency between UI, API, email, or other methods -
Security reports checked/validated by a reviewer from the AppSec team
Edited by 🤖 GitLab Bot 🤖