ES Migration add permission data to notes documents (!53406) · Merge requests · GitLab.org / GitLab

Terri Chu requested to merge 300351-remove-joins-from-the-elasticsearch-query-for-project-group-scoped-notes-comments-search-2 into master Feb 04, 2021

Background

Related to #300351 (closed)

Re-adding the Elasticsearch migration for Notes permission data which was reverted.

Original MR: !52837 (merged)
Revert MR: !53388 (merged)
Incident Issue: gitlab-com/gl-infra/production#3509 (closed)

Changes from original MR:

split work into three MRs:
- one with new data fields for indexing !54482 (merged)
- a migration to cleanup permission data from the previous migration attempt !53525 (merged)
- this migration to back fill the permission data
only contains the migration code + specs

What does this MR do?

Migration to denormalize the notes project permission data required to remove the project parent joins from Elasticsearch Notes scoped queries. This MR will:

add a migration to queue all searchable notes missing permission data to be reindexed. All notes are indexed but only some notes are searchable (Issue, Comment, Snippet, and MergeRequest types). Any permission data migrations for other note types will be handled in future issues/MRs.
the reindexing process will add permission data because of the MR where the as_json method was modified to include those new fields

Runtime expectations on GitLab.com

There are approximately 34,000,000 notes in the GitLab.com Elasticsearch index.

command run: curl "$CLUSTER_URL/_count?q=type:note"

The migration will run batches of 9,000 notes every 3 minute

Time estimate (GitLab.com): 188 hours

How to test

Setup

ensure that there are some comments in the database
enable Elasticsearch in gdk & Advanced Search indexing in Admin Settings
create the index using rake tasks on the master branch (may take a bit if you have large amount of projects or data): bundle exec rake gitlab:elastic:index
manually remove permission data from the index for the comments

expand for CURL request

curl --request POST \
  --url http://localhost:9200/gitlab-development/_update_by_query \
  --header 'Content-Type: application/json' \
  --data '{
	"script": {
		"source": "ctx._source.remove('\''visibility_level'\''); ctx._source.remove('\''repository_access_level'\''); ctx._source.remove('\''snippets_access_level'\''); ctx._source.remove('\''merge_requests_access_level'\''); ctx._source.remove('\''issues_access_level'\'');"
	},
	"query": {
		"bool": {
			"must": [
				{
					"term": {
						"type": {
							"value": "note"
						}
					}
				}				
			]
		}
	}
}'

Instructions

open a rails console and run the migration worker: Elastic::MigrationWorker.new.perform
follow along with the migration logs in the log/elasticsearch.log file

Elasticsearch log example

{"severity":"INFO","time":"2021-02-16T19:31:40.203Z","correlation_id":null,"message":"MigrationWorker: migration[AddPermissionsDataToNotesDocuments] executing migrate method"}
{"severity":"INFO","time":"2021-02-16T19:31:40.206Z","correlation_id":null,"message":"[Elastic::Migration: 20210128163600] completed check: Refreshing gitlab-development-20210216-1420"}
{"severity":"INFO","time":"2021-02-16T19:31:40.235Z","correlation_id":null,"message":"[Elastic::Migration: 20210128163600] Migration has 1533 documents remaining"}
{"severity":"INFO","time":"2021-02-16T19:31:40.235Z","correlation_id":null,"message":"[Elastic::Migration: 20210128163600] Adding permission data to notes documents for batch of 9000 documents"}
{"severity":"DEBUG","time":"2021-02-16T19:31:40.297Z","correlation_id":null,"class":"Elastic::ProcessBookkeepingService","redis_set":"elastic:incremental:updates:0:zset","message":"track_items","count":100,"tracked_items_encoded":"[[1,\"Note 449 note_449 project_7\"],[2,\"Note 450 note_450 project_7\"],[3,\"Note 451 note_451 project_7\"],[4,\"Note 452 note_452 project_7\"],[5,\"Note 453 note_453 project_7\"],[6,\"Note 454 note_454 project_7\"],[7,\"Note 455 note_455 project_7\"],[8,\"Note 456 note_456 project_7\"],[9,\"Note 457 note_457 project_7\"],[10,\"Note 458 note_458 project_7\"],[11,\"Note 459 note_459 project_7\"],[12,\"Note 460 note_460 project_7\"],[13,\"Note 461 note_461 project_7\"],[14,\"Note 462 note_462 project_7\"],[15,\"Note 463 note_463 project_7\"],[16,\"Note 464 note_464 project_7\"],[17,\"Note 465 note_465 project_7\"],[18,\"Note 466 note_466 project_7\"],[19,\"Note 467 note_467 project_7\"],[20,\"Note 468 note_468 project_7\"],[21,\"Note 469 note_469 project_7\"],[22,\"Note 470 note_470 project_7\"],[23,\"Note 471 note_471 project_7\"],[24,\"Note 472 note_472 project_7\"],[25,\"Note 473 note_473 project_7\"],[26,\"Note 474 note_474 project_7\"],[27,\"Note 475 note_475 project_7\"],[28,\"Note 476 note_476 project_7\"],[29,\"Note 477 note_477 project_7\"],[30,\"Note 478 note_478 project_7\"],[31,\"Note 479 note_479 project_7\"],[32,\"Note 480 note_480 project_7\"],[33,\"Note 481 note_481 project_7\"],[34,\"Note 482 note_482 project_7\"],[35,\"Note 483 note_483 project_7\"],[36,\"Note 484 note_484 project_7\"],[37,\"Note 485 note_485 project_7\"],[38,\"Note 486 note_486 project_7\"],[39,\"Note 487 note_487 project_7\"],[40,\"Note 488 note_488 project_7\"],[41,\"Note 489 note_489 project_7\"],[42,\"Note 490 note_490 project_7\"],[43,\"Note 491 note_491 project_7\"],[44,\"Note 492 note_492 project_7\"],[45,\"Note 493 note_493 project_7\"],[46,\"Note 494 note_494 project_7\"],[47,\"Note 495 note_495 project_7\"],[48,\"Note 496 note_496 project_7\"],[49,\"Note 497 note_497 project_7\"],[50,\"Note 498 note_498 project_7\"],[51,\"Note 499 note_499 project_7\"],[52,\"Note 500 note_500 project_7\"],[53,\"Note 501 note_501 project_7\"],[54,\"Note 502 note_502 project_7\"],[55,\"Note 503 note_503 project_7\"],[56,\"Note 504 note_504 project_7\"],[57,\"Note 505 note_505 project_7\"],[58,\"Note 506 note_506 project_7\"],[59,\"Note 507 note_507 project_7\"],[60,\"Note 508 note_508 project_7\"],[61,\"Note 509 note_509 project_7\"],[62,\"Note 510 note_510 project_7\"],[63,\"Note 511 note_511 project_7\"],[64,\"Note 512 note_512 project_7\"],[65,\"Note 513 note_513 project_7\"],[66,\"Note 514 note_514 project_7\"],[67,\"Note 515 note_515 project_7\"],[68,\"Note 516 note_516 project_7\"],[69,\"Note 517 note_517 project_7\"],[70,\"Note 518 note_518 project_7\"],[71,\"Note 519 note_519 project_7\"],[72,\"Note 520 note_520 project_7\"],[73,\"Note 521 note_521 project_7\"],[74,\"Note 522 note_522 project_7\"],[75,\"Note 523 note_523 project_7\"],[76,\"Note 524 note_524 project_7\"],[77,\"Note 525 note_525 project_7\"],[78,\"Note 1295 note_1295 project_7\"],[79,\"Note 1296 note_1296 project_7\"],[80,\"Note 1297 note_1297 project_7\"],[81,\"Note 1298 note_1298 project_7\"],[82,\"Note 1299 note_1299 project_7\"],[83,\"Note 1300 note_1300 project_7\"],[84,\"Note 1301 note_1301 project_7\"],[85,\"Note 1302 note_1302 project_7\"],[86,\"Note 1303 note_1303 project_7\"],[87,\"Note 1304 note_1304 project_7\"],[88,\"Note 1305 note_1305 project_7\"],[89,\"Note 1306 note_1306 project_7\"],[90,\"Note 1307 note_1307 project_7\"],[91,\"Note 1308 note_1308 project_7\"],[92,\"Note 989 note_989 project_14\"],[93,\"Note 990 note_990 project_14\"],[94,\"Note 991 note_991 project_14\"],[95,\"Note 992 note_992 project_14\"],[96,\"Note 993 note_993 project_14\"],[97,\"Note 994 note_994 project_14\"],[98,\"Note 995 note_995 project_14\"],[99,\"Note 996 note_996 project_14\"],[100,\"Note 997 note_997 project_14\"]]"}
{"severity":"DEBUG","time":"2021-02-16T19:31:40.299Z","correlation_id":null,"class":"Elastic::ProcessBookkeepingService","redis_set":"elastic:incremental:updates:0:zset","message":"track_items","count":100,"tracked_items_encoded":"[[101,\"Note 998 note_998 project_14\"],[102,\"Note 999 note_999 project_14\"],[103,\"Note 1000 note_1000 project_14\"],[104,\"Note 1001 note_1001 project_14\"],[105,\"Note 1002 note_1002 project_14\"],[106,\"Note 1003 note_1003 project_14\"],[107,\"Note 1004 note_1004 project_14\"],[108,\"Note 1005 note_1005 project_14\"],[109,\"Note 1006 note_1006 project_14\"],[110,\"Note 1007 note_1007 project_14\"],[111,\"Note 1008 note_1008 project_14\"],[112,\"Note 1009 note_1009 project_14\"],[113,\"Note 1010 note_1010 project_14\"],[114,\"Note 1011 note_1011 project_14\"],[115,\"Note 1012 note_1012 project_14\"],[116,\"Note 1013 note_1013 project_14\"],[117,\"Note 1014 note_1014 project_14\"],[118,\"Note 1015 note_1015 project_14\"],[119,\"Note 1016 note_1016 project_14\"],[120,\"Note 1017 note_1017 project_14\"],[121,\"Note 1018 note_1018 project_14\"],[122,\"Note 1019 note_1019 project_14\"],[123,\"Note 1020 note_1020 project_14\"],[124,\"Note 1021 note_1021 project_14\"],[125,\"Note 1022 note_1022 project_14\"],[126,\"Note 1023 note_1023 project_14\"],[127,\"Note 1024 note_1024 project_14\"],[128,\"Note 1025 note_1025 project_14\"],[129,\"Note 1026 note_1026 project_14\"],[130,\"Note 1027 note_1027 project_14\"],[131,\"Note 1028 note_1028 project_14\"],[132,\"Note 1029 note_1029 project_14\"],[133,\"Note 1030 note_1030 project_14\"],[134,\"Note 1031 note_1031 project_14\"],[135,\"Note 1032 note_1032 project_14\"],[136,\"Note 1033 note_1033 project_14\"],[137,\"Note 1034 note_1034 project_14\"],[138,\"Note 1035 note_1035 project_14\"],[139,\"Note 1036 note_1036 project_14\"],[140,\"Note 1037 note_1037 project_14\"],[141,\"Note 1038 note_1038 project_14\"],[142,\"Note 1039 note_1039 project_14\"],[143,\"Note 1040 note_1040 project_14\"],[144,\"Note 1041 note_1041 project_14\"],[145,\"Note 1042 note_1042 project_14\"],[146,\"Note 1043 note_1043 project_14\"],[147,\"Note 1044 note_1044 project_14\"],[148,\"Note 1045 note_1045 project_14\"],[149,\"Note 1046 note_1046 project_14\"],[150,\"Note 1047 note_1047 project_14\"],[151,\"Note 1048 note_1048 project_14\"],[152,\"Note 1049 note_1049 project_14\"],[153,\"Note 1050 note_1050 project_14\"],[154,\"Note 1051 note_1051 project_14\"],[155,\"Note 1052 note_1052 project_14\"],[156,\"Note 1053 note_1053 project_14\"],[157,\"Note 1054 note_1054 project_14\"],[158,\"Note 1055 note_1055 project_14\"],[159,\"Note 1056 note_1056 project_14\"],[160,\"Note 1057 note_1057 project_14\"],[161,\"Note 1058 note_1058 project_14\"],[162,\"Note 1059 note_1059 project_14\"],[163,\"Note 1060 note_1060 project_14\"],[164,\"Note 1061 note_1061 project_14\"],[165,\"Note 1062 note_1062 project_14\"],[166,\"Note 1063 note_1063 project_14\"],[167,\"Note 1064 note_1064 project_14\"],[168,\"Note 1065 note_1065 project_14\"],[169,\"Note 1066 note_1066 project_14\"],[170,\"Note 1067 note_1067 project_14\"],[171,\"Note 1068 note_1068 project_14\"],[172,\"Note 1069 note_1069 project_14\"],[173,\"Note 1070 note_1070 project_14\"],[174,\"Note 1071 note_1071 project_14\"],[175,\"Note 1072 note_1072 project_14\"],[176,\"Note 1073 note_1073 project_14\"],[177,\"Note 1074 note_1074 project_14\"],[178,\"Note 1075 note_1075 project_14\"],[179,\"Note 1076 note_1076 project_14\"],[180,\"Note 1372 note_1372 project_14\"],[181,\"Note 1373 note_1373 project_14\"],[182,\"Note 1374 note_1374 project_14\"],[183,\"Note 1375 note_1375 project_14\"],[184,\"Note 1376 note_1376 project_14\"],[185,\"Note 1377 note_1377 project_14\"],[186,\"Note 1378 note_1378 project_14\"],[187,\"Note 1379 note_1379 project_14\"],[188,\"Note 1380 note_1380 project_14\"],[189,\"Note 1381 note_1381 project_14\"],[190,\"Note 1382 note_1382 project_14\"],[191,\"Note 1383 note_1383 project_14\"],[192,\"Note 1384 note_1384 project_14\"],[193,\"Note 1385 note_1385 project_14\"],[194,\"Note 1386 note_1386 project_14\"],[195,\"Note 1387 note_1387 project_14\"],[196,\"Note 1388 note_1388 project_14\"],[197,\"Note 1389 note_1389 project_14\"],[198,\"Note 1390 note_1390 project_14\"],[199,\"Note 1391 note_1391 project_14\"],[200,\"Note 1392 note_1392 project_14\"]]"}
{"severity":"DEBUG","time":"2021-02-16T19:31:40.300Z","correlation_id":null,"class":"Elastic::ProcessBookkeepingService","redis_set":"elastic:incremental:updates:0:zset","message":"track_items","count":100,"tracked_items_encoded":"[[201,\"Note 1393 note_1393 project_14\"],[202,\"Note 1394 note_1394 project_14\"],[203,\"Note 1395 note_1395 project_14\"],[204,\"Note 1396 note_1396 project_14\"],[205,\"Note 1397 note_1397 project_14\"],[206,\"Note 1398 note_1398 project_14\"],[207,\"Note 1399 note_1399 project_14\"],[208,\"Note 1400 note_1400 project_14\"],[209,\"Note 1401 note_1401 project_14\"],[210,\"Note 1402 note_1402 project_14\"],[211,\"Note 1403 note_1403 project_14\"],[212,\"Note 1404 note_1404 project_14\"],[213,\"Note 1405 note_1405 project_14\"],[214,\"Note 1406 note_1406 project_14\"],[215,\"Note 1407 note_1407 project_14\"],[216,\"Note 1408 note_1408 project_14\"],[217,\"Note 1409 note_1409 project_14\"],[218,\"Note 1410 note_1410 project_14\"],[219,\"Note 1411 note_1411 project_14\"],[220,\"Note 1412 note_1412 project_14\"],[221,\"Note 1413 note_1413 project_14\"],[222,\"Note 1414 note_1414 project_14\"],[223,\"Note 1415 note_1415 project_14\"],[224,\"Note 1416 note_1416 project_14\"],[225,\"Note 1417 note_1417 project_14\"],[226,\"Note 1418 note_1418 project_14\"],[227,\"Note 1419 note_1419 project_14\"],[228,\"Note 1420 note_1420 project_14\"],[229,\"Note 1421 note_1421 project_14\"],[230,\"Note 1422 note_1422 project_14\"],[231,\"Note 1423 note_1423 project_14\"],[232,\"Note 1424 note_1424 project_14\"],[233,\"Note 1425 note_1425 project_14\"],[234,\"Note 1426 note_1426 project_14\"],[235,\"Note 1427 note_1427 project_14\"],[236,\"Note 1575 note_1575 project_33\"],[237,\"Note 1580 note_1580 project_33\"],[238,\"Note 1576 note_1576 project_34\"],[239,\"Note 271 note_271 project_5\"],[240,\"Note 272 note_272 project_5\"],[241,\"Note 273 note_273 project_5\"],[242,\"Note 274 note_274 project_5\"],[243,\"Note 275 note_275 project_5\"],[244,\"Note 276 note_276 project_5\"],[245,\"Note 277 note_277 project_5\"],[246,\"Note 278 note_278 project_5\"],[247,\"Note 279 note_279 project_5\"],[248,\"Note 280 note_280 project_5\"],[249,\"Note 281 note_281 project_5\"],[250,\"Note 282 note_282 project_5\"],[251,\"Note 283 note_283 project_5\"],[252,\"Note 284 note_284 project_5\"],[253,\"Note 285 note_285 project_5\"],[254,\"Note 286 note_286 project_5\"],[255,\"Note 287 note_287 project_5\"],[256,\"Note 288 note_288 project_5\"],[257,\"Note 289 note_289 project_5\"],[258,\"Note 290 note_290 project_5\"],[259,\"Note 291 note_291 project_5\"],[260,\"Note 292 note_292 project_5\"],[261,\"Note 293 note_293 project_5\"],[262,\"Note 294 note_294 project_5\"],[263,\"Note 295 note_295 project_5\"],[264,\"Note 296 note_296 project_5\"],[265,\"Note 297 note_297 project_5\"],[266,\"Note 298 note_298 project_5\"],[267,\"Note 299 note_299 project_5\"],[268,\"Note 300 note_300 project_5\"],[269,\"Note 301 note_301 project_5\"],[270,\"Note 302 note_302 project_5\"],[271,\"Note 303 note_303 project_5\"],[272,\"Note 304 note_304 project_5\"],[273,\"Note 305 note_305 project_5\"],[274,\"Note 306 note_306 project_5\"],[275,\"Note 307 note_307 project_5\"],[276,\"Note 308 note_308 project_5\"],[277,\"Note 309 note_309 project_5\"],[278,\"Note 310 note_310 project_5\"],[279,\"Note 311 note_311 project_5\"],[280,\"Note 312 note_312 project_5\"],[281,\"Note 313 note_313 project_5\"],[282,\"Note 314 note_314 project_5\"],[283,\"Note 315 note_315 project_5\"],[284,\"Note 316 note_316 project_5\"],[285,\"Note 317 note_317 project_5\"],[286,\"Note 318 note_318 project_5\"],[287,\"Note 319 note_319 project_5\"],[288,\"Note 320 note_320 project_5\"],[289,\"Note 321 note_321 project_5\"],[290,\"Note 322 note_322 project_5\"],[291,\"Note 323 note_323 project_5\"],[292,\"Note 324 note_324 project_5\"],[293,\"Note 325 note_325 project_5\"],[294,\"Note 326 note_326 project_5\"],[295,\"Note 327 note_327 project_5\"],[296,\"Note 328 note_328 project_5\"],[297,\"Note 329 note_329 project_5\"],[298,\"Note 330 note_330 project_5\"],[299,\"Note 331 note_331 project_5\"],[300,\"Note 332 note_332 project_5\"]]"}
{"severity":"DEBUG","time":"2021-02-16T19:31:40.302Z","correlation_id":null,"class":"Elastic::ProcessBookkeepingService","redis_set":"elastic:incremental:updates:0:zset","message":"track_items","count":100,"tracked_items_encoded":"[[301,\"Note 333 note_333 project_5\"],[302,\"Note 334 note_334 project_5\"],[303,\"Note 335 note_335 project_5\"],[304,\"Note 336 note_336 project_5\"],[305,\"Note 337 note_337 project_5\"],[306,\"Note 338 note_338 project_5\"],[307,\"Note 339 note_339 project_5\"],[308,\"Note 340 note_340 project_5\"],[309,\"Note 341 note_341 project_5\"],[310,\"Note 342 note_342 project_5\"],[311,\"Note 343 note_343 project_5\"],[312,\"Note 344 note_344 project_5\"],[313,\"Note 345 note_345 project_5\"],[314,\"Note 346 note_346 project_5\"],[315,\"Note 347 note_347 project_5\"],[316,\"Note 348 note_348 project_5\"],[317,\"Note 349 note_349 project_5\"],[318,\"Note 350 note_350 project_5\"],[319,\"Note 351 note_351 project_5\"],[320,\"Note 352 note_352 project_5\"],[321,\"Note 353 note_353 project_5\"],[322,\"Note 354 note_354 project_5\"],[323,\"Note 355 note_355 project_5\"],[324,\"Note 356 note_356 project_5\"],[325,\"Note 357 note_357 project_5\"],[326,\"Note 358 note_358 project_5\"],[327,\"Note 359 note_359 project_5\"],[328,\"Note 360 note_360 project_5\"],[329,\"Note 1245 note_1245 project_5\"],[330,\"Note 1246 note_1246 project_5\"],[331,\"Note 1247 note_1247 project_5\"],[332,\"Note 1248 note_1248 project_5\"],[333,\"Note 1249 note_1249 project_5\"],[334,\"Note 1250 note_1250 project_5\"],[335,\"Note 1251 note_1251 project_5\"],[336,\"Note 1252 note_1252 project_5\"],[337,\"Note 1253 note_1253 project_5\"],[338,\"Note 1254 note_1254 project_5\"],[339,\"Note 1255 note_1255 project_5\"],[340,\"Note 1256 note_1256 project_5\"],[341,\"Note 1257 note_1257 project_5\"],[342,\"Note 1258 note_1258 project_5\"],[343,\"Note 1259 note_1259 project_5\"],[344,\"Note 1260 note_1260 project_5\"],[345,\"Note 1261 note_1261 project_5\"],[346,\"Note 1262 note_1262 project_5\"],[347,\"Note 643 note_643 project_10\"],[348,\"Note 644 note_644 project_10\"],[349,\"Note 645 note_645 project_10\"],[350,\"Note 646 note_646 project_10\"],[351,\"Note 647 note_647 project_10\"],[352,\"Note 648 note_648 project_10\"],[353,\"Note 649 note_649 project_10\"],[354,\"Note 650 note_650 project_10\"],[355,\"Note 651 note_651 project_10\"],[356,\"Note 652 note_652 project_10\"],[357,\"Note 653 note_653 project_10\"],[358,\"Note 654 note_654 project_10\"],[359,\"Note 655 note_655 project_10\"],[360,\"Note 656 note_656 project_10\"],[361,\"Note 657 note_657 project_10\"],[362,\"Note 658 note_658 project_10\"],[363,\"Note 659 note_659 project_10\"],[364,\"Note 660 note_660 project_10\"],[365,\"Note 661 note_661 project_10\"],[366,\"Note 662 note_662 project_10\"],[367,\"Note 663 note_663 project_10\"],[368,\"Note 664 note_664 project_10\"],[369,\"Note 665 note_665 project_10\"],[370,\"Note 666 note_666 project_10\"],[371,\"Note 667 note_667 project_10\"],[372,\"Note 668 note_668 project_10\"],[373,\"Note 669 note_669 project_10\"],[374,\"Note 670 note_670 project_10\"],[375,\"Note 671 note_671 project_10\"],[376,\"Note 672 note_672 project_10\"],[377,\"Note 673 note_673 project_10\"],[378,\"Note 674 note_674 project_10\"],[379,\"Note 675 note_675 project_10\"],[380,\"Note 676 note_676 project_10\"],[381,\"Note 677 note_677 project_10\"],[382,\"Note 678 note_678 project_10\"],[383,\"Note 679 note_679 project_10\"],[384,\"Note 680 note_680 project_10\"],[385,\"Note 681 note_681 project_10\"],[386,\"Note 682 note_682 project_10\"],[387,\"Note 683 note_683 project_10\"],[388,\"Note 684 note_684 project_10\"],[389,\"Note 685 note_685 project_10\"],[390,\"Note 686 note_686 project_10\"],[391,\"Note 687 note_687 project_10\"],[392,\"Note 688 note_688 project_10\"],[393,\"Note 689 note_689 project_10\"],[394,\"Note 690 note_690 project_10\"],[395,\"Note 691 note_691 project_10\"],[396,\"Note 692 note_692 project_10\"],[397,\"Note 693 note_693 project_10\"],[398,\"Note 694 note_694 project_10\"],[399,\"Note 695 note_695 project_10\"],[400,\"Note 696 note_696 project_10\"]]"}
{"severity":"DEBUG","time":"2021-02-16T19:31:40.304Z","correlation_id":null,"class":"Elastic::ProcessBookkeepingService","redis_set":"elastic:incremental:updates:0:zset","message":"track_items","count":100,"tracked_items_encoded":"[[401,\"Note 697 note_697 project_10\"],[402,\"Note 698 note_698 project_10\"],[403,\"Note 699 note_699 project_10\"],[404,\"Note 700 note_700 project_10\"],[405,\"Note 701 note_701 project_10\"],[406,\"Note 702 note_702 project_10\"],[407,\"Note 703 note_703 project_10\"],[408,\"Note 704 note_704 project_10\"],[409,\"Note 705 note_705 project_10\"],[410,\"Note 706 note_706 project_10\"],[411,\"Note 707 note_707 project_10\"],[412,\"Note 708 note_708 project_10\"],[413,\"Note 709 note_709 project_10\"],[414,\"Note 710 note_710 project_10\"],[415,\"Note 711 note_711 project_10\"],[416,\"Note 712 note_712 project_10\"],[417,\"Note 713 note_713 project_10\"],[418,\"Note 714 note_714 project_10\"],[419,\"Note 715 note_715 project_10\"],[420,\"Note 716 note_716 project_10\"],[421,\"Note 717 note_717 project_10\"],[422,\"Note 718 note_718 project_10\"],[423,\"Note 719 note_719 project_10\"],[424,\"Note 720 note_720 project_10\"],[425,\"Note 721 note_721 project_10\"],[426,\"Note 722 note_722 project_10\"],[427,\"Note 723 note_723 project_10\"],[428,\"Note 724 note_724 project_10\"],[429,\"Note 725 note_725 project_10\"],[430,\"Note 726 note_726 project_10\"],[431,\"Note 727 note_727 project_10\"],[432,\"Note 728 note_728 project_10\"],[433,\"Note 729 note_729 project_10\"],[434,\"Note 730 note_730 project_10\"],[435,\"Note 731 note_731 project_10\"],[436,\"Note 732 note_732 project_10\"],[437,\"Note 733 note_733 project_10\"],[438,\"Note 734 note_734 project_10\"],[439,\"Note 735 note_735 project_10\"],[440,\"Note 736 note_736 project_10\"],[441,\"Note 737 note_737 project_10\"],[442,\"Note 738 note_738 project_10\"],[443,\"Note 1587 note_1587 project_37\"],[444,\"Note 1588 note_1588 project_37\"],[445,\"Note 1589 note_1589 project_37\"],[446,\"Note 1590 note_1590 project_37\"],[447,\"Note 1591 note_1591 project_37\"],[448,\"Note 1592 note_1592 project_37\"],[449,\"Note 1593 note_1593 project_37\"],[450,\"Note 145 note_145 project_3\"],[451,\"Note 146 note_146 project_3\"],[452,\"Note 147 note_147 project_3\"],[453,\"Note 148 note_148 project_3\"],[454,\"Note 149 note_149 project_3\"],[455,\"Note 150 note_150 project_3\"],[456,\"Note 151 note_151 project_3\"],[457,\"Note 152 note_152 project_3\"],[458,\"Note 153 note_153 project_3\"],[459,\"Note 154 note_154 project_3\"],[460,\"Note 155 note_155 project_3\"],[461,\"Note 156 note_156 project_3\"],[462,\"Note 157 note_157 project_3\"],[463,\"Note 158 note_158 project_3\"],[464,\"Note 159 note_159 project_3\"],[465,\"Note 160 note_160 project_3\"],[466,\"Note 161 note_161 project_3\"],[467,\"Note 162 note_162 project_3\"],[468,\"Note 163 note_163 project_3\"],[469,\"Note 164 note_164 project_3\"],[470,\"Note 165 note_165 project_3\"],[471,\"Note 166 note_166 project_3\"],[472,\"Note 167 note_167 project_3\"],[473,\"Note 168 note_168 project_3\"],[474,\"Note 169 note_169 project_3\"],[475,\"Note 170 note_170 project_3\"],[476,\"Note 171 note_171 project_3\"],[477,\"Note 172 note_172 project_3\"],[478,\"Note 173 note_173 project_3\"],[479,\"Note 174 note_174 project_3\"],[480,\"Note 175 note_175 project_3\"],[481,\"Note 176 note_176 project_3\"],[482,\"Note 177 note_177 project_3\"],[483,\"Note 178 note_178 project_3\"],[484,\"Note 179 note_179 project_3\"],[485,\"Note 180 note_180 project_3\"],[486,\"Note 181 note_181 project_3\"],[487,\"Note 182 note_182 project_3\"],[488,\"Note 183 note_183 project_3\"],[489,\"Note 184 note_184 project_3\"],[490,\"Note 185 note_185 project_3\"],[491,\"Note 186 note_186 project_3\"],[492,\"Note 187 note_187 project_3\"],[493,\"Note 188 note_188 project_3\"],[494,\"Note 189 note_189 project_3\"],[495,\"Note 190 note_190 project_3\"],[496,\"Note 191 note_191 project_3\"],[497,\"Note 192 note_192 project_3\"],[498,\"Note 193 note_193 project_3\"],[499,\"Note 194 note_194 project_3\"],[500,\"Note 195 note_195 project_3\"]]"}
{"severity":"DEBUG","time":"2021-02-16T19:31:40.305Z","correlation_id":null,"class":"Elastic::ProcessBookkeepingService","redis_set":"elastic:incremental:updates:0:zset","message":"track_items","count":100,"tracked_items_encoded":"[[501,\"Note 196 note_196 project_3\"],[502,\"Note 197 note_197 project_3\"],[503,\"Note 198 note_198 project_3\"],[504,\"Note 199 note_199 project_3\"],[505,\"Note 200 note_200 project_3\"],[506,\"Note 201 note_201 project_3\"],[507,\"Note 202 note_202 project_3\"],[508,\"Note 203 note_203 project_3\"],[509,\"Note 204 note_204 project_3\"],[510,\"Note 205 note_205 project_3\"],[511,\"Note 206 note_206 project_3\"],[512,\"Note 207 note_207 project_3\"],[513,\"Note 208 note_208 project_3\"],[514,\"Note 209 note_209 project_3\"],[515,\"Note 210 note_210 project_3\"],[516,\"Note 211 note_211 project_3\"],[517,\"Note 212 note_212 project_3\"],[518,\"Note 213 note_213 project_3\"],[519,\"Note 214 note_214 project_3\"],[520,\"Note 215 note_215 project_3\"],[521,\"Note 216 note_216 project_3\"],[522,\"Note 1189 note_1189 project_3\"],[523,\"Note 1190 note_1190 project_3\"],[524,\"Note 1191 note_1191 project_3\"],[525,\"Note 1192 note_1192 project_3\"],[526,\"Note 1193 note_1193 project_3\"],[527,\"Note 1194 note_1194 project_3\"],[528,\"Note 1195 note_1195 project_3\"],[529,\"Note 1196 note_1196 project_3\"],[530,\"Note 1197 note_1197 project_3\"],[531,\"Note 1198 note_1198 project_3\"],[532,\"Note 1199 note_1199 project_3\"],[533,\"Note 1200 note_1200 project_3\"],[534,\"Note 1201 note_1201 project_3\"],[535,\"Note 1202 note_1202 project_3\"],[536,\"Note 1203 note_1203 project_3\"],[537,\"Note 1204 note_1204 project_3\"],[538,\"Note 1205 note_1205 project_3\"],[539,\"Note 1206 note_1206 project_3\"],[540,\"Note 1207 note_1207 project_3\"],[541,\"Note 1208 note_1208 project_3\"],[542,\"Note 1209 note_1209 project_3\"],[543,\"Note 1210 note_1210 project_3\"],[544,\"Note 1211 note_1211 project_3\"],[545,\"Note 1212 note_1212 project_3\"],[546,\"Note 1213 note_1213 project_3\"],[547,\"Note 1214 note_1214 project_3\"],[548,\"Note 1215 note_1215 project_3\"],[549,\"Note 1216 note_1216 project_3\"],[550,\"Note 1217 note_1217 project_3\"],[551,\"Note 1218 note_1218 project_3\"],[552,\"Note 1219 note_1219 project_3\"],[553,\"Note 1220 note_1220 project_3\"],[554,\"Note 1221 note_1221 project_3\"],[555,\"Note 1222 note_1222 project_3\"],[556,\"Note 1223 note_1223 project_3\"],[557,\"Note 1224 note_1224 project_3\"],[558,\"Note 1225 note_1225 project_3\"],[559,\"Note 1226 note_1226 project_3\"],[560,\"Note 1227 note_1227 project_3\"],[561,\"Note 1228 note_1228 project_3\"],[562,\"Note 1229 note_1229 project_3\"],[563,\"Note 1230 note_1230 project_3\"],[564,\"Note 1231 note_1231 project_3\"],[565,\"Note 1232 note_1232 project_3\"],[566,\"Note 1233 note_1233 project_3\"],[567,\"Note 1234 note_1234 project_3\"],[568,\"Note 1235 note_1235 project_3\"],[569,\"Note 1236 note_1236 project_3\"],[570,\"Note 1237 note_1237 project_3\"],[571,\"Note 1238 note_1238 project_3\"],[572,\"Note 1239 note_1239 project_3\"],[573,\"Note 1240 note_1240 project_3\"],[574,\"Note 1241 note_1241 project_3\"],[575,\"Note 1242 note_1242 project_3\"],[576,\"Note 1243 note_1243 project_3\"],[577,\"Note 1244 note_1244 project_3\"],[578,\"Note 217 note_217 project_4\"],[579,\"Note 218 note_218 project_4\"],[580,\"Note 219 note_219 project_4\"],[581,\"Note 220 note_220 project_4\"],[582,\"Note 221 note_221 project_4\"],[583,\"Note 222 note_222 project_4\"],[584,\"Note 223 note_223 project_4\"],[585,\"Note 224 note_224 project_4\"],[586,\"Note 225 note_225 project_4\"],[587,\"Note 226 note_226 project_4\"],[588,\"Note 227 note_227 project_4\"],[589,\"Note 228 note_228 project_4\"],[590,\"Note 229 note_229 project_4\"],[591,\"Note 230 note_230 project_4\"],[592,\"Note 231 note_231 project_4\"],[593,\"Note 232 note_232 project_4\"],[594,\"Note 233 note_233 project_4\"],[595,\"Note 234 note_234 project_4\"],[596,\"Note 235 note_235 project_4\"],[597,\"Note 236 note_236 project_4\"],[598,\"Note 237 note_237 project_4\"],[599,\"Note 238 note_238 project_4\"],[600,\"Note 239 note_239 project_4\"]]"}
{"severity":"DEBUG","time":"2021-02-16T19:31:40.306Z","correlation_id":null,"class":"Elastic::ProcessBookkeepingService","redis_set":"elastic:incremental:updates:0:zset","message":"track_items","count":100,"tracked_items_encoded":"[[601,\"Note 240 note_240 project_4\"],[602,\"Note 241 note_241 project_4\"],[603,\"Note 242 note_242 project_4\"],[604,\"Note 243 note_243 project_4\"],[605,\"Note 244 note_244 project_4\"],[606,\"Note 245 note_245 project_4\"],[607,\"Note 246 note_246 project_4\"],[608,\"Note 247 note_247 project_4\"],[609,\"Note 248 note_248 project_4\"],[610,\"Note 249 note_249 project_4\"],[611,\"Note 250 note_250 project_4\"],[612,\"Note 251 note_251 project_4\"],[613,\"Note 252 note_252 project_4\"],[614,\"Note 253 note_253 project_4\"],[615,\"Note 254 note_254 project_4\"],[616,\"Note 255 note_255 project_4\"],[617,\"Note 256 note_256 project_4\"],[618,\"Note 257 note_257 project_4\"],[619,\"Note 258 note_258 project_4\"],[620,\"Note 259 note_259 project_4\"],[621,\"Note 260 note_260 project_4\"],[622,\"Note 261 note_261 project_4\"],[623,\"Note 262 note_262 project_4\"],[624,\"Note 263 note_263 project_4\"],[625,\"Note 264 note_264 project_4\"],[626,\"Note 265 note_265 project_4\"],[627,\"Note 266 note_266 project_4\"],[628,\"Note 267 note_267 project_4\"],[629,\"Note 268 note_268 project_4\"],[630,\"Note 269 note_269 project_4\"],[631,\"Note 270 note_270 project_4\"],[632,\"Note 361 note_361 project_6\"],[633,\"Note 362 note_362 project_6\"],[634,\"Note 363 note_363 project_6\"],[635,\"Note 364 note_364 project_6\"],[636,\"Note 365 note_365 project_6\"],[637,\"Note 366 note_366 project_6\"],[638,\"Note 367 note_367 project_6\"],[639,\"Note 368 note_368 project_6\"],[640,\"Note 369 note_369 project_6\"],[641,\"Note 370 note_370 project_6\"],[642,\"Note 371 note_371 project_6\"],[643,\"Note 372 note_372 project_6\"],[644,\"Note 373 note_373 project_6\"],[645,\"Note 374 note_374 project_6\"],[646,\"Note 375 note_375 project_6\"],[647,\"Note 376 note_376 project_6\"],[648,\"Note 377 note_377 project_6\"],[649,\"Note 378 note_378 project_6\"],[650,\"Note 379 note_379 project_6\"],[651,\"Note 380 note_380 project_6\"],[652,\"Note 381 note_381 project_6\"],[653,\"Note 382 note_382 project_6\"],[654,\"Note 383 note_383 project_6\"],[655,\"Note 384 note_384 project_6\"],[656,\"Note 385 note_385 project_6\"],[657,\"Note 386 note_386 project_6\"],[658,\"Note 387 note_387 project_6\"],[659,\"Note 388 note_388 project_6\"],[660,\"Note 389 note_389 project_6\"],[661,\"Note 390 note_390 project_6\"],[662,\"Note 391 note_391 project_6\"],[663,\"Note 392 note_392 project_6\"],[664,\"Note 393 note_393 project_6\"],[665,\"Note 394 note_394 project_6\"],[666,\"Note 395 note_395 project_6\"],[667,\"Note 396 note_396 project_6\"],[668,\"Note 397 note_397 project_6\"],[669,\"Note 398 note_398 project_6\"],[670,\"Note 399 note_399 project_6\"],[671,\"Note 400 note_400 project_6\"],[672,\"Note 401 note_401 project_6\"],[673,\"Note 402 note_402 project_6\"],[674,\"Note 403 note_403 project_6\"],[675,\"Note 404 note_404 project_6\"],[676,\"Note 405 note_405 project_6\"],[677,\"Note 406 note_406 project_6\"],[678,\"Note 407 note_407 project_6\"],[679,\"Note 408 note_408 project_6\"],[680,\"Note 409 note_409 project_6\"],[681,\"Note 410 note_410 project_6\"],[682,\"Note 411 note_411 project_6\"],[683,\"Note 412 note_412 project_6\"],[684,\"Note 413 note_413 project_6\"],[685,\"Note 414 note_414 project_6\"],[686,\"Note 415 note_415 project_6\"],[687,\"Note 416 note_416 project_6\"],[688,\"Note 417 note_417 project_6\"],[689,\"Note 418 note_418 project_6\"],[690,\"Note 419 note_419 project_6\"],[691,\"Note 420 note_420 project_6\"],[692,\"Note 421 note_421 project_6\"],[693,\"Note 422 note_422 project_6\"],[694,\"Note 423 note_423 project_6\"],[695,\"Note 424 note_424 project_6\"],[696,\"Note 425 note_425 project_6\"],[697,\"Note 426 note_426 project_6\"],[698,\"Note 427 note_427 project_6\"],[699,\"Note 428 note_428 project_6\"],[700,\"Note 429 note_429 project_6\"]]"}
{"severity":"DEBUG","time":"2021-02-16T19:31:40.308Z","correlation_id":null,"class":"Elastic::ProcessBookkeepingService","redis_set":"elastic:incremental:updates:0:zset","message":"track_items","count":100,"tracked_items_encoded":"[[701,\"Note 430 note_430 project_6\"],[702,\"Note 431 note_431 project_6\"],[703,\"Note 432 note_432 project_6\"],[704,\"Note 433 note_433 project_6\"],[705,\"Note 434 note_434 project_6\"],[706,\"Note 435 note_435 project_6\"],[707,\"Note 436 note_436 project_6\"],[708,\"Note 437 note_437 project_6\"],[709,\"Note 438 note_438 project_6\"],[710,\"Note 439 note_439 project_6\"],[711,\"Note 440 note_440 project_6\"],[712,\"Note 441 note_441 project_6\"],[713,\"Note 442 note_442 project_6\"],[714,\"Note 443 note_443 project_6\"],[715,\"Note 444 note_444 project_6\"],[716,\"Note 445 note_445 project_6\"],[717,\"Note 446 note_446 project_6\"],[718,\"Note 447 note_447 project_6\"],[719,\"Note 448 note_448 project_6\"],[720,\"Note 1263 note_1263 project_6\"],[721,\"Note 1264 note_1264 project_6\"],[722,\"Note 1265 note_1265 project_6\"],[723,\"Note 1266 note_1266 project_6\"],[724,\"Note 1267 note_1267 project_6\"],[725,\"Note 1268 note_1268 project_6\"],[726,\"Note 1269 note_1269 project_6\"],[727,\"Note 1270 note_1270 project_6\"],[728,\"Note 1271 note_1271 project_6\"],[729,\"Note 1272 note_1272 project_6\"],[730,\"Note 1273 note_1273 project_6\"],[731,\"Note 1274 note_1274 project_6\"],[732,\"Note 1275 note_1275 project_6\"],[733,\"Note 1276 note_1276 project_6\"],[734,\"Note 1277 note_1277 project_6\"],[735,\"Note 1278 note_1278 project_6\"],[736,\"Note 1279 note_1279 project_6\"],[737,\"Note 1280 note_1280 project_6\"],[738,\"Note 1281 note_1281 project_6\"],[739,\"Note 1282 note_1282 project_6\"],[740,\"Note 1283 note_1283 project_6\"],[741,\"Note 1284 note_1284 project_6\"],[742,\"Note 1285 note_1285 project_6\"],[743,\"Note 1286 note_1286 project_6\"],[744,\"Note 1287 note_1287 project_6\"],[745,\"Note 1288 note_1288 project_6\"],[746,\"Note 1289 note_1289 project_6\"],[747,\"Note 1290 note_1290 project_6\"],[748,\"Note 1291 note_1291 project_6\"],[749,\"Note 1292 note_1292 project_6\"],[750,\"Note 1293 note_1293 project_6\"],[751,\"Note 1294 note_1294 project_6\"],[752,\"Note 899 note_899 project_13\"],[753,\"Note 900 note_900 project_13\"],[754,\"Note 901 note_901 project_13\"],[755,\"Note 902 note_902 project_13\"],[756,\"Note 903 note_903 project_13\"],[757,\"Note 904 note_904 project_13\"],[758,\"Note 905 note_905 project_13\"],[759,\"Note 906 note_906 project_13\"],[760,\"Note 907 note_907 project_13\"],[761,\"Note 908 note_908 project_13\"],[762,\"Note 909 note_909 project_13\"],[763,\"Note 910 note_910 project_13\"],[764,\"Note 911 note_911 project_13\"],[765,\"Note 912 note_912 project_13\"],[766,\"Note 913 note_913 project_13\"],[767,\"Note 914 note_914 project_13\"],[768,\"Note 915 note_915 project_13\"],[769,\"Note 916 note_916 project_13\"],[770,\"Note 917 note_917 project_13\"],[771,\"Note 918 note_918 project_13\"],[772,\"Note 919 note_919 project_13\"],[773,\"Note 920 note_920 project_13\"],[774,\"Note 921 note_921 project_13\"],[775,\"Note 922 note_922 project_13\"],[776,\"Note 923 note_923 project_13\"],[777,\"Note 924 note_924 project_13\"],[778,\"Note 925 note_925 project_13\"],[779,\"Note 926 note_926 project_13\"],[780,\"Note 927 note_927 project_13\"],[781,\"Note 928 note_928 project_13\"],[782,\"Note 929 note_929 project_13\"],[783,\"Note 930 note_930 project_13\"],[784,\"Note 931 note_931 project_13\"],[785,\"Note 932 note_932 project_13\"],[786,\"Note 933 note_933 project_13\"],[787,\"Note 934 note_934 project_13\"],[788,\"Note 935 note_935 project_13\"],[789,\"Note 936 note_936 project_13\"],[790,\"Note 937 note_937 project_13\"],[791,\"Note 938 note_938 project_13\"],[792,\"Note 939 note_939 project_13\"],[793,\"Note 940 note_940 project_13\"],[794,\"Note 941 note_941 project_13\"],[795,\"Note 942 note_942 project_13\"],[796,\"Note 943 note_943 project_13\"],[797,\"Note 944 note_944 project_13\"],[798,\"Note 945 note_945 project_13\"],[799,\"Note 946 note_946 project_13\"],[800,\"Note 947 note_947 project_13\"]]"}
{"severity":"DEBUG","time":"2021-02-16T19:31:40.309Z","correlation_id":null,"class":"Elastic::ProcessBookkeepingService","redis_set":"elastic:incremental:updates:0:zset","message":"track_items","count":100,"tracked_items_encoded":"[[801,\"Note 948 note_948 project_13\"],[802,\"Note 949 note_949 project_13\"],[803,\"Note 950 note_950 project_13\"],[804,\"Note 951 note_951 project_13\"],[805,\"Note 952 note_952 project_13\"],[806,\"Note 953 note_953 project_13\"],[807,\"Note 954 note_954 project_13\"],[808,\"Note 955 note_955 project_13\"],[809,\"Note 956 note_956 project_13\"],[810,\"Note 957 note_957 project_13\"],[811,\"Note 958 note_958 project_13\"],[812,\"Note 959 note_959 project_13\"],[813,\"Note 960 note_960 project_13\"],[814,\"Note 961 note_961 project_13\"],[815,\"Note 962 note_962 project_13\"],[816,\"Note 963 note_963 project_13\"],[817,\"Note 964 note_964 project_13\"],[818,\"Note 965 note_965 project_13\"],[819,\"Note 966 note_966 project_13\"],[820,\"Note 967 note_967 project_13\"],[821,\"Note 968 note_968 project_13\"],[822,\"Note 969 note_969 project_13\"],[823,\"Note 970 note_970 project_13\"],[824,\"Note 971 note_971 project_13\"],[825,\"Note 972 note_972 project_13\"],[826,\"Note 973 note_973 project_13\"],[827,\"Note 974 note_974 project_13\"],[828,\"Note 975 note_975 project_13\"],[829,\"Note 976 note_976 project_13\"],[830,\"Note 977 note_977 project_13\"],[831,\"Note 978 note_978 project_13\"],[832,\"Note 979 note_979 project_13\"],[833,\"Note 980 note_980 project_13\"],[834,\"Note 981 note_981 project_13\"],[835,\"Note 982 note_982 project_13\"],[836,\"Note 983 note_983 project_13\"],[837,\"Note 984 note_984 project_13\"],[838,\"Note 985 note_985 project_13\"],[839,\"Note 986 note_986 project_13\"],[840,\"Note 987 note_987 project_13\"],[841,\"Note 988 note_988 project_13\"],[842,\"Note 1309 note_1309 project_13\"],[843,\"Note 1310 note_1310 project_13\"],[844,\"Note 1311 note_1311 project_13\"],[845,\"Note 1312 note_1312 project_13\"],[846,\"Note 1313 note_1313 project_13\"],[847,\"Note 1314 note_1314 project_13\"],[848,\"Note 1315 note_1315 project_13\"],[849,\"Note 1316 note_1316 project_13\"],[850,\"Note 1317 note_1317 project_13\"],[851,\"Note 1318 note_1318 project_13\"],[852,\"Note 1319 note_1319 project_13\"],[853,\"Note 1320 note_1320 project_13\"],[854,\"Note 1321 note_1321 project_13\"],[855,\"Note 1322 note_1322 project_13\"],[856,\"Note 1323 note_1323 project_13\"],[857,\"Note 1324 note_1324 project_13\"],[858,\"Note 1325 note_1325 project_13\"],[859,\"Note 1326 note_1326 project_13\"],[860,\"Note 1327 note_1327 project_13\"],[861,\"Note 1328 note_1328 project_13\"],[862,\"Note 1329 note_1329 project_13\"],[863,\"Note 1330 note_1330 project_13\"],[864,\"Note 1331 note_1331 project_13\"],[865,\"Note 1332 note_1332 project_13\"],[866,\"Note 1333 note_1333 project_13\"],[867,\"Note 1334 note_1334 project_13\"],[868,\"Note 1335 note_1335 project_13\"],[869,\"Note 1336 note_1336 project_13\"],[870,\"Note 1337 note_1337 project_13\"],[871,\"Note 1338 note_1338 project_13\"],[872,\"Note 1339 note_1339 project_13\"],[873,\"Note 1340 note_1340 project_13\"],[874,\"Note 1341 note_1341 project_13\"],[875,\"Note 1342 note_1342 project_13\"],[876,\"Note 1343 note_1343 project_13\"],[877,\"Note 1344 note_1344 project_13\"],[878,\"Note 1345 note_1345 project_13\"],[879,\"Note 1346 note_1346 project_13\"],[880,\"Note 1347 note_1347 project_13\"],[881,\"Note 1348 note_1348 project_13\"],[882,\"Note 1349 note_1349 project_13\"],[883,\"Note 1350 note_1350 project_13\"],[884,\"Note 1351 note_1351 project_13\"],[885,\"Note 1352 note_1352 project_13\"],[886,\"Note 1353 note_1353 project_13\"],[887,\"Note 1354 note_1354 project_13\"],[888,\"Note 1355 note_1355 project_13\"],[889,\"Note 1356 note_1356 project_13\"],[890,\"Note 1357 note_1357 project_13\"],[891,\"Note 1358 note_1358 project_13\"],[892,\"Note 1359 note_1359 project_13\"],[893,\"Note 1360 note_1360 project_13\"],[894,\"Note 1361 note_1361 project_13\"],[895,\"Note 1362 note_1362 project_13\"],[896,\"Note 1363 note_1363 project_13\"],[897,\"Note 1364 note_1364 project_13\"],[898,\"Note 1365 note_1365 project_13\"],[899,\"Note 1366 note_1366 project_13\"],[900,\"Note 1367 note_1367 project_13\"]]"}
{"severity":"DEBUG","time":"2021-02-16T19:31:40.311Z","correlation_id":null,"class":"Elastic::ProcessBookkeepingService","redis_set":"elastic:incremental:updates:0:zset","message":"track_items","count":100,"tracked_items_encoded":"[[901,\"Note 1368 note_1368 project_13\"],[902,\"Note 1369 note_1369 project_13\"],[903,\"Note 1370 note_1370 project_13\"],[904,\"Note 1371 note_1371 project_13\"],[905,\"Note 1582 note_1582 project_32\"],[906,\"Note 1585 note_1585 project_32\"],[907,\"Note 819 note_819 project_12\"],[908,\"Note 820 note_820 project_12\"],[909,\"Note 821 note_821 project_12\"],[910,\"Note 822 note_822 project_12\"],[911,\"Note 823 note_823 project_12\"],[912,\"Note 824 note_824 project_12\"],[913,\"Note 825 note_825 project_12\"],[914,\"Note 826 note_826 project_12\"],[915,\"Note 827 note_827 project_12\"],[916,\"Note 828 note_828 project_12\"],[917,\"Note 829 note_829 project_12\"],[918,\"Note 830 note_830 project_12\"],[919,\"Note 831 note_831 project_12\"],[920,\"Note 832 note_832 project_12\"],[921,\"Note 833 note_833 project_12\"],[922,\"Note 834 note_834 project_12\"],[923,\"Note 835 note_835 project_12\"],[924,\"Note 836 note_836 project_12\"],[925,\"Note 837 note_837 project_12\"],[926,\"Note 838 note_838 project_12\"],[927,\"Note 839 note_839 project_12\"],[928,\"Note 840 note_840 project_12\"],[929,\"Note 841 note_841 project_12\"],[930,\"Note 842 note_842 project_12\"],[931,\"Note 843 note_843 project_12\"],[932,\"Note 844 note_844 project_12\"],[933,\"Note 845 note_845 project_12\"],[934,\"Note 846 note_846 project_12\"],[935,\"Note 847 note_847 project_12\"],[936,\"Note 848 note_848 project_12\"],[937,\"Note 849 note_849 project_12\"],[938,\"Note 850 note_850 project_12\"],[939,\"Note 851 note_851 project_12\"],[940,\"Note 852 note_852 project_12\"],[941,\"Note 853 note_853 project_12\"],[942,\"Note 854 note_854 project_12\"],[943,\"Note 855 note_855 project_12\"],[944,\"Note 856 note_856 project_12\"],[945,\"Note 857 note_857 project_12\"],[946,\"Note 858 note_858 project_12\"],[947,\"Note 859 note_859 project_12\"],[948,\"Note 860 note_860 project_12\"],[949,\"Note 861 note_861 project_12\"],[950,\"Note 862 note_862 project_12\"],[951,\"Note 863 note_863 project_12\"],[952,\"Note 864 note_864 project_12\"],[953,\"Note 865 note_865 project_12\"],[954,\"Note 866 note_866 project_12\"],[955,\"Note 867 note_867 project_12\"],[956,\"Note 868 note_868 project_12\"],[957,\"Note 869 note_869 project_12\"],[958,\"Note 870 note_870 project_12\"],[959,\"Note 871 note_871 project_12\"],[960,\"Note 872 note_872 project_12\"],[961,\"Note 873 note_873 project_12\"],[962,\"Note 874 note_874 project_12\"],[963,\"Note 875 note_875 project_12\"],[964,\"Note 876 note_876 project_12\"],[965,\"Note 877 note_877 project_12\"],[966,\"Note 878 note_878 project_12\"],[967,\"Note 879 note_879 project_12\"],[968,\"Note 880 note_880 project_12\"],[969,\"Note 881 note_881 project_12\"],[970,\"Note 882 note_882 project_12\"],[971,\"Note 883 note_883 project_12\"],[972,\"Note 884 note_884 project_12\"],[973,\"Note 885 note_885 project_12\"],[974,\"Note 886 note_886 project_12\"],[975,\"Note 887 note_887 project_12\"],[976,\"Note 888 note_888 project_12\"],[977,\"Note 889 note_889 project_12\"],[978,\"Note 890 note_890 project_12\"],[979,\"Note 891 note_891 project_12\"],[980,\"Note 892 note_892 project_12\"],[981,\"Note 893 note_893 project_12\"],[982,\"Note 894 note_894 project_12\"],[983,\"Note 895 note_895 project_12\"],[984,\"Note 896 note_896 project_12\"],[985,\"Note 897 note_897 project_12\"],[986,\"Note 898 note_898 project_12\"],[987,\"Note 1579 note_1579 project_12\"],[988,\"Note 1581 note_1581 project_12\"],[989,\"Note 1577 note_1577 project_28\"],[990,\"Note 1578 note_1578 project_28\"],[991,\"Note 1468 note_1468 project_29\"],[992,\"Note 1469 note_1469 project_29\"],[993,\"Note 1470 note_1470 project_29\"],[994,\"Note 1471 note_1471 project_29\"],[995,\"Note 1472 note_1472 project_29\"],[996,\"Note 1473 note_1473 project_29\"],[997,\"Note 1474 note_1474 project_29\"],[998,\"Note 1475 note_1475 project_29\"],[999,\"Note 1476 note_1476 project_29\"],[1000,\"Note 1477 note_1477 project_29\"]]"}
{"severity":"DEBUG","time":"2021-02-16T19:31:40.312Z","correlation_id":null,"class":"Elastic::ProcessBookkeepingService","redis_set":"elastic:incremental:updates:0:zset","message":"track_items","count":100,"tracked_items_encoded":"[[1001,\"Note 1478 note_1478 project_29\"],[1002,\"Note 1479 note_1479 project_29\"],[1003,\"Note 1480 note_1480 project_29\"],[1004,\"Note 1481 note_1481 project_29\"],[1005,\"Note 1482 note_1482 project_29\"],[1006,\"Note 1483 note_1483 project_29\"],[1007,\"Note 1484 note_1484 project_29\"],[1008,\"Note 1485 note_1485 project_29\"],[1009,\"Note 1486 note_1486 project_29\"],[1010,\"Note 1487 note_1487 project_29\"],[1011,\"Note 1488 note_1488 project_29\"],[1012,\"Note 1489 note_1489 project_29\"],[1013,\"Note 1490 note_1490 project_29\"],[1014,\"Note 1491 note_1491 project_29\"],[1015,\"Note 1492 note_1492 project_29\"],[1016,\"Note 1493 note_1493 project_29\"],[1017,\"Note 1494 note_1494 project_29\"],[1018,\"Note 1495 note_1495 project_29\"],[1019,\"Note 1496 note_1496 project_29\"],[1020,\"Note 1497 note_1497 project_29\"],[1021,\"Note 1498 note_1498 project_29\"],[1022,\"Note 1499 note_1499 project_29\"],[1023,\"Note 1500 note_1500 project_29\"],[1024,\"Note 1501 note_1501 project_29\"],[1025,\"Note 1502 note_1502 project_29\"],[1026,\"Note 1503 note_1503 project_29\"],[1027,\"Note 1504 note_1504 project_29\"],[1028,\"Note 1505 note_1505 project_29\"],[1029,\"Note 1506 note_1506 project_29\"],[1030,\"Note 1507 note_1507 project_29\"],[1031,\"Note 1508 note_1508 project_29\"],[1032,\"Note 1509 note_1509 project_29\"],[1033,\"Note 1510 note_1510 project_29\"],[1034,\"Note 1511 note_1511 project_29\"],[1035,\"Note 1512 note_1512 project_29\"],[1036,\"Note 1513 note_1513 project_29\"],[1037,\"Note 1514 note_1514 project_29\"],[1038,\"Note 1515 note_1515 project_29\"],[1039,\"Note 1516 note_1516 project_29\"],[1040,\"Note 1517 note_1517 project_29\"],[1041,\"Note 1518 note_1518 project_29\"],[1042,\"Note 1519 note_1519 project_29\"],[1043,\"Note 1520 note_1520 project_29\"],[1044,\"Note 1521 note_1521 project_29\"],[1045,\"Note 1522 note_1522 project_29\"],[1046,\"Note 1523 note_1523 project_29\"],[1047,\"Note 1524 note_1524 project_29\"],[1048,\"Note 1525 note_1525 project_29\"],[1049,\"Note 1526 note_1526 project_29\"],[1050,\"Note 1527 note_1527 project_29\"],[1051,\"Note 1528 note_1528 project_29\"],[1052,\"Note 1529 note_1529 project_29\"],[1053,\"Note 1530 note_1530 project_29\"],[1054,\"Note 1531 note_1531 project_29\"],[1055,\"Note 1532 note_1532 project_29\"],[1056,\"Note 1533 note_1533 project_29\"],[1057,\"Note 1534 note_1534 project_29\"],[1058,\"Note 1535 note_1535 project_29\"],[1059,\"Note 1536 note_1536 project_29\"],[1060,\"Note 1537 note_1537 project_29\"],[1061,\"Note 1538 note_1538 project_29\"],[1062,\"Note 1539 note_1539 project_29\"],[1063,\"Note 1540 note_1540 project_29\"],[1064,\"Note 1541 note_1541 project_29\"],[1065,\"Note 1542 note_1542 project_29\"],[1066,\"Note 1543 note_1543 project_29\"],[1067,\"Note 1544 note_1544 project_29\"],[1068,\"Note 1545 note_1545 project_29\"],[1069,\"Note 1546 note_1546 project_29\"],[1070,\"Note 1547 note_1547 project_29\"],[1071,\"Note 1548 note_1548 project_29\"],[1072,\"Note 1549 note_1549 project_29\"],[1073,\"Note 1550 note_1550 project_29\"],[1074,\"Note 1551 note_1551 project_29\"],[1075,\"Note 1552 note_1552 project_29\"],[1076,\"Note 1553 note_1553 project_29\"],[1077,\"Note 1554 note_1554 project_29\"],[1078,\"Note 1555 note_1555 project_29\"],[1079,\"Note 1556 note_1556 project_29\"],[1080,\"Note 1557 note_1557 project_29\"],[1081,\"Note 1558 note_1558 project_29\"],[1082,\"Note 1559 note_1559 project_29\"],[1083,\"Note 1560 note_1560 project_29\"],[1084,\"Note 1561 note_1561 project_29\"],[1085,\"Note 1562 note_1562 project_29\"],[1086,\"Note 1563 note_1563 project_29\"],[1087,\"Note 1564 note_1564 project_29\"],[1088,\"Note 1565 note_1565 project_29\"],[1089,\"Note 1566 note_1566 project_29\"],[1090,\"Note 1567 note_1567 project_29\"],[1091,\"Note 1568 note_1568 project_29\"],[1092,\"Note 1569 note_1569 project_29\"],[1093,\"Note 1570 note_1570 project_29\"],[1094,\"Note 1571 note_1571 project_29\"],[1095,\"Note 1 note_1 project_1\"],[1096,\"Note 2 note_2 project_1\"],[1097,\"Note 3 note_3 project_1\"],[1098,\"Note 4 note_4 project_1\"],[1099,\"Note 5 note_5 project_1\"],[1100,\"Note 6 note_6 project_1\"]]"}
{"severity":"DEBUG","time":"2021-02-16T19:31:40.314Z","correlation_id":null,"class":"Elastic::ProcessBookkeepingService","redis_set":"elastic:incremental:updates:0:zset","message":"track_items","count":100,"tracked_items_encoded":"[[1101,\"Note 7 note_7 project_1\"],[1102,\"Note 8 note_8 project_1\"],[1103,\"Note 9 note_9 project_1\"],[1104,\"Note 10 note_10 project_1\"],[1105,\"Note 11 note_11 project_1\"],[1106,\"Note 12 note_12 project_1\"],[1107,\"Note 13 note_13 project_1\"],[1108,\"Note 14 note_14 project_1\"],[1109,\"Note 15 note_15 project_1\"],[1110,\"Note 16 note_16 project_1\"],[1111,\"Note 17 note_17 project_1\"],[1112,\"Note 18 note_18 project_1\"],[1113,\"Note 19 note_19 project_1\"],[1114,\"Note 20 note_20 project_1\"],[1115,\"Note 21 note_21 project_1\"],[1116,\"Note 22 note_22 project_1\"],[1117,\"Note 23 note_23 project_1\"],[1118,\"Note 24 note_24 project_1\"],[1119,\"Note 25 note_25 project_1\"],[1120,\"Note 26 note_26 project_1\"],[1121,\"Note 27 note_27 project_1\"],[1122,\"Note 28 note_28 project_1\"],[1123,\"Note 29 note_29 project_1\"],[1124,\"Note 30 note_30 project_1\"],[1125,\"Note 31 note_31 project_1\"],[1126,\"Note 32 note_32 project_1\"],[1127,\"Note 33 note_33 project_1\"],[1128,\"Note 34 note_34 project_1\"],[1129,\"Note 35 note_35 project_1\"],[1130,\"Note 36 note_36 project_1\"],[1131,\"Note 37 note_37 project_1\"],[1132,\"Note 38 note_38 project_1\"],[1133,\"Note 39 note_39 project_1\"],[1134,\"Note 40 note_40 project_1\"],[1135,\"Note 41 note_41 project_1\"],[1136,\"Note 42 note_42 project_1\"],[1137,\"Note 43 note_43 project_1\"],[1138,\"Note 44 note_44 project_1\"],[1139,\"Note 45 note_45 project_1\"],[1140,\"Note 46 note_46 project_1\"],[1141,\"Note 47 note_47 project_1\"],[1142,\"Note 48 note_48 project_1\"],[1143,\"Note 49 note_49 project_1\"],[1144,\"Note 50 note_50 project_1\"],[1145,\"Note 51 note_51 project_1\"],[1146,\"Note 52 note_52 project_1\"],[1147,\"Note 53 note_53 project_1\"],[1148,\"Note 54 note_54 project_1\"],[1149,\"Note 55 note_55 project_1\"],[1150,\"Note 56 note_56 project_1\"],[1151,\"Note 57 note_57 project_1\"],[1152,\"Note 58 note_58 project_1\"],[1153,\"Note 59 note_59 project_1\"],[1154,\"Note 60 note_60 project_1\"],[1155,\"Note 61 note_61 project_1\"],[1156,\"Note 62 note_62 project_1\"],[1157,\"Note 63 note_63 project_1\"],[1158,\"Note 64 note_64 project_1\"],[1159,\"Note 65 note_65 project_1\"],[1160,\"Note 66 note_66 project_1\"],[1161,\"Note 67 note_67 project_1\"],[1162,\"Note 68 note_68 project_1\"],[1163,\"Note 69 note_69 project_1\"],[1164,\"Note 70 note_70 project_1\"],[1165,\"Note 71 note_71 project_1\"],[1166,\"Note 72 note_72 project_1\"],[1167,\"Note 1077 note_1077 project_1\"],[1168,\"Note 1078 note_1078 project_1\"],[1169,\"Note 1079 note_1079 project_1\"],[1170,\"Note 1080 note_1080 project_1\"],[1171,\"Note 1081 note_1081 project_1\"],[1172,\"Note 1082 note_1082 project_1\"],[1173,\"Note 1083 note_1083 project_1\"],[1174,\"Note 1084 note_1084 project_1\"],[1175,\"Note 1085 note_1085 project_1\"],[1176,\"Note 1086 note_1086 project_1\"],[1177,\"Note 1087 note_1087 project_1\"],[1178,\"Note 1088 note_1088 project_1\"],[1179,\"Note 1089 note_1089 project_1\"],[1180,\"Note 1090 note_1090 project_1\"],[1181,\"Note 1091 note_1091 project_1\"],[1182,\"Note 1092 note_1092 project_1\"],[1183,\"Note 1093 note_1093 project_1\"],[1184,\"Note 1094 note_1094 project_1\"],[1185,\"Note 1095 note_1095 project_1\"],[1186,\"Note 1096 note_1096 project_1\"],[1187,\"Note 1097 note_1097 project_1\"],[1188,\"Note 1098 note_1098 project_1\"],[1189,\"Note 1099 note_1099 project_1\"],[1190,\"Note 1100 note_1100 project_1\"],[1191,\"Note 1101 note_1101 project_1\"],[1192,\"Note 1102 note_1102 project_1\"],[1193,\"Note 1103 note_1103 project_1\"],[1194,\"Note 1104 note_1104 project_1\"],[1195,\"Note 1105 note_1105 project_1\"],[1196,\"Note 1106 note_1106 project_1\"],[1197,\"Note 1107 note_1107 project_1\"],[1198,\"Note 1108 note_1108 project_1\"],[1199,\"Note 1109 note_1109 project_1\"],[1200,\"Note 1110 note_1110 project_1\"]]"}
{"severity":"DEBUG","time":"2021-02-16T19:31:40.315Z","correlation_id":null,"class":"Elastic::ProcessBookkeepingService","redis_set":"elastic:incremental:updates:0:zset","message":"track_items","count":100,"tracked_items_encoded":"[[1201,\"Note 1111 note_1111 project_1\"],[1202,\"Note 1112 note_1112 project_1\"],[1203,\"Note 1113 note_1113 project_1\"],[1204,\"Note 1114 note_1114 project_1\"],[1205,\"Note 1115 note_1115 project_1\"],[1206,\"Note 1116 note_1116 project_1\"],[1207,\"Note 1117 note_1117 project_1\"],[1208,\"Note 1118 note_1118 project_1\"],[1209,\"Note 1119 note_1119 project_1\"],[1210,\"Note 1120 note_1120 project_1\"],[1211,\"Note 1121 note_1121 project_1\"],[1212,\"Note 1122 note_1122 project_1\"],[1213,\"Note 1123 note_1123 project_1\"],[1214,\"Note 1124 note_1124 project_1\"],[1215,\"Note 1125 note_1125 project_1\"],[1216,\"Note 1126 note_1126 project_1\"],[1217,\"Note 1127 note_1127 project_1\"],[1218,\"Note 1128 note_1128 project_1\"],[1219,\"Note 1129 note_1129 project_1\"],[1220,\"Note 1130 note_1130 project_1\"],[1221,\"Note 1131 note_1131 project_1\"],[1222,\"Note 1132 note_1132 project_1\"],[1223,\"Note 1452 note_1452 project_1\"],[1224,\"Note 1453 note_1453 project_1\"],[1225,\"Note 1454 note_1454 project_1\"],[1226,\"Note 1455 note_1455 project_1\"],[1227,\"Note 1456 note_1456 project_1\"],[1228,\"Note 1457 note_1457 project_1\"],[1229,\"Note 1458 note_1458 project_1\"],[1230,\"Note 1459 note_1459 project_1\"],[1231,\"Note 1460 note_1460 project_1\"],[1232,\"Note 1461 note_1461 project_1\"],[1233,\"Note 1462 note_1462 project_1\"],[1234,\"Note 1463 note_1463 project_1\"],[1235,\"Note 1464 note_1464 project_1\"],[1236,\"Note 1465 note_1465 project_1\"],[1237,\"Note 1466 note_1466 project_1\"],[1238,\"Note 1467 note_1467 project_1\"],[1239,\"Note 73 note_73 project_2\"],[1240,\"Note 74 note_74 project_2\"],[1241,\"Note 75 note_75 project_2\"],[1242,\"Note 76 note_76 project_2\"],[1243,\"Note 77 note_77 project_2\"],[1244,\"Note 78 note_78 project_2\"],[1245,\"Note 79 note_79 project_2\"],[1246,\"Note 80 note_80 project_2\"],[1247,\"Note 81 note_81 project_2\"],[1248,\"Note 82 note_82 project_2\"],[1249,\"Note 83 note_83 project_2\"],[1250,\"Note 84 note_84 project_2\"],[1251,\"Note 85 note_85 project_2\"],[1252,\"Note 86 note_86 project_2\"],[1253,\"Note 87 note_87 project_2\"],[1254,\"Note 88 note_88 project_2\"],[1255,\"Note 89 note_89 project_2\"],[1256,\"Note 90 note_90 project_2\"],[1257,\"Note 91 note_91 project_2\"],[1258,\"Note 92 note_92 project_2\"],[1259,\"Note 93 note_93 project_2\"],[1260,\"Note 94 note_94 project_2\"],[1261,\"Note 95 note_95 project_2\"],[1262,\"Note 96 note_96 project_2\"],[1263,\"Note 97 note_97 project_2\"],[1264,\"Note 98 note_98 project_2\"],[1265,\"Note 99 note_99 project_2\"],[1266,\"Note 100 note_100 project_2\"],[1267,\"Note 101 note_101 project_2\"],[1268,\"Note 102 note_102 project_2\"],[1269,\"Note 103 note_103 project_2\"],[1270,\"Note 104 note_104 project_2\"],[1271,\"Note 105 note_105 project_2\"],[1272,\"Note 106 note_106 project_2\"],[1273,\"Note 107 note_107 project_2\"],[1274,\"Note 108 note_108 project_2\"],[1275,\"Note 109 note_109 project_2\"],[1276,\"Note 110 note_110 project_2\"],[1277,\"Note 111 note_111 project_2\"],[1278,\"Note 112 note_112 project_2\"],[1279,\"Note 113 note_113 project_2\"],[1280,\"Note 114 note_114 project_2\"],[1281,\"Note 115 note_115 project_2\"],[1282,\"Note 116 note_116 project_2\"],[1283,\"Note 117 note_117 project_2\"],[1284,\"Note 118 note_118 project_2\"],[1285,\"Note 119 note_119 project_2\"],[1286,\"Note 120 note_120 project_2\"],[1287,\"Note 121 note_121 project_2\"],[1288,\"Note 122 note_122 project_2\"],[1289,\"Note 123 note_123 project_2\"],[1290,\"Note 124 note_124 project_2\"],[1291,\"Note 125 note_125 project_2\"],[1292,\"Note 126 note_126 project_2\"],[1293,\"Note 127 note_127 project_2\"],[1294,\"Note 128 note_128 project_2\"],[1295,\"Note 129 note_129 project_2\"],[1296,\"Note 130 note_130 project_2\"],[1297,\"Note 131 note_131 project_2\"],[1298,\"Note 132 note_132 project_2\"],[1299,\"Note 133 note_133 project_2\"],[1300,\"Note 134 note_134 project_2\"]]"}
{"severity":"DEBUG","time":"2021-02-16T19:31:40.317Z","correlation_id":null,"class":"Elastic::ProcessBookkeepingService","redis_set":"elastic:incremental:updates:0:zset","message":"track_items","count":100,"tracked_items_encoded":"[[1301,\"Note 135 note_135 project_2\"],[1302,\"Note 136 note_136 project_2\"],[1303,\"Note 137 note_137 project_2\"],[1304,\"Note 138 note_138 project_2\"],[1305,\"Note 139 note_139 project_2\"],[1306,\"Note 140 note_140 project_2\"],[1307,\"Note 141 note_141 project_2\"],[1308,\"Note 142 note_142 project_2\"],[1309,\"Note 143 note_143 project_2\"],[1310,\"Note 144 note_144 project_2\"],[1311,\"Note 1133 note_1133 project_2\"],[1312,\"Note 1134 note_1134 project_2\"],[1313,\"Note 1135 note_1135 project_2\"],[1314,\"Note 1136 note_1136 project_2\"],[1315,\"Note 1137 note_1137 project_2\"],[1316,\"Note 1138 note_1138 project_2\"],[1317,\"Note 1139 note_1139 project_2\"],[1318,\"Note 1140 note_1140 project_2\"],[1319,\"Note 1141 note_1141 project_2\"],[1320,\"Note 1142 note_1142 project_2\"],[1321,\"Note 1143 note_1143 project_2\"],[1322,\"Note 1144 note_1144 project_2\"],[1323,\"Note 1145 note_1145 project_2\"],[1324,\"Note 1146 note_1146 project_2\"],[1325,\"Note 1147 note_1147 project_2\"],[1326,\"Note 1148 note_1148 project_2\"],[1327,\"Note 1149 note_1149 project_2\"],[1328,\"Note 1150 note_1150 project_2\"],[1329,\"Note 1151 note_1151 project_2\"],[1330,\"Note 1152 note_1152 project_2\"],[1331,\"Note 1153 note_1153 project_2\"],[1332,\"Note 1154 note_1154 project_2\"],[1333,\"Note 1155 note_1155 project_2\"],[1334,\"Note 1156 note_1156 project_2\"],[1335,\"Note 1157 note_1157 project_2\"],[1336,\"Note 1158 note_1158 project_2\"],[1337,\"Note 1159 note_1159 project_2\"],[1338,\"Note 1160 note_1160 project_2\"],[1339,\"Note 1161 note_1161 project_2\"],[1340,\"Note 1162 note_1162 project_2\"],[1341,\"Note 1163 note_1163 project_2\"],[1342,\"Note 1164 note_1164 project_2\"],[1343,\"Note 1165 note_1165 project_2\"],[1344,\"Note 1166 note_1166 project_2\"],[1345,\"Note 1167 note_1167 project_2\"],[1346,\"Note 1168 note_1168 project_2\"],[1347,\"Note 1169 note_1169 project_2\"],[1348,\"Note 1170 note_1170 project_2\"],[1349,\"Note 1171 note_1171 project_2\"],[1350,\"Note 1172 note_1172 project_2\"],[1351,\"Note 1173 note_1173 project_2\"],[1352,\"Note 1174 note_1174 project_2\"],[1353,\"Note 1175 note_1175 project_2\"],[1354,\"Note 1176 note_1176 project_2\"],[1355,\"Note 1177 note_1177 project_2\"],[1356,\"Note 1178 note_1178 project_2\"],[1357,\"Note 1179 note_1179 project_2\"],[1358,\"Note 1180 note_1180 project_2\"],[1359,\"Note 1181 note_1181 project_2\"],[1360,\"Note 1182 note_1182 project_2\"],[1361,\"Note 1183 note_1183 project_2\"],[1362,\"Note 1184 note_1184 project_2\"],[1363,\"Note 1185 note_1185 project_2\"],[1364,\"Note 1186 note_1186 project_2\"],[1365,\"Note 1187 note_1187 project_2\"],[1366,\"Note 1188 note_1188 project_2\"],[1367,\"Note 526 note_526 project_8\"],[1368,\"Note 527 note_527 project_8\"],[1369,\"Note 528 note_528 project_8\"],[1370,\"Note 529 note_529 project_8\"],[1371,\"Note 530 note_530 project_8\"],[1372,\"Note 531 note_531 project_8\"],[1373,\"Note 532 note_532 project_8\"],[1374,\"Note 533 note_533 project_8\"],[1375,\"Note 534 note_534 project_8\"],[1376,\"Note 535 note_535 project_8\"],[1377,\"Note 536 note_536 project_8\"],[1378,\"Note 537 note_537 project_8\"],[1379,\"Note 538 note_538 project_8\"],[1380,\"Note 539 note_539 project_8\"],[1381,\"Note 540 note_540 project_8\"],[1382,\"Note 541 note_541 project_8\"],[1383,\"Note 542 note_542 project_8\"],[1384,\"Note 543 note_543 project_8\"],[1385,\"Note 544 note_544 project_8\"],[1386,\"Note 545 note_545 project_8\"],[1387,\"Note 546 note_546 project_8\"],[1388,\"Note 547 note_547 project_8\"],[1389,\"Note 548 note_548 project_8\"],[1390,\"Note 549 note_549 project_8\"],[1391,\"Note 550 note_550 project_8\"],[1392,\"Note 551 note_551 project_8\"],[1393,\"Note 552 note_552 project_8\"],[1394,\"Note 553 note_553 project_8\"],[1395,\"Note 554 note_554 project_8\"],[1396,\"Note 555 note_555 project_8\"],[1397,\"Note 556 note_556 project_8\"],[1398,\"Note 557 note_557 project_8\"],[1399,\"Note 558 note_558 project_8\"],[1400,\"Note 559 note_559 project_8\"]]"}
{"severity":"DEBUG","time":"2021-02-16T19:31:40.318Z","correlation_id":null,"class":"Elastic::ProcessBookkeepingService","redis_set":"elastic:incremental:updates:0:zset","message":"track_items","count":100,"tracked_items_encoded":"[[1401,\"Note 560 note_560 project_8\"],[1402,\"Note 561 note_561 project_8\"],[1403,\"Note 562 note_562 project_8\"],[1404,\"Note 563 note_563 project_8\"],[1405,\"Note 564 note_564 project_8\"],[1406,\"Note 565 note_565 project_8\"],[1407,\"Note 566 note_566 project_8\"],[1408,\"Note 567 note_567 project_8\"],[1409,\"Note 568 note_568 project_8\"],[1410,\"Note 569 note_569 project_8\"],[1411,\"Note 570 note_570 project_8\"],[1412,\"Note 571 note_571 project_8\"],[1413,\"Note 572 note_572 project_8\"],[1414,\"Note 573 note_573 project_8\"],[1415,\"Note 574 note_574 project_8\"],[1416,\"Note 575 note_575 project_8\"],[1417,\"Note 576 note_576 project_8\"],[1418,\"Note 577 note_577 project_8\"],[1419,\"Note 578 note_578 project_8\"],[1420,\"Note 579 note_579 project_8\"],[1421,\"Note 580 note_580 project_8\"],[1422,\"Note 581 note_581 project_8\"],[1423,\"Note 582 note_582 project_8\"],[1424,\"Note 583 note_583 project_8\"],[1425,\"Note 584 note_584 project_8\"],[1426,\"Note 585 note_585 project_8\"],[1427,\"Note 586 note_586 project_8\"],[1428,\"Note 587 note_587 project_8\"],[1429,\"Note 588 note_588 project_8\"],[1430,\"Note 739 note_739 project_11\"],[1431,\"Note 740 note_740 project_11\"],[1432,\"Note 741 note_741 project_11\"],[1433,\"Note 742 note_742 project_11\"],[1434,\"Note 743 note_743 project_11\"],[1435,\"Note 744 note_744 project_11\"],[1436,\"Note 745 note_745 project_11\"],[1437,\"Note 746 note_746 project_11\"],[1438,\"Note 747 note_747 project_11\"],[1439,\"Note 748 note_748 project_11\"],[1440,\"Note 749 note_749 project_11\"],[1441,\"Note 750 note_750 project_11\"],[1442,\"Note 751 note_751 project_11\"],[1443,\"Note 752 note_752 project_11\"],[1444,\"Note 753 note_753 project_11\"],[1445,\"Note 754 note_754 project_11\"],[1446,\"Note 755 note_755 project_11\"],[1447,\"Note 756 note_756 project_11\"],[1448,\"Note 757 note_757 project_11\"],[1449,\"Note 758 note_758 project_11\"],[1450,\"Note 759 note_759 project_11\"],[1451,\"Note 760 note_760 project_11\"],[1452,\"Note 761 note_761 project_11\"],[1453,\"Note 762 note_762 project_11\"],[1454,\"Note 763 note_763 project_11\"],[1455,\"Note 764 note_764 project_11\"],[1456,\"Note 765 note_765 project_11\"],[1457,\"Note 766 note_766 project_11\"],[1458,\"Note 767 note_767 project_11\"],[1459,\"Note 768 note_768 project_11\"],[1460,\"Note 769 note_769 project_11\"],[1461,\"Note 770 note_770 project_11\"],[1462,\"Note 771 note_771 project_11\"],[1463,\"Note 772 note_772 project_11\"],[1464,\"Note 773 note_773 project_11\"],[1465,\"Note 774 note_774 project_11\"],[1466,\"Note 775 note_775 project_11\"],[1467,\"Note 776 note_776 project_11\"],[1468,\"Note 777 note_777 project_11\"],[1469,\"Note 778 note_778 project_11\"],[1470,\"Note 779 note_779 project_11\"],[1471,\"Note 780 note_780 project_11\"],[1472,\"Note 781 note_781 project_11\"],[1473,\"Note 782 note_782 project_11\"],[1474,\"Note 783 note_783 project_11\"],[1475,\"Note 784 note_784 project_11\"],[1476,\"Note 785 note_785 project_11\"],[1477,\"Note 786 note_786 project_11\"],[1478,\"Note 787 note_787 project_11\"],[1479,\"Note 788 note_788 project_11\"],[1480,\"Note 789 note_789 project_11\"],[1481,\"Note 790 note_790 project_11\"],[1482,\"Note 791 note_791 project_11\"],[1483,\"Note 792 note_792 project_11\"],[1484,\"Note 793 note_793 project_11\"],[1485,\"Note 794 note_794 project_11\"],[1486,\"Note 795 note_795 project_11\"],[1487,\"Note 796 note_796 project_11\"],[1488,\"Note 797 note_797 project_11\"],[1489,\"Note 798 note_798 project_11\"],[1490,\"Note 799 note_799 project_11\"],[1491,\"Note 800 note_800 project_11\"],[1492,\"Note 801 note_801 project_11\"],[1493,\"Note 802 note_802 project_11\"],[1494,\"Note 803 note_803 project_11\"],[1495,\"Note 804 note_804 project_11\"],[1496,\"Note 805 note_805 project_11\"],[1497,\"Note 806 note_806 project_11\"],[1498,\"Note 807 note_807 project_11\"],[1499,\"Note 808 note_808 project_11\"],[1500,\"Note 809 note_809 project_11\"]]"}
{"severity":"DEBUG","time":"2021-02-16T19:31:40.320Z","correlation_id":null,"class":"Elastic::ProcessBookkeepingService","redis_set":"elastic:incremental:updates:0:zset","message":"track_items","count":33,"tracked_items_encoded":"[[1501,\"Note 810 note_810 project_11\"],[1502,\"Note 811 note_811 project_11\"],[1503,\"Note 812 note_812 project_11\"],[1504,\"Note 813 note_813 project_11\"],[1505,\"Note 814 note_814 project_11\"],[1506,\"Note 815 note_815 project_11\"],[1507,\"Note 816 note_816 project_11\"],[1508,\"Note 817 note_817 project_11\"],[1509,\"Note 818 note_818 project_11\"],[1510,\"Note 1428 note_1428 project_11\"],[1511,\"Note 1429 note_1429 project_11\"],[1512,\"Note 1430 note_1430 project_11\"],[1513,\"Note 1431 note_1431 project_11\"],[1514,\"Note 1432 note_1432 project_11\"],[1515,\"Note 1433 note_1433 project_11\"],[1516,\"Note 1434 note_1434 project_11\"],[1517,\"Note 1435 note_1435 project_11\"],[1518,\"Note 1436 note_1436 project_11\"],[1519,\"Note 1437 note_1437 project_11\"],[1520,\"Note 1438 note_1438 project_11\"],[1521,\"Note 1439 note_1439 project_11\"],[1522,\"Note 1440 note_1440 project_11\"],[1523,\"Note 1441 note_1441 project_11\"],[1524,\"Note 1442 note_1442 project_11\"],[1525,\"Note 1443 note_1443 project_11\"],[1526,\"Note 1444 note_1444 project_11\"],[1527,\"Note 1445 note_1445 project_11\"],[1528,\"Note 1446 note_1446 project_11\"],[1529,\"Note 1447 note_1447 project_11\"],[1530,\"Note 1448 note_1448 project_11\"],[1531,\"Note 1449 note_1449 project_11\"],[1532,\"Note 1450 note_1450 project_11\"],[1533,\"Note 1451 note_1451 project_11\"]]"}
{"severity":"INFO","time":"2021-02-16T19:31:40.320Z","correlation_id":null,"message":"[Elastic::Migration: 20210128163600] Adding permission data to notes documents is completed for batch of 1533 documents"}
{"severity":"INFO","time":"2021-02-16T19:31:40.323Z","correlation_id":null,"message":"[Elastic::Migration: 20210128163600] completed check: Refreshing gitlab-development-20210216-1420"}
{"severity":"INFO","time":"2021-02-16T19:31:40.344Z","correlation_id":null,"message":"[Elastic::Migration: 20210128163600] Migration has 1533 documents remaining"}
{"severity":"INFO","time":"2021-02-16T19:31:40.344Z","correlation_id":null,"message":"MigrationWorker: migration[AddPermissionsDataToNotesDocuments] kicking off next migration batch"}
{"severity":"INFO","time":"2021-02-16T19:31:40.354Z","correlation_id":null,"message":"[Elastic::Migration: 20210128163600] completed check: Refreshing gitlab-development-20210216-1420"}
{"severity":"INFO","time":"2021-02-16T19:31:40.363Z","correlation_id":null,"message":"[Elastic::Migration: 20210128163600] Migration has 1533 documents remaining"}
{"severity":"INFO","time":"2021-02-16T19:31:40.363Z","correlation_id":null,"message":"MigrationWorker: migration[AddPermissionsDataToNotesDocuments] updating with completed: false"}
{"severity":"INFO","time":"2021-02-16T19:31:43.143Z","correlation_id":"5d0d9d6da0df22c8a0042929fbd8b904","message":"bulk_indexing_start","records_count":1533,"first_score":1.0,"last_score":1533.0}
{"severity":"INFO","time":"2021-02-16T19:31:53.654Z","correlation_id":"5d0d9d6da0df22c8a0042929fbd8b904","message":"bulk_submitted","body_size_bytes":742081,"bulk_count":1533,"errors_count":0}
{"severity":"INFO","time":"2021-02-16T19:31:53.655Z","correlation_id":"5d0d9d6da0df22c8a0042929fbd8b904","message":"bulk_indexing_end","records_count":1533,"failures_count":0,"first_score":1.0,"last_score":1533.0,"bulk_execution_duration_s":10.524697}
{"severity":"INFO","time":"2021-02-16T19:32:12.242Z","correlation_id":null,"message":"MigrationWorker: migration[AddPermissionsDataToNotesDocuments] executing migrate method"}
{"severity":"INFO","time":"2021-02-16T19:32:12.247Z","correlation_id":null,"message":"[Elastic::Migration: 20210128163600] completed check: Refreshing gitlab-development-20210216-1420"}
{"severity":"INFO","time":"2021-02-16T19:32:12.258Z","correlation_id":null,"message":"[Elastic::Migration: 20210128163600] Migration has 0 documents remaining"}
{"severity":"INFO","time":"2021-02-16T19:32:12.258Z","correlation_id":null,"message":"[Elastic::Migration: 20210128163600] Skipping adding permission data to notes documents migration since it is already applied"}
{"severity":"INFO","time":"2021-02-16T19:32:12.261Z","correlation_id":null,"message":"[Elastic::Migration: 20210128163600] completed check: Refreshing gitlab-development-20210216-1420"}
{"severity":"INFO","time":"2021-02-16T19:32:12.270Z","correlation_id":null,"message":"[Elastic::Migration: 20210128163600] Migration has 0 documents remaining"}
{"severity":"INFO","time":"2021-02-16T19:32:12.272Z","correlation_id":null,"message":"[Elastic::Migration: 20210128163600] completed check: Refreshing gitlab-development-20210216-1420"}
{"severity":"INFO","time":"2021-02-16T19:32:12.283Z","correlation_id":null,"message":"[Elastic::Migration: 20210128163600] Migration has 0 documents remaining"}
{"severity":"INFO","time":"2021-02-16T19:32:12.283Z","correlation_id":null,"message":"MigrationWorker: migration[AddPermissionsDataToNotesDocuments] updating with completed: true"}

NOTE: if you run this and it completes, you will need to delete the migration record from Elasticsearch to get the Elastic::MigrationWorker to pick the migration up again

curl --request DELETE \
  --url http://localhost:9200/gitlab-development-migrations/_doc/20210128163600 \

Screenshots (strongly suggested)

Does this MR meet the acceptance criteria?

Conformity

Availability and Testing

Review and add/update tests for this feature/bug. Consider all test levels. See the Test Planning Process.
[-] Tested in all supported browsers
[-] Informed Infrastructure department of a default or new setting change, if applicable per definition of done

Security

If this MR contains changes to processing or storing of credentials or tokens, authorization and authentication methods and other items described in the security review guidelines:

[-] Label as security and @ mention @gitlab-com/gl-security/appsec
[-] The MR includes necessary changes to maintain consistency between UI, API, email, or other methods
[-] Security reports checked/validated by a reviewer from the AppSec team

Edited Feb 23, 2021 by Terri Chu

ES Migration add permission data to notes documents