As part of T345141: No ALIS for 2023-08-14 snapshot, we elicited a manual update of search indices, taking as input the analytics_platform_eng.image_suggestions_search_index_full/snapshot=2023-08-21 dataset.
Data in the indices doesn't seem to be the same as in the dataset. For instance, article-level suggestions:
Same for section-level image suggestions, e.g.,:
| Title | Reference | Author | Source Branch | Dest Branch | |
|---|---|---|---|---|---|
| search: generalize image_suggestions_manual | repos/data-engineering/airflow-dags!485 | dcausse | image_suggestion_fixup_T345545 | main |
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | None | T340437 [EPIC] Image suggestions data pipelines maintenance | |||
| Resolved | Etonkovidova | T345188 Add Image: all wikis ran out of image recommendations | |||
| Resolved | mfossati | T345141 No ALIS for 2023-08-14 snapshot | |||
| Resolved | dcausse | T345545 Search indices image suggestion tags differ from the dataset used to update |
dcausse opened https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/485
search: generalize image_suggestions_manual
dcausse merged https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/485
search: generalize image_suggestions_manual
Mentioned in SAL (#wikimedia-operations) [2023-09-05T17:47:15Z] <dcausse@deploy1002> Started deploy [airflow-dags/search@b3d43bb]: T345545: search: generalize image_suggestions_manual
Mentioned in SAL (#wikimedia-operations) [2023-09-05T17:47:42Z] <dcausse@deploy1002> Finished deploy [airflow-dags/search@b3d43bb]: T345545: search: generalize image_suggestions_manual (duration: 00m 26s)
Mentioned in SAL (#wikimedia-operations) [2023-09-05T17:57:24Z] <dcausse> T345545: triggered a manual dag run to import analytics_platform_eng.image_suggestions_search_index_full/snapshot=2023-08-21
Checked the search queries mentioned in the task description and they seem to return the expected number of results, moving to our board's "Needs Reporting" column but please consider the parent task unblocked.