Page MenuHomePhabricator

Prepare and check storage layer for gpewiki
Closed, ResolvedPublic

Description

The new wiki's visibility will be: Public.

Event Timeline

Marostegui moved this task from Triage to Blocked on the DBA board.
Marostegui subscribed.

Let us know when the wiki is created so we can sanitize it

We received an alert about this- it should create no issues until added to wikireplicas.

Adding Amir as Manuel and I are off.

Ladsgroup moved this task from Blocked to In progress on the DBA board.

I will take care of this

Ran the private data fix on both sanitariums. Will finish it ASAP.

Ladsgroup moved this task from In progress to Done on the DBA board.
Ladsgroup added a subscriber: BTullis.

It's done from our side, handing over to @BTullis

@Ladsgroup The alert is still going on (more recently 2 hours ago)- if you confirm data has all been correctly sanitized, there could be a data leak!

@BTullis Please don't proceed until this is clarified.

@BTullis Please don't proceed until this is clarified.

Acknowledged. I'll await verification that the sanitization has been checked and validated.

I'm 100% sure I ran the clean up in both eqiad and codfw sanitariums and result of check_private_data.py -S /run/mysqld/mysqld.s5.sock was empty in both places afterwards

I'm 100% sure I ran the clean up in both eqiad and codfw sanitariums and result of check_private_data.py -S /run/mysqld/mysqld.s5.sock was empty in both places afterwards

This didn't have any empty value back then but now got it again :/ I think something is broken

I have to debug how the whole thing is working. Give me a bit.

The alert is gone and check_private_data.py -S /run/mysqld/mysqld.s5.sock is not outputting anything anymore. I think it's good to go now but it would be great if @jcrespo could take a look. Thanks!

@Ladsgroup The wikireplicas don't have the triggers. I don't know if they should or not in general/long term, but given that all other dbs have them, you should probably run the script for the new dbs there for consistency (on the 3 dbs: clouddb[1016,1020-1021].eqiad.wmnet), and later you can discuss with manuel if that should change, but I would absolutely add them now (it takes very little time to do that and consistency is better than inconsistency). For example, maybe if new users are created on the wiki they are sanitized on sanitarium but not on wikireplicas (unsure, but I remember ROW configuration being buggy and being added there for a reason).

Maybe it is not needed, but for now I would keep all dbs equally. What do you think?

Thanks. Done now. I'll update docs to reflect that.

And again, stressing that it may be not needed, but that should be handled on a separate ticket. With that done, I think @BTullis can proceed.

Mentioned in SAL (#wikimedia-operations) [2023-07-31T17:00:44Z] <btullis@cumin1001> Added views for new wiki: gpewiki T338678

Ladsgroup removed Ladsgroup as the assignee of this task.