weekly update:

In T357036#9976771, @Aitolkyn wrote:

Prepared the code here: https://gitlab.wikimedia.org/repos/research/reference-quality/-/tree/classifiers

ref. need - time performance tested with CPU setting (no batching) on 1000 revisions shows 50% of revisions take <0.70sec for prediction, and 95% of revisions take <6.06sec, refer to the cdf distribution below

ref.risk - annotating additional 1000 domains

a comment for language support

weekly update:

• thanks for Miriam's feedback, a few adjustments added

weekly update:

• deliverables for the remaining two essential work tasks are being finalized, though there are back-and-forth on details that have not been agreed up on. Will finalized on Monday.

weekly update:

initial document:
https://docs.google.com/document/d/1Va6owaYtpx9eNMB0ZkhHS_iTDQhzj2NHYnsdq7QVjZY/edit?pli=1#heading=h.63vmzm9jkjni

reopening this task as research engineering and deployment component is not done yet.

closing the ticket to mark the conclusion of the PoC on this.

most of the work is done, what's left is to resolve comments on the MR above. Will resolve this task mid-July ...

dependency on https://phabricator.wikimedia.org/T357036 will start once this task is concluded

@MunizaA any comments please put in the ticket and please close this out

will continue under our essential work for model quantization in q1

Muniza has completed the last bit of the task:
https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/blob/4062396de9545939e8e892003f14ecb8344f933f/research/dags/article_topics_dag.py

Do we have an estimate of when this access can be given to Muniza?
My understanding is that we are sort of blocked by this access, if it can be resolved sooner that would be appreciated. Thanks!

weekly update:

to review https://gitlab.wikimedia.org/repos/research/research-datasets/-/merge_requests/31

airflow done, will merge this week

still in research phase

the team is on the same page for hypothesis OKR work planning
essential work planning is ongoing, but the team has already reviewed all proposals internally

will tackle in Q2

thank you!

when it is about "supporting research scientists work" and/or "moving research work to production"
thanks!

I think everybody in the foundation should have the option to tag a task as "research-engineering"

@Aklapper thanks for the questions....
maybe my misconception - I would like to create a tag called "research-engineering" that we could tag tasks when we work on project management (something like https://phabricator.wikimedia.org/tag/research/ )

@fkaelin what's left for this task?

@JAllemandou what's the impact of this as we can see right now? How long do we expect to have this built?

will not prioritize this task, Adam Baso may be able to explore the possibility of "how to store/retrieve large dataset"

@achou please let us know if there is a corresponding ML board related to this task? We'd like to know if this is prioritized...

discussion will continue discussion in the above ticket Kosta mentioned.

step 3-5 has been completed, and step 1 & 2 coincide with other streams of work. Closing this ticket.