Page MenuHomePhabricator
Create Task
Maniphest T226119

Build middleware to utilize machine vision API for structured data on commons depicts tag suggestion tool
Closed, ResolvedPublic
Actions

Description

In Q1 FY 2019-20, the Wikimedia Reading Infrastructure team is designing and building a generalized solution for communicating with machine vision (MV) service providers and storing results for usage on the wikis.

Specifically, we need support for:

  • Requesting MV-generated image metadata from machine vision providers
  • Providing temporary storage for MV results pending human editor verification
  • Serving MV data to Commons users for verification and promotion to Structured Data on Commons
  • Providing the results of human editor verification back to third-party MV providers for model refinement

Full project documentation: https://www.mediawiki.org/wiki/Wikimedia_Product/Machine_vision_middleware

labels.png (629×658 px, 40 KB)

Related Objects
Search...

StatusSubtypeAssignedTask
 Resolved• Ramsey-WMFT225964 [SDC] Build a depicts tag suggestion tool that is powered by machine vision platforms
 Resolved• MhollowayT226119 Build middleware to utilize machine vision API for structured data on commons depicts tag suggestion tool
 Resolved• MhollowayT227349 Deploy the MachineVision extension to production
 Resolved• MhollowayT227348 Deploy MachineVision extension to the Beta Cluster
 ResolvedsbassettT227346 Security readiness review for the MachineVision extension
 Resolved• MhollowayT227347 Create a diagram of the machine vision middleware architecture
 Resolved• MarosteguiT227355 DBA review for the MachineVision extension
 Resolved• MhollowayT227351 Define DB table schemas for MV depicts suggestions
 ResolvedKrinkleT230813 Performance review for the MachineVision extension
 Resolved• MhollowayT240210 Fallback text for non-JS-supporting clients on Special:SuggestedTags
 ResolvedNoneT242662 "machinevision-machineaidedtagging-intro" message should not refer to production interwiki codes
 Resolved• Ramsey-WMFT242667 Reduce flash of empty page and hoisted footer when loading Special:SuggestedTags (FOUC)
 Resolved• MhollowayT236797 How should the MachineVision extension interact with external APIs from production?
 Resolved• MhollowayT236426 Configure Google Cloud Vision credentials in production
 Resolved• MhollowayT236843 Add HTTP proxy support to the MachineVision extension
 Resolved• MhollowayT237596 Add MachineVision dependencies to vendor
 DeclinedReedyT237588 Security review for MachineVision libraries
 Resolved• MhollowayT227353 Define the lifecycle for MV-generated depicts suggestion data
 InvalidNoneT227341 Define criteria for human editor verification of MV-generated metadata for purposes of model refinement
 ResolvedsbassettT227591 Security Concept Review for the machine vision middleware project
 Resolved• MhollowayT227342 Define criteria for human editor verification of MV-generated metadata for promotion to SDC
 DeclinedNoneT227339 Create a spec for the depicts suggestion response
 Resolved• TgrT228694 Design a system for recording votes on depicts suggestions
 InvalidNoneT229314 Decide where to store past labeling data

Event Timeline

JoeWalsh created this task.Jun 19 2019, 5:23 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJun 19 2019, 5:23 PM
JoeWalsh triaged this task as Medium priority.Jun 19 2019, 5:23 PM
JoeWalsh added a parent task: T225964: [SDC] Build a depicts tag suggestion tool that is powered by machine vision platforms.
JoeWalsh added a project: Epic.
JoeWalsh moved this task from Needs triage to Epics on the Product-Infrastructure-Team-Backlog-Deprecated board.
dr0ptp4kt updated the task description. (Show Details)Jun 19 2019, 5:52 PM
• Mholloway subscribed.Jun 20 2019, 4:45 PM
• Mholloway mentioned this in T226534: Request creation of machine-vision VPS project.Jun 25 2019, 4:40 PM
• Mholloway updated the task description. (Show Details)Jul 5 2019, 4:00 PM
• Mholloway moved this task from Backlog to Epics on the MachineVision board.Jul 5 2019, 4:04 PM
• Mholloway updated the task description. (Show Details)Jul 8 2019, 9:13 PM
• Mholloway mentioned this in T227347: Create a diagram of the machine vision middleware architecture.Jul 9 2019, 4:37 PM
MSantos subscribed.Jul 15 2019, 10:49 PM
• Mholloway added a subtask: T227349: Deploy the MachineVision extension to production.Jul 17 2019, 3:43 PM
• Mholloway added a subtask: T227353: Define the lifecycle for MV-generated depicts suggestion data.
• Mholloway added a subtask: T227355: DBA review for the MachineVision extension.
• Mholloway added a subtask: T227348: Deploy MachineVision extension to the Beta Cluster.
• Mholloway added a subtask: T227346: Security readiness review for the MachineVision extension.Jul 17 2019, 3:46 PM
• Mholloway added a subtask: T227341: Define criteria for human editor verification of MV-generated metadata for purposes of model refinement.
• Mholloway added a subtask: T227591: Security Concept Review for the machine vision middleware project.
• Mholloway added a subtask: T227351: Define DB table schemas for MV depicts suggestions.Jul 17 2019, 3:48 PM
• Mholloway added a subtask: T227342: Define criteria for human editor verification of MV-generated metadata for promotion to SDC.
• Mholloway added a subtask: T227339: Create a spec for the depicts suggestion response.
• Mholloway added a subtask: T228694: Design a system for recording votes on depicts suggestions.Jul 22 2019, 8:19 PM
• PDrouin-WMF subscribed.Jul 24 2019, 7:30 PM
• Mholloway closed subtask T227341: Define criteria for human editor verification of MV-generated metadata for purposes of model refinement as Invalid.Aug 1 2019, 9:33 PM
• Mholloway closed subtask T227348: Deploy MachineVision extension to the Beta Cluster as Resolved.Aug 13 2019, 8:40 PM
• Mholloway closed subtask T228694: Design a system for recording votes on depicts suggestions as Resolved.Aug 15 2019, 2:22 PM
• Mholloway closed subtask T227342: Define criteria for human editor verification of MV-generated metadata for promotion to SDC as Resolved.Aug 19 2019, 1:23 PM
sbassett closed subtask T227591: Security Concept Review for the machine vision middleware project as Resolved.Aug 21 2019, 2:11 PM
• Mholloway closed subtask T227353: Define the lifecycle for MV-generated depicts suggestion data as Resolved.Aug 23 2019, 5:37 PM
• Mholloway added a subtask: T229314: Decide where to store past labeling data.
• Mholloway closed subtask T227339: Create a spec for the depicts suggestion response as Declined.Sep 10 2019, 1:26 AM
• Mholloway closed subtask T227351: Define DB table schemas for MV depicts suggestions as Resolved.Sep 10 2019, 1:29 AM
Keegan mentioned this in T233035: Support computer-aided tagging tool development.Sep 16 2019, 4:42 PM
• Mholloway closed subtask T227355: DBA review for the MachineVision extension as Resolved.Oct 18 2019, 3:41 PM
• Mholloway raised the priority of this task from Medium to High.Oct 24 2019, 12:50 AM
• Mholloway closed subtask T227346: Security readiness review for the MachineVision extension as Resolved.Nov 5 2019, 3:15 PM
sbassett reopened subtask T227346: Security readiness review for the MachineVision extension as Open.Nov 6 2019, 8:06 PM
sbassett closed subtask T227346: Security readiness review for the MachineVision extension as Resolved.Nov 26 2019, 4:41 PM
• Mholloway closed subtask T227349: Deploy the MachineVision extension to production as Resolved.Dec 18 2019, 12:21 AM
• Mholloway closed this task as Resolved.Feb 12 2020, 5:15 PM
• Mholloway claimed this task.
Restricted Application added a project: Structured-Data-Backlog. · View Herald TranscriptFeb 12 2020, 5:15 PM
Jdforrester-WMF closed subtask T229314: Decide where to store past labeling data as Invalid.Apr 5 2024, 7:58 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits