Some expert work has to be shown first
The paper’s best point is that expert work often lives in motion. A written procedure may miss the clicks, checks, and habits that make the task work. Record the person, turn the click log into steps, add rules, and verify each run.
What the source reports
Xiao and coauthors introduce OmegaUse-SOP. The system builds standard operating procedures from expert computer demos. A standard operating procedure, or SOP, is a repeatable set of steps for doing a task. The system has four modules: Observe, Reason, Configure, and Execute. It records expert screen actions. It turns small clicks into step instructions. It adds domain rules and task settings. Then it runs the skill with checks. The authors tested it with a power-sector client on photovoltaic simulation tasks in PVsyst 7.2. The claim is practical reliability for specialized software. It is not a claim of general autonomy.
Original source
- Title
- OmegaUse-SOP: SOP Engineering for Professional Computer Use from Human Demonstrations
- Author
- Xiao, An, Yang, Ma, Chen, Cao, Zhao, Wang, Liu, Bao, Zhou & Wu
- Publication
- arXiv
- Date
- Wednesday, September 2, 2026