Training Data for

Computer Use Agents

High-fidelity human trajectories with full key, click, touch, and pixel traces for BC, reward modeling, and RL fine-tuning.

Mouse Move
55.98 s
Before
After
BeforeAfter
01111
1
Frame 1
Mouse Move
55.98 s
Start: (1060, 550)End: (137, 257)
2
Frame 2
Mouse Click
56.44 s
at (137, 257)
3
Frame 3
Mouse Move
58.55 s
Start: (138, 257)End: (814, 65)
4
Frame 4
Mouse Click
59.12 s
at (814, 65)
5
Frame 5
Key press
60.17 s
4
6
Frame 6
Key press
60.87 s
return
7
Frame 7
Mouse Move
62.88 s
Start: (814, 65)End: (344, 65)
8
Frame 8
Mouse Click
63.35 s
at (344, 65)
9
Frame 9
Mouse Move
63.97 s
Start: (343, 65)End: (315, 92)
10
Frame 10
Mouse Click
64.43 s
at (315, 92)
11
Frame 11
Mouse Move
68.02 s
Start: (316, 92)End: (487, 622)
12
Frame 12
Mouse Click
70.93 s
Start: (487, 622)End: (488, 620)
13
Frame 13
Mouse Move
71.18 s
Start: (488, 620)End: (457, 620)
14
Frame 14
Mouse Click
73.20 s
Start: (457, 620)End: (486, 582)
15
Frame 15
Mouse Click
74.80 s
at (486, 582)
16
Frame 16
Mouse Move
75.78 s
Start: (486, 582)End: (472, 574)
17
Frame 17
Mouse Click
78.44 s
Start: (472, 574)End: (473, 576)
18
Frame 18
Mouse Move
78.97 s
Start: (473, 576)End: (457, 580)
19
Frame 19
Mouse Click
81.33 s
Start: (457, 580)End: (482, 560)
20
Frame 20
Mouse Click
82.31 s
at (482, 560)
21
Frame 21
Mouse Move
83.32 s
Start: (482, 559)End: (473, 528)
22
Frame 22
Mouse Click
85.27 s
Start: (473, 528)End: (468, 528)
23
Frame 23
Mouse Move
300.81 s
Start: (501, 570)End: (646, 346)
24
Frame 24
Mouse Click
304.36 s
Start: (646, 346)End: (650, 336)
25
Frame 25
Mouse Move
304.67 s
Start: (651, 336)End: (730, 321)
26
Frame 26
Mouse Click
306.20 s
Start: (730, 321)End: (602, 667)
27
Frame 27
Mouse Move
306.98 s
Start: (602, 667)End: (601, 663)
28
Frame 28
Mouse Click
307.49 s
at (601, 663)
29
Frame 29
Mouse Move
309.13 s
Start: (601, 663)End: (669, 414)
30
Frame 30
Mouse Click
312.40 s
Start: (669, 414)End: (675, 406)
31
Frame 31
Mouse Move
312.72 s
Start: (675, 406)End: (807, 409)
32
Frame 32
Mouse Click
314.40 s
Start: (807, 409)End: (519, 666)
33
Frame 33
Mouse Click
315.74 s
at (519, 666)
34
Frame 34
Mouse Move
317.03 s
Start: (519, 665)End: (775, 352)
35
Frame 35
Mouse Click
319.65 s
Start: (775, 352)End: (786, 349)
36
Frame 36
Mouse Move
319.97 s
Start: (787, 349)End: (847, 335)
37
Frame 37
Mouse Click
322.49 s
Start: (847, 335)End: (446, 607)
38
Frame 38
Mouse Click
323.45 s
at (446, 607)
39
Frame 39
Mouse Move
324.70 s
Start: (446, 607)End: (669, 488)
40
Frame 40
Mouse Click
328.85 s
Start: (669, 488)End: (674, 487)
41
Frame 41
Mouse Move
329.22 s
Start: (674, 487)End: (777, 500)
42
Frame 42
Mouse Click
330.31 s
Start: (777, 500)End: (552, 637)
43
Frame 43
Mouse Move
331.81 s
Start: (552, 638)End: (541, 668)
44
Frame 44
Mouse Click
332.39 s
at (541, 668)
45
Frame 45
Mouse Move
333.33 s
Start: (541, 668)End: (475, 661)
46
Frame 46
Mouse Click
336.03 s
Start: (475, 661)End: (467, 659)
47
Frame 47
Mouse Move
336.34 s
Start: (466, 660)End: (417, 685)
48
Frame 48
Mouse Click
337.12 s
Start: (417, 685)End: (475, 600)
49
Frame 49
Mouse Move
338.78 s
Start: (475, 601)End: (540, 651)
50
Frame 50
Mouse Click
339.21 s
at (540, 651)
51
Frame 51
Mouse Move
340.37 s
Start: (540, 652)End: (639, 686)
52
Frame 52
Mouse Click
343.91 s
Start: (639, 686)End: (641, 692)
53
Frame 53
Mouse Move
344.29 s
Start: (641, 692)End: (686, 684)
54
Frame 54
Mouse Click
345.27 s
Start: (686, 684)End: (547, 717)
55
Frame 55
Mouse Click
346.50 s
at (548, 717)
56
Frame 56
Mouse Move
347.73 s
Start: (548, 717)End: (801, 579)
57
Frame 57
Mouse Click
349.99 s
Start: (801, 579)End: (803, 579)
58
Frame 58
Mouse Move
350.33 s
Start: (803, 579)End: (779, 609)
59
Frame 59
Mouse Click
351.76 s
Start: (779, 609)End: (550, 716)
60
Frame 60
Mouse Click
352.63 s
at (550, 716)
61
Frame 61
Mouse Move
353.77 s
Start: (550, 716)End: (832, 511)
62
Frame 62
Mouse Click
356.55 s
Start: (832, 511)End: (843, 502)
63
Frame 63
Mouse Move
356.97 s
Start: (843, 502)End: (843, 533)
64
Frame 64
Mouse Click
358.56 s
Start: (843, 533)End: (680, 649)
65
Frame 65
Mouse Click
359.55 s
at (680, 649)
66
Frame 66
Mouse Move
361.25 s
Start: (681, 648)End: (884, 445)
67
Frame 67
Mouse Click
363.92 s
Start: (884, 445)End: (886, 441)
68
Frame 68
Mouse Move
364.61 s
Start: (886, 441)End: (868, 371)
69
Frame 69
Mouse Click
366.81 s
Start: (868, 371)End: (860, 383)
70
Frame 70
Mouse Move
367.96 s
Start: (860, 384)End: (865, 387)
71
Frame 71
Mouse Click
368.70 s
Start: (865, 387)End: (808, 407)
72
Frame 72
Mouse Move
370.04 s
Start: (808, 407)End: (814, 410)
73
Frame 73
Mouse Click
370.51 s
at (814, 410)
74
Frame 74
Mouse Move
371.66 s
Start: (815, 410)End: (881, 377)
75
Frame 75
Mouse Click
373.78 s
Start: (881, 377)End: (885, 376)
76
Frame 76
Mouse Move
374.29 s
Start: (885, 376)End: (892, 391)
77
Frame 77
Mouse Click
376.11 s
Start: (892, 391)End: (825, 625)
78
Frame 78
Mouse Click
377.05 s
at (825, 625)
79
Frame 79
Mouse Move
378.67 s
Start: (825, 624)End: (873, 474)
80
Frame 80
Mouse Click
381.20 s
Start: (873, 474)End: (860, 473)
81
Frame 81
Mouse Move
381.52 s
Start: (860, 473)End: (834, 490)
82
Frame 82
Mouse Click
382.48 s
Start: (834, 490)End: (767, 550)
83
Frame 83
Mouse Move
383.66 s
Start: (767, 550)End: (773, 564)
84
Frame 84
Mouse Click
384.05 s
at (773, 564)
85
Frame 85
Mouse Move
387.71 s
Start: (773, 564)End: (710, 312)
86
Frame 86
Mouse Click
391.72 s
Start: (710, 312)End: (727, 304)
87
Frame 87
Mouse Move
392.10 s
Start: (727, 304)End: (774, 241)
88
Frame 88
Mouse Click
394.16 s
Start: (774, 241)End: (572, 701)
89
Frame 89
Mouse Click
395.30 s
at (572, 701)
90
Frame 90
Mouse Move
396.89 s
Start: (572, 701)End: (629, 199)
91
Frame 91
Mouse Click
399.83 s
Start: (629, 199)End: (638, 194)
92
Frame 92
Mouse Move
400.25 s
Start: (638, 194)End: (628, 147)
93
Frame 93
Mouse Click
404.40 s
Start: (628, 147)End: (422, 587)
94
Frame 94
Mouse Move
405.27 s
Start: (422, 587)End: (421, 593)
95
Frame 95
Mouse Click
405.75 s
at (421, 593)
96
Frame 96
Mouse Move
407.31 s
Start: (421, 593)End: (715, 176)
97
Frame 97
Mouse Click
409.27 s
Start: (715, 176)End: (714, 167)
98
Frame 98
Mouse Move
409.61 s
Start: (713, 167)End: (679, 168)
99
Frame 99
Mouse Click
412.46 s
Start: (679, 168)End: (467, 627)
100
Frame 100
Mouse Click
413.66 s
at (467, 627)
101
Frame 101
Mouse Move
415.33 s
Start: (467, 627)End: (513, 467)
102
Frame 102
Mouse Click
418.79 s
Start: (513, 467)End: (512, 467)
103
Frame 103
Mouse Move
419.34 s
Start: (512, 467)End: (498, 473)
104
Frame 104
Mouse Click
420.73 s
Start: (498, 473)End: (519, 293)
105
Frame 105
Mouse Click
421.64 s
at (519, 293)
106
Frame 106
Mouse Move
422.71 s
Start: (519, 294)End: (552, 376)
107
Frame 107
Mouse Click
426.16 s
Start: (552, 376)End: (546, 370)
108
Frame 108
Mouse Move
426.60 s
Start: (546, 370)End: (575, 298)
109
Frame 109
Mouse Click
428.25 s
Start: (575, 298)End: (443, 684)
110
Frame 110
Mouse Click
429.41 s
at (443, 684)
111
Frame 111
Mouse Move
430.26 s
Start: (443, 684)End: (606, 589)

Used by teams developing
computer use agents

ADEPT
Perplexity
rabbit
Twin

201K+ Trajectories by 24K+ Collectors

Built for scale, depth, and cross-tool generalization.

Source: Benchmark values derived from OpenCUA: Open Foundations for Computer-Use Agents (2025). https://arxiv.org/pdf/2508.09123

Proof of Work

8.9M+ Actions Across 150+ Tools

Use off-the-shelf datasets or request custom data by task, domain, and environment.

Dataset Overview

Trajectories
201K
State Action Pairs
8.9M
Recorded Hours
3044 hours
Tools
150+
Human Actions
AllDesktopMobile

Every click, scroll, and keypress — logged at millisecond granularity.

Tap
Mobile
Tap on Login button
Double Tap
Mobile
Double tap to zoom image
Long Press
Mobile
Long press on message to open options
Scroll
Mobile
Scroll down product list
Pinch Zoom
Mobile
Pinch zoom in on image
Drag
Mobile
Drag card to reorder
Text Entry
Mobile
Typed "features" in search field
Orientation Change
Mobile
Rotated screen to landscape
Back Navigation
Mobile
Navigated back to previous screen
Mouse Movement
Desktop
Mouse moved across navigation bar
Mouse Clicks
Desktop
Left click on Pricing tab
Mouse Scroll
Desktop
Scroll down landing page
Drag and Drop
Desktop
Drag file into upload area
Text Input
Desktop
Typed "pricing" in search bar
Keypress
Desktop
Pressed Ctrl+S to save

What Files You Get

Each trajectory includes a complete set of synchronized files for training and evaluation.

  • Event Logs (.txt)
  • Screen Recording (.mp4)
  • Semantic Actions (.json)
  • Frames (.jpg)

Raw Data View

Displaying raw mouse and keyboard event data with timestamps and coordinates.

Pricing

Per-task pricing with clear visibility. Custom data priced by scope.

Licensing

Purchased datasets are owned by you and licensed for model training.

Privacy

PII is excluded by default. When present, explicit user consent is obtained.

Common Questions

Real human work. At training scale