Report: Meta will train AI agents by tracking employees’ mouse, keyboard use (arstechnica.com)

Meta is set to implement a new initiative where it will track the mouse movements, clicks, and keystrokes of its U.S. employees to gather training data for future AI agents. According to internal memos from the Meta Superintelligence Labs, this Model Capability Initiative will utilize software operating on specific apps and websites, along with periodic screenshots for contextual training. The goal is to enhance Meta’s AI agents in performing tasks they currently find challenging, such as accurately interpreting mouse movements and navigating dropdown menus. This move is significant for the AI/ML community as it represents a notable shift toward leveraging real-world user interactions to improve AI model performance. By capturing how employees engage with their computers during daily tasks, Meta aims to refine its AI systems to better assist in routine activities. However, the initiative raises ethical concerns, particularly regarding employee privacy and data usage, although Meta has assured that the data will not be used for employee evaluations. The company's cautious stance in not extending this initiative to its European employees highlights the complex legal landscape surrounding employee monitoring in the EU, where stringent regulations could pose challenges for similar data collection practices.