OpenAI asks contractors to upload real work from past jobs to train advanced AI agents

OpenAI is reportedly asking contractors to upload real work from past jobs | TechCrunch

OpenAI reportedly asking contractors to upload real work from past jobs OpenAI and training data company Handshake AI are asking third-party contractors to upload real work that they did in past and current jobs, according to a report in Wired. This appears to be part of a larger strategy across AI companies that are hiring contractors to generate high-quality training data in the hopes that this will eventually allow their models to automate more white-collar work. In OpenAI's case, a company presentation reportedly asks contractors to describe tasks they've performed at other jobs and upload examples of "real, on-the-job work" that they've "actually done." These examples can include "a concrete output (not a summary of the file, but the actual file), e.g., Word doc, PDF, Powerpoint, Excel, image, repo." The company reportedly instructs contractors to delete proprietary and personally identifiable information before uploading, and it points them to a ChatGPT "Superstar Scrubbing" tool to do so. Nonetheless, intellectual property lawyer Evan Brown told Wired that any AI lab taking this approach is "putting itself at great risk" with an approach that requires "a lot of trust in its contractors to decide what is and isn't confidential."

OpenAI Is Asking Contractors to Upload Work From Past Jobs to Evaluate the Performance of AI Agents

OpenAI is asking third-party contractors to upload real assignments and tasks from their current or previous workplaces so that it can use the data to evaluate the performance of its next-generation AI models, according to records from OpenAI and the training data company Handshake AI obtained by WIRED. The project appears to be part of OpenAI's efforts to establish a human baseline for different tasks that can then be compared with AI models. In September, the company launched a new evaluation process to measure the performance of its AI models against human professionals across a variety of industries. OpenAI says this is a key indicator of its progress towards achieving AGI, or an AI system that outperforms humans at most economically valuable tasks. "We've hired folks across occupations to help collect real-world tasks modeled off those you've done in your full-time jobs, so we can measure how well AI models perform on those tasks," reads one confidential document from OpenAI. "Take existing pieces of long-term or complex work (hours or days+) that you've done in your occupation and turn each into a task." OpenAI is asking contractors to describe tasks they've done in their current job or in the past and to upload real examples of work they did, according to an OpenAI presentation about the project viewed by WIRED. Each of the examples should be "a concrete output (not a summary of the file, but the actual file), e.g., Word doc, PDF, Powerpoint, Excel, image, repo," the presentation notes. OpenAI says people can also share fabricated work examples created to demonstrate how they would realistically respond in specific scenarios. OpenAI and Handshake AI declined to comment. Real-world tasks have two components, according to the OpenAI presentation. There's the task request (what a person's manager or colleague told them to do) and the task deliverable (the actual work they produced in response to that request). The company emphasizes multiple times in instructions that the examples contractors share should reflect "real, on-the-job work" that the person has "actually done." One example in the OpenAI presentation outlines a task from a "Senior Lifestyle Manager at a luxury concierge company for ultra-high-net-worth individuals." The goal is to "Prepare a short, 2-page PDF draft of a 7-day yacht trip overview to the Bahamas for a family who will be traveling there for the first time." It includes additional details regarding the family's interests and what the itinerary should look like. The "experienced human deliverable" then shows what the contractor in this case would upload: a real Bahamas itinerary created for a client. OpenAI instructs the contractors to delete corporate intellectual property and personally identifiable information from the work files they upload. Under a section labeled "Important reminders," OpenAI tells the workers to"Remove or anonymize any: personal information, proprietary or confidential data, material nonpublic information (e.g., internal strategy, unreleased product details)." One of the files viewed by WIRED document mentions an ChatGPT tool called ""Superstar Scrubbing" that provides advice on how to delete confidential information. Evan Brown, an intellectual property lawyer with Neal & McDevitt, tells WIRED that AI labs that receive confidential information from contractors at this scale could be subject to trade secret misappropriation claims. Contractors who offer documents from their previous workplaces to an AI company, even scrubbed, could be at risk of violating their previous employers' non-disclosure agreements, or exposing trade secrets. "The AI lab is putting a lot of trust in its contractors to decide what is and isn't confidential," says Brown. "If they do let something slip through, are the AI labs really taking the time to determine what is and isn't a trade secret? It seems to me that the AI lab is putting itself at great risk."

OpenAI asks contractors to upload real work from past jobs to test AI agents: Report

OpenAI reportedly provides a tool called the ChatGPT "Superstar Scrubbing" tool to help removing the personal information. OpenAI has asked contractors to upload real work they have done in previous jobs, according to a report from Wired. The move is part of a larger trend among AI companies that hire contractors to create high-quality training data. The goal is likely to eventually enable AI models to handle more complex office tasks. According to the report, OpenAI has asked contractors to describe the tasks they've completed at other jobs and to share actual examples of their work. These examples could include Word documents, PDFs, PowerPoint presentations, Excel files or images. The company reportedly specifies that the files must be real outputs, not just summaries of the work. Contractors are instructed to remove any proprietary or personal information before uploading their work. OpenAI reportedly provides a tool called the ChatGPT "Superstar Scrubbing" tool to help with this process. Also read: Instagram denies data breach reports, says user accounts are secure Despite these precautions, the approach carries risks. Intellectual property lawyer Evan Brown told Wired, any AI lab using this method "is putting itself at great risk" because it relies heavily on contractors to judge what is confidential and what is not. AI companies have been increasingly looking for ways to make models capable of handling office tasks like creating presentations, drafting emails, or analysing spreadsheets. By studying actual work from humans, companies hope their AI agents can learn from realistic examples rather than artificial or synthetic data. Also read: Samsung Galaxy Z Fold 7 price drops by over Rs 19,000: Check details here The practice raises important questions about privacy, intellectual property, and the ethics of using real work for AI training.