Several current and former employees of OpenAI and Google DeepMind today shared an open letter warning of the dangers of advanced AI and the current lack of oversight of companies working on AI technology.
The employees suggest there are a number of risks that we are facing from AI development, including further entrenchment of existing inequalities, manipulation and misinformation, and loss of control of autonomous AI systems, which the letter says could lead to human extinction.
AI companies have "strong financial incentives" to forge ahead with development and to avoid sharing information about their protective measures and risk levels. "We do not think they can all be relied upon to share it voluntarily," reads the letter, which says that it is up to current and former employees to speak out.
So long as there is no effective government oversight of these corporations, current and former employees are among the few people who can hold them accountable to the public. Yet broad confidentiality agree
