Generative AI systems, which create content across different formats, are becoming more widespread. These systems are used in various fields, including medicine, news, politics, and social interaction, providing companionship. Using natural language output, these systems produced information in a single format, such as text or graphics. To make generative AI systems more adaptable, there is an increasing trend in improving them to operate with additional formats, such as audio (including voice and music) and video.
The increasing use of generative AI systems highlights the need to assess potential risks associated with their deployment. As these technologies become more prevalent and integrated into various applications, concerns arise regarding public safety. Consequently, evaluating the potential risks posed by generative AI systems is becoming a priority for AI developers, policymakers, regulators, and civil society.
The growing use of these systems highlights the necessity to evaluate potential dangers related to implementing generative AI systems. As a result, it is becoming more important for AI developers, regulators, and civil society to assess the possible threats posed by generative AI systems. The development of AI that might spread false information raises moral questions about how such technologies will affect society.
Consequently, a recent study by Google DeepMind researchers offers a thorough approach to assessing AI systems’ social and ethical hazards across several contextual layers. The DeepMind framework systematically assesses risks at three distinct levels: the system’s capabilities, human interactions with the technology, and the broader systemic impacts it may have.
They emphasized that it is crucial to recognize that even highly capable systems may only necessarily cause harm if used problematically within a specific context. Also, the framework examines real-world human interactions with the AI system. This involves considering factors such as who utilizes the technology and whether it operates as intended.
Finally, the framework checks how AI delves into the risks that may arise when AI is extensively adopted. This evaluation considers how technology influences larger social systems and institutions. The researchers emphasize how important context is in determining how risky AI is. Each layer of the framework is permeated by contextual concerns, emphasizing the importance of knowing who will use the AI and why. For instance, even if an AI system produces factually accurate outputs, users’ interpretation and subsequent dissemination of these outputs may have unintended consequences only apparent within certain contextual constraints.
The researchers provided a case study concentrating on misinformation to demonstrate this strategy. The evaluation includes assessing an AI’s tendency for factual errors, observing how users interact with the system, and measuring any subsequent repercussions, such as the spread of incorrect information. This interconnection of model behavior with actual harm occurring in a given context leads to actionable insights.
DeepMind’s context-based approach underscores the importance of moving beyond isolated model metrics. It emphasizes the critical need to evaluate how AI systems operate within the complex reality of social contexts. This holistic assessment is crucial for harnessing the benefits of AI while minimizing associated risks.
Check out the Paper. All Credit For This Research Goes To the Researchers on This Project. Also, don’t forget to join our 31k+ ML SubReddit, 40k+ Facebook Community, Discord Channel, and Email Newsletter, where we share the latest AI research news, cool AI projects, and more.
If you like our work, you will love our newsletter..
We are also on WhatsApp. Join our AI Channel on Whatsapp..
Rachit Ranjan is a consulting intern at MarktechPost . He is currently pursuing his B.Tech from Indian Institute of Technology(IIT) Patna . He is actively shaping his career in the field of Artificial Intelligence and Data Science and is passionate and dedicated for exploring these fields.