Australia’s Plan to Regulate High-Risk AI

Mar 15, 2024
Share this post
Sharing to FacebookSharing to LinkedInSharing to XSharing to Email

In mid-January 2024, Australia’s Minister for Industry and Science, Ed Husic, unveiled the government's response to the Safe and Responsible AI in Australia consultation. The response, shaped by feedback from last year's consultation on Australia Ai regulation, incorporates over 500 submissions from individuals as well as businesses. These submissions expressed enthusiasm for AI tools' potential while also highlighting concerns about potential risks and Australians' expectations for regulatory safeguards to prevent harm.The potential of AI systems and applications to enhance well-being, quality of life, and to stimulate economic growth is widely acknowledged. Projections suggest that integrating AI and automation could contribute an additional $170 billion to $600 billion annually to Australia's GDP by 2030. Realizing these benefits does, however, require fostering trust to encourage the adoption of this technology, a trust which is currently lacking.

The Main Concerns Expressed in the Consultation

The submissions concerning risks associated with AI highlight both familiar challenges and new, emerging concerns. Traditional issues like bias, discrimination, and scams remain prevalent, often due to inadequate mitigation efforts. However, there is growing apprehension surrounding novel risks that current regulations do not fully address. The rapid development and deployment of AI raise concerns about the need for enhanced testing, transparency, and oversight to mitigate potential harms. Public unease is exacerbated by insufficient testing protocols and a lack of detailed understanding of AI system operations.The risks regarding which Australians raised concerns are broadly categorized into technical, unpredictability and opacity, domain-specific, systemic, and unforeseen risks. Technical risks include concerns about compromised outputs due to design inaccuracies, non-representative data, or biases in training data, leading to unfair outcomes, especially in critical areas like healthcare. Unpredictability and opacity arise from opaque AI systems that make it difficult to identify harms (black box issue), hinder error prediction, accountability establishment, and outcome explanation. Domain-specific risks involve AI's exacerbation of existing harms or systems, such as the spread of online harms through deep fake pornography and the undermining of social cohesion through misinformation.Systemic risks are highlighted, including concerns about highly capable and potentially dangerous frontier models and the broader accessibility and usability of generative AI models, which can lead to unprecedented harm at an unprecedented pace. Additionally, the rapid evolution of AI presents unforeseen risks, challenging regulatory frameworks to remain agile and adaptable without stifling innovation. Submissions stress the need for flexible regulatory approaches responsive to emerging risks, requiring governments to swiftly address evolving challenges while ensuring regulatory frameworks remain future-proof and adaptable.Submissions by businesses call for amendments to existing laws and regulatory guidance, whereas individual consumers were more likely to prefer a dedicated AI act to tackle these issues. However, there was broad agreement among submissions that voluntary guardrails are insufficient, suggesting that mandatory guardrails should be targeted primarily at high-risk AI applications to facilitate innovation in low-risk areas.It was emphasized that any regulatory framework should align with international approaches and remain adaptable. Additionally, submissions highlighted the importance of non-regulatory measures, such as education and capacity building, to foster public trust and encourage adoption of AI technologies.

The Government’s Response to the Consultation

To address the notable lack of public trust in the safe and responsible design, development, deployment, and use of AI systems, hampering business adoption and public acceptance, the government of Australia is indicating that it will take a risk-based approach, particularly focusing on implementing additional safeguards to mitigate potential harms in high-risk scenarios, such as workplace discrimination, the justice system, surveillance, or self-driving cars. The government is yet unclear on whether this will require only amending existing laws or a comprehensive AI law. Additionally, the government intends to establish a temporary expert advisory group to aid in developing these protective measures.The government recognizes that mandatory safeguards for the development and deployment of AI are necessary in high-risk settings as harms can, at worst, be irreversible, meaning we might only get one shot at getting this right, at ensuring that harms are prevented from occurring in the first place. Mandatory safeguards are also intended to be complemented by voluntary safety standards, as has been the approach internationally.The interim response also highlights ongoing efforts in strengthening existing and introducing new laws, for example the privacy law reform, a review of the Online Safety Act 2021, and legislative efforts to enact laws relating to misinformation and disinformation.At the same time, in low-risk settings, the sentiment is that AI should be allowed to flourish uninhibitedly, for example to filter spam emails or to optimize business operations.

Concerns

The focus in Australia, as elsewhere, seems to be on known risks without an eye towards smarter than human AI that might be achieved in the future with more far-reaching consequences than those contemplated in mainstream conversation. The approach is comparable to common consumer protection or environmental law. Strong arguments can be made that risk regulation alone is not an effective approach in the face of AI because it assumes that a bit of tweaking will suffice to properly govern it. However, according to Margot E. Kaminski’s article The Developing Law of AI: A Turn To Risk Regulation: “The deontological harms raised by the use of AI systems—to autonomy, dignity, privacy, equality, and other human rights—are not inherently well-suited to a risk regulation framework.” The questions that should be asked before we assume that we can prevent harms from occurring is whether the technology should be developed or used in the way that it is today.For example, the use of the vast amount of data for the development of LLMs poses significant threats to personal information included in this data. There may be little visibility as to what personal information is in these data sets. That makes it very difficult for downstream users to use these models confidently because they are inevitably exposed to risks of non-compliance with data protection requirements.

Possible Solutions Addressing Privacy Concerns

A little-pursued avenue is to filter out personal information before the model is trained on data sets containing personal information. But this doesn’t have to be as onerous as it seems. With the support of Private AI’s technology businesses could meet, for example, the personal data minimization requirement that demands that only personal data that is necessary to achieve the stipulated purpose is used. In the case of training an AI model, depending on the specific use case, personal information may not at all be required and hence prohibited from being included in the data set.Private AI’s technology can identify and report on personal identifiers included in large unstructured data sets and replace them with synthetic data or placeholders. For many use cases, this approach that relies on context-aware algorithms trained by data experts in multiple languages is able to preserve data utility while maximizing data privacy. Try it on your own data here.

Data Left Behind: AI Scribes’ Promises in Healthcare

Why is linguistics essential when dealing with healthcare data?

Why Health Data Strategies Fail Before They Start

Private AI to Redefine Enterprise Data Privacy and Compliance with NVIDIA

EDPB’s Pseudonymization Guideline and the Challenge of Unstructured Data

HHS’ proposed HIPAA Amendment to Strengthen Cybersecurity in Healthcare and how Private AI can Support Compliance

Japan's Health Data Anonymization Act: Enabling Large-Scale Health Research

What the International AI Safety Report 2025 has to say about Privacy Risks from General Purpose AI

Private AI 4.0: Your Data’s Potential, Protected and Unlocked

How Private AI Facilitates GDPR Compliance for AI Models: Insights from the EDPB's Latest Opinion

Navigating the New Frontier of Data Privacy: Protecting Confidential Company Information in the Age of AI

Belgium’s Data Protection Authority on the Interplay of the EU AI Act and the GDPR

Enhancing Compliance with US Privacy Regulations for the Insurance Industry Using Private AI

Navigating Compliance with Quebec’s Act Respecting Health and Social Services Information Through Private AI’s De-identification Technology

Unlocking New Levels of Accuracy in Privacy-Preserving AI with Co-Reference Resolution

Strengthened Data Protection Enforcement on the Horizon in Japan

How Private AI Can Help to Comply with Thailand's PDPA

How Private AI Can Help Financial Institutions Comply with OSFI Guidelines

The American Privacy Rights Act – The Next Generation of Privacy Laws

How Private AI Can Help with Compliance under China’s Personal Information Protection Law (PIPL)

PII Redaction for Reviews Data: Ensuring Privacy Compliance when Using Review APIs

Independent Review Certifies Private AI’s PII Identification Model as Secure and Reliable

To Use or Not to Use AI: A Delicate Balance Between Productivity and Privacy

To Use or Not to Use AI: A Delicate Balance Between Productivity and Privacy

News from NIST: Dioptra, AI Risk Management Framework (AI RMF) Generative AI Profile, and How PII Identification and Redaction can Support Suggested Best Practices

Handling Personal Information by Financial Institutions in Japan – The Strict Requirements of the FSA Guidelines

日本における金融機関の個人情報の取り扱い - 金融庁ガイドラインの要件

Leveraging Private AI to Meet the EDPB’s AI Audit Checklist for GDPR-Compliant AI Systems

Who is Responsible for Protecting PII?

How Private AI can help the Public Sector to Comply with the Strengthening Cyber Security and Building Trust in the Public Sector Act, 2024

A Comparison of the Approaches to Generative AI in Japan and China

Updated OECD AI Principles to keep up with novel and increased risks from general purpose and generative AI

Is Consent Required for Processing Personal Data via LLMs?

The evolving landscape of data privacy legislation in healthcare in Germany

The CIO’s and CISO’s Guide for Proactive Reporting and DLP with Private AI and Elastic

The Evolving Landscape of Health Data Protection Laws in the United States

Comparing Privacy and Safety Concerns Around Llama 2, GPT4, and Gemini

How to Safely Redact PII from Segment Events using Destination Insert Functions and Private AI API

WHO’s AI Ethics and Governance Guidance for Large Multi-Modal Models operating in the Health Sector – Data Protection Considerations

How to Protect Confidential Corporate Information in the ChatGPT Era

Unlocking the Power of Retrieval Augmented Generation with Added Privacy: A Comprehensive Guide

Leveraging ChatGPT and other AI Tools for Legal Services

Leveraging ChatGPT and other AI tools for HR

Leveraging ChatGPT in the Banking Industry

Law 25 and Data Transfers Outside of Quebec

The Colorado and Connecticut Data Privacy Acts

Unlocking Compliance with the Japanese Data Privacy Act (APPI) using Private AI

Tokenization and Its Benefits for Data Protection

Private AI Launches Cloud API to Streamline Data Privacy

Processing of Special Categories of Data in Germany

End-to-end Privacy Management

Privacy Breach Reporting Requirements under Law25

Migrating Your Privacy Workflows from Amazon Comprehend to Private AI

A Comparison of the Approaches to Generative AI in the US and EU

Benefits of AI in Healthcare and Data Sources (Part 1)

Privacy Attacks against Data and AI Models (Part 3)

Risks of Noncompliance and Challenges around Privacy-Preserving Techniques (Part 2)

Enhancing Data Lake Security: A Guide to PII Scanning in S3 buckets

The Costs of a Data Breach in the Healthcare Sector and its Privacy Compliance Implications

Navigating GDPR Compliance in the Life Cycle of LLM-Based Solutions

What’s New in Version 3.8

How to Protect Your Business from Data Leaks: Lessons from Toyota and the Department of Home Affairs

New York's Acceptable Use of AI Policy: A Focus on Privacy Obligations

Safeguarding Personal Data in Sentiment Analysis: A Guide to PII Anonymization

Changes to South Korea’s Personal Information Protection Act to Take Effect on March 15, 2024

Australia’s Plan to Regulate High-Risk AI

How Private AI can help comply with the EU AI Act

Comment la Loi 25 Impacte l'Utilisation de ChatGPT et de l'IA en Général

Endgültiger Entwurf des Gesetzes über Künstliche Intelligenz – Datenschutzpflichten der KI-Modelle mit Allgemeinem Verwendungszweck

How Law25 Impacts the Use of ChatGPT and AI in General

Is Salesforce Law25 Compliant?

Creating De-Identified Embeddings

Exciting Updates in 3.7

EU AI Act Final Draft – Obligations of General-Purpose AI Systems relating to Data Privacy

FTC Privacy Enforcement Actions Against AI Companies

The CCPA, CPRA, and California's Evolving Data Protection Landscape

HIPAA Compliance – Expert Determination Aided by Private AI

Private AI Software As a Service Agreement

EU's Review of Canada's Data Protection Adequacy: Implications for Ongoing Privacy Reform

Acceptable Use Policy

ISO/IEC 42001: A New Standard for Ethical and Responsible AI Management

Reviewing OpenAI's 31st Jan 2024 Privacy and Business Terms Updates

Comparing OpenAI vs. Azure OpenAI Services

Quebec’s Draft Regulation Respecting the Anonymization of Personal Information

Version 3.6 Release: Enhanced Streaming, Auto Model Selection, and More in Our Data Privacy Platform

Brazil's LGPD: Anonymization, Pseudonymization, and Access Requests

LGPD do Brasil: Anonimização, Pseudonimização e Solicitações de Acesso à Informação

Canada’s Principles for Responsible, Trustworthy and Privacy-Protective Generative AI Technologies and How to Comply Using Private AI

Private AI Named One of The Most Innovative RegTech Companies by RegTech100

Data Integrity, Data Security, and the New NIST Cybersecurity Framework

Safeguarding Privacy with Commercial LLMs

Cybersecurity in the Public Sector: Protecting Vital Services

Privacy Impact Assessment (PIA) Requirements under Law25

Elevate Your Experience with Version 3.5

Fine-Tuning LLMs with a Focus on Privacy

GDPR in Germany: Challenges of German Data Privacy (Part 2)

Comply with US Executive Order on Safe, Secure, and Trustworthy Artificial Intelligence using Private AI

How to Comply with EU AI Act using PrivateGPT

Navigating the Privacy Paradox: A Guide to Ethical Fine-Tuning of Large Language Models

Adding Privacy to LangChain with Private AI