Canada’s Principles for Responsible, Trustworthy and Privacy-Protective Generative AI Technologies and How to Comply Using Private AI

Dec 12, 2023
Share this post
Sharing to FacebookSharing to LinkedInSharing to XSharing to Email

The realm of generative AI, encompassing technologies that generate content like text, images, and videos, have seen a significant surge in usage and development. In response, the Office of the Privacy Commissioner of Canada (OPC) has introduced key privacy principles tailored to generative AI technologies on December 7, 2023. This framework is crucial for organizations navigating the complex intersection of AI innovation and data privacy. Here, we explore the significance of these principles for generative AI development and use and the pivotal role of Private AI’s technology in ensuring compliance with a broad subset of these principles.

1. Legal Authority and Consent

The Principle: Legal authority for collecting, using, or disclosing personal data for use in generative AI systems, whether that is training, development, deployment, operation, or decommissioning of a generative AI system, is as crucial as it is for any other use case. The OPC emphasises that this principle also applies when data containing personal information is obtained from third parties or when an inference is drawn from personal information, as drawing inferences is considered collection for which legal authority is required. Oftentimes, the legal authority required will be consent. It may not be easy to obtain valid consent, the first hurdle being that training data scraped from the internet may contain an unmanageable amount of personal data.Private AI’s Role: While Private AI’s technology does not directly handle consent, it can aid organizations in minimizing the scope of personal data used, reducing the breadth of consent required. Private AI can detect, redact, or replace personal information with synthetic data. It does so in 52 languages, various different file types, and with unparalleled accuracy.

2. Limiting Collection, Use, and Disclosure to what is Necessary

The Principle: Data collection, use and disclosure must be restricted to what is necessary for the AI model’s training and operation. Unnecessary data collection can lead to privacy risks and regulatory non-compliance. The OPC proposes the use of anonymized, synthetic, or de-identified data rather than personal information where the latter is not required to fulfill the identified appropriate purpose(s). The OPC further reminds developers of AI systems that personal information available on the internet is not outside of the purview of applicable privacy laws.Private AI’s Advantage: Private AI’s technology aids in ensuring that only essential data is utilized for AI training and operations, helping to render personal information anonymized or de-identified, or by creating synthetic data in place of personal information. For the use of AI systems, organizations are well advised to use Private AI’s PrivateGPT, which ensures that user prompts are sanitized – i.e., personal information is filtered out from the prompts – before it is sent to the AI system. Depending on the use case, the personal information to be excluded from the prompt can be selected on a very granular level to ensure the prompt’s utility. Before the system’s answer is sent back to the user, the personal information is automatically inserted into the output, without ever being disclosed to the model.

3. Openness

The Principle: The openness principle is very broad and asks for transparency by developers, providers, and organizations using AI systems regarding collection, use, and disclosure of personal information, associated risks and their mitigation, the training data set(s), whether an AI system will be used as part of a decision-making process, and more.Private AI’s Role: Private AI can help with one aspect of compliance with the openness principle: To be open about the use of personal information firstly requires knowing what personal information is being used, if using it is indeed necessary for the use case. Given the enormous amount of data AI models are usually trained on, this is not an easy ask. Private AI’s algorithm can detect personal information at scale and make otherwise overwhelmingly large data sets reportable.

4. Accountability

The Principle: Accountability is a big topic that includes, among other aspects, an internal governance structure and clearly defined roles and responsibilities. It also importantly requires explainability of the model’s output. The OPC advises that one aspect of achieving this is conducting Privacy Impact Assessments (PIA) and/or Algorithmic Impact Assessments (AIA) to identify and mitigate against privacy and other fundamental rights impacts.Private AI’s Role: For PIAs and AIAs it is again crucial to know what the model has been trained or fine-tuned on, as these models are all about data, and lots of it. Private AI can help with this onerous task.

5. Access and Correction

The Principle: The principle of individual access necessitates that users can access their personal data used by generative AI systems. They also have a right to ask for their information to be corrected, especially if the information is included in the model’s output. Both of these requirements pose a particular challenge in the context of generative AI. These models do not in any straightforward way store the source they are trained on, so that it could be retrieved like from a folder. However, the encoded training data may be spewed out in production. Removing incorrect information from AI systems can therefore mean that the model has to be retrained, which is expensive and time consuming.Private AI’s Role: Private AI’s technology can rapidly identify and categorize personal data within AI training data, whether this is pre-training data or stored user prompts, aiding organizations in efficiently responding to user access or correction requests. There are limits to this, though. The technology can only help identify what went into the model – how to get it out or corrected remains a challenge, which is another great reason for ensuring that as little personal information is contained in training data as possible.

6. Data Safeguards in Generative AI Operations

The Principle: Implementing safeguards for personal information is essential in generative AI, particularly given the vast amount of data these systems can process and store and the pervasive proliferation and impact these tools are expected to have on society.Private AI’s Contribution: Aside from the previously discussed help with anonymization and pseudonymization, Private AI’s tools can also aid in mitigating bias. When sensitive identifiers such as gender, race, origin, and religion are removed from the model’s training data, the generated output of the model is necessarily more neutral and less likely to be biased or discriminatory.

Conclusion: Private AI as an Ally in Generative AI Privacy Compliance

In the rapidly evolving field of generative AI, adhering to Canadian privacy principles is a complex but critical endeavor. Technologies like Private AI’s detection and redaction products play a crucial role in this landscape, offering tools for anonymization, pseudonymization, and synthetic data generation that can help protect privacy and reduce bias in model outputs. While challenges like retraining AI models and preventing data extraction persist, leveraging Private AI’s solutions is a substantial step towards responsible, trustworthy, and privacy-compliant AI development and usage in Canada. Try it on your own data using our web demo or sign up to get a free API key.

Data Left Behind: AI Scribes’ Promises in Healthcare

Data Left Behind: Healthcare’s Untapped Goldmine

The Future of Health Data: How New Tech is Changing the Game

Why is linguistics essential when dealing with healthcare data?

Why Health Data Strategies Fail Before They Start

Private AI to Redefine Enterprise Data Privacy and Compliance with NVIDIA

EDPB’s Pseudonymization Guideline and the Challenge of Unstructured Data

HHS’ proposed HIPAA Amendment to Strengthen Cybersecurity in Healthcare and how Private AI can Support Compliance

Japan's Health Data Anonymization Act: Enabling Large-Scale Health Research

What the International AI Safety Report 2025 has to say about Privacy Risks from General Purpose AI

Private AI 4.0: Your Data’s Potential, Protected and Unlocked

How Private AI Facilitates GDPR Compliance for AI Models: Insights from the EDPB's Latest Opinion

Navigating the New Frontier of Data Privacy: Protecting Confidential Company Information in the Age of AI

Belgium’s Data Protection Authority on the Interplay of the EU AI Act and the GDPR

Enhancing Compliance with US Privacy Regulations for the Insurance Industry Using Private AI

Navigating Compliance with Quebec’s Act Respecting Health and Social Services Information Through Private AI’s De-identification Technology

Unlocking New Levels of Accuracy in Privacy-Preserving AI with Co-Reference Resolution

Strengthened Data Protection Enforcement on the Horizon in Japan

How Private AI Can Help to Comply with Thailand's PDPA

How Private AI Can Help Financial Institutions Comply with OSFI Guidelines

The American Privacy Rights Act – The Next Generation of Privacy Laws

How Private AI Can Help with Compliance under China’s Personal Information Protection Law (PIPL)

PII Redaction for Reviews Data: Ensuring Privacy Compliance when Using Review APIs

Independent Review Certifies Private AI’s PII Identification Model as Secure and Reliable

To Use or Not to Use AI: A Delicate Balance Between Productivity and Privacy

To Use or Not to Use AI: A Delicate Balance Between Productivity and Privacy

News from NIST: Dioptra, AI Risk Management Framework (AI RMF) Generative AI Profile, and How PII Identification and Redaction can Support Suggested Best Practices

Handling Personal Information by Financial Institutions in Japan – The Strict Requirements of the FSA Guidelines

日本における金融機関の個人情報の取り扱い - 金融庁ガイドラインの要件

Leveraging Private AI to Meet the EDPB’s AI Audit Checklist for GDPR-Compliant AI Systems

Who is Responsible for Protecting PII?

How Private AI can help the Public Sector to Comply with the Strengthening Cyber Security and Building Trust in the Public Sector Act, 2024

A Comparison of the Approaches to Generative AI in Japan and China

Updated OECD AI Principles to keep up with novel and increased risks from general purpose and generative AI

Is Consent Required for Processing Personal Data via LLMs?

The evolving landscape of data privacy legislation in healthcare in Germany

The CIO’s and CISO’s Guide for Proactive Reporting and DLP with Private AI and Elastic

The Evolving Landscape of Health Data Protection Laws in the United States

Comparing Privacy and Safety Concerns Around Llama 2, GPT4, and Gemini

How to Safely Redact PII from Segment Events using Destination Insert Functions and Private AI API

WHO’s AI Ethics and Governance Guidance for Large Multi-Modal Models operating in the Health Sector – Data Protection Considerations

How to Protect Confidential Corporate Information in the ChatGPT Era

Unlocking the Power of Retrieval Augmented Generation with Added Privacy: A Comprehensive Guide

Leveraging ChatGPT and other AI Tools for Legal Services

Leveraging ChatGPT and other AI tools for HR

Leveraging ChatGPT in the Banking Industry

Law 25 and Data Transfers Outside of Quebec

The Colorado and Connecticut Data Privacy Acts

Unlocking Compliance with the Japanese Data Privacy Act (APPI) using Private AI

Tokenization and Its Benefits for Data Protection

Private AI Launches Cloud API to Streamline Data Privacy

Processing of Special Categories of Data in Germany

End-to-end Privacy Management

Privacy Breach Reporting Requirements under Law25

Migrating Your Privacy Workflows from Amazon Comprehend to Private AI

A Comparison of the Approaches to Generative AI in the US and EU

Benefits of AI in Healthcare and Data Sources (Part 1)

Privacy Attacks against Data and AI Models (Part 3)

Risks of Noncompliance and Challenges around Privacy-Preserving Techniques (Part 2)

Enhancing Data Lake Security: A Guide to PII Scanning in S3 buckets

The Costs of a Data Breach in the Healthcare Sector and its Privacy Compliance Implications

Navigating GDPR Compliance in the Life Cycle of LLM-Based Solutions

What’s New in Version 3.8

How to Protect Your Business from Data Leaks: Lessons from Toyota and the Department of Home Affairs

New York's Acceptable Use of AI Policy: A Focus on Privacy Obligations

Safeguarding Personal Data in Sentiment Analysis: A Guide to PII Anonymization

Changes to South Korea’s Personal Information Protection Act to Take Effect on March 15, 2024

Australia’s Plan to Regulate High-Risk AI

How Private AI can help comply with the EU AI Act

Comment la Loi 25 Impacte l'Utilisation de ChatGPT et de l'IA en Général

Endgültiger Entwurf des Gesetzes über Künstliche Intelligenz – Datenschutzpflichten der KI-Modelle mit Allgemeinem Verwendungszweck

How Law25 Impacts the Use of ChatGPT and AI in General

Is Salesforce Law25 Compliant?

Creating De-Identified Embeddings

Exciting Updates in 3.7

EU AI Act Final Draft – Obligations of General-Purpose AI Systems relating to Data Privacy

FTC Privacy Enforcement Actions Against AI Companies

The CCPA, CPRA, and California's Evolving Data Protection Landscape

HIPAA Compliance – Expert Determination Aided by Private AI

Private AI Software As a Service Agreement

EU's Review of Canada's Data Protection Adequacy: Implications for Ongoing Privacy Reform

Acceptable Use Policy

ISO/IEC 42001: A New Standard for Ethical and Responsible AI Management

Reviewing OpenAI's 31st Jan 2024 Privacy and Business Terms Updates

Comparing OpenAI vs. Azure OpenAI Services

Quebec’s Draft Regulation Respecting the Anonymization of Personal Information

Version 3.6 Release: Enhanced Streaming, Auto Model Selection, and More in Our Data Privacy Platform

Brazil's LGPD: Anonymization, Pseudonymization, and Access Requests

LGPD do Brasil: Anonimização, Pseudonimização e Solicitações de Acesso à Informação

Canada’s Principles for Responsible, Trustworthy and Privacy-Protective Generative AI Technologies and How to Comply Using Private AI

Private AI Named One of The Most Innovative RegTech Companies by RegTech100

Data Integrity, Data Security, and the New NIST Cybersecurity Framework

Safeguarding Privacy with Commercial LLMs

Cybersecurity in the Public Sector: Protecting Vital Services

Privacy Impact Assessment (PIA) Requirements under Law25

Elevate Your Experience with Version 3.5

Fine-Tuning LLMs with a Focus on Privacy

GDPR in Germany: Challenges of German Data Privacy (Part 2)

Comply with US Executive Order on Safe, Secure, and Trustworthy Artificial Intelligence using Private AI

How to Comply with EU AI Act using PrivateGPT