Regulating AI-Generated Child Sexual Abuse Material in Indonesia: State Obligation under Human Rights Standards
Keywords:
Accountability, Artificial Intelligence, Child Protection, Child Sexual Abuse Material, Human Rights-Based ApproachAbstract
Generative artificial intelligence (AI) has created new forms of child sexual abuse material that challenge existing child protection and cybercrime frameworks. This study explores the extent to which the national legal framework can address AI-generated child sexual abuse material (AI-CSAM), including semi-synthetic and fully synthetic materials. It also evaluates whether the state has fulfilled its obligations to protect children’s rights, as a component of human rights, in digital environments. This study employed a doctrinal legal research methodology, utilizing statutory and conceptual approaches. The analysis is grounded in a human rights-based approach and the theory of state obligations, with a focus on four principles of state obligation in the context of children’s rights protection: non-discrimination, the best interests of the child, participation, accountability, and the duties to respect, protect, and fulfill children’s rights. The study finds that existing legal frameworks function in a fragmented and insufficiently responsive manner to the technological characteristics of AI-generated abuse materials, particularly deepfake manipulation, prompt-based generation, synthetic victims, the abuse of datasets, and the legal obligations of digital platforms and AI developers. The state’s obligations remain only partially fulfilled due to inadequate procedures for handling digital evidence, preventing revictimization, regulating corporate responsibility, facilitating child-friendly mechanism for content reporting and removal, supporting victim recovery, coordinating institutions, and strengthening AI-specific enforcement capacity. This study conceptualizes AI-CSAM as a distinct form of technology-enabled sexual exploitation, extending beyond conventional online abuse and deepfake cases. The study argues that a more explicit, child-centered, and preventive legal framework is necessary to ensure effective protection, reporting, content removal, accountability, and recovery.
Downloads
References
Amalia, Ayu Riska, Diva Pitaloka, and Adhitya Nini Rizki Apriliana. “Gender Discrimination in Artificial Intelligence: An International Human Rights Law Perspective and the Quest for Binding Regulation.” Unram Law Review 9, no. 2 (2025): 311–333. https://doi.org/10.29303/ulrev.v9i2.450.
Antoro, Hendri, Danrivanto Budhijanto, and Somawijaya. “Admissibility of Artificial Intelligence as Electronic Evidence: Comparative Perspectives from Indonesia, the United States, and Japan.” Jurnal IUS Kajian Hukum dan Keadilan 14, no. 1 (2026): 122–139. https://doi.org/10.29303/ius.v14i1.1880.
Armiwulan, Hesti, Rofi Aulia Rahman, Valentino Nathanael Prabowo, and József Hajdú. “Artificial Intelligence and Its Challenges to Elections in Indonesia: A Legal Analysis.” Jambura Law Review 6, no. 2 (2024): 264–285. https://doi.org/10.33756/jlr.v6i2.24243.
Ayalew, Yohannes Eneyew, Valerie Verdoodt, and Eva Lievens. “General Comment No. 25 on Children’s Rights in Relation to the Digital Environment: Implications for Children’s Right to Privacy and Data Protection in Africa.” Human Rights Law Review 24, no. 3 (2024).
Brown, Rick, et al. “Artificial Intelligence and Child Sexual Abuse: A Rapid Evidence Assessment.” Trends & Issues in Crime and Criminal Justice, no. 711 (2025). https://www.aic.gov.au/sites/default/files/2025-01/ti711_artificial_intelligence_and_child_sexual_abuse.pdf
Carr, John. “Child Abuse, Child Pornography and the Internet.” International Review of Law, Computers & Technology 18, no. 2 (2004): 169–184.
Christensen, L. S., D. Moritz, and A. Pearson. “Psychological Perspectives of Virtual Child Sexual Abuse Material.” Sexuality & Culture 25 (2021): 1354–1368. https://doi.org/10.1007/s12119-021-09820-1
Ciardha, Caoilte Ó., John Buckley, and Rebecca S. Portnoff. “AI-Generated Child Sexual Abuse Material: What’s the Harm?” AI & Society (2026). https://doi.org/10.1007/s00146-026-02932-y.
Committee on the Rights of the Child. Concluding Observations on the Combined Fifth and Sixth Periodic Reports of Indonesia. U.N. Doc. CRC/C/IDN/CO/5-6. July 28, 2025.
Committee on the Rights of the Child. General Comment No. 12 (2009): The Right of the Child to Be Heard. U.N. Doc. CRC/C/GC/12. July 20, 2009.
Committee on the Rights of the Child. General Comment No. 13 (2011): The Right of the Child to Freedom from All Forms of Violence. U.N. Doc. CRC/C/GC/13. April 18, 2011.
Committee on the Rights of the Child. General Comment No. 14 (2013) on the Right of the Child to Have His or Her Best Interests Taken as a Primary Consideration. U.N. Doc. CRC/C/GC/14. May 29, 2013.
Committee on the Rights of the Child. General Comment No. 20 (2016) on the Implementation of the Rights of the Child during Adolescence. U.N. Doc. CRC/C/GC/20. December 6, 2016.
Committee on the Rights of the Child. General Comment No. 25 (2021) on Children’s Rights in Relation to the Digital Environment. U.N. Doc. CRC/C/GC/25. March 2, 2021.
Committee on the Rights of the Child. Guidelines regarding the Implementation of the Optional Protocol to the Convention on the Rights of the Child on the Sale of Children, Child Prostitution and Child Pornography. U.N. Doc. CRC/C/156. September 10, 2019.
Danaher, John. “The Law and Ethics of Deepfakes.” Oxford Journal of Legal Studies 37, no. 3 (2017): 534–561. https://doi.org/10.1093/ojls/gqw033
Djeffal, Christian “Children’s Rights by Design and Internet Governance: Revisiting General Comment No. 25 (2021) on Children’s Rights in Relation to the Digital Environment,” Laws 11, no. 6 (2022): 84, https://doi.org/10.3390/laws11060084
Dushi, Desara, Nertil Berdufi, and Anastasia Karagianni. “The Legal Framework and Legal Gaps for AI-Generated Child Sexual Abuse Material.” Computer Law & Security Review 59 (2025): 106205.
Ebers, Martin. “Truly Risk-Based Regulation of Artificial Intelligence: How to Implement the EU’s AI Act.” European Journal of Risk Regulation 16, no. 2 (2025): 684–703.
ECPAT International. Disrupting Harm: Evidence on Online Child Sexual Exploitation and Abuse. Bangkok: ECPAT International, 2021.
ECPAT, INTERPOL, and UNICEF. Disrupting Harm in Indonesia: Evidence on Online Child Sexual Exploitation and Abuse. Bangkok: ECPAT International, 2022.
European Parliament and Council of the European Union. Regulation (EU) 2024/1689 of 13 June 2024 Laying Down Harmonised Rules on Artificial Intelligence. Official Journal of the European Union, L 2024/1689. July 12, 2024.
Foster, Jennifer. “Pixelated Harm: An Analysis of the Impact of AI-Generated Images on CSAM Criminalization and Child Safety.” Oklahoma City University Law Review 49, no. 3 (2025): 425–440.
Global Partnership to End Violence Against Children. “Generative AI and Child Sexual Abuse Material (CSAM).” Global Child Exploitation Policy and Advocacy Centre. Accessed May 5, 2026. https://www.globalchildexploitationpolicy.org/policy-advocacy/generative-ai-csam
Henry, Nicola, and Anastasia Powell. “Technology-Facilitated Sexual Violence: A Literature Review of Empirical Research.” Trauma, Violence, & Abuse 19, no. 2 (2018): 195–208. https://doi.org/10.1177/1524838016650189
Hunt, Paul, and Gunilla Backman. “Health Systems and the Right to the Highest Attainable Standard of Health.” Health and Human Rights 10, no. 1 (2008): 81–92.
Indonesia. Peraturan Menteri Komunikasi dan Informatika Nomor 5 Tahun 2020 tentang Penyelenggara Sistem Elektronik Lingkup Privat.
Indonesia. Peraturan Presiden Nomor 53 Tahun 2017 tentang Badan Siber dan Sandi Negara.
Indonesia. Peraturan Presiden Nomor 133 Tahun 2017 tentang Perubahan atas Peraturan Presiden Nomor 53 Tahun 2017 tentang Badan Siber dan Sandi Negara.
Indonesia. Peraturan Presiden Nomor 174 Tahun 2024 tentang Kementerian Komunikasi dan Digital.
Indonesia. Undang-Undang Dasar Negara Republik Indonesia Tahun 1945.
Indonesia. Undang-Undang Nomor 23 Tahun 2002 tentang Perlindungan Anak. Lembaran Negara Republik Indonesia Tahun 2002 Nomor 109. Tambahan Lembaran Negara Republik Indonesia Nomor 4235.
Indonesia. Undang-Undang Nomor 35 Tahun 2014 tentang Perubahan atas Undang-Undang Nomor 23 Tahun 2002 tentang Perlindungan Anak. Lembaran Negara Republik Indonesia Tahun 2014 Nomor 297.
Indonesia. Undang-Undang Nomor 44 Tahun 2008 tentang Pornografi.
Indonesia. Undang-Undang Nomor 12 Tahun 2022 tentang Tindak Pidana Kekerasan Seksual. Lembaran Negara Republik Indonesia Tahun 2022 Nomor 120. Tambahan Lembaran Negara Republik Indonesia Nomor 6792.
Indonesia. Undang-Undang Nomor 1 Tahun 2024 tentang Perubahan Kedua atas Undang-Undang Nomor 11 Tahun 2008 tentang Informasi dan Transaksi Elektronik. Lembaran Negara Republik Indonesia Tahun 2024.
Interagency Working Group in Luxembourg. Terminology Guidelines for the Protection of Children from Sexual Exploitation and Sexual Abuse. 2nd ed. Luxembourg: ECPAT International, 2025. https://icmec.org.au/wp-content/uploads/2025/04/Second-Edition-Terminology-Guidelines-final.pdf
Interagency Working Group on Sexual Exploitation of Children. Terminology Guidelines for the Protection of Children from Sexual Exploitation and Sexual Abuse. Luxembourg: ECPAT International, 2016.
Internet Watch Foundation. AI-Generated CSAM: A Threat Assessment. Cambridge: Internet Watch Foundation, 2023.
Internet Watch Foundation. How AI Is Being Abused to Create Child Sexual Abuse Imagery. Cambridge: Internet Watch Foundation, 2023.
Kementerian Kominfo RI. “Direktorat Siber Polri, Tameng Hadapi Kejahatan Siber di Era Digital.” September 27, 2024.
Kementerian Komunikasi dan Digital Republik Indonesia. “Pemerintah Putus Akses Sementara Grok demi Lindungi Masyarakat di Ruang Digital.” DJED Komdigi. Accessed April 21, 2026. https://djed.komdigi.go.id/news/pemerintah-putus-akses-sementara-grok-demi-lindungi-masyarakat-di-ruang-digital.
Lazaridou, Maria. The Criminalization of AI-Generated Child Sexual Abuse Material: Challenges and Prospects under International and European Law. Master’s thesis, Utrecht University, 2024. https://studenttheses.uu.nl/bitstream/handle/20.500.12932/48359/Master_Thesis_Maria_Lazaridou.pdf
Lembaga Bantuan Hukum Asosiasi Perempuan Indonesia untuk Keadilan. Laporan Kekerasan Seksual Berbasis Digital 2023. Jakarta: LBH APIK Jakarta, 2024.
Loney-Howes, Rachel. “Technology-Facilitated Re-Victimization: How Video Evidence of Sexual Violence Can Harm Survivors.” Theoretical Criminology 27, no. 1 (2023): 94–112.
McGlynn, Clare, and Erika Rackley. “Image-Based Sexual Abuse.” Oxford Journal of Legal Studies 37, no. 3 (2017): 534–561. https://doi.org/10.1093/ojls/gqw033
McGlynn, Clare, Erika Rackley, and Ruth Houghton. “Beyond ‘Revenge Porn’: The Continuum of Image-Based Sexual Abuse.” Feminist Legal Studies 25, no. 1 (2017): 25–46. https://doi.org/10.1007/s10691-017-9343-2
Mertokusumo, Sudikno. Penemuan Hukum: Sebuah Pengantar. Yogyakarta: Liberty, 2007.
Mitchell, Kimberly J., Ateret Gewirtz-Meydan, Lisa M. Jones, David Finkelhor, and Heather A. Turner. “Identifying Subtypes of Image-Based Sexual Abuse and Their Associations with Harms.” Child Abuse & Neglect 160 (2025): 107205.
Muthmainnah, Yulianti, Zakiyuddin Baidhawy, Yusron Razak, and Ilham Mundzir. “Zakat Initiatives for Supporting Victims of Violence against Women and Children in Indonesia.” Ijtihad: Jurnal Wacana Hukum Islam dan Kemanusiaan24, no. 2 (2024): 331–357. https://doi.org/10.18326/ijtihad.v24i2.331-357.
Parti, Katalin, and Judit Szabó. “The Legal Challenges of Realistic and AI-Driven Child Sexual Abuse Material: Regulatory and Enforcement Perspectives in Europe.” Laws 13, no. 67 (2024). https://doi.org/10.3390/laws13060067.
Paul, Bryant, and Daniel G. Linz. “The Effects of Exposure to Virtual Child Pornography on Viewer Cognitions and Attitudes toward Deviant Sexual Behavior.” Communication Research 35, no. 1 (2008): 3–38. https://doi.org/10.1177/0093650207309359
Pocol, A., et al. “Seeing Is No Longer Believing: A Survey on the State of Deepfakes, AI-Generated Humans, and Other Nonveridical Media.” In Advances in Computer Graphics, edited by B. Sheng, L. Bi, et al., 434. Lecture Notes in Computer Science 14496. Cham: Springer, 2023. https://doi.org/10.1007/978-3-031-50072-5_34
Quayle, Ethel, and Thomas Jones. “The Challenges of Identifying and Classifying Child Sexual Abuse Material.” Sexual Abuse 31, no. 2 (2019): 173–196. https://doi.org/10.1177/1079063217724768.
Rahayu, Sri, Monalisa, Yulia Monita, and Melyana Sugiharto. “Legal Protection for Children in Cases of Online Sexual Abuse: A Comparative Study.” Jambe Law Journal 5, no. 1 (2022): 91–92. https://doi.org/10.22437/jlj.v5i1.18164.
Rahman, Abdul, Zainal Amin Ayub, and Ratnawati. “Legal Framework for Protecting Children from Commercial Sexual Exploitation.” Volksgeist: Jurnal Ilmu Hukum dan Konstitusi 8, no. 1 (2025): 87–110. https://doi.org/10.24090/volksgeist.v8i1.13156.
Ramadhani, Evyta Rosiyanti, Ayudya Rizqi Rachmawati, and Roro Hera Kurnikova. “Integrating Islamic Values with the Right to Be Forgotten: A Legal Approach to Addressing Deepfake Pornography in Indonesia.” De Jure: Jurnal Hukum dan Syar’iah 17, no. 1 (2025): 118–119. https://doi.org/10.18860/j-fsh.v17i1.28880.
Salter, Michael. “Child Sexual Abuse Material and the Digital Economy.” New Media & Society 25, no. 9 (2023): 2277–2295.
Sekretariat Negara Republik Indonesia. “Komisi Perlindungan Anak Indonesia.” Accessed June 1, 2026.
Septianita, Hesti, Pujiyono, and Irma Cahyaningtyas. “Online Child Sexual Exploitation and Abuse as Organized Crime: Towards a New International Legal Framework.” Jurnal Litigasi 27, no. 1 (2026): 1–25. https://doi.org/10.23969/litigasi.v27i1.43221.
Stanford Internet Observatory. Generative AI and Child Safety: An Emerging Challenge. Stanford, CA: Stanford Internet Observatory, 2024.
UNESCO. Recommendation on the Ethics of Artificial Intelligence. Paris: UNESCO, 2021.
UNICEF. Guidance on AI and Children. 3rd ed. New York: UNICEF, 2025.
United Nations. Convention on the Rights of the Child. New York: United Nations, 1989.
United Nations. Guiding Principles on Business and Human Rights. U.N. Doc. HR/PUB/11/04. 2011.
United Nations. International Covenant on Civil and Political Rights. New York: United Nations, 1966.
United Nations. Optional Protocol to the Convention on the Rights of the Child on the Sale of Children, Child Prostitution and Child Pornography. New York: United Nations, 2000.
United Nations Development Group. The Human Rights Based Approach to Development Cooperation: Towards a Common Understanding among UN Agencies. New York: United Nations, 2003.
United Nations Interregional Crime and Justice Research Institute. Generative AI: A New Threat for Online Child Sexual Exploitation and Abuse. Turin: UNICRI, 2024. https://unicri.org/sites/default/files/2024-09/Generative-AI-New-Threat-Online-Child-Abuse.pdf.
United Nations Office on Drugs and Crime. United Nations Convention against Cybercrime. Adopted by U.N. General Assembly Resolution 79/243. December 24, 2024.
United Nations Sustainable Development Group. “Human Rights-Based Approach.” Accessed May 5, 2026. https://unsdg.un.org/2030-agenda/universal-values/human-rights-based-approach.
U.S. Department of Justice. Child Sexual Abuse Material. Washington, DC: U.S. Department of Justice, 2023. https://www.justice.gov/d9/2023-06/child_sexual_abuse_material_2.pdf.
WeProtect Global Alliance. Global Threat Assessment 2023 Press Release. October 17, 2023.
Published
How to Cite
Issue
Section
Copyright (c) 2026 Hafina Haula Arsy, Hadi Rahmat Purnama
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
The authors hold the copyright. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal. How ever the author should affirming that the article is their original work should accompany the article via online submission form. Authors are permitted to share a Preprint of their article anywhere at any time. Link Declaration of originality (PDF)
