Skip to content
Information Technology, Political

AI Experts Call for National Safety Institute

Australians for AI Safety 3 mins read
  • Media:

Testimony before the Senate Committee on Adopting AI focused on the need for Australia to create an AI Safety Institute.

 

Polling from the Lowy Institute shows that more than half of Australians think that the risks of AI outweigh its benefits.

 

Mr Greg Sadler, spokesperson for Australians for AI Safety, said: “The Government will fail to achieve its economic ambitions from AI unless it can satisfy Australians that it's working to make AI safe.”

 

Many countries, including the US, UK, Canada, Japan, Korea and Singapore have moved to create AI safety institutes to progress technical efforts to make sure that next-generation AI models are safe.

 

On 24 May 2024, participants in the Seoul Declaration on AI Safety – including Australia –  committed to “create or expand Al safety institutes”. Minister Husic has not said how Australia will approach the issue.

 

Senator Pocock expressed his concern that Minister Husic was creating temporary expert advisory bodies, but hasn’t taken steps to create an enduring AI Safety Institute.

 

After hearing evidence about the funding Canada and the UK provide to their AI Safety Institutes, Mr Pocock said “That seems very doable to me”.

 

Microsoft suggested that Australia was at risk of falling behind other countries, like Canada, the UK, and the US who have already created their own safety institutes.

 

A recent report found that the global AI assurance industry – companies that work to ensure AI is safe – could be worth USD $276 billion by the end of the decade.

 

Mr Lee Hickin, AI Technology and Policy Lead for Microsoft Asia, said:

 

“What I see developing globally is the establishment of AI Safety Institutes. UK, US, Japan, Korea, and obviously the opportunity exists for Australia to also participate in that safety institute network which has a very clear focus of investing in learning, development and skills.”

 

“There is not just a need, but a value, to Australians and Australian business and Australian industry to have Australia represented on that global stage. “

 

“Australia has some world-leading researchers and capability.”

 

Mr Soroush Pour, CEO of Harmony Intelligence, also gave testimony at the recent hearing. Mr Pour said:

 

“The next generation of AI models could pose grave risks to public safety. Australian businesses and researchers have world-leading skills but receive far too little support from the Australian government. If Australia urgently created an AI Safety Institute, it would help create a powerful new export industry and make Australia relevant on the global stage. If Government fails to do the work necessary to take these risks off the table, the outcomes could be catastrophic.”

 

Research from the University of Queensland found that 80% of Australians think AI risk is a global priority. When asked what the Australian government’s focus should be when it comes to AI, most respondents said “preventing dangerous and catastrophic outcomes”.

 

More than 40 Australian AI experts made a joint submission to the Inquiry. The submission from Australians for AI Safety calls for the creation of an AI Safety Institute. The experts said

 

“Australia has yet to position itself to learn from and contribute to growing global efforts. To achieve the economic and social benefits that AI promises, we need to be active in global action to ensure the safety of AI systems that approach or surpass human-level capabilities.”

 

“Too often, lessons are learned only after something goes wrong. With AI systems that might approach or surpass human-level capabilities, we cannot afford for that to be the case.”

 

The full letter is available at AustraliansForAISafety.com.au.

Contact: Greg Sadler
Email:
greg@australiansforaisafety.com.au
Phone: 0401 534 879

 

 

 

Greg Sadler is the spokesperson for Australians for AI Safety and the CEO of Good Ancestors Policy. Good Ancestors is a charity that develops and advocates for policies that aim to solve this century’s most challenging problems. Good Ancestors is one of Australia’s leading nonprofits focused on the safety of artificial intelligence. Learn more at: https://www.goodancestors.org.au/

 

Soroush Pour is CEO of technology startup Harmony Intelligence. Harmony Intelligence works with AI labs and governments to help measure & mitigate societal-scale risks of cutting-edge AI systems, such as election manipulation, cyberattacks, bioterrorism, and loss of control. Their current work focuses on model evaluation and red-teaming of frontier AI models, with team members across Australia & the US. Learn more at: https://www.harmonyintelligence.com/

 

 

Sources:

UQ:

Lowy:

Microsoft Testimony (starts 5:01:30):

Testimony from Mr Sadler and Mr Pour (starts 5:28:45):

Report on the AI Assurance Industry:

Media

Images
Greg Sadler giving evidence to the AI Adoption Committee.Greg Sadler giving evidence to the AI Adoption Committee.

Mr Sadler giving evidence to the AI Adoption Committee.png

Greg Sadler giving evidence to the AI Adoption Committee.
Download media

More from this category

  • Information Technology
  • 07/03/2025
  • 15:55
ESET

Cybersecurity Needs Diversity: ESET’s 2025 Scholarship to Empower Women Leaders

SYDNEY, March 07, 2025 (GLOBE NEWSWIRE) -- ESET, a global leader in cybersecurity, today announced the fourth run of the ESET Women in Cybersecurity Scholarship in Australia in celebration of International Women’s Day on 8 March. Originally launched in 2022, this initiative aims to support and empower aspiring female professionals in cybersecurity and STEM, providing them with opportunities to advance their education and careers in the industry.A recent study by RMIT University, in collaboration with the Australian Women Security Network (AWSN), found that women make up only 17% of Australia’s cybersecurity workforce and tend to leave the industry after just…

  • Crime, Information Technology
  • 07/03/2025
  • 12:57
IJM Australia

Digital duty of care needed to mandate safeguards against online sexual abuse of children on Australian screens

7 March 2025 eSafety’s transparency report published yesterday reveals the gaps in Telegram and Reddit’s detection and deterrence of child sexual exploitation and abuse on their services. Failures to detect new child sexual exploitation and abuse images and videos should urgently be addressed to stop the circulation of this illegal material and protect the children depicted who may be at immediate risk of harm. A legislated digital duty of care could require tech companies to ensure measures are in place to mitigate new child sexual abuse material being created or shared on their platforms, and to reported on and improve…

  • Contains:
  • Energy, Political
  • 07/03/2025
  • 07:08
RE-Alliance

Media Release: Hunter community frustrated at lack of funding for Local Energy Hubs

March 7, 2025 Community groups have labelled the Federal Minister for Climate Change and Energy’s decision not to announce funding for Local Energy Hubs at last night’s Hunter Community Alliance (HCA) Assembly as a missed opportunity. An extensive listening process before the Assembly found residents wanting access to more information and opportunities about large scale renewable energy projects slated for the region, and how renewable energy and energy efficiency can lower energy bills at a household and business level. Which is why they called on Minister Chris Bowen to address the information gap with Local Energy Hubs. The Renewable Energy…

Media Outreach made fast, easy, simple.

Feature your press release on Medianet's News Hub every time you distribute with Medianet. Pay per release or save with a subscription.