Skip to content
Information Technology, Political

AI Experts Call for National Safety Institute

Australians for AI Safety 3 mins read

Testimony before the Senate Committee on Adopting AI focused on the need for Australia to create an AI Safety Institute.

 

Polling from the Lowy Institute shows that more than half of Australians think that the risks of AI outweigh its benefits.

 

Mr Greg Sadler, spokesperson for Australians for AI Safety, said: “The Government will fail to achieve its economic ambitions from AI unless it can satisfy Australians that it's working to make AI safe.”

 

Many countries, including the US, UK, Canada, Japan, Korea and Singapore have moved to create AI safety institutes to progress technical efforts to make sure that next-generation AI models are safe.

 

On 24 May 2024, participants in the Seoul Declaration on AI Safety – including Australia –  committed to “create or expand Al safety institutes”. Minister Husic has not said how Australia will approach the issue.

 

Senator Pocock expressed his concern that Minister Husic was creating temporary expert advisory bodies, but hasn’t taken steps to create an enduring AI Safety Institute.

 

After hearing evidence about the funding Canada and the UK provide to their AI Safety Institutes, Mr Pocock said “That seems very doable to me”.

 

Microsoft suggested that Australia was at risk of falling behind other countries, like Canada, the UK, and the US who have already created their own safety institutes.

 

A recent report found that the global AI assurance industry – companies that work to ensure AI is safe – could be worth USD $276 billion by the end of the decade.

 

Mr Lee Hickin, AI Technology and Policy Lead for Microsoft Asia, said:

 

“What I see developing globally is the establishment of AI Safety Institutes. UK, US, Japan, Korea, and obviously the opportunity exists for Australia to also participate in that safety institute network which has a very clear focus of investing in learning, development and skills.”

 

“There is not just a need, but a value, to Australians and Australian business and Australian industry to have Australia represented on that global stage. “

 

“Australia has some world-leading researchers and capability.”

 

Mr Soroush Pour, CEO of Harmony Intelligence, also gave testimony at the recent hearing. Mr Pour said:

 

“The next generation of AI models could pose grave risks to public safety. Australian businesses and researchers have world-leading skills but receive far too little support from the Australian government. If Australia urgently created an AI Safety Institute, it would help create a powerful new export industry and make Australia relevant on the global stage. If Government fails to do the work necessary to take these risks off the table, the outcomes could be catastrophic.”

 

Research from the University of Queensland found that 80% of Australians think AI risk is a global priority. When asked what the Australian government’s focus should be when it comes to AI, most respondents said “preventing dangerous and catastrophic outcomes”.

 

More than 40 Australian AI experts made a joint submission to the Inquiry. The submission from Australians for AI Safety calls for the creation of an AI Safety Institute. The experts said

 

“Australia has yet to position itself to learn from and contribute to growing global efforts. To achieve the economic and social benefits that AI promises, we need to be active in global action to ensure the safety of AI systems that approach or surpass human-level capabilities.”

 

“Too often, lessons are learned only after something goes wrong. With AI systems that might approach or surpass human-level capabilities, we cannot afford for that to be the case.”

 

The full letter is available at AustraliansForAISafety.com.au.

Contact: Greg Sadler
Email:
[email protected]
Phone: 0401 534 879

 

 

 

Greg Sadler is the spokesperson for Australians for AI Safety and the CEO of Good Ancestors Policy. Good Ancestors is a charity that develops and advocates for policies that aim to solve this century’s most challenging problems. Good Ancestors is one of Australia’s leading nonprofits focused on the safety of artificial intelligence. Learn more at: https://www.goodancestors.org.au/

 

Soroush Pour is CEO of technology startup Harmony Intelligence. Harmony Intelligence works with AI labs and governments to help measure & mitigate societal-scale risks of cutting-edge AI systems, such as election manipulation, cyberattacks, bioterrorism, and loss of control. Their current work focuses on model evaluation and red-teaming of frontier AI models, with team members across Australia & the US. Learn more at: https://www.harmonyintelligence.com/

 

 

Sources:

UQ:

Lowy:

Microsoft Testimony (starts 5:01:30):

Testimony from Mr Sadler and Mr Pour (starts 5:28:45):

Report on the AI Assurance Industry:

Media

More from this category

  • Political, Transport Automotive
  • 23/04/2025
  • 16:21
NALSPA

Cross-party support for EV FBT exemption to help more working Australians ease cost-of-living pressures

Bipartisan support for the Fringe Benefits Tax (FBT) exemption on eligible electric vehicles (EVs) will enable more working Australians to afford an EV amid rising cost-of-living pressures, according to the National Automotive Leasing and Salary Packaging Association (NALSPA).NALSPA Chief Executive Rohan Martin said the Opposition Leader Peter Dutton’s commitment to the policy provided certainty for working families across the country facing growing cost-of-living pressures, assuring them that there is an affordable way to access the cost saving benefits of an EV.NALSPA data shows the FBT exemption and novated leasing arrangements have helped thousands of Australian workers and families afford an…

  • Political, Transport Automotive
  • 23/04/2025
  • 07:15
Electric Vehicle Council

Bipartisan support for electric car discount a win for all Australians

Australians will continue to benefit from lower purchase prices and significant savings on running costs for electric vehicles, with bipartisan support for the electric car discount. Both major parties have confirmed the discount through support for the Fringe Benefits Tax (FBT) exemption for electric vehicles, with the Liberal Leader Peter Dutton committing to retain it should the Coalition be elected at the May 3 election. EVC Chief Executive Julie Delvecchio said the development provides certainty for Australian families looking to make the switch to cleaner, more affordable transport. “The Electric Vehicle Council is pleased to see our call for bipartisan…

  • Information Technology
  • 22/04/2025
  • 18:10
HERE Europe B.V.

HERE partners with ECARX to launch Next-Generation, In-Car Navigation at Auto Shanghai 2025

The collaboration leverages HERE’s next-generation navigation platform, and ECARX’s full-stack capabilities to deliver an industry-leading navigation solution for leading Chinese automakers. By integrating HERE SDK and compliant location data across 200+ countries, the solution significantly shortens development cycles for international vehicle platforms. A production-ready solution, along with a demo, will debut at Auto Shanghai 2025.Shanghai, Auto Shanghai 2025 – HERE Technologies, the leading location data and technology platform, today announced its strategic partnership with ECARX, global mobility technology company ECARX (Nasdaq: ECX), on co-developing a new-generation navigation system with multi-scenario adaptability, integrating the HERE SDK navigation platform with ECARX's full-stack…

Media Outreach made fast, easy, simple.

Feature your press release on Medianet's News Hub every time you distribute with Medianet. Pay per release or save with a subscription.