Verified Human Experts Find 37% of ChatGPT Answers Untrustworthy, Revealing Alarming Risks, According to Recent Analysis
Friday, June 21, 2024
JustAnswer doctors, lawyers, veterinarians and other subject matter experts found many inaccuracies, including misleading or dangerous information
SAN FRANCISCO, June 13, 2024 /PRNewswire/ -- More than one-third (37%) of all ChatGPT answers reviewed by doctors, lawyers, veterinarians and other subject matter experts were ranked untrustworthy, with numerous instances of misleading or hazardous information identified.
This concerning finding comes from an in-depth analysis conducted by the verified and vetted human experts powering JustAnswer's recently launched Pearl.com AI Answer Review fact-checking tool. These experts rated 37% of ChatGPT answers with a "Trust Score" of 3 or lower on a scale from 1 (least trustworthy) to 5 (most accurate and trustworthy).
In addition, a survey of these subject matter experts found:
-- 42% of the ChatGPT answers reviewed are "missing crucial details"
-- 14% of the ChatGPT answers reviewed are "misleading"
-- 4% of the ChatGPT answers reviewed "give dangerous information"
Examples of dangerous AI-generated information provided to real people included:
-- A veterinarian reviewing a ChatGPT response about a pet wound was
flagged as dangerous, potentially resulting in damage to the pet's
internal organs.
-- Another user seeking guidance on inheritance laws was given incorrect
legal information that failed to consider jurisdiction-specific
regulations, according to the reviewing lawyer.
-- A doctor reviewing a ChatGPT response about a possible subarachnoid
hemorrhage found the medical information to be misleading and
potentially life-threatening.
"These findings reflect the troubling inaccuracy rates observed in other studies of current AI models. With more people relying on AI for critical life and health issues, it is terrifying how often these AI tools deliver misinformation that can lead to devastating consequences, including health issues, financial ruin, or even loss of life," said JustAnswer CEO Andy Kurtzig. "While AI technologies hold immense potential, human oversight and expertise are crucial to harnessing their benefits and mitigating their risks."
More about JustAnswer
JustAnswer has been connecting consumers with verified and vetted professionals online since 2003 and has helped millions of people get the right answers to their life dilemmas. The site has about 12,000 experts across more than 150 categories including health, legal, finance, veterinary, tech, home improvement and more.
Media Contact: Andrea Toch; (602) 405-8335; 379082@email4pr.com
View original content to download multimedia:https://www.prnewswire.com/news-releases/verified-human-experts-find-37-of-chatgpt-answers-untrustworthy-revealing-alarming-risks-according-to-recent-analysis-302171292.html
SOURCE JustAnswer
|
|
|
|
|
 |
Dream Vacations Transforms Travel Booking Experience with New Website | Mar 28, 2025
|
|
Land id(TM) Partners with The Land Report to Profile America's Largest Landowners | Mar 28, 2025
|
|
New medical technology pilot environment established in Finland aims to slash market entry time of patient-friendly solutions | Mar 28, 2025
|
|
Playcasino.co.nz Releases Comprehensive Guide to Online Casino Payment Methods for NZ Players | Mar 28, 2025
|
|
MetAI to Debut AI-Powered Controller Simulator at NVIDIA GTC 2025, Advancing Digital Twins for Industrial Automation | Mar 28, 2025
|
|
Netflix Worldwide Exclusive Streaming Anime"The Summer Hikaru Died" Reveals Main Trailer and New Cast Members, Yumiri Hanamori, Wakana Kowaka, and Chikahiro Kobayashi | Mar 28, 2025
|
|
Constructor Unveils Retail Media Suite with Personalized Sponsored Listings and Retail Media Network Integrations | Mar 28, 2025
|
|
Appcast Named a 2025 Google Premier Partner | Mar 28, 2025
|
|
Hy-Vee RedMedia Partners with Instacart to Further Retail Media Capabilities | Mar 28, 2025
|
|
New Website Developed by Flightpath, A Ruder Finn Company Launched by Goya Foods | Mar 28, 2025
|
|
|
