Read the Beforeitsnews.com story here. Advertise at Before It's News here.
Profile image
By Political Calculations (Reporter)
Contributor profile | More stories
Story Views
Now:
Last hour:
Last 24 hours:
Total:

Whales, Tails and How Far to Trust AI

% of readers think this story is Fact. Add your two cents.


How can you train an AI?

By AI, we’re referring to “artificial intelligence” systems, which are a special class of machine learning computer programs that are increasing showing up in some pretty amazing applications. Whether its generating an image based on text you enter or nearly instantaneously writing the equivalent of a school report on a particular subject, AI systems are leaving the world of science fiction and becoming today’s reality.

But how do their developers train these systems to do these things?

Last year, Matt Parker visited Antartica, where he learned how to apply maths to identify specific humpback whales. The following 22-minute video describes how the mathematical methods developed for advanced image recognition made it possible for him to use an Excel spreadsheet to identify a specific whale he photographed swimming off the north coast of Antartica*.

Clearly, AI can deliver impressive results, but how far can you trust those results?

One area where photo-recognition AI systems could make a real impact is in radiology, where such systems could potentially diagnosis serious health conditions much more quickly at much lower cost than can be done by professional radiologists.

A recent study published in the British Medical Journal (BMJ) asked if AI could pass the Royal College of Radiologists’ board examination. Spoiler alert: It couldn’t, where why it couldn’t tells us something about the limitations of these AI deep maching learning systems. Chuck Dinerstein of the American Council on Science and Health summarizes the study’s main findings, in which the performance of AI-trained systems and human radiologists were compared (emphasis ours):

First, the obvious, with two exceptions, humans did better than the AI on diagnosis where both had been trained; when unfamiliar pathology was introduced, AI failed across the board. Second, while the humans fared better, theirs was not a stellar performance. On average, newly minted radiologists passed 4 of the ten examinations.

“The artificial intelligence candidate… outperformed three radiologists who passed only one mock examination (the artificial intelligence candidate passed two). Nevertheless, the artificial intelligence candidate would still need further training to achieve the same level of performance and skill of an average recently FRCR qualified radiologist, particularly in the identification of subtle musculoskeletal abnormalities.”

The abilities of an AI radiology program remain brittle, unable to extend outside their training set, and as evidenced by this testing, not ready for independent work. All of this speaks to a point Dr. Hinton made in a less hyperbolic moment.

“[AI in the future is] going to know a lot about what you’re probably going to want to do and how to do it, and it’s going to be very helpful. But it’s not going to replace you.”

Here’s the kicker according to Dinerstein:

We would serve our purposes better by seeing AI diagnostics as a part of our workflow, a second set of eyes on the problem, or in this case, an image. Interestingly, in this study, the researchers asked the radiologists how they thought the AI program would do; they overestimated AI, expecting it to do better than humans in 3 examinations. That suggests a bit of bias, unconscious or not, to trust the AI over themselves. Hopefully, experience and identifying the weakness of AI radiology will hone that expectation.

Like any human expert, AI has limitations. Identifying and knowing what those limitations are will be key to determining how trustworthy they are. In the case of health care, as the example from radiology makes clear, it could be your health that’s on the line if you blindly put more trust into a system than it deserves.

Reference

Shelmerdine, S.C.; Martin, H.; Shirodkar, K.; Shamshuddin, S.; Weir-McCall, J.R. “Can artificial intelligence pass the Fellowship of the Royal College of Radiologists examination? Multi-reader diagnostic accuracy study.” BMJ 2022; 379. DOI: 10.1136/bmj-2022-072826. (Published 21 December 2022).

* If you know your geography, you already knew every coast of Antartica is the north coast!…


Source: https://politicalcalculations.blogspot.com/2023/01/whales-tails-and-how-far-to-trust-ai.html


Before It’s News® is a community of individuals who report on what’s going on around them, from all around the world.

Anyone can join.
Anyone can contribute.
Anyone can become informed about their world.

"United We Stand" Click Here To Create Your Personal Citizen Journalist Account Today, Be Sure To Invite Your Friends.

Please Help Support BeforeitsNews by trying our Natural Health Products below!


Order by Phone at 888-809-8385 or online at https://mitocopper.com M - F 9am to 5pm EST

Order by Phone at 866-388-7003 or online at https://www.herbanomic.com M - F 9am to 5pm EST

Order by Phone at 866-388-7003 or online at https://www.herbanomics.com M - F 9am to 5pm EST


Humic & Fulvic Trace Minerals Complex - Nature's most important supplement! Vivid Dreams again!

HNEX HydroNano EXtracellular Water - Improve immune system health and reduce inflammation.

Ultimate Clinical Potency Curcumin - Natural pain relief, reduce inflammation and so much more.

MitoCopper - Bioavailable Copper destroys pathogens and gives you more energy. (See Blood Video)

Oxy Powder - Natural Colon Cleanser!  Cleans out toxic buildup with oxygen!

Nascent Iodine - Promotes detoxification, mental focus and thyroid health.

Smart Meter Cover -  Reduces Smart Meter radiation by 96%! (See Video).

Report abuse

    Comments

    Your Comments
    Question   Razz  Sad   Evil  Exclaim  Smile  Redface  Biggrin  Surprised  Eek   Confused   Cool  LOL   Mad   Twisted  Rolleyes   Wink  Idea  Arrow  Neutral  Cry   Mr. Green

    MOST RECENT
    Load more ...

    SignUp

    Login

    Newsletter

    Email this story
    Email this story

    If you really want to ban this commenter, please write down the reason:

    If you really want to disable all recommended stories, click on OK button. After that, you will be redirect to your options page.