Read the story here. Advertise at Before It's News here.
Profile image
By Universe Today (Reporter)
Contributor profile | More stories
Story Views
Last hour:
Last 24 hours:

Machine Learning Algorithms Can Find Anomalous Needles in Cosmic Haystacks

% of readers think this story is Fact. Add your two cents.

The face of astronomy is changing. Though narrow-field point-and-shoot astronomy still matters (JWST anyone?), large wide-field surveys promise to be the powerhouses of discovery in the coming decades, especially with the advent of machine learning.

A recently developed machine learning program, called ASTRONOMALY, scanned nearly four million galaxy images from the Dark Energy Camera Legacy Survey (DECaLS), discovering 1635 anomalies including 18 previously unidentified sources with “highly unusual morphology.” It is a sign of things to come: a partnership between humans and software that can do better observational science than either could do on their own.

Survey telescopes have long been part of the astronomers’ toolkit. The difference in the twenty-first century is that they can now produce incredibly vast amounts of data, far more than a human could hope to dig through and examine on their own. The upcoming Vera Rubin Observatory, for example, is expected to create 20 terabytes of data every single night (60 petabytes over 10 years), and ultimately provide “32 trillion observations of 20 billion galaxies.”

Pouring through all that data would take humans decades. AI can do it much faster.

Most previous anomaly detection programs were trained on test datasets, teaching the algorithm to look for specific phenomena. The limitation of these programs is that they tend to find many anomalies of the same type, rather than entirely new anomalies.

ASTRONOMALY is instead run ‘unsupervised’, allowing it to find new kinds of outliers – the kind of thing that gets astronomers excited, like gravitational lenses, galactic mergers, odd red-shift patterns, and anything else that is just weird. However, ASTRONOMALY performs best when it employs a form of active learning, with input from humans to correct its mistakes. Incorporating this feedback into its searches offers much better results.

The best part: it only takes the astronomer a few hours.

In a recent preprint paper, astronomers tested ASTRONOMALY on a larger dataset than ever before, demonstrating that it can work at scale. After feeding the program a huge amount of DECaLS data, they tested several different algorithms. The results showed that the unsupervised method, enhanced by active learning input from humans, offered the highest output of unique anomalies.

The Vera Rubin Observatory under construction in 2022. Rubin Observatory/NOIRLab/NSF/AURA/T. Matsopoulos.

The most interesting anomalies, according to the researchers, included “ring galaxies exhibiting strange colors and morphology, a source that is half red and half blue, a potential strongly lensed system with a pair of sources acting as the lens, several known interacting groups and some sources that are either interacting or coincidental alignments.”

One puzzling object is giving off radio emissions that might be explained by the presence of a quasar, but the galaxy also has a ring feature that is either a rare red-ringed galaxy or a gravitational lens. Another anomaly looks to be a ring-shaped starburst galaxy with either a tidal tail or a colliding companion galaxy.

All of these rare objects would have been missed without the active learning algorithm. The results promise exciting new finds in the very near future.

But there is still one challenge to overcome in this new age of enormous datasets: data transfer.

“One of the main challenges that we experienced was the transfer of data from the host server to a local computer, which took several weeks,” the researchers said. Their proposed solution? In the future, it makes more sense to bring the computational power to the host observatory, rather than try and bring the data offsite.

Learn More:

Verlon Etsebeth, Michelle Lochner, Mike Walmsley, Margherita Grespan. “Astronomaly at Scale: Searching for Anomalies Amongst 4 Million Galaxies.” ArXiv Preprint.

The post Machine Learning Algorithms Can Find Anomalous Needles in Cosmic Haystacks appeared first on Universe Today.


Before It’s News® is a community of individuals who report on what’s going on around them, from all around the world.

Anyone can join.
Anyone can contribute.
Anyone can become informed about their world.

"United We Stand" Click Here To Create Your Personal Citizen Journalist Account Today, Be Sure To Invite Your Friends.

Please Help Support BeforeitsNews by trying our Natural Health Products below!

Order by Phone at 888-809-8385 or online at M - F 9am to 5pm EST

Order by Phone at 866-388-7003 or online at M - F 9am to 5pm EST

Order by Phone at 866-388-7003 or online at M - F 9am to 5pm EST

Humic & Fulvic Trace Minerals Complex - Nature's most important supplement! Vivid Dreams again!

HNEX HydroNano EXtracellular Water - Improve immune system health and reduce inflammation.

Ultimate Clinical Potency Curcumin - Natural pain relief, reduce inflammation and so much more.

MitoCopper - Bioavailable Copper destroys pathogens and gives you more energy. (See Blood Video)

Oxy Powder - Natural Colon Cleanser!  Cleans out toxic buildup with oxygen!

Nascent Iodine - Promotes detoxification, mental focus and thyroid health.

Smart Meter Cover -  Reduces Smart Meter radiation by 96%! (See Video).

Report abuse


    Your Comments
    Question   Razz  Sad   Evil  Exclaim  Smile  Redface  Biggrin  Surprised  Eek   Confused   Cool  LOL   Mad   Twisted  Rolleyes   Wink  Idea  Arrow  Neutral  Cry   Mr. Green

    Load more ...




    Email this story
    Email this story

    If you really want to ban this commenter, please write down the reason:

    If you really want to disable all recommended stories, click on OK button. After that, you will be redirect to your options page.