Visualizing The Extreme Cost Of Training AI Models
The cost of training AI models has exploded in just the past year, according to data released by the research firm Epoch AI.
This development aptly shows how much more complex and capable AI models have gotten in a short time span.
Last year saw the release of ChatGPT-4 in March by OpenAI, which kickstarted the global AI hype. Google followed suit with its advanced AI model, Gemini, in December.
As Statista’s Katharina Buchholz reports, both systems have been much more expensive to train than previous AI models and their development has potentially cost hundreds of millions of dollars, according to the Epoch AI release.
You will find more infographics at Statista
The cost of training Gemini, which is a large language model that can be inputted with text, voice commands and images, reportedly stood between $30 and $191 million even before taking staff salaries into consideration.
According to Epoch AI, these can make up 29 percent to 49 percent of the final price. ChatGPT-4, the latest edition, had a technical creation cost of $41 million to $78 million, according to the source. Sam Altman, CEO of OpenAI, has in the past said that the model has cost more than $100 million, confirming the calculations.
Looking back, the cost of earlier AI models was much lower. ChatGPT-3 cost only around $2 million to $4 million make in 2020, while Gemini’s precursor PaLM in 2022 took between $3 million and $12 million to train when only looking at the cost of computing.
Even at these price points, keeping up with cutting-edge AI development might have proved difficult for academic or other public institutions that have traditionally been active in AI research.
While it was updated to support voice and images in fall 2023, ChatGPT-4, like its name suggests, started out based around its central text input, while Gemini and its app have been designed as a multimodal LLM from the get-go.
This explains why ChatGPT’s initial training cost might have been lower.
On the other hand, Gemini’s general focus on app delivery – for example, prompting users to snap pictures with their smartphones, pick out features in them and have them analyzed – could have warranted a higher cost.
Tyler Durden Wed, 09/25/2024 – 06:55
Source: https://freedombunker.com/2024/09/25/visualizing-the-extreme-cost-of-training-ai-models/
Anyone can join.
Anyone can contribute.
Anyone can become informed about their world.
"United We Stand" Click Here To Create Your Personal Citizen Journalist Account Today, Be Sure To Invite Your Friends.
Before It’s News® is a community of individuals who report on what’s going on around them, from all around the world. Anyone can join. Anyone can contribute. Anyone can become informed about their world. "United We Stand" Click Here To Create Your Personal Citizen Journalist Account Today, Be Sure To Invite Your Friends.
LION'S MANE PRODUCT
Try Our Lion’s Mane WHOLE MIND Nootropic Blend 60 Capsules
Mushrooms are having a moment. One fabulous fungus in particular, lion’s mane, may help improve memory, depression and anxiety symptoms. They are also an excellent source of nutrients that show promise as a therapy for dementia, and other neurodegenerative diseases. If you’re living with anxiety or depression, you may be curious about all the therapy options out there — including the natural ones.Our Lion’s Mane WHOLE MIND Nootropic Blend has been formulated to utilize the potency of Lion’s mane but also include the benefits of four other Highly Beneficial Mushrooms. Synergistically, they work together to Build your health through improving cognitive function and immunity regardless of your age. Our Nootropic not only improves your Cognitive Function and Activates your Immune System, but it benefits growth of Essential Gut Flora, further enhancing your Vitality.
Our Formula includes: Lion’s Mane Mushrooms which Increase Brain Power through nerve growth, lessen anxiety, reduce depression, and improve concentration. Its an excellent adaptogen, promotes sleep and improves immunity. Shiitake Mushrooms which Fight cancer cells and infectious disease, boost the immune system, promotes brain function, and serves as a source of B vitamins. Maitake Mushrooms which regulate blood sugar levels of diabetics, reduce hypertension and boosts the immune system. Reishi Mushrooms which Fight inflammation, liver disease, fatigue, tumor growth and cancer. They Improve skin disorders and soothes digestive problems, stomach ulcers and leaky gut syndrome. Chaga Mushrooms which have anti-aging effects, boost immune function, improve stamina and athletic performance, even act as a natural aphrodisiac, fighting diabetes and improving liver function. Try Our Lion’s Mane WHOLE MIND Nootropic Blend 60 Capsules Today. Be 100% Satisfied or Receive a Full Money Back Guarantee. Order Yours Today by Following This Link.
| Visits: | 1,821,587,207 |
| Stories: | 8,672,541 |
Whistler Blowers, Insiders
