Verification: 0d460fb81828e89b
Connect with us


keys to control and optimize your cost

Although the possibilities that are glimpsed for ChatGPT and generative Artificial Intelligence (AI) are many, the high cost that it can entail for organizations is a topic that is not always talked about. However, it is necessary to go deeper in order to control its cost.

Typically, it is the big companies like Microsoft, Meta and Google that are investing heavily to develop their technological advantage by leveraging the AI. However, if the margin for AI applications is typically smaller than the margins for Software as a Service, due to the high cost of computing, it could dampen the current boom.

Even when the software is built or trained, it still requires a lot of computation to run large language models because it does billions of calculations every time it returns a response to a prompt. By comparison, serving applications or web pages requires much less computation.

These calculations also require specialized hardware. While traditional processors can run models of machine learning, They’re slow. Most of the training now takes place on graphics processors, or GPUs, which were initially intended for 3D gaming but have become the standard for AI applications because they can do many simple calculations simultaneously.

AI training models

Analysts estimate that the process of training a language model such as OpenAI GPT-3 could cost more than 4 million dollars. The most advanced language models could multiply this number.

Organizations that build great language models they should be cautious because it costs a lot

Meta’s largest LLaMA model released last month, for example, used 2048 Nvidia A100 GPUs to train on 1.4 trillion tokens (750 words is about 1000 tokens), which took about 21 days.

It took about a million GPU hours to train. With AWS-exclusive pricing, it would cost more than $2.4 million. And with 65 billion parameters, it’s smaller than current GPT models in OpenAI, such as ChatGPT-3, which has 175 billion parameters.

Organizations that build great language models they should be cautious when they retrain the software, which helps improve their capabilities, because it costs a lot.


More use, higher pay

To use a trained machine learning model to make predictions or generate text, engineers use the model in a process called “inference,” which can be much more expensive than training as it may need to be run millions of times to become popular.

A product like ChatGPTwhich is estimated to have hit 100 million monthly active users in January, could have cost OpenAI $40 million to process the millions of messages people entered into the software that month.

Costs skyrocket when these tools are used billions of times a day. Financial analysts anticipate that the chatbot Bing AI from Microsoftwhich runs on an OpenAI ChatGPT model, needs at least $4 trillion in infrastructure to deliver answers to all Bing users.

how could i change

It is not clear whether AI computing will remain expensive as the industry develops. Companies that make entry-level models, semiconductor manufacturers, and start-ups see opportunities in lowering the price of running AI software.

More and more companies will focus on the development of smaller and more specific models to optimize costs

Nvidia, which has about 95% of the market for AI chips, continues to develop powerful versions designed specifically for machine learning, but improvements in chip power across the industry have slowed in recent years.

Some companies have focused on the high cost of AI as a business opportunity and more and more companies will focus on developing smaller and more specific models. These are cheaper to train and operate, rather than language models which, like ChatGPT, manage to attract much of the attention.

Meanwhile, OpenAI announced last month that it is lowering the cost for enterprises to access its GPT models. Now he charges a fifth of a cent for about 750 words of production.

initial image | Negative Space


Continue Reading
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *


Pilsner in the test: cheap beer among the test winners

However, the testers found traces of the suspected carcinogenic weed killer glyphosate in twelve beers from well-known brands. The values ​​are well below the maximum permitted level for brewing barley in the European Union. For reasons of preventative consumer protection, ÖKO-TEST still awards grade deductions. After all, all organic mushroom beers tested are free of the controversial herbicide.

When it comes to original wort content and foam durability, no Pilsner is wrong. The test drinkers also had little to complain about. In ten beers, however, the experts detected off-notes that were not typical of pilsners.

They attested that the bottom of the field, an organic pilsner, had “a contaminated taste with buttery notes”. The reason: The laboratory detects contamination with pediococci. Although the lactic acid bacteria are not harmful to humans, they do cause a significant reduction in quality, according to ÖKO-TEST. This is what is affected here Pinkus Pils (Bioland) from the Pinkus Müller brewery and scored “unsatisfactory” (grade 6).

Even a Pils from the discounter is not convincing and fails with the rating “poor” (grade 5): That Kaiserkrone Pils Norma’s taste didn’t impress the testers.

Continue Reading


AEG vacuum cleaner in a cheap set: Ultimate 7000 for 333 euros

Flexibel im Einsatz ist der AEG Ultimate 7000. Der Akku-Staubsauger Not only can it be operated wirelessly, but thanks to numerous nozzles it is also suitable for hard-to-reach places. As a weekly deal, Tech Xataka is offering the AEG including an additional mattress nozzle for just 333 euros. A look at the comparison portal idealo shows that this is a top price! At other online retailers you will spend around 232 euros more for both parts. Shipping is free (all prices and information as of September 22, 2023).

AEG Ultimate 7000: Für 333 Euro bei Tech Xataka

“Leistungsstarke Reinigung vom Boden bis zur Decke” ist das Motto des Ultimate 7000 von AEG. Der Akku-Staubsauger wiegt gerade mal 2,2 Kilogramm und soll der leichteste AEG-Staubsauger sein. Der 4.000-Milliamperestunden-Akku soll bis zu 50 Minuten durchhalten und eine Flächenleistung von 120 Quadratmetern garantieren. Praktisch: Der Auto-Modus dient laut AEG zur automatischen Anpassung der Saugkraft an den Bodenbelag und damit zur Optimierung der Laufzeit. Weitere Merkmale des Saugers sind eine digitale Anzeige für Infos zum Akku-, Geräte- sowie Filterstatus und die Wandhalterung mit Ladestation.

  • Rund 232 Euro compared to other online retailers sparen
  • 300-Milliliter-Staubbox; Bodendüse mit Licht; 2,2 Kilogramm leicht
  • Flächenleistung: bis zu 120 Quadratmeter (Herstellerangabe)
  • Zugabe: Matratzendüse AEG AZE149 BedProPower

AEG Ultimate 7000 at Tech Xataka

Mit Gutscheinen Rabatte sichern

Starke Schnäppchen finden Sie nicht nur bei Tech Xataka, sondern ebenso bei anderen Online-Shops. Mit einem passenden Fashionette-Gutschein save extra when buying handbags, sunglasses and more.

Continue Reading


Favorite treat: This is what Germans like to snack on most

Candies, chocolates, gummy bears, chocolate – sweets are popular with young and old alike. But one classic dominates the ranking of the most popular sweets: chocolate.

It is in the top 5 most popular sweets three times. According to Statista’s consumption and media analysis, around 26.1 percent of the German-speaking population aged 14 and over consumed chocolate bars at least once a week in 2021. This means an increase of almost two percent compared to the previous year.

An increase was also recorded for the most popular sweet, chocolate bars. In 2020, around 31.5 percent of those surveyed had eaten chocolate bars, while a year later the figure was already around 33 percent.

Continue Reading