Cringe

keys to control and optimize your cost

Although the possibilities that are glimpsed for ChatGPT and generative Artificial Intelligence (AI) are many, the high cost that it can entail for organizations is a topic that is not always talked about. However, it is necessary to go deeper in order to control its cost.

Typically, it is the big companies like Microsoft, Meta and Google that are investing heavily to develop their technological advantage by leveraging the AI. However, if the margin for AI applications is typically smaller than the margins for Software as a Service, due to the high cost of computing, it could dampen the current boom.

Even when the software is built or trained, it still requires a lot of computation to run large language models because it does billions of calculations every time it returns a response to a prompt. By comparison, serving applications or web pages requires much less computation.

These calculations also require specialized hardware. While traditional processors can run models of machine learning, They’re slow. Most of the training now takes place on graphics processors, or GPUs, which were initially intended for 3D gaming but have become the standard for AI applications because they can do many simple calculations simultaneously.

AI training models

Analysts estimate that the process of training a language model such as OpenAI GPT-3 could cost more than 4 million dollars. The most advanced language models could multiply this number.

Organizations that build great language models they should be cautious because it costs a lot

Meta’s largest LLaMA model released last month, for example, used 2048 Nvidia A100 GPUs to train on 1.4 trillion tokens (750 words is about 1000 tokens), which took about 21 days.

It took about a million GPU hours to train. With AWS-exclusive pricing, it would cost more than $2.4 million. And with 65 billion parameters, it’s smaller than current GPT models in OpenAI, such as ChatGPT-3, which has 175 billion parameters.

Organizations that build great language models they should be cautious when they retrain the software, which helps improve their capabilities, because it costs a lot.

More use, higher pay

To use a trained machine learning model to make predictions or generate text, engineers use the model in a process called “inference,” which can be much more expensive than training as it may need to be run millions of times to become popular.

A product like ChatGPTwhich is estimated to have hit 100 million monthly active users in January, could have cost OpenAI $40 million to process the millions of messages people entered into the software that month.

Costs skyrocket when these tools are used billions of times a day. Financial analysts anticipate that the chatbot Bing AI from Microsoftwhich runs on an OpenAI ChatGPT model, needs at least $4 trillion in infrastructure to deliver answers to all Bing users.

how could i change

It is not clear whether AI computing will remain expensive as the industry develops. Companies that make entry-level models, semiconductor manufacturers, and start-ups see opportunities in lowering the price of running AI software.

More and more companies will focus on the development of smaller and more specific models to optimize costs

Nvidia, which has about 95% of the market for AI chips, continues to develop powerful versions designed specifically for machine learning, but improvements in chip power across the industry have slowed in recent years.

Some companies have focused on the high cost of AI as a business opportunity and more and more companies will focus on developing smaller and more specific models. These are cheaper to train and operate, rather than language models which, like ChatGPT, manage to attract much of the attention.

Meanwhile, OpenAI announced last month that it is lowering the cost for enterprises to access its GPT models. Now he charges a fifth of a cent for about 750 words of production.

initial image | Negative Space

Related Topics:control cost keys optimize

Up Next

The IT channel, a fundamental ally of the CISO to face new challenges

Don't Miss

What to keep in mind when negotiating with clients

Click to comment

Cringe

Test winner headphones: These ANC headphones beat even Sony from the throne

The most important things at a glance:

The Sennheiser Momentum 4 Wireless is our current test winner among Bluetooth headphones

You are currently getting the model for 268.21 euros at Amazon

Below you will find an excerpt from our best list of Bluetooth headphones

At the time of writing, Sony’s WH-1000XM5 is no longer our number one noise-cancelling headphone. The Sony headphones were beaten by the Sennheiser Momentum 4 Wireless.

The Momentum 4 Wireless convinces with a great, clear sound with a rich bass. As a reward, there is the top grade of 1.2, with which the Sennheiser model beats the former test winner in terms of sound. The excellent active noise suppression was also a lot of fun in the practical test. In our stress test scenario (simulated aircraft noise), the Sennheiser Momentum 4 Wireless attenuated very effectively for us. There is further praise for the excellent battery life: With the highest ANC strength, the Sennheiser Momentum 4 Wireless ran for a whopping 53 hours in our test scenario – a very strong performance. Although some headphones run longer without ANC, since the external signal processing cannot be deactivated with the Sennheiser Momentum 4 Wireless, we were not able to test this here.

A few small things bothered, for example, the ear cups can only be rotated, but not folded. But that’s complaining on a high level.

Cringe

Time change from Saturday to Sunday: Drivers now face a very special danger

The ADAC advises drivers to drive with foresight and be more aware of the dangers in order to avoid serious accidents involving wildlife. This applies in particular to forest sections and roadside field edges. In purely temporal terms, the evening and early morning hours during twilight are particularly dangerous. So foot off the gas and always be ready to brake.

An additional helper is the free Wildwarner app, which is available for Android and iOS. The uses acoustic signals to draw your attention to particular danger spots. The best way to do this is to connect the app to your car via Bluetooth and receive the information via the built-in music system. You do not have to operate the app itself while driving.

Wildwarner covers Germany, Austria and Switzerland. Hunters and drivers can optionally register and actively report danger spots themselves. If you already see wild animals on the side of the road, reduce your speed further and switch off the high beam. Horns can be used to scare away wild animals.

If you want, you can also report an accident with wildlife or a dead animal along the route in the animal find register. This is a database that systematically records animals nationwide.

Cringe

The end of “John Wick 4” explained: what comes after the action hit?

The end of “John Wick 4” probably came as a surprise to most fans. The ex-killer wins the duel against the nasty Marquis de Gramont (Bill Skarsgård) and is thus released from all duties to the Hohen Hammer. Unfortunately, he was badly injured in the shootout with his former friend and current antagonist Caine (Donnie Yen). And so, with everything settled, John Wick, bleeding heavily, sits on the steps below the Sacre Ceour Cathedral, looks up at the beautiful suns and thinks of his late wife Helen (Bridget Moynahan) before he falls dead himself. In the next scene, Winston (Ian McShane) and the Bowery King (Laurence Fishburne) stand in front of the former hitman’s grave and wonder whether he has ended up in heaven or hell.

So John Wick really does appear to be dead. And that, although it was said for a long time that there would be a fifth part. But as director Chad Stahelski has now revealed to The Hollywood Reporter, he and Keanu Reeves have only just finished the “John Wick” series. Nevertheless, they are not averse to further sequels. Unfortunately, ambiguous statements like these are standard in Hollywood. After all, you don’t want to obstruct the future of a franchise. But with Chad Stahelski’s announcement, you can be pretty sure that we won’t see a “John Wick” movie in the near future.

The post-credit sequence in the fourth part is all the more irritating. Because we see Donnie Yen’s character Caine again, how he visits his daughter. But before he can reach her, Akira (Rina Sawayama) suddenly appears. She probably wants revenge on Caine for killing her father. But before that happens, the film ends. Now, of course, one can speculate: is the scene just there to bring Caine and Akira’s stories to an end? Or is it even the cornerstone for a spin-off? An offshoot has already been confirmed that expands the “John Wick” universe.