TTNEWS
  • entertainment
  • Sport
  • Finance
  • tec
  • Travel
  • military
  • Parenting
  • fashion
  • game
  • history
  1. home
  2. tec

The model "bigger and better" has passed?AI big guy: find a new breakthrough

2024-11-12 12:46:43

November 12 news, artificial intelligence companies like OPENAI are committed to developing new training technologies in order to overcome unexpected delays and challenges encountered when constructing larger -scale language models.These technologies aim to "think" in a more similar to humans.

Many scientists, researchers and investors in the fieldIt affects the continuous demand of artificial intelligence companies to resources (such as energy and chip types).

Openai did not comment.Since the release of chat robots, many technology companies have benefited from the artificial intelligence boom, and the valuation has risen sharply.These companies have publicly announced that they can continue to improve artificial intelligence technology by increasing data and computing capabilities to continue to improve artificial intelligence technology.

However, some top scientists now publicly pointed out that the concept of "bigger and better" models is limited.Ilya Sutskever, former chief scientist and SAFE SuperIntelligence (SSI) founder, said that expanding the pre -training method has entered a bottleneck period.Pre -training refers to the stage of training artificial intelligence models. The model uses a large amount of unbar data to understand the language pattern and structure.

Sutzkwei has advocated that by increasing data and computing power to promote the progress of production artificial intelligence, it has created ChatGPT.Earlier this year, Suzkwei left Openai and established SSI.He pointed out: "The 2010s was an era of model expansion, and now we have returned to the era of miracles and discovery. Everyone is looking for the next breakthrough point. Now choosing the correct expansion method is more important than ever."

Sutzkwei did not disclose the specific details of the new method of the SSI teams exploration, only indicating that the team is studying the alternative way to expand the pre -training scale.

According to three insiders, researchers in the main artificial intelligence laboratory are trying to release a large language model that exceeds the performance of the OpenAI GPT-4 model.As a result, the GPT-4 model has been launched for nearly two years.

The "training operation" of these big models is not only costly, but it may reach tens of millions of dollars. It also needs to run hundreds of chips at the same time. The system is complicated and the risk of hardware failure is also high.In addition, researchers usually wait for several months to evaluate the final performance of the model, which increases the uncertainty in the development process.

What is even more tricky is that the demand for data for large language models is great, and the current artificial intelligence model has almost exhausted all the data resources in the world.At the same time, power shortage has also become another major problem in restricting training operations, because this process requires huge energy support.

In order to deal with these challenges, researchers are actively exploring the "test time calculation" technology, which enhances its performance in the "reasoning" stage of the model.For example, the model can generate and evaluate a variety of possibilities in real time, and ultimately select the best path instead of the answer immediately.

This method allows models to use more processing capabilities for challenging tasks, such as mathematics or coding problems, or complex operations similar to human reasoning and decision -making.

OpenAI researcher Noam Brown said at the TED Artificial Intelligence Conference held in San Francisco last month: "It turns out that letting robots think in play card games for 20 seconds for 20 secondsIt is equivalent to the effect of expanding the model of 100,000 times."Strawberry" can "think" in multiple steps, similar to human reasoning.At the same time, the O1 model also combines data and feedback from doctoral and industry experts.The core is to conduct additional training on the "basic" model such as GPT-4.Openai said it plans to apply this technology to more and larger basic models.

At the same time, according to five people familiar with the matter, researchers from other top artificial intelligence laboratories such as Anthropic, XAI and Google DeepMind are also actively developing their own "test time calculations".technology.

OPENAI chief product officer Kevin Weil (at a science and technology conference in October: "There are many results at the moment.Improve the model of the model.

This trend may reshape the competitive pattern of artificial intelligence hardware.So far, the demand for Nvidia artificial intelligence chips has always occupied the market leading position.Well -known venture capital institutions such as Sequoia Capital and Andreessen Horowitz have been keenly capturing this transformation and are evaluating the impact of its high investment.These institutions have invested heavily in the development of artificial intelligence models in many artificial intelligence laboratories such as OpenAi and XAI.

Sonya Huang, a partner of Sequoia Capital, said: "This change will lead us to a large -scale pre -training cluster to cloud -based distributed reasoning server-—The reasoning cloud "

Nvidias most advanced artificial intelligence chip demand has increased, promoting the companys market value to surpass Apple in October, becoming the highest market value company.However, with Nvidias leading position in the training chip market, this chip giant may face more competition in the reasoning market.

In response to the impact of its product demand, Nvidia responded that in the recent demonstration, the importance of the technology behind the O1 model has been emphasized.Huang Renxun, CEO of Nvidia, pointed out that the need for reasoning using its chip for reasoning is rising.

He said at a meeting in India: "We have found the second laboratory law, that is, the laws of zooming during reasoning ... All these factors jointly promoted Blackwell (the companyThe latest artificial intelligence chip) demand surge. "(Small)

Popular information
  • "Liang Ping No. 1" satellite is successfully launched at Jiuquan Satellite Launch Center | 2024-11-12 00:22:34
  • Highlights look first!The multi -type star equipment of China Electric Science and Technology 38 will be unveiled at the China Air Show | 2024-11-12 00:42:00
  • Feitian Integrity Apply for an implementation method and device patent installation method and device patent in the MacOS system device, solve the problem of unspeakable hardware equipment | 2024-11-12 00:42:19
  • Sword Monkey Gills!American female astronauts are thin and thin, Taiwan experts: three conditions appear in the body | 2024-11-12 00:45:06
  • Samsung Patent Exploring the Future of XR Head Display: Diversifying the way of interacting, creating an ultimate immersive experience | 2024-11-12 12:32:58
  • Lenovo ThinkPad X1 Carbon Aura Ai announced on November 18th, 986G weighing | 2024-11-12 12:33:01
  • In the third quarter, the Russian laptop sales TOP10 Honor Xiaomi Lenovo swipe the screen | 2024-11-12 12:33:06
  • OPPO PAD3 parameter exposure: equipped with Tianye 8350 chip+2.8K high screen | 2024-11-12 12:33:10
  • Intel Core Ultra 5 245K processor nuclear display overclocking to 3.0GHz, the performance increases by 50% | 2024-11-12 12:33:12
  • Conjusational blowing fan +1: Qiao Sibo launched the Th ARGB series integrated water cold radiator | 2024-11-12 12:33:17
  • Ryzen 7 9800X3D is difficult to find!German retailer: Only at the end of December | 2024-11-12 12:33:21
  • Apple upgrade Find My: Share location information, get back faster to lose luggage | 2024-11-12 12:33:26
  • In 2024, the total number of global TV foundry shipments was 3.1438 million units, an increase of 6.8% year -on -year | 2024-11-12 12:33:30
  • Intel Core Ultra 9 285 (65W)/285T (35W) processor exposure | 2024-11-12 12:33:33
  • Foreign media: U.S. pressure, TSMC stopped to supply the mainland 7nm AI chip | 2024-11-12 12:34:20
  • In October, the production and sales of new energy vehicles increased by nearly 50 % year -on -year | 2024-11-12 12:34:27
  • 65W/35W is here!Core Ultra 200s Family appeared in 11 CEOs to see flowers | 2024-11-12 12:43:43
  • ASUS launched the new 27 -inch display: 2K 360Hz screen first hair 5499 yuan | 2024-11-12 12:43:50
  • Guo Mingzheng: Apple first entered the smart home network camera market for the first time, and plans to mass production in 2026 | 2024-11-12 12:43:54
  • Apple launches AirPods Pro 2 and AirPods 4 firmware updates to repair small loopholes | 2024-11-12 12:44:01
  • The sales volume of Xiaomi bracelet 9 Pro is about three times the previous generation Lu Weibing: the more the generations do better, the better | 2024-11-12 12:44:05
  • Sulfide/polymer composite solid -state electrolytes help the development of all solid -state lithium batteries | 2024-11-12 12:44:59
  • Huiding Technology and United Electronics sign a strategic cooperation agreement: Promote the cutting -edge technology of the digital key system | 2024-11-12 12:45:14
  • Rhodes Wireless Micro Pocket Wireless Collar Microbi was released, with a double -off of 995 yuan | 2024-11-12 12:45:20
  • Haowei launched a laptop ultra -small -sized sensor OV0TA1B for the existence of detection and face recognition | 2024-11-12 12:45:23
  • Ryzen 7 9800X3D, 7800X3D, 9700X, 7700X 4.8GHz Same frequency comparison: performance improvement is simply simply | 2024-11-12 12:45:27
  • Colorful little hand wireless cross -screen Leibo MT560 Multimodes wireless mouse evaluation | 2024-11-12 12:45:34
  • An Titank launched the CX600M Trio mid -tower gaming case: panoramic sea view room, dual -cavity design | 2024-11-12 12:46:14
  • Xiaomi TV Hot Sale TCL foundry has won the first year of the world for the first year without suspense | 2024-11-12 12:46:21
  • Bank of America: AMD market share is obviously the leading Intel | 2024-11-12 12:46:24
Latest
Happy Bao | Dream of Dream Medicine Bloom -Graduate Students from our hospital won the second prize of the Capital Medical University 2024 Speech Contest Personal evaluation of the 30 -year history of the best lineup of Ma Lai can barely enter the bench The domestic "three major airlines" C919 aircraft gathered in Chengdu!Practicing flying and going north Shangguang Parents do this to break the "only performance theory", and each child can bloom unique light She, sent a letterless letter to the moon Old cup bonus super lpl champion!Attract the old We Korean aid: I want to support the championship, I want to raise children In 2025, the statutory holidays have been added for 2 days. What is the true attitude of tourism practitioners? What does the PPT look like by Lin updated?After reading it, I was cried by ugliness Beiqing: After the National Football Team Barin will return to Xiamen for the afternoon of the 15th, the 15th day of the 15th National Football Team VS Balling 23 people List exposure: Xie Wen can suspend the race!Fourth goalkeeper+flying wing failure selection The best element of the Super League announced, Wei Shihao missed, 4 people in Shanghai, Luneng 2, Wu Xi was surprised Ding Yongxun fell in love with Zhao Xuehua at first sight and loved each other for 37 years. Now the 36 -year -old son makes him worry Ye Ke has not seen Huang Xiaoming in the checkup. Paparas have been exposed to 5 months of pregnancy. The 24 -year -old Fan Ye compared the 28 -year -old Shi Yunpeng. Aspen: Mbappe has been silent after joining Real Madrid for 4 months. Only 2 interviews have been accepted in 4 months Chen Meng withdrew!Instead, Sun Yingsha was forced to have both and gave birth to 2 questions. What did Ma Lin think? It is the lowest -key county in Shanxi, with world -class famous mountains, but few people know the county name! Ye Ke promised to return the net to cancel the account again as a demon again!Huang Xiaoming is lazy, Ye Ke is alone for pregnancy! Big!Blast Yang Zi accompanied by sleeping: evidence has been obtained, involved in many popular actresses, more synthetic streams out "The Lane Family" Zhuang rushed to drive away his parents and forced Pengfei to buy a house. Only then did you know that Zhuang Chaoying was very lucky Wang Xiaofei hit Big S: A wedding with Ma Xiaomei will be re -wedd, Ma Xiaomei threw out propositions Who is the most runner -up in the World Cup?The Dutch Three Entry Finals are defeated, Argentina is tied, and the other team is the most The Clippers regretted, Harden 19+6+7, after the game, Harden walked towards the Rockets bench, hugged Ethan to pay attention to Rockets 111-103 Clippers!Player scores are released: 4 people are full, 3 people pass, 2 people pull their hips! No accident, this will become the main framework of Amurin Manchester United! Choose a rational student in kindergarten?Can "Run Run" Education really win on the starting line? British PS5 Pro price or permanent drop: the largest retail sales leading price reduction The 19 -day box office broke through 3.3 billion and won the global championship. The strongest movie this year was born. Daolang: The Macau concert is well received, and I won the two former CCTV host of Zhao Pu Li Xiaomeng. 2024 Inner Entertainment is to be exploded, only one year, the gap is obvious Lei Jun is jealous. Xiaomi SU7 has 100,000 offline and 100,000 orders. Guangzhou house tickets can buy new houses in the city!Expert: It is necessary to make the demolished households realized that in the past It is said that the Chery FR Division was established, and the headquarters is located in Shanghai Win 20 points!Du Feng won the first victory, and the new aid 23 points hit a new high. The chef should describe the job from the teachers and students and parents, and the supplier will not run away. Thirty points defeated, the CBA Journey really walked over?The three major foreign aids in Zhejiang broke out, and genius teenagers burst and burst The transformation of Jinji Co., Ltd. suffered a decline of 922 million large orders to terminate the operating pressure of 8.82 million yuan in the first three quarters. 4 games 0 goals!The number of shooters is lost, Alda is deeply trapped in the mud, and the situation of winning the championship deteriorates Crown: 0 to 4!The fatigue is shown. In the first round, Trump took Ding Junhui lightly Korean dramas have evolved to the male lead, no male lead is required The performance benchmark covers the global stock market and gold, and the world is actively configured with FOF to open the closed period CITIC Securities A shares increased by 60% of Yuexiu Capital to reduce holdings by 1% or cash out 5 billion yuan Academician Qian Qihu: The domestic shield is going to the world. I hope that the younger generation of "Chinese tunnelers" will create further glory The whole Chinese class rushes for another year!BLG is highly likely to renew the contract, ELK renewal conditions are only one The husband takes the child to buy milk powder to bring it back to the PS5 Pro, his wife asked the Internet online, and the merchant sent God to assist The most surprising seven players?Downs first!Hilde, three goals on the list! Shenzhen Chuanyin Communications under Chuanyin was awarded the title of new "Little Giant" enterprise in the national specialized specialty The stock price of the market fell by 6.43%in the afternoon of US $ 13.37 in the US real estate investment Sure enough!6 major foreign aid blessings, old acquaintances return, Zhou Peng will lead the Shenzhen team to take off The Egyptian Museum opened the night exhibition tourists with close contact with Pharaoh

©2024 ttnews All rights reserved

Privacy Policy | Service Terms | contact us