• Home
  • Motorcycles
  • Electric Motorcycles
  • 3 wheelers
  • FUV Electric 3 wheeler
  • Shop
  • Listings

Subscribe to Updates

Get the latest creative news from CycleNews about two, three wheelers and Electric vehicles.

What's Hot

Arcimoto to resume electric vehicle production at Eugene factory after shutdown – The Register-Guard

Diabetes Is Rising in Africa. Could It Lead to New Breakthroughs?

Samsung Galaxy S25 Edge Reveal Confirmed and Lenovo Launches a New 3D Laptop—Your Gear News of the Week

Facebook Twitter Instagram
  • Home
  • Motorcycles
  • Electric Motorcycles
  • 3 wheelers
  • FUV Electric 3 wheeler
  • Shop
  • Listings
Facebook Twitter Instagram Pinterest
Cycle News
Submit Your Ad
Cycle News
You are at:Home » How Chinese AI Startup DeepSeek Made a Model that Rivals OpenAI
Electric Motorcycles

How Chinese AI Startup DeepSeek Made a Model that Rivals OpenAI

cycleBy cycleJanuary 25, 202504 Mins Read
Share Facebook Twitter Pinterest LinkedIn Tumblr Email
Share
Facebook Twitter LinkedIn Pinterest Email


Today, DeepSeek is one of the only leading AI firms in China that doesn’t rely on funding from tech giants like Baidu, Alibaba, or ByteDance.

A Young Group of Geniuses Eager to Prove Themselves

According to Liang, when he put together DeepSeek’s research team, he was not looking for experienced engineers to build a consumer-facing product. Instead, he focused on PhD students from China’s top universities, including Peking University and Tsinghua University, who were eager to prove themselves. Many had been published in top journals and won awards at international academic conferences, but lacked industry experience, according to the Chinese tech publication QBitAI.

“Our core technical positions are mostly filled by people who graduated this year or in the past one or two years,” Liang told 36Kr in 2023. The hiring strategy helped create a collaborative company culture where people were free to use ample computing resources to pursue unorthodox research projects. It’s a starkly different way of operating from established internet companies in China, where teams are often competing for resources. (A recent example: ByteDance accused a former intern—a prestigious academic award winner, no less—of sabotaging his colleagues’ work in order to hoard more computing resources for his team.)

Liang said that students can be a better fit for high-investment, low-profit research. “Most people, when they are young, can devote themselves completely to a mission without utilitarian considerations,” he explained. His pitch to prospective hires is that DeepSeek was created to “solve the hardest questions in the world.”

The fact that these young researchers are almost entirely educated in China adds to their drive, experts say. “This younger generation also embodies a sense of patriotism, particularly as they navigate US restrictions and choke points in critical hardware and software technologies,” explains Zhang. “Their determination to overcome these barriers reflects not only personal ambition but also a broader commitment to advancing China’s position as a global innovation leader.”

Innovation Born out of a Crisis

In October 2022, the US government started putting together export controls that severely restricted Chinese AI companies from accessing cutting-edge chips like Nvidia’s H100. The move presented a problem for DeepSeek. The firm had started out with a stockpile of 10,000 H100’s, but it needed more to compete with firms like OpenAI and Meta. “The problem we are facing has never been funding, but the export control on advanced chips,” Liang told 36Kr in a second interview in 2024.

DeepSeek had to come up with more efficient methods to train its models. “They optimized their model architecture using a battery of engineering tricks—custom communication schemes between chips, reducing the size of fields to save memory, and innovative use of the mix-of-models approach,” says Wendy Chang, a software engineer turned policy analyst at the Mercator Institute for China Studies. “Many of these approaches aren’t new ideas, but combining them successfully to produce a cutting-edge model is a remarkable feat.”

DeepSeek has also made significant progress on Multi-head Latent Attention (MLA) and Mixture-of-Experts, two technical designs that make DeepSeek models more cost-effective by requiring fewer computing resources to train. In fact, DeepSeek’s latest model is so efficient that it required one-tenth the computing power of Meta’s comparable Llama 3.1 model to train, according to the research institution Epoch AI.

DeepSeek’s willingness to share these innovations with the public has earned it considerable goodwill within the global AI research community. For many Chinese AI companies, developing open source models is the only way to play catch-up with their Western counterparts, because it attracts more users and contributors, which in turn help the models grow. “They’ve now demonstrated that cutting-edge models can be built using less, though still a lot of, money and that the current norms of model-building leave plenty of room for optimization,” Chang says. “We are sure to see a lot more attempts in this direction going forward.”

The news could spell trouble for the current US export controls that focus on creating computing resource bottlenecks. “Existing estimates of how much AI computing power China has, and what they can achieve with it, could be upended,” Chang says.



Source link

Share. Facebook Twitter Pinterest LinkedIn Tumblr Email
Previous ArticleThis Man Eats So Much Butter, Cheese, and Beef That Cholesterol Oozes From His Skin
Next Article Taylor Swift Triggered a Tsunami of Sports Bets. Then She Stopped Turning Up
cycle
  • Website

Related Posts

Diabetes Is Rising in Africa. Could It Lead to New Breakthroughs?

May 10, 2025

Samsung Galaxy S25 Edge Reveal Confirmed and Lenovo Launches a New 3D Laptop—Your Gear News of the Week

May 10, 2025

ICE’s Deportation Airline Hack Reveals Man ‘Disappeared’ to El Salvador

May 10, 2025
Add A Comment

Leave A Reply Cancel Reply

You must be logged in to post a comment.

Demo
Top Posts

Arcimoto to resume electric vehicle production at Eugene factory after shutdown – The Register-Guard

May 10, 2025

The urban electric commuter FUELL Fllow designed by Erik Buell is now opening orders | thepack.news | THE PACK

July 29, 2023

2024 Yamaha Ténéré 700 First Look [6 Fast Facts For ADV Riding]

July 29, 2023
Stay In Touch
  • Facebook
  • YouTube
  • TikTok
  • WhatsApp
  • Twitter
  • Instagram
Latest Reviews

Subscribe to Updates

Get the latest tech news from FooBar about tech, design and biz.

Demo
Most Popular

Arcimoto to resume electric vehicle production at Eugene factory after shutdown – The Register-Guard

May 10, 2025

The urban electric commuter FUELL Fllow designed by Erik Buell is now opening orders | thepack.news | THE PACK

July 29, 2023

2024 Yamaha Ténéré 700 First Look [6 Fast Facts For ADV Riding]

July 29, 2023
Our Picks

Grand Prix, The Quail Winner

Generative AI Learned Nothing From Web 2.0

11 Best Computer Speakers (2024): Affordable, Soundbar, Surround Sound, Gaming

Subscribe to Updates

Get the latest news from CycleNews about two, three wheelers and Electric vehicles.

© 2025 cyclenews.blog
  • Home
  • About us
  • Get In Touch
  • Shop
  • Listings
  • My Account
  • Submit Your Ad
  • Terms & Conditions
  • Stock Ticker

Type above and press Enter to search. Press Esc to cancel.