Connect with us

Tech

Meta to deploy in-house custom chips this year to power AI drive – memo

Meta to deploy in-house custom chips this year to power AI drive – memo

Published

on

Meta to deploy in-house custom chips this year to power AI drive - memo

 Facebook owner Meta Platforms (META.O), opens new tab plans to deploy into its data centers this year a new version of a custom chip aimed at supporting its artificial intelligence (AI) push, according to an internal company document seen by Reuters on Thursday.

The chip, a second generation of an in-house silicon line Meta announced last year, could help to reduce Meta’s dependence on the Nvidia (NVDA.O), opens new tab chips that dominate the market and control the spiraling costs associated with running AI workloads as it races to launch AI products.

The world’s biggest social media company has been scrambling to boost its computing capacity for the power-hungry generative AI products it is pushing into apps Facebook, Instagram and WhatsApp and hardware devices like its Ray-Ban smartglasses, spending billions of dollars to amass arsenals of specialized chips and reconfigure data centers to accommodate them.

At the scale at which Meta operates, a successful deployment of its own chip could potentially shave off hundreds of millions of dollars in annual energy costs and billions in chip purchasing costs, according to Dylan Patel, founder of the silicon research group SemiAnalysis.

Advertisement

The chips, infrastructure and energy required to run AI applications has become a giant sinkhole of investment for tech companies, to some degree offsetting gains made in the rush of excitement around the technology.

A Meta spokesperson confirmed the plan to put the updated chip into production in 2024, saying it would work in coordination with the hundreds of thousands of off-the-shelf graphics processing units (GPUs) – the go-to chips for AI – the company was buying.

“We see our internally developed accelerators to be highly complementary to commercially available GPUs in delivering the optimal mix of performance and efficiency on Meta-specific workloads,” the spokesperson said in a statement.

Meta CEO Mark Zuckerberg last month said the company planned to have by the end of the year roughly 350,000 flagship “H100” processors from Nvidia, which produces the most sought-after GPUs used for AI. Combined with other suppliers, Meta would accumulate the equivalent compute capacity of 600,000 H100s in total, he said.

The deployment of its own chip as part of that plan is a positive turn for Meta’s in-house AI silicon project, after a decision by executives in 2022 to pull the plug on the chip’s first iteration.

Advertisement

The company instead opted to buy billions of dollars worth of Nvidia’s GPUs, which have a near monopoly on an AI process called training that involves feeding enormous data sets into models to teach them how to perform tasks.

The new chip, referred to internally as “Artemis,” like its predecessor can perform only a process known as inference in which the models are called on to use their algorithms to make ranking judgments and generate responses to user prompts.

Reuters last year reported that Meta is also working on a more ambitious chip that, like GPUs, would be capable of performing both training and inference.

The Menlo Park, California-based company shared details about the first generation of its Meta Training and Inference Accelerator (MTIA) program last year. The announcement portrayed that version of the chip as a learning opportunity.

Despite those early stumbles, an inference chip could be considerably more efficient at crunching Meta’s recommendation models than the energy thirsty Nvidia processors, according to Patel.

Advertisement

“There is a lot of money and power being spent that could be saved,” he said. 

Tech

Don’t worry if your Android gets stolen, new Theft Detection Lock comes to rescue

Don’t worry if your Android gets stolen, new Theft Detection Lock comes to rescue

Published

on

By

Don't worry if your Android gets stolen, new Theft Detection Lock comes to rescue

Google revealed plans to introduce a ground-breaking security feature for Android devices: Theft Detection Lock at the Google I/O 2024 developer conference held on Wednesday.

This innovative addition is specifically designed to combat the rising threat of smartphone theft by automatically locking the device when suspicious activity is detected.

Powered by artificial intelligence, Theft Detection Lock utilizes advanced algorithms to identify common motions associated with theft.

For instance, if a device suddenly begins moving rapidly in the opposite direction, indicative of a potential theft scenario, the feature swiftly triggers a screen lock mechanism.

Advertisement

This proactive measure aims to thwart thieves from easily accessing sensitive user data stored on the device.

In addition to Theft Detection Lock, Google also announced the introduction of an Offline Device Lock feature. This functionality serves as a safeguard against intentional disconnection from the network, a common tactic employed by thieves to bypass security measures.

Instances such as repeated failed authentication attempts will prompt the Offline Device Lock, providing an added layer of protection for users’ devices.

Google revealed plans to enhance device security with measures aimed at preventing remote factory resets initiated by thieves.

Under the forthcoming update, if a thief attempts to reset a stolen device, they will be unable to set it up again without the necessary device or Google account credentials. This strategic move renders stolen devices essentially unsellable, significantly diminishing the incentives for phone theft.

Advertisement

Continue Reading

Tech

Tesla must face vehicle owners’ lawsuit over self-driving claims

Tesla must face vehicle owners’ lawsuit over self-driving claims

Published

on

By

Tesla must face vehicle owners' lawsuit over self-driving claims

A U.S. judge on Wednesday rejected Tesla’s bid to dismiss a lawsuit accusing Elon Musk’s electric car company of misleading owners into believing that their vehicles could soon have self-driving capabilities.

The proposed nationwide class action accused Tesla and Musk of having since 2016 falsely advertised Autopilot and other self-driving technology as functional or “just around the corner,” inducing drivers to pay more for their vehicles. 

U.S. District Judge Rita Lin in San Francisco said owners could pursue negligence and fraud-based claims, to the extent they relied on Tesla’s representations regarding vehicles’ hardware and ability to drive coast-to-coast across the U.S.

Without ruling on the merits, Lin said that “if Tesla meant to convey that its hardware was sufficient to reach high or full automation, the plainly alleges sufficient falsity.”

Advertisement

The judge dismissed some other claims.

Tesla and its lawyers did not immediately respond to requests for comment. Lawyers for Tesla vehicle owners did not immediately respond to similar requests.

The case was led by Thomas LoSavio, a retired California lawyer who said he paid an $8,000 premium in 2017 for Full Self-Driving capabilities on a Tesla Model S, believing it would make driving safer if his reflexes deteriorated as he aged.

LoSavio said he was still waiting for the technology six years later, with Tesla remaining unable “even remotely” to produce a fully self-driving car.

The lawsuit seeks unspecified damages for people who since 2016 bought or leased Tesla vehicles with Autopilot, Enhanced Autopilot and Full Self-Driving features.

Advertisement

Tesla has for many years faced federal probes into whether its self-driving technology might have contributed to fatal crashes.

Federal prosecutors are separately examining whether Tesla committed securities fraud or wire fraud by misleading investors about its vehicles’ self-driving capabilities, according to three people familiar with the matter.

Tesla has said Autopilot lets vehicles steer, accelerate and brake in their lanes, and Full Self-Driving lets vehicles obey traffic signals and change lanes.

But it had acknowledged that neither technology makes vehicles autonomous, or excuses drivers from paying attention to the roads.

The case is In re Tesla Advanced Driver Assistance Systems Litigation, U.S. District Court, Northern District of California, No. 22-05240.

Advertisement

Continue Reading

Tech

Microsoft asks hundreds of China staff to relocate

Microsoft asks hundreds of China staff to relocate

Published

on

By

Microsoft asks hundreds of China staff to relocate

Microsoft is asking about 700 to 800 people in its China-based cloud-computing and artificial-intelligence operations to consider transferring outside the country, the Wall Street Journal reported on Thursday.

The employees, mostly engineers with Chinese nationality, were earlier in the week offered an option to transfer to countries including the U.S., Ireland, Australia and New Zealand, the report said, citing people familiar with the matter.

The move comes amid spiralling US-China relations as the Biden administration cracks down on various sectors of Chinese imports, including electric vehicle (EV) batteries, computer chips and medical products.

A Microsoft spokesperson told the Journal that providing internal opportunities is part of its global business and confirmed the company had shared an optional internal transfer opportunity with a subset of employees. 

Advertisement

Reuters reported earlier this month that the U.S. Commerce Department is considering a new regulatory push to restrict the export of proprietary or closed source AI models, whose software and the data it is trained on are kept under wraps.

The spokesperson, however, told the newspaper that the company remains committed to the region and will continue to operate in China.

Microsoft didn’t immediately respond to a Reuters request for comment.

Advertisement
Continue Reading

Trending

Copyright © GLOBAL TIMES PAKISTAN