in

Apple opts for Google chips in AI infrastructure, sidestepping Nvidia


In a report published on Monday, it was disclosed that Apple sidestepped industry leader Nvidia in favour of chips designed by Google.

Instead of employing Nvidia’s GPUs for its artificial intelligence software infrastructure, Apple will use Google chips as the cornerstone of AI-related features and tools set to launch soon.

The fact that Apple chose to use Google’s cloud infrastructure is quite interesting because Nvidia has already captured this market, bringing Google, Amazon.com, and other cloud computing companies to 80% of the overall share. Therefore, it seems to be a smart strategic move by Apple to use an alternative source to minimise its hardware dependency.

Apple has never revealed that it is avoiding Nvidia chips in any way. However, a statement in a research paper detailing the hardware and software infrastructure powering the company’s AI tools and features is raising eyebrows. This description conspicuously lacks any reference to Nvidia chips. When asked about this, Apple chose not to respond, leaving industry analysts to make educated guesses.

According to the paper, Apple’s AI model training process leverages two distinct varieties of Google’s tensor processing units (TPUs), organised in expansive clusters of chips. When the tech giant Google prepared to build its new AI model, designed to operate on iPhones and other products offered by the company, it began deploying no fewer than 2,048 of its advanced TPUv5p chips. An even more significant part of developing the server-side for this model involved no fewer than 8,192 TPUv4 processors.

Google’s decision to use TPUs contrasts with Nvidia’s focus on GPUs, which are now practically synonymous with machine learning development. Making the choice even more interesting, Google’s TPUs are not only different by design, but also by access. Unlike Nvidia’s products – which are available independently of other providers – Google only leases TPUs through the Google Cloud Platform, forcing customers to develop their software with the help of Google’s cloud to take advantage of them.

Apple revealed this information just as it started rolling out its Apple Intelligence abilities to beta users. Currently, its developer beta program – which gives app creators an early preview of future software versions – incorporates a variety of AI-powered features. First and foremost, the use of its Writing Tools is now enhanced. Users may find an improved iteration of Siri, which now understands text as well as voice. AI alternatives can also be used for Mail and Smart Replies, thanks to email summarisation. As a bonus, beta testers can now transcribe their dictations with the assistance of AI.

Based on real-world usage and feedback, Apple will be able to improve its AI features – such as ChatGPT integration – as well as expand the functionality of Siri to interact with third-party apps. Allowing users to familiarise themselves with the AI and provide feedback, this strategy will enable the corporation to make an optimal general release in the fall.

Even though Reuters reported in June about Apple using TPU chips, the full scope of the use of Google hardware by the company would have remained unknown were it not for Monday’s detailed research. Furthermore, it is noteworthy that Apple’s engineers claimed to have the potential to develop even more significant and complex models with Google’s chips—suggesting that the current implementation is only the beginning of Apple’s AI projects.

This news comes a week after Apple held its annual developer conference in June, where the firm revealed a range of new AI capabilities, including the incorporation of OpenAI’s ChatGPT technology into the Apple software ecosystem. There was widespread euphoria in the tech space, with some seeing it as proof positive of Apple’s commitment to the future, blending ambiance with the latest technological trends.

Despite the significance of this news, Apple’s stock showed only a marginal reaction, ticking down 0.1% to $218.24 in regular trading on Monday. This muted response may indicate that investors are taking a wait-and-see approach to Apple’s AI strategy, particularly given the company’s historical tendency to enter new technological landscape deliberately, and with polished offerings.

(Photo by Medhat Dawoud)

See also: NVIDIA and Meta CEOs: Every business will ‘have an AI’

Want to learn more about AI and big data from industry leaders? Check out AI & Big Data Expo taking place in Amsterdam, California, and London. The comprehensive event is co-located with other leading events including Intelligent Automation Conference, BlockX, Digital Transformation Week, and Cyber Security & Cloud Expo.

Explore other upcoming enterprise technology events and webinars powered by TechForge here.

Tags: apple, artificial intelligence, Google, machine learning, Nvidia


AI Shocks Again: AI Robots with Human Brain, AGI, OpenAI, DeepMind & More (July Monthly News)

TRIVAGO logo

Trivago Set to Acquire Holisto for Up to $60M