News/Computing
Apple’s M5 Chip Is Powering Macs, AI Servers with Advanced 3D Packaging
Apple's M5 chip will utilize advanced packaging technology to serve both Macs and AI servers, highlighting the company's strategy to vertically integrate its supply chain and meet growing computational demands. Key Takeaways: Apple is expanding its cooperation with TSMC to develop a next-generation hybrid SoIC (System on Integrated Chip) package that combines 3D stacking and thermoplastic carbon fiber composite molding technology: The advanced packaging allows for better electrical performance and thermal management compared to traditional 2D chip designs, enabling Apple to create powerful, efficient chips for a wide range of applications. The M5 chip is currently in a small trial...
read Jul 8, 2024Applied Materials Unveils Chip Wiring Innovations To Keep Pace With Moore’s Law
The semiconductor industry is striving to keep pace with Moore's Law and enable more powerful, energy-efficient chips for AI computing. Applied Materials has unveiled crucial chip wiring innovations that will help address key challenges in this pursuit: Enabling 2nm node manufacturing and beyond: Applied Materials' new materials in chip wiring will enable the production of logic chips at the 2nm node, where circuits are just two billionths of a meter apart. These advancements will: Reduce wiring resistance by up to 25%, improving chip performance and power consumption Decrease chip capacitance by up to 3% through the use of innovative materials...
read Jul 8, 2024DeepMind Just Made a Breakthrough in AI Training
Google DeepMind's JEST AI training method promises significant speed and efficiency gains over traditional techniques, potentially addressing concerns about AI's growing power demands. Key Takeaways: DeepMind's JEST (joint example selection) training method breaks from traditional AI training by focusing on entire batches of data instead of individual data points: A smaller AI model first grades data quality from high-quality sources and ranks batches by quality. The small model then determines the batches most fit for training a larger model, resulting in up to 13 times faster training with 10 times less computation. Addressing AI's Power Demands: The JEST research comes...
read Jul 6, 2024Neuromorphic AI Chips Poised to Change Edge Computing and Intelligent Devices
The rise of neuromorphic computing and ultra-efficient AI chips promises to revolutionize edge computing and intelligent devices by dramatically reducing the energy and computational requirements of AI. Mimicking the brain's efficiency: Neuromorphic processors, like Innatera's Spiking Neural Processor, are designed to emulate the way biological brains process information using artificial neurons that communicate through spikes, enabling complex AI tasks with a fraction of the energy used by traditional solutions. These brain-inspired architectures are particularly well-suited for edge computing applications in consumer devices and industrial IoT, such as always-on audio processing, real-time sensor fusion, and ultra-low power computer vision. Innatera's neuromorphic...
read Jul 5, 2024AI Scalability Concerns: Experts Explore Solutions for Infrastructure Challenges and Future Potential
The rapid advancement of AI is creating concerns about the scalability of the infrastructure required to support it, potentially limiting its future potential. Key stakeholders are exploring various solutions to address the growing compute and storage demands while controlling costs and environmental impact. The challenge of scaling AI infrastructure: As large language models (LLMs) continue to grow, so do the training and inference requirements, raising concerns about the availability of GPU AI accelerators and the overall scalability of AI workloads: Daniel Newman, CEO at The Futurum Group, highlights the complexities that come with scaling AI, including the availability of power...
read Jul 4, 2024AI Hackathon Reveals Rapid Problem-Solving Potential, Heralds Specialized AI Infrastructure Era
The AI-powered hackathon hosted by Crusoe Energy and Lowercarbon Capital showcased the transformative potential of artificial intelligence in tackling complex challenges in the clean energy sector and beyond. AI accelerating problem-solving in the energy industry: The winning projects demonstrated how AI can compress months or years of traditional work into mere hours, potentially revolutionizing clean energy deployment: Verdigris developed an AI system that analyzes mortgage data to identify homeowners for zero-cost energy upgrades and generates personalized marketing materials, including AI-created images of homes with proposed improvements. Daylight created a system that rapidly extracts and maps complex stakeholder relationships from dense...
read Jul 2, 2024Surface Pro 11 and Laptop 7 Represent Milestone for AI-Enabled Computers
Microsoft's new Surface Pro 11 and Surface Laptop 7 mark a significant milestone for Windows on Arm, offering improved performance and compatibility that make them viable alternatives to Intel-based PCs for many users, despite some remaining limitations and superfluous AI features. Familiar design, improved internals: The Surface Pro 11 and Surface Laptop 7 maintain the iconic Surface design elements, such as 3:2 aspect ratio displays and rounded corners, while overhauling the internal hardware with Arm-based processors: By keeping the exterior design unchanged, Microsoft sends a message that these are just regular Surface devices, and users need not worry about the...
read Jul 2, 2024Microsoft’s AI-Powered Contact Center Solution Provides Glimpse Into Future of Customer Service
Microsoft Dynamics 365 Contact Center now generally available: Microsoft's Copilot-powered contact center solution, Dynamics 365 Contact Center, is now generally available, offering a complete, composable solution for contact centers built on Azure's hyperscale cloud platform. Key benefits of Dynamics 365 Contact Center: The solution provides effortless self-service across various channels, accelerated human-assisted service through intelligent routing and AI tools, and operational efficiency gains via generative AI-based real-time reporting and extensive integration capabilities. Customers can engage through voice, SMS, chat, email, and social media, with sophisticated pre-integrated copilots driving personalized conversations for rich self-service. Intelligent unified routing directs requests requiring human...
read Jul 2, 2024The AI Operating System Poised to Transform Generative AI in the Enterprise
A revolutionary AI operating system is on the horizon, promising to redefine how generative AI is used in the enterprise by providing a scalable data platform capable of handling vast amounts of structured and unstructured data. The challenges of an AI operating system: Creating an operating system that enables generative AI to perform at its best requires meeting specific demands while maintaining compatibility with existing enterprise infrastructure: Advanced dynamic resource management, real-time processing, enhanced security, and support for edge computing are essential components of an AI operating system. The operating system must provide a layer of abstraction to allow algorithms...
read Jul 1, 2024Groq’s AI Chip Ignites Industry Buzz, Promising Unrivaled Efficiency and Performance
The buzz around AI chip startup Groq is reaching a fever pitch as the company gears up to showcase its groundbreaking technology at VentureBeat's Transform 2024 conference. With claims of delivering lightning-fast AI inference at a fraction of the power consumption of traditional GPUs, Groq is positioning itself as a formidable challenger to Nvidia's dominance in the AI hardware market. Groq's AI PU Inference Engine sparks industry excitement: CEO Jonathan Ross has been making waves with impressive demos of Groq's technology, which has caught the attention of industry experts and media outlets alike: Matt Shumer, CEO of HypeWriteAI and OthersideAI,...
read Jun 27, 2024AI Breakthrough: Language Models without Matrix Multiplication, Slashing Power Consumption
Researchers claim a breakthrough in AI efficiency by eliminating matrix multiplication, a fundamental operation in current neural networks, which could significantly reduce the power consumption and costs of running large language models. Key Takeaways: Researchers from UC Santa Cruz, UC Davis, LuxiTech, and Soochow University have developed a method to run AI language models without using matrix multiplication (MatMul), which is currently accelerated by power-hungry GPU chips. Their custom 2.7 billion parameter model achieved similar performance to conventional large language models while consuming far less power when run on an FPGA chip. This development challenges the prevailing paradigm that matrix...
read Jun 26, 2024Intel’s Optical Chiplet Promises AI Boost, Transforming Data Centers
Intel has developed a small chiplet that uses light instead of electricity to transmit data between processors, potentially improving the bandwidth and efficiency of data centers tasked with intense AI processing. The OCI chiplet was recently demonstrated by Intel at the Optical Fiber Communication Conference, integrated with one of its CPUs. By using laser light traveling through fiber optic connections, the chiplet enables processors to communicate over distances nearly 100 times longer than traditional copper cables, allowing for more flexible and distributed data center architectures. Addressing AI's computational demands: The OCI chiplet is designed to help data centers cope with...
read Jun 26, 2024AI Data Center Boom: Powering Growth, Benefiting REITs, Energy, and Mining Sectors
The AI data center boom is set to drive significant growth in electricity demand and benefit a range of sectors, according to Jefferies analysts: Key takeaways: The increasing use of GPUs for AI investments has led to a surge in demand for data center space and power, with growth exceeding 30% in most markets over the past two years and showing no signs of slowing down. While Jefferies expects data center growth to remain robust, power generation constraints, supply chain issues, and labor market limitations may limit the acceleration rate. As the data center market expands, electricity demand is expected...
read Jun 26, 2024AI’s Growing Energy Demand: A Nuanced Look Beyond the Hype
The energy demands of generative AI have recently come under scrutiny, but a closer look reveals a more nuanced picture: Data centers' growing energy use predates AI boom: While recent articles have focused on AI's impact on energy usage, the growth in data center energy consumption has been steady for over a decade, largely preceding the current generative AI boom: Worldwide data center energy usage has grown from about 100 TWh in 2012 to around 350 TWh in 2024, with the majority of this growth occurring before the launch of popular generative AI tools in 2022. Projections suggest that AI...
read Jun 26, 2024AI’s Energy Apocalypse Fears Exaggerated: Putting Generative AI’s Power Consumption Into Perspective
The rapid rise of generative AI has sparked concerns about its potential impact on global energy consumption and the power grid, but a closer examination suggests these fears may be overstated: Data centers' soaring energy use not solely due to AI: While recent media reports have focused on AI's energy demands, the growth in data center power usage largely predates the current generative AI boom. Data center energy usage has been growing steadily since 2012, with the majority of the increase occurring before the launch of popular AI tools like Dall-E and ChatGPT in 2022. The vast majority of data...
read Jun 24, 2024AI Boosts Quantum Computing, Paving Way for Heterogeneous Data Centers and Breakthrough Applications
IBM makes strides in linking artificial intelligence and quantum computing, potentially accelerating the development and adoption of quantum computing applications. AI enhancing quantum computing: IBM is integrating its AI technology into quantum computing software and tools to improve ease of use and performance: IBM is using its watsonx generative AI platform to create digital agents that provide developer support and quantum code assistance through the Qiskit Code Assistant service and planned quantum chatbots. AI models are being developed to optimize quantum circuits, resulting in up to 40% improvement in circuit size, better quality, and 2x to 5x faster processing speeds...
read