Artificial Intelligence for Edge Devices

Edge-Based AI Chipsets and Accelerators for Mobile Phones, Smart Speakers, Head-Mounted Displays, Automotive, PCs/Tablets, Drones, Security Cameras, and Robots: Global Market Analysis and Forecasts

Report Details

Price: Log In to View
Pages: 65
Tables, Charts,
     & Figures:
123
Publication Date: 3Q 2018
Log In to Purchase/Access Report

Downloads

Register or Log In to download a free Executive Summary and brochure for this report.

Artificial intelligence (AI) processing today is mostly done in a cloud-based data center. The majority of AI processing is dominated by training of deep learning models, which requires heavy compute capacity. In the last 6 years, we have seen a 300,000X growth in compute requirements, with graphics processing units (GPUs) providing most of that horsep ower. AI inference, which is performed post-training, and is relatively less compute intensive, has been largely overlooked from an AI processing standpoint. Like training, inference has also been largely done in the data center. However, as the diversity of AI applications grows, the centralized, cloud-based training and inference regime is coming into question.

AI edge processing today is focused on moving the inference part of the AI workflow to the device, keeping data constrained to the device. There are several different reasons why AI processing is moving to the edge device, depending on the application. Privacy, security, cost, latency, and bandwidth all need to be considered when evaluating cloud versus edge processing. The impact of model compression techniques like Google’s Learn2Compress that enables squeezing large AI models into small hardware form factors is also contributing to the rise of AI edge processing. Federated learning and blockchain-based decentralized AI architectures are also part of the shift of AI processing to the edge with part of the training also likely to move to the edge. Depending on the AI application and device category, there are several hardware options for performing AI edge processing. These options include CPUs, GPUs, ASICs, FPGAs, and SoC accelerators.

This Tractica report provides a quantitative and qualitative assessment of the market opportunity for AI edge processing across several consumer and enterprise device markets. The device categories include automotive, consumer and enterprise robots, drones, head-mounted displays, mobile phones, PCs/tablets, security cameras, and smart speakers. The report includes segmentation by processor type, power consumption, compute capacity, and training versus inference for each device category, with unit shipment and revenue forecasts for the period from 2017 to 2025.

Key Questions Addressed:

  • What are the reasons for AI processing moving to the edge?
  • How will AI processing hardware vary among different device types?
  • What is the role of SoC accelerators at the edge and how will they compare to ASICs, CPUs, GPUs, and FPGAs?
  • What will be the attach rates for AI edge processing across different device categories between 2017 and 2025?
  • How will 5G networks impact the deployment of AI edge processors?
  • Which hardware companies will benefit from AI processing moving to the edge?
  • What is the impact of China and Chinese hardware companies on the AI edge processing market?

Who Needs This Report?

  • Artificial intelligence technology companies
  • Semiconductor and component vendors
  • Edge computing software vendors
  • Electronics manufacturers
  • Automotive companies
  • Drone and robot manufacturers
  • Investor community

Table of Contents

  1. Executive Summary
    1. Introduction
    2. Market Issues
    3. Technology Issues
    4. Market Ecosystem
    5. Market Forecasts
  2. Market Issues
    1. Market Drivers
      1. Privacy
      2. Latency
      3. Bandwidth
      4. Security
      5. Cost
      6. Model Compression
      7. Decentralized AI Architectures
    2. Market Barriers
      1. Rapid Evolution of AI Models
      2. Lack of Clarity on Applications or Workloads for the Edge
      3. 5G Networks
    3. Key Markets and Applications
      1. Automotive
      2. Consumer and Enterprise Robotics
      3. Drones
      4. Head-Mounted Displays
      5. Smart Speakers
      6. Mobile Phones
      7. PCs/Tablets
      8. Security Cameras
    4. Rise of China, AI Hardware, and Edge Computing
  3. Technology Issues
    1. AI Hardware Considerations at the Edge
      1. Training versus Inference
      2. Power versus Accuracy
    2. Hardware Options
      1. Application Specific Integrated Circuit
      2. System-on-a-Chip Accelerators
      3. Central Processing Units
      4. Graphics Processing Uni
      5. Field Programmable Gate Arrays
    3. Architecture Comparison
  4. Key Industry Players
    1. Alibaba
    2. Apple
    3. Arm
    4. Baidu
    5. CEVA Logistics
    6. Cambricon
    7. Google
    8. Horizon Robotics
    9. Intel
    10. Kneron
    11. MediaTek
    12. Mobileye
    13. Movidius
    14. Mythic
    15. NVIDIA
    16. Qualcomm
    17. Edge AI Hardware Enablers
  5. Market Forecasts
    1. Forecast Methodology
      1. Two Different Models
    2. AI Edge Chipset Forecasts by Device Category
    3. AI Edge Chipset Forecasts by Chipset Type
    4. AI Edge Device Forecasts by Application
    5. Additional Breakdowns
      1. AI Edge Chipset Forecasts by Power Consumption
      2. AI Edge Chipset Forecasts by Compute Capacity
      3. AI Edge Chipset Forecasts for Training versus Inference
    6. Conclusions and Recommendations
  6. Company Directory
  7. Acronym and Abbreviation List
  8. Table of Contents
  9. Table of Charts and Figures
  10. Scope of Study, Sources and Methodology, Notes

List of Charts, Figures, and Tables

Charts
  • AI Edge Chipset Revenue, World Markets: 2017-2025
  • AI Edge Device Attach Rates, World Markets: 2017-2025
  • AI Edge Chipset Revenue by Device Category, World Markets: 2017-2025
  • AI Edge Chipset Shipments by Device Category, World Markets: 2017-2025
  • AI Edge Chipset Year-on-Year Revenue Growth Rates, World Markets: 2017-2025
  • AI Edge Chipset Revenue by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Unit Shipments by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Average Selling Price by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Revenue by Power Consumption, World Markets: 2017-2025
  • AI Edge Chipset Revenue by Compute Capacity, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Inference versus Training, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Automotive by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Unit Shipments for Automotive by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Automotive by Power Consumption, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Automotive by Compute Capacity, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Automotive, Inference versus Training, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Consumer and Enterprise Robots by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Unit Shipments for Consumer and Enterprise Robots by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Consumer and Enterprise Robots by Power Consumption, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Drones by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Unit Shipments for Drones by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Drones by Power Consumption, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Drones by Compute Capacity, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Drones, Inference versus Training, World Markets: 2017-2025
  • AI Edge Chipset Revenue for HMDs by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Unit Shipments for HMDs by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Unit Shipments for HMDs by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Revenue for HMDs by Power Consumption, World Markets: 2017-2025
  • AI Edge Chipset Revenue for HMDs by Compute Capacity, World Markets: 2017-2025
  • AI Edge Chipset Revenue for HMDs, Inference versus Training, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Smart Speakers by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Unit Shipments for Smart Speakers by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Smart Speakers by Power Consumption, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Smart Speakers by Compute Capacity, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Smart Speakers, Inference versus Training, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Mobile Phones by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Mobile Phones by Power Consumption, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Mobile Phones by Compute Capacity, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Mobile Phones, Inference versus Training, World Markets: 2017-2025
  • AI Edge Chipset Revenue for PCs/Tablets by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Unit Shipments for PCs/Tablets by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Revenue for PCs/Tablets by Power Consumption, World Markets: 2017-2025
  • AI Edge Chipset Revenue for PCs/Tablets by Compute Capacity, World Markets: 2017-2025
  • AI Edge Chipset Revenue for PCs/Tablets, Inference versus Training, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Security Cameras by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Unit Shipments for Security Cameras by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Security Cameras by Power Consumption, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Security Cameras by Compute Capacity, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Security Cameras, Inference versus Training, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Consumer and Enterprise Robots by Compute Capacity, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Consumer and Enterprise Robots, Inference versus Training, World Markets: 2017-2025
Figures
  • Google’s Learn2Compress for Machine Learning Models
  • Google’s Federated Learning for Smartphones
  • OpenMined Architecture
  • Image Classification Model List with Error Rates
  • ADAS Features in Manual Cars
  • Deep Learning-Based SLAM by Magic Lea
  • Amazon Alexa Skills Workflow
  • Layers of a Convolutional Neural Network
  • Training versus Inference in Neural Networks: Forward and Backward Pass
  • AI Hardware: Power versus Accuracy
  • AI Hardware: Power versus Accuracy
Tables
  • AI Edge Chipset Revenue by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Unit Shipments by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Revenue Growth Rates, World Markets: 2017-2025
  • AI Edge Chipset Average Selling Price by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Revenue by Power Consumption, World Markets: 2017-2025
  • AI Edge Chipset Revenue by Compute Capacity, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Inference versus Training, World Markets: 2017-2025
  • AI Edge Chipset Revenue by Device Category, World Markets: 2017-2025
  • AI Edge Chipset Shipments by Device Category, World Markets: 2017-2025
  • AI Edge Device Shipments by Device Category, World Markets: 2017-2025
  • AI Edge Device Attach Rates by Device Category, World Markets: 2017-2025
  • AI Edge Device Attach Rates by Application, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Automotive by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Unit Shipments for Automotive by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Automotive by Power Consumption, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Automotive by Compute Capacity, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Automotive, Inference versus Training, World Markets: 2017-2025
  • AI Edge Device Attach Rates for Automotive by Application, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Consumer and Enterprise Robots by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Unit Shipments for Consumer and Enterprise Robots by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Consumer and Enterprise Robots by Power Consumption, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Consumer and Enterprise Robots by Compute Capacity, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Consumer and Enterprise Robots, Inference versus Training, World Markets: 2017-2025
  • AI Edge Device Attach Rates for Consumer and Enterprise Robots by Application, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Drones by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Unit Shipments for Drones by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Drones by Power Consumption, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Drones by Compute Capacity, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Drones, Inference versus Training, World Markets: 2017-2025
  • AI Edge Device Attach Rates for Drones by Application, World Markets: 2017-2025
  • AI Edge Chipset Revenue for HMDs by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Unit Shipments for HMDs by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Revenue for HMDs by Power Consumption, World Markets: 2017-2025
  • AI Edge Chipset Revenue for HMDs by Compute Capacity, World Markets: 2017-2025
  • AI Edge Chipset Revenue for HMDs, Inference versus Training, World Markets: 2017-2025
  • AI Edge Device Attach Rates for HMDs by Application, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Smart Speakers by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Unit Shipments for Smart Speakers by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Smart Speakers by Power Consumption, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Smart Speakers by Compute Capacity, World Markets: 2017-2025
  • AI Edge Device Attach Rates for Smart Speakers by Application, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Mobile Phones by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Unit Shipments for Mobile Phones by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Mobile Phones by Power Consumption, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Mobile Phones by Compute Capacity, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Mobile Phones, Inference versus Training, World Markets: 2017-2025
  • AI Edge Device Attach Rates for Mobile Phones by Application, World Markets: 2017-2025
  • AI Edge Chipset Revenue for PCs/Tablets by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Unit Shipments for PCs/Tablets by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Revenue for PCs/Tablets by Power Consumption, World Markets: 2017-2025
  • AI Edge Chipset Revenue for PCs/Tablets by Compute Capacity, World Markets: 2017-2025
  • AI Edge Chipset Revenue for PCs/Tablets, Inference versus Training, World Markets: 2017-2025
  • AI Edge Device Attach Rates for PCs/Tablets by Application, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Security Cameras by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Unit Shipments for Security Cameras by Chipset Type, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Security Cameras by Power Consumption, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Security Cameras by Compute Capacity, World Markets: 2017-2025
  • AI Edge Chipset Revenue for Security Cameras, Inference versus Training, World Markets: 2017-2025
  • AI Edge Device Attach Rates for Security Cameras by Application, World Markets: 2017-2025
  • AI Edge Device Attach Rates for Drones by Application, World Markets: 2017-2025
  • Comparison of AI Chipsets for Edge Applications